<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>The Storage Architect &#187; Amazon S3</title>
	<atom:link href="http://thestoragearchitect.com/tag/amazon-s3/feed/" rel="self" type="application/rss+xml" />
	<link>http://thestoragearchitect.com</link>
	<description>Storage, Virtualisation &#38; Cloud</description>
	<lastBuildDate>Tue, 07 Feb 2012 10:08:05 +0000</lastBuildDate>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.2.1</generator>
		<item>
		<title>Cloud Computing: Cloud Standardisation</title>
		<link>http://thestoragearchitect.com/2009/09/22/cloud-computing-cloud-standardisation/</link>
		<comments>http://thestoragearchitect.com/2009/09/22/cloud-computing-cloud-standardisation/#comments</comments>
		<pubDate>Tue, 22 Sep 2009 19:57:14 +0000</pubDate>
		<dc:creator>Chris M Evans</dc:creator>
				<category><![CDATA[Cloud]]></category>
		<category><![CDATA[GestaltIT]]></category>
		<category><![CDATA[Amazon S3]]></category>
		<category><![CDATA[CDMI]]></category>
		<category><![CDATA[Cloudloop]]></category>
		<category><![CDATA[Nirvanix]]></category>
		<category><![CDATA[Rackspace]]></category>
		<category><![CDATA[RAIC]]></category>
		<category><![CDATA[SNIA]]></category>
		<category><![CDATA[Stephen Foskett]]></category>
		<category><![CDATA[Zend]]></category>

		<guid isPermaLink="false">http://thestoragearchitect.com/?p=747</guid>
		<description><![CDATA[<p><a href="http://fosketts.net/Site/Welcome.html" >Stephen Foskett</a> has been posting some interesting commentary over the last week relating to cloud standards and today <a href="http://blog.fosketts.net/2009/09/22/zend-simple-cloud-api/" >discussed</a> the <a href="http://www.simplecloud.org/" >Zend</a> API for PHP.  In previous posts, he&#8217;s mentioned the <a href="http://www.snia.org/tech_activities/publicreview/CDMI_Spec_v08.pdf" >SNIA initiative</a> amongst others.  Have a look at <a href="http://blog.fosketts.net/2009/09/16/cloud-services-standards/" >this</a> great post he wrote on why [...]<!--Begin ClixTrac.com Rotator Code -->
<script type="text/javascript" language="javascript" src="http://www.clixtrac.com/rotate/321"></script>
<!--End ClixTrac.com Rotator Code -->]]></description>
			<content:encoded><![CDATA[<p><a href="http://fosketts.net/Site/Welcome.html" >Stephen Foskett</a> has been posting some interesting commentary over the last week relating to <strong>cloud standards</strong> and today <a href="http://blog.fosketts.net/2009/09/22/zend-simple-cloud-api/" >discussed</a> the <a href="http://www.simplecloud.org/" >Zend</a> API for PHP.  In previous posts, he&#8217;s mentioned the <a href="http://www.snia.org/tech_activities/publicreview/CDMI_Spec_v08.pdf" >SNIA initiative</a> amongst others.  Have a look at <a href="http://blog.fosketts.net/2009/09/16/cloud-services-standards/" >this</a> great post he wrote on why standards aren&#8217;t needed.</p>
<p>Now, it&#8217;s <strong>no</strong> secret that I&#8217;m keen on the idea of <strong>Cloud Computing</strong> (and to be more precise, cloud storage in particular), so the concept of evolving standardisation is extremely exciting.  Last year, I discussed <strong>RAIC</strong> (<a rel="nofollow" href="http://storagearchitect.blogspot.com/2008/12/redundant-array-of-inexpensive-clouds.html" >here</a> and <a href="http://thestoragearchitect.com/2008/12/16/redundant-array-of-inexpensive-clouds-pt-ii/" >here</a>) &#8211; the concept of using multiple clouds to form a redundant repository.</p>
<p><strong>Too Early?</strong></p>
<p>Whilst on the one hand I agree with Stephen that it may be <strong>too early</strong> for standards to be set, I would also contend that for certain pieces of the cloud storage infrastructure we do need standards, for example <strong>security</strong> and authentication.  It would be useful to have a consistent authentication model to be applied across cloud storage infrastructures, especially if in the future the ultimate evolution of cloud storage (and for that matter cloud computing) is the ability to dynamically switch workloads and data locations based on service quality (i.e. cost and performance) and availability.</p>
<p>Of course, there will always be the <strong>eternal tradeoff</strong> between standardisation (which suits the customer) and proprietary interfaces and functionality (which suits the vendor).  Get a customer hooked into proprietary technology and the<strong> inertia</strong> to change becomes much increased, so even if another vendor does offer a better solution, the cost and effort of change is too great to make the savings/benefits worthwhile.</p>
<p><strong>New Business</strong></p>
<p>Does this mean initiatives like Zend and <a href="http://www.cloudloop.com" >Cloudloop</a> offer an insight into new business opportunities?  I think they do.  Most, if not all of us will not interface directly with Amazon S3, Nirvanix, Atmos, Rackspace and the others that will spring up.  These companies are infrastructure, not application, providers.  Taking the UK as an example, do I care where or how my electricity is generated or where my gas comes from, as long as it is available when I need it?  No.  Whether the cloud storage infrastructure providers (CSIP) choose to standardise isn&#8217;t important.  The future is how easily we can interface into the cloud, and how services such as the following can be easily delivered:</p>
<ul>
<li>Create/Retrieve/Update/Delete (CRUD)</li>
<li>Search</li>
<li>Index</li>
<li>Migrate</li>
</ul>
<p>and of course the influencing factors will be:</p>
<ul>
<li>Cost</li>
<li>Availability</li>
<li>Performance</li>
</ul>
<p>Today there are plenty of companies offering services based on cloud storage &#8211; exclusively targeting the consumer market or limited business features such as backup.  As things evolve, we&#8217;ll see opportunities to move into the Enterprise space.  These will take advantage of extending the data space into the cloud, giving us new and interesting ways of managing data.  Here are some ideas I want to explore in upcoming posts:</p>
<ul>
<li>Extending the Global Name Space into the Cloud</li>
<li>Block-based array tiering and the Storage Cloud</li>
<li>Using the Storage Cloud for data migration</li>
<li>Archive, Backup and the storage cloud</li>
</ul>
<p>Anyone have their own ideas they want to share?</p>
]]></content:encoded>
			<wfw:commentRss>http://thestoragearchitect.com/2009/09/22/cloud-computing-cloud-standardisation/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Cloud Computing: Have You Got Your Atmos onLine Account?</title>
		<link>http://thestoragearchitect.com/2009/06/04/cloud-computing-have-you-got-your-atmos-online-account/</link>
		<comments>http://thestoragearchitect.com/2009/06/04/cloud-computing-have-you-got-your-atmos-online-account/#comments</comments>
		<pubDate>Thu, 04 Jun 2009 21:18:17 +0000</pubDate>
		<dc:creator>Chris M Evans</dc:creator>
				<category><![CDATA[Cloud]]></category>
		<category><![CDATA[Amazon S3]]></category>
		<category><![CDATA[Atmos onLine]]></category>
		<category><![CDATA[Nirvanix SDN]]></category>

		<guid isPermaLink="false">http://thestoragearchitect.com/?p=601</guid>
		<description><![CDATA[<p>I registered for the beta of EMC&#8217;s Atmos Cloud storage offering, <a href="http://www.emccis.com/" >Atmos onLine</a> right after EMC World and this week I received confirmation that my registration had been accepted.</p> <p>So tonight I&#8217;ve been looking through the documentation before I start putting together some code to test the service out.</p> <p>The interesting thing, is [...]<!--Begin ClixTrac.com Rotator Code -->
<script type="text/javascript" language="javascript" src="http://www.clixtrac.com/rotate/321"></script>
<!--End ClixTrac.com Rotator Code -->]]></description>
			<content:encoded><![CDATA[<p><img class="alignleft size-full wp-image-603" style="margin:8px;" title="AtmosOnline" src="http://thestoragearchitect.files.wordpress.com/2009/06/atmosonline1.png" alt="AtmosOnline" width="275" height="187" />I registered for the beta of EMC&#8217;s Atmos Cloud storage offering, <a href="http://www.emccis.com/" >Atmos onLine</a> right after EMC World and this week I received confirmation that my registration had been accepted.</p>
<p>So tonight I&#8217;ve been looking through the documentation before I start putting together some code to test the service out.</p>
<p>The interesting thing, is (not surprisingly) how initially similar Atmos onLine appears to be to <a href="http://www.nirvanix.com/services.aspx" >Nirvanix SDN</a> and <a rel="nofollow" href="http://aws.amazon.com/s3/" >Amazon S3</a>.  Clearly the devil will be in the detail.</p>
<p>With three major services now available, how will they all compare?  Look out for a post on that soon.  </p>
<p>Finally, I might eventually have the ability to put together <a href="http://thestoragearchitect.com/2008/12/15/redundant-array-of-inexpensive-clouds-pt-i/" >RAIC&#8230;</a></p>
]]></content:encoded>
			<wfw:commentRss>http://thestoragearchitect.com/2009/06/04/cloud-computing-have-you-got-your-atmos-online-account/feed/</wfw:commentRss>
		<slash:comments>4</slash:comments>
		</item>
		<item>
		<title>Cloud Computing: Misunderstanding Data Availability</title>
		<link>http://thestoragearchitect.com/2009/03/28/cloud-computing-misunderstanding-data-availability/</link>
		<comments>http://thestoragearchitect.com/2009/03/28/cloud-computing-misunderstanding-data-availability/#comments</comments>
		<pubDate>Sat, 28 Mar 2009 12:21:00 +0000</pubDate>
		<dc:creator>Chris M Evans</dc:creator>
				<category><![CDATA[Cloud]]></category>
		<category><![CDATA[Amazon S3]]></category>
		<category><![CDATA[carbonite]]></category>
		<category><![CDATA[data loss]]></category>
		<category><![CDATA[TechCrunch]]></category>

		<guid isPermaLink="false">http://thestoragearchitect.com/?p=444</guid>
		<description><![CDATA[<p><a href="http://thestoragearchitect.com/2009/03/28/cloud-computing-misunderstanding-data-availability/logo_main1/" rel="attachment wp-att-446" ></a>As is widely reported (<a href="http://www.techcrunch.com/2009/03/23/online-backup-company-carbonite-loses-customers-data-blames-and-sues-suppliers/" >here</a> by TechCrunch), <a href="http://www.carbonite.com/" >Carbonite</a>, an online backup service,  have lost customer data.  Another one of a long line-up of data losses, (whether partial or complete &#8211; which has taken some companies down) this demonstrates that relying on someone else to keep your data [...]<!--Begin ClixTrac.com Rotator Code -->
<script type="text/javascript" language="javascript" src="http://www.clixtrac.com/rotate/321"></script>
<!--End ClixTrac.com Rotator Code -->]]></description>
			<content:encoded><![CDATA[<p><a href="http://thestoragearchitect.com/2009/03/28/cloud-computing-misunderstanding-data-availability/logo_main1/" rel="attachment wp-att-446" ><img class="alignright size-full wp-image-446" title="logo_main1" src="http://thestoragearchitect.files.wordpress.com/2009/03/logo_main1.gif" alt="logo_main1" width="259" height="54" /></a>As is widely reported (<a href="http://www.techcrunch.com/2009/03/23/online-backup-company-carbonite-loses-customers-data-blames-and-sues-suppliers/" >here</a> by TechCrunch), <a href="http://www.carbonite.com/" >Carbonite</a>, an online backup service,  have lost customer data.  Another one of a long line-up of data losses, (whether partial or complete &#8211; which has taken some companies down) this demonstrates that relying on someone else to keep your data safe is not an infallible solution.</p>
<p>Now, don&#8217;t forget I&#8217;m a fan of the concept of cloud storage, but I also think that we need better data availability models to cope with the failure of a single provider (I wrote a series of posts on this starting <a href="http://thestoragearchitect.com/2008/12/15/redundant-array-of-inexpensive-clouds-pt-i/" >here</a>).  However, reading the comments on the TechCrunch site, one entry from Chris Walker made me think that people aren&#8217;t understanding the way IT works:</p>
<blockquote><p><span style="color:#008000;">&#8220;I believe data stores in S3 auto-replicates across multiple data centers so theoretically you should not encounter a data loss like this one &#8211; unless all of amazons data centers get nuked.&#8221;</span></p></blockquote>
<p>Data loss is <strong>not</strong> purely a hardware failure issue.  Information is lost for many reasons; whether that&#8217;s malicious data destruction, lack of forethought on IT design, a rolling disaster, failure in replication, or something else, you can&#8217;t assume just because data exists in multiple locations that it will be 100% safe.  </p>
<p>Data security is as much about process as it is the technology.  Here&#8217;s a few questions to ask:</p>
<ul>
<li>Is my data replicated in real-time (so if I delete/corrupt it, I ruin all copies)?</li>
<li>Is my data saved in snapshots (helps prevent the above issue)?</li>
<li>Is my data secured on multiple technology platforms (e.g. primary, secondary and/or tape storage)?</li>
<li>How is my data being replicated (tools and process)?</li>
<li>How can I prove my data has been backed up/replicated successfully?</li>
<li>What level of user/electronic/physical security is in place?</li>
</ul>
<p>Unfortunately, the appeal of online storage services today is the low cost and ease of use.  Perhaps we should also be giving more weight and consideration to the value of our data before we commit to using these services; it may then be worth paying a little more to get a more resilient service, or to insure against the consequential losses of losing valuable data.</p>
]]></content:encoded>
			<wfw:commentRss>http://thestoragearchitect.com/2009/03/28/cloud-computing-misunderstanding-data-availability/feed/</wfw:commentRss>
		<slash:comments>11</slash:comments>
		</item>
		<item>
		<title>Redundant Array of Inexpensive Clouds &#8211; Pt III</title>
		<link>http://thestoragearchitect.com/2009/01/07/redundant-array-of-inexpensive-clouds-pt-iii/</link>
		<comments>http://thestoragearchitect.com/2009/01/07/redundant-array-of-inexpensive-clouds-pt-iii/#comments</comments>
		<pubDate>Wed, 07 Jan 2009 15:53:00 +0000</pubDate>
		<dc:creator>Chris M Evans</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[Amazon S3]]></category>
		<category><![CDATA[Cloud storage]]></category>
		<category><![CDATA[Nirvanix]]></category>

		<guid isPermaLink="false">http://thestoragearchitect.wordpress.com/2009/01/07/redundant-array-of-inexpensive-clouds-pt-iii/</guid>
		<description><![CDATA[<p><a rel="nofollow" href="http://2.bp.blogspot.com/_b1B7GuxiR0o/SWvtp7kRH1I/AAAAAAAAAMU/xyW7QQHnNcw/s1600-h/securitykey.jpg" ></a> In my two <a rel="nofollow" href="http://storagearchitect.blogspot.com/2008/12/redundant-array-of-inexpensive-clouds.html" >previous</a> <a rel="nofollow" href="http://storagearchitect.blogspot.com/2008/12/redundant-array-of-inexpensive-clouds_16.html" >articles</a> I discussed Cloud Storage and the concept of using middleware to store multiple copies of data across different service providers. In this final part, I&#8217;d like to discuss the whole issue of security. <p> Using &#8220;the cloud&#8221; to store data [...]<!--Begin ClixTrac.com Rotator Code -->
<script type="text/javascript" language="javascript" src="http://www.clixtrac.com/rotate/321"></script>
<!--End ClixTrac.com Rotator Code -->]]></description>
			<content:encoded><![CDATA[<p><a rel="nofollow" href="http://2.bp.blogspot.com/_b1B7GuxiR0o/SWvtp7kRH1I/AAAAAAAAAMU/xyW7QQHnNcw/s1600-h/securitykey.jpg" ><img style="float:left;width:171px;cursor:hand;height:159px;margin:0 10px 10px 0;" alt="" src="http://2.bp.blogspot.com/_b1B7GuxiR0o/SWvtp7kRH1I/AAAAAAAAAMU/xyW7QQHnNcw/s320/securitykey.jpg" border="0" /></a> In my two <a rel="nofollow" href="http://storagearchitect.blogspot.com/2008/12/redundant-array-of-inexpensive-clouds.html" >previous</a> <a rel="nofollow" href="http://storagearchitect.blogspot.com/2008/12/redundant-array-of-inexpensive-clouds_16.html" >articles</a> I discussed Cloud Storage and the concept of using middleware to store multiple copies of data across different service providers. In this final part, I&#8217;d like to discuss the whole issue of security.
<div></div>
<p>
<div>Using &#8220;the cloud&#8221; to store data requires a major shift in thinking; traditionally all your information would be stored locally and therefore benefit from the advantage of physical security. Not only would someone need to hack your firewall to get network access, they would then have to obtain system access too, and likely as not would be spotted (hopefully) quite quickly. So, retaining physical access to data has been a significant benefit.</div>
<div></div>
<p>
<div>Now we&#8217;ve obviously been trusting a form of cloud storage for some time. Email systems like Gmail, Hotmail and Yahoo have always had access to our email data and have provided limited storage capabilities but they haven&#8217;t really been the foundation for running a business (although I&#8217;m sure there are organisations that have done it). Putting data into the cloud means there&#8217;s always a risk of someone else getting to your data. You make someone else the guardian or gatekeeper of that data access and rely on the quality of their encryption and access controls. So, it is important to understand what facilities each infrastructure provider offers.</div>
<div></div>
<p>
<div><strong>Amazon Web Services</strong></div>
<div></div>
<p>
<div>Amazon have a great whitepaper on security, which can be found here. It highlights the level of physical security offered (which is high) plus details of the logical security of data. It may seem surprising that Amazon don&#8217;t routinely back up data on AWS but rely instead on multiple copies in remote locations, however backup and archive should be thought of as distinct requirements. In addition, data at rest in AWS is not encrypted; users of AWS should therefore ensure their service provider offers this capability at source.</div>
<div></div>
<p>
<div><strong>Nirvanix</strong></div>
<div></div>
<p>
<div>Nirvanix have two white papers which discuss data security. They can be found <a href="http://www.nirvanix.com/resources.aspx#whitePapers" >here</a> (registration required). As with Amazon, Nirvanix are keen to highlight the security of their facilities and adherence to Statement on Auditing Standard (<a rel="nofollow" href="http://en.wikipedia.org/wiki/SAS_70" >SAS 70</a>) certification. They also go further in indicating that data is stored using RAID-6 and RAID-10 protection, with backups in place too.</div>
<div></div>
<p>
<div><strong>Summary</strong></div>
<p>
<div></div>
<div>Both AWS and Nirvanix offer good physical security and SSL encryption for data in flight. Encryption at rest and backups are not routinely offered and therefore a cloud user should weigh up how these features are to be implemented. This takes us back to the original premise of these postings, the idea of using multiple cloud providers to add resilience and availability to cloud stored data. It also demands a set of standards for cloud storage use, which I am working on even as I write this post. Watch this space.</div>
<div class="blogger-post-footer">
<p>_uacct = &#8220;UA-1104321-2&#8243;;<br />
urchinTracker();
</p></div>
]]></content:encoded>
			<wfw:commentRss>http://thestoragearchitect.com/2009/01/07/redundant-array-of-inexpensive-clouds-pt-iii/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Redundant Array of Inexpensive Clouds &#8211; Pt II</title>
		<link>http://thestoragearchitect.com/2008/12/16/redundant-array-of-inexpensive-clouds-pt-ii/</link>
		<comments>http://thestoragearchitect.com/2008/12/16/redundant-array-of-inexpensive-clouds-pt-ii/#comments</comments>
		<pubDate>Tue, 16 Dec 2008 13:00:00 +0000</pubDate>
		<dc:creator>Chris M Evans</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[Amazon S3]]></category>
		<category><![CDATA[Cloud]]></category>
		<category><![CDATA[CSIP]]></category>
		<category><![CDATA[data storage]]></category>
		<category><![CDATA[Nirvanix]]></category>
		<category><![CDATA[SDN]]></category>

		<guid isPermaLink="false">http://thestoragearchitect.wordpress.com/2008/12/16/redundant-array-of-inexpensive-clouds-pt-ii/</guid>
		<description><![CDATA[In my <a rel="nofollow" href="http://storagearchitect.blogspot.com/2008/12/redundant-array-of-inexpensive-clouds.html" >previous post</a> I started the discussion on how cloud storage could actually be useful to organisations and not be simply for consumer use. <p> Standards <p> One of the big issues that will arise is the subject of standards. To my knowledge, there is no standard so far which determines [...]<!--Begin ClixTrac.com Rotator Code -->
<script type="text/javascript" language="javascript" src="http://www.clixtrac.com/rotate/321"></script>
<!--End ClixTrac.com Rotator Code -->]]></description>
			<content:encoded><![CDATA[<div>
<div>
<div>In my <a rel="nofollow" href="http://storagearchitect.blogspot.com/2008/12/redundant-array-of-inexpensive-clouds.html" >previous post</a> I started the discussion on how cloud storage could actually be useful to organisations and not be simply for consumer use. </div>
<div></div>
<p>
<div><strong><span style="font-size:130%;">Standards</span></strong></div>
<div></div>
<p>
<div>One of the big issues that will arise is the subject of standards. To my knowledge, there is no standard so far which determines how cloud storage should be accessed and how objects should be stored. Looking at the two main infrastructure providers, Amazon and Nirvanix, the following services are offered:</div>
<p>
<div><strong>Amazon</strong></div>
<div><strong></strong> </div>
<p><a rel="nofollow" href="http://4.bp.blogspot.com/_b1B7GuxiR0o/SUddxiScXcI/AAAAAAAAALs/q4h3LmLTwyo/s1600-h/logo_aws.gif" ><img style="float:left;width:164px;cursor:hand;height:60px;margin:0 10px 10px 0;" alt="" src="http://4.bp.blogspot.com/_b1B7GuxiR0o/SUddxiScXcI/AAAAAAAAALs/q4h3LmLTwyo/s200/logo_aws.gif" border="0" /></a>
<div><strong>S3 (Simple Storage Service)</strong> &#8211; storage of data objects up to 5GB in size. These objects are basically files with metadata and can be accessed via HTTP or BitTorrent protocols. The application programming interface (API) uses REST/SOAP (which is standard) but follows Amazon&#8217;s own standards in terms of functions to store and retrieve data.</div>
<div></div>
<p>
<div><strong>Elastic Block Store (EBS)</strong> &#8211; this feature offers block-level storage to Amazon EC2 instances (elastic compute cloud) to store persistent data outside of the compute instance itself. Data is accessed at the block level, however it is still stored in S3.</div>
<div></div>
<p>
<div><strong>Nirvanix</strong></div>
<div></div>
<p>
<div><strong><a rel="nofollow" href="http://4.bp.blogspot.com/_b1B7GuxiR0o/SUddmpesANI/AAAAAAAAALk/kGvSqoTc4P8/s1600-h/logoNirvanix.gif" ><img style="float:left;width:136px;cursor:hand;height:90px;margin:0 10px 10px 0;" alt="" src="http://4.bp.blogspot.com/_b1B7GuxiR0o/SUddmpesANI/AAAAAAAAALk/kGvSqoTc4P8/s200/logoNirvanix.gif" border="0" /></a>Storage Delivery Network (SDN)</strong> &#8211; provides file-based access to store and retrieve data on Nirvanix&#8217;s Internet Media File System. Access is via HTTP(S) using standard REST/SOAP protocols but follow Nirvanix&#8217;s proprietary API. Nirvanix also offer access to files with their CloudNAS and FTP Proxy services.</div>
<p>
<div></div>
<div>The protocols from both Amazon and Nirvanix follow standard access methods (i.e. REST/SOAP) but the format of the APIs are proprietary in nature. This means the terminology is different, command structures are different, the method of storing and retrieving objects is different and the metadata format for referencing those objects is different. </div>
<div></div>
<p>
<div>Lack of standards is a problem. Without a consistent method for storing and retrieving data, it will become necessary to program to each service provider implementation, effectively causing lock-in to that solution or creating significant overhead for development. </div>
<p>
<div></div>
<div>What about availability? Some customers may choose not to use one service provider in isolation, in order to improve the availability of data. Unfortunately this means programming to two (or potentially more) interfaces and investing time to standardise data access to those features available in both products.</div>
<div></div>
<p>
<div>What&#8217;s required is middleware to sit between the service providers and the customer. The middleware would provide a set of standardized services, which would allow data to be stored in either cloud, or both depending on the requirement. This is where RAIC comes in:</div>
<div></div>
<p>
<div>RAIC-0 &#8211; data is striped across multiple Cloud Storage infrastructure providers. No redundancy is provided, however data can be stored selectively based on cost or performance.</div>
<p>
<div>RAIC-1 &#8211; data is replicated across multiple Cloud Storage infrastructure providers. Redundancy is provided by multiple copies (as many as required by the customer) and data can be retrieved using the cheapest or fastest service provider.</div>
<div></div>
<div><a rel="nofollow" href="http://4.bp.blogspot.com/_b1B7GuxiR0o/SUdddNcGaqI/AAAAAAAAALc/G7TV1dnZDr0/s1600-h/Cloud+Middleware.jpg" ><img style="float:left;width:320px;cursor:hand;height:204px;margin:0 10px 10px 0;" alt="" src="http://4.bp.blogspot.com/_b1B7GuxiR0o/SUdddNcGaqI/AAAAAAAAALc/G7TV1dnZDr0/s320/Cloud+Middleware.jpg" border="0" /></a>Now there are already service providers out there offering services that store data on Amazon S3 and Nirvanix SDN; companies like <a href="http://www.freedrive.com/" >FreeDrive</a> and <a href="http://www.jungledisk.com/" >JungleDisk</a>, however these companies are providing cloud storage as a service rather than offering a tool which integrates the datacentre directly with S3 and SDN.</div>
<div> </div>
<div>I&#8217;m proposing middleware which sits on the customer&#8217;s infrastructure and provides the bridge between the internal systems and the infrastructure providers.  How this middleware should work, I haven&#8217;t formulated yet.  Perhaps it sits on a server, perhaps it is integrated into a NAS application, or a fabric device.  I guess it depends on the data itself.</div>
<div> </div>
<div>At this stage there are only two cloud storage infrastructure providers (CSIPs), however barriers to entry in the market are low; just get yourself some kit and an API and off you go.  I envisage that we&#8217;ll see lots of companies entering the CSIP space (EMC have already set their stall out by offering Atmos as a product, they just need to now offer it as a service via Decho) and if that&#8217;s the case, then competition will be fierce.  As the offering count grows, then the ability to differentiate and access multiple suppliers becomes critical.  When costs are forced down and access becomes transparent, then we&#8217;ll truly have usable cloud storage.</div>
<div> </div>
<div> </div>
</div>
</div>
<div class="blogger-post-footer">
<p>_uacct = &#8220;UA-1104321-2&#8243;;<br />
urchinTracker();
</p></div>
]]></content:encoded>
			<wfw:commentRss>http://thestoragearchitect.com/2008/12/16/redundant-array-of-inexpensive-clouds-pt-ii/feed/</wfw:commentRss>
		<slash:comments>8</slash:comments>
		</item>
	</channel>
</rss>

