Unified Storage For The Cloud Means Higher-Level Interfaces

Unified Storage for the Cloud Means Higher-Level Interfaces

In common use, the term “unified storage” means providing block-level and file-level access to the same storage system with a single management and control interface. Traditionally, block-level access is via fiber channel or iSCSI, and file-level access is via NFS or CIFS protocol.

Recently, storage vendors are also adding _object_-level storage where the objects are entities with metadata like type, access control policies. Objects are read and written by applications using REST HTTP or SOAP and used directly at the application level. The most popular API is Amazon’s S3 (Simple Storage Service). With the higher-abstraction level of objects, the underlying implementation (e.g., number of parts, tiered storage, etc.) is hidden even more than with block- and file-level interfaces. EMC, Hitachi Data Systems, and NetApp among others provide unified storage systems.

Cloud storage is bringing some different requirements for a unified storage system. Most notably, not only is the data in the cloud, but the applications and compute resources are in the cloud. Instead of pulling data from the cloud, processing the data, and pushing back to cloud, the paradigm is to have compute resources in the cloud read and write data directly, local to the cloud. The data is never moved out of the cloud unless absolutely needed.

This type of usage pushes the need for even higher-level interfaces to data like SQL, Map-Reduce, and ETL. Unified storage for the cloud needs to do more than provide multi-protocol access to data that can be managed with one system. In addition to access, there must be the ability to process the data, e.g., running an SQL query. Then applications can easily use the functionality of the cloud storage/compute system instead of using the cloud as a dumb storage system and pulling and pushing the data between the cloud storage system and compute resources.

Unified storage for block- and file- level is still required and important because of tghe need to integrate with compute nodes that have a block-level or file-level interface. And also, there is the cloud data bootstrap problem of how do you initially get the data in the cloud that can be efficiently done by block-level transfer.

The power of a unified cloud storage system is in the network effect of having a single management interface that allows managing users, multiple tenants, storage and resource quotas, security, access management with ACLs (access control lists) for sharing, and other functions. With the single management interface, the system administrator can effectively control the backend storage system used in a wide variety of users using a small slice of different functionality (e.g., object storage only) or users using a wide scope of data access and processing.

By Gary Ogasawara

Gary Ogasawara is the VP Engineering at Gemini Mobile Technologies. He has worked on large scale mail systems for service providers and other high-performance, high-volume software systems. Gemini’s Cloudian™ product is an S3-compatible storage software package.

Follow Us!

CloudTweaks

Established in 2009, CloudTweaks.com is recognized as one of the leading authorities in cloud computing information. Most of the excellent CloudTweaks articles are provided by our own paid writers, with a small percentage provided by guest authors from around the globe, including CEOs, CIOs, Technology bloggers and Cloud enthusiasts. Our goal is to continue to build a growing community offering the best in-depth articles, interviews, event listings, whitepapers, infographics and much more...
Follow Us!

Sorry, comments are closed for this post.

2014 Future Of Cloud Computing Survey Results

2014 Future Of Cloud Computing Survey Results

Engine Yard Joins North Bridge Venture Partners, Gigaom Research and Industry Collaborators to Unveil 2014 Future of Cloud Computing Survey Results SAN FRANCISCO, CA–(Marketwired – Jun 25, 2014) – Engine Yard, the leading cloud application management platform, today announced its role as a collaborator in releasing the results of the fourth annual Future of Cloud Computing Survey,…

Cloud Infographic: Disaster Recovery

Cloud Infographic: Disaster Recovery

Cloud Infographic: Disaster Recovery  Business downtime can be detrimental without a proper disaster recovery plan in place. Only 6% of businesses that experience downtime without a plan will survive long term. Less than half of all businesses that experience a disaster are likely to reopen their doors. There are many causes of data loss and…

Cloud Infographic – What Is The Internet of Things?

Cloud Infographic – What Is The Internet of Things?

What Is The Internet of Things? “We’re still in the first minutes of the first day of the Internet revolution.”  – Scott Cook The Internet of Things (IOT) and Smart Systems are based on the notions of Sensors, Connectivity, People and Processes. We are creating a new world to view and measure anything around us through…

Cloud Computing and Social Networks

Cloud Computing and Social Networks

Pushing Innovation With Social Networks There was a time when storage space was a precious commodity. A few videos and photographs and the system would be gasping for breath in old PCs’ limited storage space. 10 Years ago, today’s top social networking sites would have broken down under the burden of the heavily visual traffic…

Are Cloud Servers The Right Choice For Your Business?

Are Cloud Servers The Right Choice For Your Business?

Cloud servers offer power, flexibility, reliability, and client friendly hosting for small and medium businesses that have outgrown shared hosting. New business hosting clients are bombarded with an incredible diversity of different choices for their site’s hosting. It can be a challenge to negotiate the range of platforms and the marketing hype that many hosting…

CONNECT TO THE CLOUD

 

Cloud Logo Sponsors

hp Logo CityCloud-PoweredByOpenstack-Bluesquare_logo_100x100-01
cisco_logo_100x100 vmware citrix100


Contributor Spotlight

Established in 2009, CloudTweaks is recognized as one of the leading influencers in cloud computing, big data and internet of things (IoT) information. Our goal is to continue to build our growing information portal, by providing the best in-depth articles, interviews, event listings, whitepapers, infographics and much more.

Contact

CloudTweaks Media
Phone: 1 (212) 763-0021