Unified Storage For The Cloud Means Higher-Level Interfaces

Unified Storage For The Cloud Means Higher-Level Interfaces

Unified Storage for the Cloud Means Higher-Level Interfaces

In common use, the term “unified storage” means providing block-level and file-level access to the same storage system with a single management and control interface. Traditionally, block-level access is via fiber channel or iSCSI, and file-level access is via NFS or CIFS protocol.

Recently, storage vendors are also adding _object_-level storage where the objects are entities with metadata like type, access control policies. Objects are read and written by applications using REST HTTP or SOAP and used directly at the application level. The most popular API is Amazon’s S3 (Simple Storage Service). With the higher-abstraction level of objects, the underlying implementation (e.g., number of parts, tiered storage, etc.) is hidden even more than with block- and file-level interfaces. EMC, Hitachi Data Systems, and NetApp among others provide unified storage systems.

Cloud Storage

Cloud storage is bringing some different requirements for a unified storage system. Most notably, not only is the data in the cloud, but the applications and compute resources are in the cloud. Instead of pulling data from the cloud, processing the data, and pushing back to cloud, the paradigm is to have compute resources in the cloud read and write data directly, local to the cloud. The data is never moved out of the cloud unless absolutely needed.

This type of usage pushes the need for even higher-level interfaces to data like SQL, Map-Reduce, and ETL. Unified storage for the cloud needs to do more than provide multi-protocol access to data that can be managed with one system. In addition to access, there must be the ability to process the data, e.g., running an SQL query. Then applications can easily use the functionality of the cloud storage/compute system instead of using the cloud as a dumb storage system and pulling and pushing the data between the cloud storage system and compute resources.

Unified storage for block- and file- level is still required and important because of the need to integrate with compute nodes that have a block-level or file-level interface. And also, there is the cloud data bootstrap problem of how do you initially get the data in the cloud that can be efficiently done by block-level transfer.

The power of a unified cloud storage system is in the network effect of having a single management interface that allows managing users, multiple tenants, storage and resource quotas, security, access management with ACLs (access control lists) for sharing, and other functions. With the single management interface, the system administrator can effectively control the backend storage system used in a wide variety of users using a small slice of different functionality (e.g., object storage only) or users using a wide scope of data access and processing.

By Gary Ogasawara

Gary Ogasawara is the VP Engineering at Gemini Mobile Technologies. He has worked on large scale mail systems for service providers and other high-performance, high-volume software systems. Gemini’s Cloudian™ product is an S3-compatible storage software package.

Read additional information on Cloud Computing News on CloudTweaks 

About CloudTweaks

Established in 2009, CloudTweaks is recognized as one of the leading authorities in connected technology information and services.

We embrace and instill thought leadership insights, relevant and timely news related stories, unbiased benchmark reporting as well as offer green/cleantech learning and consultive services around the world.

Our vision is to create awareness and to help find innovative ways to connect our planet in a positive eco-friendly manner.

In the meantime, you may connect with CloudTweaks by following and sharing our resources.

View All Articles

Sorry, comments are closed for this post.

Protecting Devices From Data Breach: Identity of Things (IDoT)

Protecting Devices From Data Breach: Identity of Things (IDoT)

How to Identify and Authenticate in the Expanding IoT Ecosystem It is a necessity to protect IoT devices and their associated data. As the IoT ecosystem continues to expand, the need to create an identity to newly-connected things is becoming increasingly crucial. These ‘things’ can include anything from basic sensors and gateways to industrial controls…

Cloud Infographic – Disaster Recovery

Cloud Infographic – Disaster Recovery

Disaster Recovery Business downtime can be detrimental without a proper disaster recovery plan in place. Only 6% of businesses that experience downtime without a plan will survive long term. Less than half of all businesses that experience a disaster are likely to reopen their doors. There are many causes of data loss and downtime —…

Surprising Facts and Stats About The Big Data Industry

Surprising Facts and Stats About The Big Data Industry

Facts and Stats About The Big Data Industry If you start talking about big data to someone who is not in the industry, they immediately conjure up images of giant warehouses full of servers, staff poring over page after page of numbers and statistics, and some big brother-esque official sat in a huge government building…

Do Small Businesses Need Cloud Storage Service?

Do Small Businesses Need Cloud Storage Service?

Cloud Storage Services Not using cloud storage for your business yet? Cloud storage provides small businesses like yours with several advantages. Start using one now and look forward to the following benefits: Easy back-up of files According to Practicalecommerce, it provides small businesses with a way to back up their documents and files. No need…

Cloud Infographic – Monetizing Internet Of Things

Cloud Infographic – Monetizing Internet Of Things

Monetizing Internet Of Things There are many interesting ways in which companies are looking to connect devices to the cloud. From the vehicles to kitchen appliances the internet of things is already a $1.9 trillion dollar market based on research estimates from IDC. Included is a fascinating infographic provided by AriaSystems which shows us some of the exciting…

Consequences Of Combining Off Premise Cloud Storage and Corporate Data

Consequences Of Combining Off Premise Cloud Storage and Corporate Data

Off Premise Corporate Data Storage Cloud storage is a broad term. It can encompass anything from on premise solutions, to file storage, disaster recovery and off premise options. To narrow the scope, I’ve dedicated the focus of today’s discussion to the more popular cloud storage services—such as Dropbox, Box, OneDrive—which are also known as hosted,…

4 Different Types of Attacks – Understanding the “Insider Threat”

4 Different Types of Attacks – Understanding the “Insider Threat”

Understanding the “Insider Threat”  The revelations that last month’s Sony hack was likely caused by a disgruntled former employee have put a renewed spotlight on the insider threat. The insider threat first received attention after Edward Snowden began to release all sorts of confidential information regarding national security. While many called him a hero, what…

Why Small Businesses Need A Business Intelligence Dashboard

Why Small Businesses Need A Business Intelligence Dashboard

The Business Intelligence Dashboard As a small business owner you would certainly know the importance of collecting and analyzing data pertaining to your business and transactions. Business Intelligence dashboards allow not only experts but you also to access information generated by analysis of data through a convenient display. Anyone in the company can have access…

Cloud Computing Is Greener Than You Think

Cloud Computing Is Greener Than You Think

Cloud Computing Is Greener Than You Think Last week we touched upon how a project in Finland had blended two of the world’s most important industries, cloud computing and green technology, to produce a data centre that used nearby sea water to both cool their servers and heat local homes.  Despite such positive environmental projects, there…

15 Cloud Data Performance Monitoring Companies

15 Cloud Data Performance Monitoring Companies

Cloud Data Performance Monitoring Companies (Updated: Originally Published Feb 9th, 2015) We have decided to put together a small list of some of our favorite cloud performance monitoring services. In this day and age it is extremely important to stay on top of critical issues as they arise. These services will accompany you in monitoring…