Pinup: Qubole – The Growth Of Big Data as a Service

Pinup: Qubole – The Growth Of Big Data as a Service

Qubole-BDaaS

In late 2013, the growth of ‘Big Data as a Service’ (BDaaS) was being tipped as one of 2014’s standout trends. It was speculated that BDaaS was even the natural replacement of Software as a Service (SaaS) – the SaaS approach to acquiring specialised enterprise applications had proved itself to be a valid technology model, so it made sense to market analysts that big data applications would follow a similar path.

The three principal benefits of BDaaS are similar to those of SaaS. Firstly, BDaaS solutions are highly scalable; it’s an important benefit because big data can become incredibly resource hungry in a very short space of time – more so than any other current technology can. As data repositories grow in size, so does the demand for storage space – the upshot being that hosting big data applications in-house can quickly lead to scalability issues.

Secondly, BDaaS offers improved security; the nature of big data is hard to monitor and audit and small companies would face massive resource overheads of trying to secure repositories. BDaaS transfers the responsibility for security the host.

Finally, quality and level of service. Big data and related technologies are still emerging, therefore, there is a significant skills shortage in the market. It means that developing big data applications in-house is not something most companies can consider. BDaaS offers the client company a way to procure ready made big data services that will be maintained and extended by the service host.

(Chart Image Source: BigData 50)

Big-Data-Investments

On startup that has embraced BDaaS is Qubole, and the quality of their service has already earned them an excellent reputation in the market place. The company was features in Jeff Vance’s ‘Big Data 50 – The Hottest Big Data Startup’s of 2014’ and won a DataWeek award for their ‘Presto as a Service’ offering. After receiving $7 million in funding from Lightspeed Ventures and Charles River Venture their growth has been explosive; they’ve already secured clients as varied as Pinterest, MediaMath, Nextdoor and Saavn, with more big tech industry names undoubtedly set to follow.

Pinterest data engineer Mohammed Shahangian recently enthused about the product in an interview, saying “Qubole has been a huge win for us. Qubole has proven to be stable at petabyte scale and has given us 30%-60% higher throughput than Amazon EMR. It has also made it extremely easy to onboard non-technical users”. It’s a glowing endorsement.

Their feature-rich big data platform was designed by the creators of Facebook’s and Apache Hive’s big data infrastructure, meaning their cloud-based big data service offers the same advanced capabilities as those used by large big data organisations. Its features include Hadoop as a Service, an intuitive GUI, optimised Hive, improved S3 performance and managed clusters – though arguably its biggest benefit to small businesses is the auto-scaling. The feature means that Qubole actively saves clients money by “spinning up users’ clusters when a job is started, automatically scaling or contracting them based on the workload, and spinning the servers back down once the job is done”.

For more information about Qubole’s pricing structure, head to their website to find out more.

By Daniel Price

If you are an exciting new startup in the Cloud, Big data, IoT, Wearable tech space and looking to be covered in the fantastic CloudTweaks community. Drop us a line and you may just be featured in our Pinup series.  

For Enterprise level exposure opportunities, please review our new Whitepaper and Premium Newsletter offerings.

Follow Me!

Daniel Price

Daniel is a Manchester-born UK native who has abandoned cold and wet Northern Europe and currently lives on the Caribbean coast of Mexico. A former Financial Consultant, he now balances his time between writing articles for several industry-leading tech (CloudTweaks.com & MakeUseOf.com), sports, and travel sites and looking after his three dogs.
Follow Me!

2 Responses to Pinup: Qubole – The Growth Of Big Data as a Service

  1. This technology capability will become simple and performant enough that clients will deploy their own BDaaS on public clouds, private clouds, and hybrid clouds. The need for Qubole will shrink to the longtail until even the tail will deploy themselves. Look at past app platforms like Engine Yard and the like.

    • Jim – would love to catchup. I almost wish I could agree with you. I wish I could go back to spending more time programming query engine internals and worrying less about our service. But what I have learnt in this business (and in prior life) is that running large distributed runtimes efficiently is hard. We are doing weekly pushes of new features and bug fixes without disrupting customers. That is hard. Building adaptive strategies into software that work reasonably well for the largest to the smallest customers *autmatically* – that’s hard. Being able to optimize workloads for customers *automatically* given their runtime history – that’s hard. Dealing with AWS and Azure and GCE and their quirks – and not losing sleep over it – that’s hard. Dealing with deployments all over the world at minimum operational cost – that’s hard.

      The comparison to running a web server farm (Engineyard) is naiive. Those are stateless. They aren’t coupled/distributed in the same manner. There’s just no comparison – and again in a way – I am glad if competitors think running Hadoop or other services is like running a web farm :-)

Join Our Newsletter

Receive updates each week on news, tips, events, comics and much more...

Can I Contribute To CloudTweaks?

Yes, much of our focus in 2015 will be on working with other influencers in a collaborative manner. If you're a technology influencer looking to collaborate long term with CloudTweaks – a globally recognized leader in cloud computing information – drop us an email with “tech influencer” in the subject line.

Please review the guidelines before applying.

Contributors

Cloud Infographic – Wearable Tech And Preventative Healthcare

Cloud Infographic – Wearable Tech And Preventative Healthcare

Wearable Tech And Preventative Healthcare There are so many exciting new opportunities available to utilize wearable technology in the future.  Areas such as nanotechnology disease monitoring, crowdfunding to wearable accessories are some excellent examples of the potential. Estimates vary, but appear to suggest that the market will produce between $14-50 Billion over the next few years. Included below

Ten Tips For Successful Business Intelligence Implementation

Ten Tips For Successful Business Intelligence Implementation

Ten Tips for Successful Business Intelligence Implementation The cost of Business Intelligence (BI) software goes far beyond the purchase price. Time spent researching, implementing, and maintaining your BI investment can snowball quickly and mistakes are often expensive. Your time is valuable – save it by learning from other businesses’ experiences. We’ve compiled the top ten

Knots And Cloud Service Providers

Knots And Cloud Service Providers

How Do These Two Compare? In Boy Scouts, I learned how to tie knots. The quickest knot you can tie is the slipknot. It’s very effective for connecting one thing to another via the rope you have. It was used in setting up tents, mooring boats to docks temporarily and lifting your food up into

Aggregated News

Popular News Sources

Storage Considerations for SharePoint Backups

Storage Considerations for SharePoint Backups

Storage Considerations for SharePoint Backups Wednesday, October 29, 2014 @ 9:00 am/12:00pm ET. Backup and Restore of a SharePoint environment can be a complex endeavor as the product consists of multiple components running at various tiers, each with their own backup and restore requirements. In addition, SharePoint documents are stored as Binary Large Objects (BLOBs) in

OpenDNS Deployment Leads to Twenty-Fold Decrease in Malware Infections at Hamamatsu

OpenDNS Deployment Leads to Twenty-Fold Decrease in Malware Infections at Hamamatsu

Decreases in Malware Infections at Hamamatsu OpenDNS, a leading provider of cloud-delivered security, today announced that it has enabled Hamamatsu, a Japanese manufacturer of optical sensor technologies, to virtually eliminate malware infections across its U.S. Read the source article at Finance News About Latest Posts Follow Me!Daniel PriceDaniel is a Manchester-born UK native who has abandoned

IBM and Microsoft – What Are They Doing With The Hybrid Cloud?

IBM and Microsoft – What Are They Doing With The Hybrid Cloud?

What Are They Doing With The Hybrid Cloud? “Microsoft is committed to helping enterprise customers realize the tremendous benefits of cloud computing across their own systems, partner clouds and Microsoft Azure,” said Scott Guthrie, executive vice president,Cloud and Enterprise, Microsoft. “With this … Read the source article at CNNMoney About Latest Posts Follow Me!Daniel PriceDaniel is a Manchester-born UK