Pinup: Qubole – The Growth Of Big Data as a Service

Pinup: Qubole – The Growth Of Big Data as a Service

Big Data as a Service

Qubole-BDaaS

In late 2013, the growth of ‘Big Data as a Service’ (BDaaS) was being tipped as one of 2014’s standout trends. It was speculated that BDaaS was even the natural replacement of Software as a Service (SaaS) – the SaaS approach to acquiring specialised enterprise applications had proved itself to be a valid technology model, so it made sense to market analysts that big data applications would follow a similar path.

The three principal benefits of BDaaS are similar to those of SaaS. Firstly, BDaaS solutions are highly scalable; it’s an important benefit because big data can become incredibly resource hungry in a very short space of time – more so than any other current technology can. As data repositories grow in size, so does the demand for storage space – the upshot being that hosting big data applications in-house can quickly lead to scalability issues.

Secondly, BDaaS offers improved security; the nature of big data is hard to monitor and audit and small companies would face massive resource overheads of trying to secure repositories. BDaaS transfers the responsibility for security the host.

Finally, quality and level of service. Big data and related technologies are still emerging, therefore, there is a significant skills shortage in the market. It means that developing big data applications in-house is not something most companies can consider. BDaaS offers the client company a way to procure ready made big data services that will be maintained and extended by the service host.

(Chart Image Source: BigData 50)

Big-Data-Investments

A startup that has embraced BDaaS is Qubole, and the quality of their service has already earned them an excellent reputation in the market place. The company was features in Jeff Vance’s ‘Big Data 50 – The Hottest Big Data Startup’s of 2014’ and won a DataWeek award for their ‘Presto as a Service’ offering. After receiving $7 million in funding from Lightspeed Ventures and Charles River Venture their growth has been explosive; they’ve already secured clients as varied as Pinterest, MediaMath, Nextdoor and Saavn, with more big tech industry names undoubtedly set to follow.

Pinterest data engineer Mohammed Shahangian recently enthused about the product in an interview, saying “Qubole has been a huge win for us. Qubole has proven to be stable at petabyte scale and has given us 30%-60% higher throughput than Amazon EMR. It has also made it extremely easy to onboard non-technical users”. It’s a glowing endorsement.

Their feature-rich big data platform was designed by the creators of Facebook’s and Apache Hive’s big data infrastructure, meaning their cloud-based big data service offers the same advanced capabilities as those used by large big data organisations. Its features include Hadoop as a Service, an intuitive GUI, optimised Hive, improved S3 performance and managed clusters – though arguably its biggest benefit to small businesses is the auto-scaling. The feature means that Qubole actively saves clients money by “spinning up users’ clusters when a job is started, automatically scaling or contracting them based on the workload, and spinning the servers back down once the job is done”.

For more information about Qubole’s pricing structure, head to their website to find out more.

By Daniel Price

If you are an exciting new startup in the Cloud, Big data, IoT, Wearable tech space and looking to be covered in the fantastic CloudTweaks community. Drop us a line and you may just be featured in our Pinup series

About Daniel Price

Daniel is a Manchester-born UK native who has abandoned cold and wet Northern Europe and currently lives on the Caribbean coast of Mexico. A former Financial Consultant, he now balances his time between writing articles for several industry-leading tech (CloudTweaks.com & MakeUseOf.com), sports, and travel sites and looking after his three dogs.

Find out more
View All Articles

2 Responses to Pinup: Qubole – The Growth Of Big Data as a Service

  1. This technology capability will become simple and performant enough that clients will deploy their own BDaaS on public clouds, private clouds, and hybrid clouds. The need for Qubole will shrink to the longtail until even the tail will deploy themselves. Look at past app platforms like Engine Yard and the like.

  2. Jim – would love to catchup. I almost wish I could agree with you. I wish I could go back to spending more time programming query engine internals and worrying less about our service. But what I have learnt in this business (and in prior life) is that running large distributed runtimes efficiently is hard. We are doing weekly pushes of new features and bug fixes without disrupting customers. That is hard. Building adaptive strategies into software that work reasonably well for the largest to the smallest customers *autmatically* – that’s hard. Being able to optimize workloads for customers *automatically* given their runtime history – that’s hard. Dealing with AWS and Azure and GCE and their quirks – and not losing sleep over it – that’s hard. Dealing with deployments all over the world at minimum operational cost – that’s hard.

    The comparison to running a web server farm (Engineyard) is naiive. Those are stateless. They aren’t coupled/distributed in the same manner. There’s just no comparison – and again in a way – I am glad if competitors think running Hadoop or other services is like running a web farm :-)

Comic
How The Cloud Is Changing Online Education

How The Cloud Is Changing Online Education

Online Education Growth There’s no doubt that the internet has changed the face of education over the last two decades. In fact, by some estimates more than 80 percent of college students expect to take at least some — if not all of their courses — online. Thousands of people have earned degrees without ever…

Investing In The Future With The Introduction of Sage Cloud

Investing In The Future With The Introduction of Sage Cloud

CHICAGO, IL–(Marketwired – Jul 26, 2016) – Sage, a market leader in cloud accounting software, announced today at Sage Summit 2016 its strong commitment to future technologies, with a focus on new and existing partnerships that power business growth. Revealed during CEO Stephen Kelly’s keynote address, which opened the world’s largest gathering of entrepreneurs and…

2016 Tour de France: Racing With Big Data

2016 Tour de France: Racing With Big Data

2016 Tour de France The 2016 Tour de France has just concluded, with Chris Froome (SKY) taking his third overall win. Not the kind of event we often focus on here at CloudTweaks, but Dimension Data has put its analytics technology to use tracking the journeys of each rider across all 21 stages, and their…

Ransomware: A Digital Pandemic – Is There A Cure?

Ransomware: A Digital Pandemic – Is There A Cure?

The Rise Of Ransomware You can imagine the scene: you’ve just completed that business plan and a set of accounts. Finally, it’s done and saved, ready for a final read through and to be sent out to your contact list. And right when you’re ready to click “Send”, the next thing you see on the…

Martech In A Content Crazed World

Martech In A Content Crazed World

Content Crazed World Everywhere you look there are pop-up ads and offers, at times it can feel like overload. What used to be a few online ads on websites has now grown into a wild world of offers that consume your every device. These advancements in marketing technology can not only be overwhelming to the…

The Cancer Moonshot: Collaboration Is Key

The Cancer Moonshot: Collaboration Is Key

Cancer Moonshot In his final State of the Union address in January 2016, President Obama announced a new American “moonshot” effort: finding a cure for cancer. The term “moonshot” comes from one of America’s greatest achievements, the moon landing. If the scientific community can achieve that kind of feat, then surely it can rally around…

Why Security Practitioners Need To Apply The 80-20 Rules To Data Security

Why Security Practitioners Need To Apply The 80-20 Rules To Data Security

The 80-20 Rule For Security Practitioners  Everyday we learn about yet another egregious data security breach, exposure of customer data or misuse of data. It begs the question why in this 21st century, as a security industry we cannot seem to secure our most valuable data assets when technology has surpassed our expectations in other regards.…

Adopting A Cohesive GRC Mindset For Cloud Security

Adopting A Cohesive GRC Mindset For Cloud Security

Cloud Security Mindset Businesses are becoming wise to the compelling benefits of cloud computing. When adopting cloud, they need a high level of confidence in how it will be risk-managed and controlled, to preserve the security of their information and integrity of their operations. Cloud implementation is sometimes built up over time in a business,…

The Cloud Is Not Enough! Why Businesses Need Hybrid Solutions

The Cloud Is Not Enough! Why Businesses Need Hybrid Solutions

Why Businesses Need Hybrid Solutions Running a cloud server is no longer the novel trend it once was. Now, the cloud is a necessary data tier that allows employees to access vital company data and maintain productivity from anywhere in the world. But it isn’t a perfect system — security and performance issues can quickly…

The Rise Of BI Data And How To Use It Effectively

The Rise Of BI Data And How To Use It Effectively

The Rise of BI Data Every few years, a new concept or technological development is introduced that drastically improves the business world as a whole. In 1983, the first commercially handheld mobile phone debuted and provided workers with an unprecedented amount of availability, leading to more productivity and profits. More recently, the Cloud has taken…

Cloud Computing – A Requirement For Greater Innovation

Cloud Computing – A Requirement For Greater Innovation

Cloud Computing Innovation Sao Paulo, Brazil has had trouble with both energy and water supplies as of late. Despite it is the rainy period. Unfortunately Sao Paulo is very dependent on its rain as a majority of its power is generated from large dams. No water, no energy. Difficult situation for a city of some…

The Storytelling Machine: Big Content and Big Data

The Storytelling Machine: Big Content and Big Data

Bridging The Gap Between Big Content and Big Data Advances in cloud computing, along with the big data movement, have transformed the business IT landscape. Leveraging the cloud, companies are now afforded on demand capacity and mobile accessibility to their business-critical systems and information. At the same time, the amount of structured and unstructured data…

Infographic Introduction – Benefits of Cloud Computing

Infographic Introduction – Benefits of Cloud Computing

Benefits of Cloud Computing Based on Aberdeen Group’s Computer Intelligence Dataset, there are more than 1.6 billion permutations to choose from when it comes to cloud computing solutions. So what, on the face of it, appears to be pretty simple is actually both complex and dynamic regardless of whether you’re in the market for networking,…

Will Your Internet of Things Device Testify Against You?

Will Your Internet of Things Device Testify Against You?

Will Your Internet of Things Device Testify Imagine this:  Your wearable device is subpoenaed to testify against you.  You were driving when you were over the legal alcohol limit and data from a smart Breathalyzer device is used against you. Some might argue that such a use case could potentially safeguard society. However, it poses…

Driving Success: 6 Key Metrics For Every Recurring Revenue Business

Driving Success: 6 Key Metrics For Every Recurring Revenue Business

Recurring Revenue Business Metrics Recurring revenue is the secret sauce behind the explosive growth of powerhouses like Netflix and Uber. Unsurprisingly, recurring revenue is also quickly gaining ground in more traditional industries like healthcare and the automotive business. In fact, nearly half of U.S. businesses have adopted or are planning to adopt a recurring revenue model,…