Louis Columbus

53% Of Companies Are Adopting Big Data Analytics

Adopting Big Data Analytics

  • Big data adoption reached 53% in 2017 for all companies interviewed, up from 17% in 2015, with telecom and financial services leading early adopters.
  • Reporting, dashboards, advanced visualization end-user “self-service” and data warehousing are the top five technologies and initiatives strategic to business intelligence.
  • Data warehouse optimization remains the top use case for big data, followed by customer/social analysis and predictive maintenance.
  • Among big data distributions, Cloudera is the most popular, followed by Hortonworks, MAP/R, and Amazon EMR.

These and many other insights are from Dresner Advisory Services’ insightful 2017 Big Data Analytics Market Study (94 pp., PDF, client accessed reqd), which is part of their Wisdom of Crowds® series of research. This 3rd annual report examines end-user trends and intentions surrounding big data analytics, defined as systems that enable end-user access to and analysis of data contained and managed within the Hadoop ecosystem. The 2017 Big Data Analytics Market Study represents a cross-section of data that spans geographies, functions, organization size, and vertical industries. Please see page 10 of the study for additional details regarding the methodology.

“Across the three years of our comprehensive study of big data analytics, we see a significant increase in uptake in usage and a large drop of those with no plans to adopt,” said Howard Dresner, founder and chief research officer at Dresner Advisory Services. “In 2017, IT has emerged as the most typical adopter of big data, although all departments – including finance – are considering future use. This is an indication that big data is becoming less an experimental endeavor and more of a practical pursuit within organizations.”

Key takeaways include the following:

  • Reporting, dashboards, advanced visualization end-user “self-service” and data warehousing are the top five technologies and initiatives strategic to business intelligence.  Big Data ranks 20th across 33 key technologies Dresner Advisory Services currently tracks.  Big Data Analytics is of greater strategic importance than the Internet of Things (IoT), natural language analytics, cognitive Business Intelligence (BI) and Location intelligence.

  • 53% of companies are using big data analytics today, up from 17% in 2015 with Telecom and Financial Services industries fueling the fastest adoption. Telecom and financial services are the most active early adopters, with Technology and Healthcare being the third and fourth industries seeing big data analytics Education has the lowest adoption as 2017 comes to a close, with the majority of institutions in that vertical saying they are evaluating big data analytics for the future. North America (55%) narrowly leads EMEA (53%) in their current levels of big data analytics adoption. Asia-Pacific respondents report 44% current adoption and are most likely to say they “may use big data in the future.”

 

  • Data warehouse optimization is considered the most important big data analytics use case in 2017, followed by customer/social analysis and predictive maintenance. Data warehouse optimization is considered critical or very important by 70% of all respondents. It’s interesting to note and ironic that the Internet of Things (IoT) is among the lowest priority use cases for big data analytics today.

 

  • Big data analytics use cases vary significantly by industry with data warehouse optimization dominating Financial Services, Healthcare, and Customer/social analysis is the leading use case in Technology-based companies. Fraud detection use cases also dominate Financial Services and Telecommunications. Using big data for clickstream analytics is most popular in Financial Services.

 

  • Spark, MapReduce, and Yarn are the three most popular software frameworks today. Over 30% of respondents consider Spark critical to their big data analytics strategies. MapReduce and Yarn are “critical” to more than 20 percent of respondents.

 

  • The big data access methods most preferred by respondents include Spark SQL, Hive, HDFS and Amazon S3. 73% of the respondents consider Spark SQL critical to their analytics strategies. Over 30% of respondents consider Hive and HDFS critical as well. Amazon S3 is critical to one of five respondents for managing big data access. The following graphic shows the distribution of big data access methods.

 

  • Machine learning continues to gain more industry support and investment plans with Spark Machine Learning Library (MLib) adoption projected to grow by 60% in the next 12 months. In the next 24 months, MLib will dominate machine learning according to the survey results. MLib is accessible from the Sparklyr R Package and many others, which continues to fuel its growth. The following graphic compares projected two-year adoption rates by machine learning libraries and frameworks.

By Louis Columbus

Louis Columbus

I am currently serving as Director, Global Cloud Product Management at Ingram Cloud. Previous positions include product marketing at iBASEt, Plex Systems, senior analyst at AMR Research (now Gartner), marketing and business development at Cincom Systems, Ingram Micro, a SaaS start-up and at hardware companies. I am also a member of the Enterprise Irregulars. My background includes marketing, product management, sales and industry analyst roles in the enterprise software and IT industries. My academic background includes an MBA from Pepperdine University and completion of the Strategic Marketing Management Program at the Stanford University Graduate School of Business. I teach MBA courses in international business, global competitive strategies, international market research, and capstone courses in strategic planning and market research. I've taught at California State University, Fullerton: University of California, Irvine; Marymount University, and Webster University. You can reach me on Twitter at @LouisColumbus.

View Website

CONTRIBUTORS

How a large Missouri medical center developed an agile healthcare infrastructure security strategy

How a large Missouri medical center developed an agile healthcare infrastructure security strategy

Healthcare provider organizations are among the most challenging environments to develop and implement comprehensive and agile security infrastructures. These providers of ...
Cloud Computing Predicted to Drive $554 Billion by 2021

Cloud Computing Predicted to Drive $554 Billion by 2021

Cloud Computing $554 Billion by 2021 It’s common to read news stories and research about certain segments of cloud computing ...
Inside the Equifax Hack

Was the Data Just Too Big? Inside the Equifax Hack

Inside the Equifax Hack Equifax is a gigantic financial organization, the entire livelihood of which revolves around collecting and analyzing ...
How SSO Software Works and Why Single Sign-On Is Important

How SSO Software Works and Why Single Sign-On Is Important

The Functionality and Importance of SSO Software SSO is an acronym for Single Sign-On, a software program which uses one ...
Have you Heard? The Chinese Cloud Is Coming!

Have you Heard? The Chinese Cloud Is Coming!

Alibaba challenges Amazon “Alibaba challenges Amazon in the Cloud marketplace!” Analysts are almost breathless in their commentary. What’s the real ...
Scale Matters in the Enterprise Cloud

Scale Matters in the Enterprise Cloud

The Enterprise Cloud What used to be an unknown and mysterious term, “the cloud” is now a common and mostly ...
How Blockchain has Unexpectedly Improved Big Data Integrity

How Blockchain has Unexpectedly Improved Big Data Integrity

Big Data Integrity Blockchain technology was developed to improve the integrity of bitcoin. However, as bitcoin became more popular, its ...
Why does the concept of airspace matter in the drone world?

Why does the concept of airspace matter in the drone world?

The Airspace Drone World Recently I was invited to continue a discussion started last year. The conversation was a roundtable ...
Safeguarding Data Before Disaster Strikes

Safeguarding Data Before Disaster Strikes

Safeguarding Data  Online data backup is one of the best methods for businesses of all sizes to replicate their data ...
Uh – Oh! Is This the Year of the Tipping Point for You?

Uh – Oh! Is This the Year of the Tipping Point for You?

Cloud Tipping Point One survey says most workloads are still in on-premise data centers. Another analysis says it’s all going ...

NEWS

DigitalOcean Announces New Compute Plans to Provide Best Price-to-Performance for Production Applications

DigitalOcean Announces New Compute Plans to Provide Best Price-to-Performance for Production Applications

Changes Position DigitalOcean as Most Competitive, Simple Pricing Solution in Cloud Infrastructure Industry NEW YORK, Jan. 16, 2018 (GLOBE NEWSWIRE) ...
Red Hat global survey finds field services operations bullish on emerging technologies

Red Hat global survey finds field services operations bullish on emerging technologies

Bullish Emerging Technologies For many industries, from transportation to utilities, manufacturing and more, field workers are pivotal to the success ...
Amazon shortlists 20 cities for second headquarters

Amazon shortlists 20 cities for second headquarters

(Reuters) - Amazon.com Inc (AMZN.O) has short-listed 20 cities and regions, including one in Canada, for the construction of a ...