Big Data – Top Critical Technology Trend For The Next Five Years

Advertise on CloudTweaks

Big Data Future

Today’s organizations should become more collaborative, virtual, adaptive, and agile in order to be successful in complex business world. They should be able to respond to changes and market needs. Many organizations found that the valuable data they possess and how they use it can make them different than others. In fact, Big Data can transform many fields such as business, management, public administration, science, and so on. In 2012, Gartner defined Big Data as “high-volume, high-velocity, and high-variety information assets that demand cost-effective, innovative forms of information processing for enhanced insight and decision making”. The term volume refers to large amounts of data, velocity indicates the speed of data in and out, and variety describes the range of data types and sources.

According to an industry report prepared by McKinsey Global Institute, the effective use of Big Data is a key basis of competition and delivering a new wave of productive growth. In other words, managing, analysing, visualizing, and extracting useful information from large data sets will help organizations to increase operational efficiency, to inform strategic direction, to develop new products and services, to identify new customers and markets, to make better decisions and to become more innovative. (Davenport, Barth, & Bean, 2012).

Although Big Data bring many attractive opportunities, organizations are also facing a lot of challenges such as data capture, storage, searching, sharing, analysis, and visualization. In recent years, a large number of Big Data techniques and technologies have developed to overcome all the obstacles. Big Data techniques such as statistics, data mining, machine learning, neural networks, social network analysis, signal processing, pattern recognition, optimization methods and visualization approaches; can be used to process efficiently large volume of data.

In addition, organizations need platforms or tools to make sense of big data. They should determine which platforms and tools can help them to meet their business goals. Current tools concentrate on three classes which are batch processing tools, stream processing tools, and interactive analysis tools. Majority of batch processing tools are based on the Apache Hadoop infrastructure which is one of the most important software platforms that support data-intensive distributed applications. It can load, store and query massive data sets on a large, flexible grid servers, as well as perform advanced analytics. It uses a programming model, which is called Map/Reduce, to process and generate great volume of data sets. Map/Reduce breaks down a complex problem into many sub-problems. These sub-problems are solved in separate and parallel ways. Finally, the solutions of sub-problems are combined to create a solution to the original problem. Although Hadoop can process large amount of data in parallel, it is not a real-time and high performance engine. It is not appropriate for high volume, high velocity and complex data types. Hence, other platforms such as SQL stream, Stream Cloud, and Storm can be used for real-time stream data analytics.

By Mojgan Afshari

Mojgan Afshari

Mojgan Afshari is a senior lecturer in the Department of Educational Management, Planning and Policy at the University of Malaya. She earned a Bachelor of Science in Industrial Applied Chemistry from Tehran, Iran. Then, she completed her Master’s degree in Educational Administration. After living in Malaysia for a few years, she pursued her PhD in Educational Administration with a focus on ICT use in education from the University Putra Malaysia.She currently teaches courses in managing change and creativity and statistics in education at the graduate level. Her research areas include teaching and learning with ICT, school technology leadership, Educational leadership, and creativity. She is a member of several professional associations and editor of the Journal of Education. She has written or co-authored articles in the following journals: Journal of Technology, Pedagogy and Education, The Turkish Online Journal of Educational Technology, International Journal of Education and Information Technologies, International Journal of Instruction, International Journal of Learning, European Journal of Social Sciences, Asia Pacific Journal of Cancer Prevention, Life Science Journal, Australian Journal of Basic and Applied Sciences, Scientific Research and Essays.

Something went wrong. Please check your entries and try again.

CONTRIBUTORS

Meet GRAIL - Fighting Cancer with Big Data, AI and the Cloud

Meet GRAIL – Fighting Cancer with Big Data, AI and the Cloud

Improve Your Chances of Surviving Cancer by 5X to 10X How would you like to improve your odds of surviving ...
The Cloudification of Healthcare: Benefits and Risks

The Cloudification of Healthcare: Benefits and Risks

Cloud Healthcare: Benefits and Risks Many organizations are moving most of their business-critical applications and workloads to the cloud. The ...
Connecting the Power of IoT

Connecting the Power of IoT

Connection Power I come not to bury Caesar. Nor do I come to bury his estimates. Estimates, attempts based on ...
IoT: Penetrating the Possibilities of a Data Driven Economy

IoT: Penetrating the Possibilities of a Data Driven Economy

Data Driven Economy All of us are accustomed to the smart wearables, such as the ones we wear on a ...
4 Tech Cleanups For National Cyber Security Awareness

4 Tech Cleanups For National Cyber Security Awareness

National Cyber Security Awareness October is Cyber Security Awareness Month, and President Obama recently called upon the American people to ...
Future of Identity Protection

AI and the Future of Identity Protection

Future of Identity Protection There’s a lot of alarm over who stands to lose their job to automation and artificial ...
5 Tips For Improving Enterprise Cloud Success In 2017

5 Tips For Improving Enterprise Cloud Success In 2017

Improving Enterprise Cloud There has been an increase in the adoption rate of cloud technology to help businesses keep capital ...
73% Are Using Internet Of Things Data To Improve Their Business

73% Are Using Internet Of Things Data To Improve Their Business

Internet Of Things Data According to the Cisco Visual Networking Index, M2M connections will represent 46% of connected devices by ...

NEWS

Cisco Unveils Industry's First Predictive Services Powered by AI

Cisco Unveils Industry’s First Predictive Services Powered by AI

New offerings designed to manage growing technical skills gap through unique expertise, intelligence and automation SAN JOSE, CA--(Marketwired - Oct ...
CIOs Cutting Through the Hype and Delivering Real Value from Machine Learning, Survey Shows 

CIOs Cutting Through the Hype and Delivering Real Value from Machine Learning, Survey Shows 

New survey reveals progressive CIOs tap machine learning to solve everyday work problems SANTA CLARA, Calif. – October 17, 2017– A ...
Toyota to test self-driving, talking cars by about 2020

Toyota to test self-driving, talking cars by about 2020

TOKYO (Reuters) - Toyota Motor Corp (7203.T) on Monday said it would begin testing self-driving electric cars around 2020, which ...

NEWSLETTER SUBSCRIBE

CloudTweaks has been a prominent influence covering cloud technologies since 2009. We have worked and continue to work with a tremendous number of writers, contributors and partners throughout the world – all of whom provide insights into the cloud business community. This information is provided to our Newsletter subscribers on a weekly basis - free of charge.

Subscribe to recieve our weekly collection of Best of Thought leadership, Technology news, Tweaks, Curated resource links, Excluisve promotions and our popular Comic series.

JOIN US

Something went wrong. Please check your entries and try again.