Big Data – Top Critical Technology Trend For The Next Five Years

Big Data – Top Critical Technology Trend For The Next Five Years

Big Data – Top Critical Technology Trend For The Next Five YearsBig Data Survey Infographic FINAL_001

Today’s organizations should become more collaborative, virtual, adaptive, and agile in order to be successful in complex business world. They should be able to respond to changes and market needs. Many organizations found that the valuable data they possess and how they use it can make them different than others. In fact, Big Data can transform many fields such as business, management, public administration, science, and so on. In 2012, Gartner defined Big Data as “high-volume, high-velocity, and high-variety information assets that demand cost-effective, innovative forms of information processing for enhanced insight and decision making”. The term volume refers to large amounts of data, velocity indicates the speed of data in and out, and variety describes the range of data types and sources.

According to an industry report prepared by McKinsey Global Institute, the effective use of Big Data is a key basis of competition and delivering a new wave of productive growth. In other words, managing, analysing, visualizing, and extracting useful information from large data sets will help organizations to increase operational efficiency, to inform strategic direction, to develop new products and services, to identify new customers and markets, to make better decisions and to become more innovative. (Davenport, Barth, & Bean, 2012).

Although Big Data bring many attractive opportunities, organizations are also facing a lot of challenges such as data capture, storage, searching, sharing, analysis, and visualization. In recent years, a large number of Big Data techniques and technologies have developed to overcome all the obstacles. Big Data techniques such as statistics, data mining, machine learning, neural networks, social network analysis, signal processing, pattern recognition, optimization methods and visualization approaches; can be used to process efficiently large volume of data.

In addition, organizations need platforms or tools to make sense of big data. They should determine which platforms and tools can help them to meet their business goals. Current tools concentrate on three classes which are batch processing tools, stream processing tools, and interactive analysis tools. Majority of batch processing tools are based on the Apache Hadoop infrastructure which is one of the most important software platforms that support data-intensive distributed applications. It can load, store and query massive data sets on a large, flexible grid servers, as well as perform advanced analytics. It uses a programming model, which is called Map/Reduce, to process and generate great volume of data sets. Map/Reduce breaks down a complex problem into many sub-problems. These sub-problems are solved in separate and parallel ways. Finally, the solutions of sub-problems are combined to create a solution to the original problem. Although Hadoop can process large amount of data in parallel, it is not a real-time and high performance engine. It is not appropriate for high volume, high velocity and complex data types. Hence, other platforms such as SQL stream, Stream Cloud, and Storm can be used for real-time stream data analytics.

By Mojgan Afshari

About Mojgan Afshari

Mojgan Afshari is a senior lecturer in the Department of Educational Management, Planning and Policy at the University of Malaya. She earned a Bachelor of Science in Industrial Applied Chemistry from Tehran, Iran. Then, she completed her Master’s degree in Educational Administration. After living in Malaysia for a few years, she pursued her PhD in Educational Administration with a focus on ICT use in education from the University Putra Malaysia.She currently teaches courses in managing change and creativity and statistics in education at the graduate level. Her research areas include teaching and learning with ICT, school technology leadership, Educational leadership, and creativity. She is a member of several professional associations and editor of the Journal of Education. She has written or co-authored articles in the following journals: Journal of Technology, Pedagogy and Education, The Turkish Online Journal of Educational Technology, International Journal of Education and Information Technologies, International Journal of Instruction, International Journal of Learning, European Journal of Social Sciences, Asia Pacific Journal of Cancer Prevention, Life Science Journal, Australian Journal of Basic and Applied Sciences, Scientific Research and Essays.

View All Articles

One Response to Big Data – Top Critical Technology Trend For The Next Five Years

The iCloud Scandal – Who Is To Blame? –  ‘Cloud’ Security vs. ‘Internet’ Security

The iCloud Scandal – Who Is To Blame? – ‘Cloud’ Security vs. ‘Internet’ Security

How the iCloud Scandal Has Helped to Define the Difference Between ‘Cloud’ Security and ‘Internet’ Security Busting the myth that bad cloud security was to blame for Apple’s recent celebrity data disaster Overview: We discuss the ‘celebrity hacking’ iCloud saga and debate whether or not the breach was likely down to Cloud encryption issues or…

Basic Cloud Risk Assessment Tips

Basic Cloud Risk Assessment Tips

Basic Cloud Risk Assessment You should worry about the risks of cloud computing. But don’t get too scared. With a few simple steps you can easily get a basic understanding of your risks in the cloud and even have a good start in managing these risks. If you are a large corporation in a regulated…

How IRM Makes Cloud-Based File Collaboration “Security-Aware”

How IRM Makes Cloud-Based File Collaboration “Security-Aware”

IRM Cloud-Based File Collaboration  Data breaches and data loss due to insider threats, including malicious insiders stealing, manipulating or destroying data, are the fastest-growing risks that keep managers up at night, according to new research by Ernst & Young. How can we ensure that the right people in an organization have the right access to…

The Internet of Things And The Knowledge Revolution

The Internet of Things And The Knowledge Revolution

The Knowledge Revolution Think about a few things in your life right now. It really doesn’t matter what they are, as long as you interact with them daily. They could be your phone, your shoes, your watch, your car, your refrigerator, your garage door opener…you get the idea. What do all of these things have…

Vendors To Enter The Cyber Security Game

Vendors To Enter The Cyber Security Game

IT Regulatory Compliance as the Next Big Focus for Cloud Vendors Back in October 2014, Defense Information Systems Agency (DISA) submitted a public request for information, calling for the assessment of the marketplace’s ability to “provide cloud ecosystems and services in two integration models that place vendor cloud services on DoD networks for use by…

Cyber Physical Systems (CPS) And BYOD Security

Cyber Physical Systems (CPS) And BYOD Security

Cyber Physical Systems (CPS)  Technology has changed the world radically. But, to date, the world hasn’t changed as fast as technology to. There are a couple of concepts that are concerning as we head into the reality of CPS-deployed systems. The first is that standards don’t exist. Many companies are considering the Bring Your Own…

5 Ways The Latest Cloud Tools Can Help Increase Sales

5 Ways The Latest Cloud Tools Can Help Increase Sales

Cloud Tools Can Help Increase Sales How new cloud technology can help you source, manage and close more leads. We take a look at how you can use cloud software to boost your sales team’s productivity and clinch more of those all-important deals! Selling and Marketing is integral to every business and a company’s sales team…

CloudTweaks is recognized as one of the leading influencers in cloud computing, infosec, big data and the internet of things (IoT) information. Our goal is to continue to build our growing information portal by providing the best in-depth articles, interviews, event listings, whitepapers, infographics and much more.

Sponsor