May 21, 2014

Big Data Survey – Top Critical Technology Trend For The Next Five Years

By Mojgan Afshari

Big Data Survey Today’s organizations should become more collaborative, virtual, adaptive, and agile in order to be successful in complex business world. They should be able to respond to changes and market needs. Many organizations found that the valuable data they possess and how they use it can make them different than others. In fact, […]

Big Data Survey

Today’s organizations should become more collaborative, virtual, adaptive, and agile in order to be successful in complex business world. They should be able to respond to changes and market needs. Many organizations found that the valuable data they possess and how they use it can make them different than others. In fact, Big Data can transform many fields such as business, management, public administration, science, and so on. In 2012, Gartner defined Big Data as “high-volume, high-velocity, and high-variety information assets that demand cost-effective, innovative forms of information processing for enhanced insight and decision making”. The term volume refers to large amounts of data, velocity indicates the speed of data in and out, and variety describes the range of data types and sources.

Big Data Survey infographic

(See Jaspersoft Big Data Survey Results)

According to an industry report prepared by McKinsey Global Institute, the effective use of Big Data is a key basis of competition and delivering a new wave of productive growth. In other words, managing, analysing, visualizing, and extracting useful information from large data sets will help organizations to increase operational efficiency, to inform strategic direction, to develop new products and services, to identify new customers and markets, to make better decisions and to become more innovative. (Davenport, Barth, & Bean, 2012).

Although Big Data bring many attractive opportunities, organizations are also facing a lot of challenges such as data capture, storage, searching, sharing, analysis, and visualization. In recent years, a large number of Big Data techniques and technologies have developed to overcome all the obstacles. Big Data techniques such as statistics, Data mining, machine learning, neural networks, social network analysis, signal processing, pattern recognition, optimization methods and visualization approaches; can be used to process efficiently large volume of data.

In addition, organizations need platforms or tools to make sense of big data. They should determine which platforms and tools can help them to meet their business goals. Current tools concentrate on three classes which are batch processing tools, stream processing tools, and interactive analysis tools. Majority of batch processing tools are based on the Apache Hadoop infrastructure which is one of the most important software platforms that support data-intensive distributed applications. It can load, store and query massive data sets on a large, flexible grid servers, as well as perform advanced analytics. It uses a programming model, which is called Map/Reduce, to process and generate great volume of data sets. Map/Reduce breaks down a complex problem into many sub-problems. These sub-problems are solved in separate and parallel ways. Finally, the solutions of sub-problems are combined to create a solution to the original problem. Although Hadoop can process large amount of data in parallel, it is not a real-time and high performance engine. It is not appropriate for high volume, high velocity and complex data types. Hence, other platforms such as SQL stream, Stream Cloud, and Storm can be used for real-time stream data analytics.

By Mojgan Afshari

Mojgan Afshari

Mojgan Afshari is a senior lecturer in the Department of Educational Management, Planning and Policy at the University of Malaya. She earned a Bachelor of Science in Industrial Applied Chemistry from Tehran, Iran. Then, she completed her Master’s degree in Educational Administration. After living in Malaysia for a few years, she pursued her PhD in Educational Administration with a focus on ICT use in education from the University Putra Malaysia. She currently teaches courses in managing change and creativity and statistics in education at the graduate level.

A.I. is Not All It’s Cracked Up to Be…At Least Not Yet!

Exploring AI’s Potential: The Gap Between Aspiration and Reality Recently Samsung releases its new Galaxy [...]
Read more

5 Azure Cost Management Strategies

What Is Azure Cost Management? Azure cost management refers to the practices and processes that [...]
Read more

AI at the Gate: Navigating the Future of Cybersecurity with SonicWall’s Bobby Cornwell

Navigating the Future of Cybersecurity In the face of the digital age’s advancements, AI’s role [...]
Read more
Jeff DeVerter

Charting the Course: An Interview with Rackspace’s Jeff DeVerter on AI and Cloud Innovation

Rackspace’s Jeff DeVerter on AI & Cloud Innovation In an insightful conversation with CloudTweaks, Jeff [...]
Read more

Lambda Cold Starts: What They Are and How to Fix Them

What Are Lambda Cold Starts? Lambda cold starts occur when AWS Lambda has to initialize [...]
Read more
Steve Prentice

Get Smarter – The Era of Microlearning 

The Era of Microlearning Becoming employable and then staying employable requires ongoing, up to date [...]
Read more

SPONSORS

Interviews and Thought Leadership

Daniel Barber

Q&A Daniel Barber – 2024 AI + Data Privacy Predictions

2024 AI + Data Privacy Predictions In a recent interview with CloudTweaks, Daniel Barber, Co-Founder and CEO of DataGrail, shared insightful perspectives on the evolving landscape of AI and privacy. [...]
Read more
Michael Kleef

Akamai’s Michael Kleef Reveals Key Shifts in Cloud Computing Landscape

Welcome to a conversation with Michael Kleef, Vice President of Product Marketing, Developer Advocacy, and Competitive Intelligence at Akamai Technologies. Today, we’re privileged to have him share his insights with [...]
Read more

Embracing Governance to Navigate 2024’s Tech Trends

Mastering Governance Strategies for Success The start of a new year is a fitting time for goal-setting, and IT managers [...]
Read more

Exploring SaaS Directories: The Path to Optimal Software Selection

Exploring the Landscape of SaaS Directories SaaS directories are vital in today’s digital age, serving as key resources for businesses [...]
Read more

CrowdStrike and Dell unleash an AI-powered, unified security vision

Dell and CrowdStrike are joining forces today to help businesses battle against cyberattacks using AI to protect against generative AI, stealth social engineering and [...]
Read more

SPONSOR PARTNER

Explore top-tier education with exclusive savings on online courses from MIT, Oxford, and Harvard through our e-learning sponsor. Elevate your career with world-class knowledge. Start now!
© 2024 CloudTweaks. All rights reserved.