Transforming Raw Data Into Meaningful Useful Information

Transforming Raw Data Into Meaningful Useful Information

Transforming Raw Data Into Meaningful Useful Information

Advanced multimedia devices, social media services, sensor networks, and corporate information systems create continuously huge amounts of structured and unstructured data which are called big data. Transforming collected masses of raw data into meaningful and useful information is important for organizations. This knowledge helps managers to make smarter decisions and improve organization’s performance.

cloud_191-bigdata

The four dimensions of big data (volume, velocity, variety and value) present challenges to businesses such as how to store and manage data, how to effectively analyse data and gain value from big data. Recently, cloud computing has been recognized as a useful technology in handling big data for many of the organizations. “ Cloud Computing platforms provide easy access to a company’s high-performance computing and storage infrastructure through web services”. The driving forces behind cloud computing are: lower infrastructure and software costs, reliability, availability, compatibility, scalability, elasticity, risk reduction, high performance and specifiable configurability. These features make cloud computing a ubiquitous paradigm for deploying novel applications which were not economically feasible in a traditional enterprise infrastructure setting.

The cloud computing model consists of three delivery models which are Software as a service (SaaS), platform as a service (PaaS), and infrastructure as a service (IaaS). In Saas, users can use services to run software on the provider’s infrastructure; Paas provides organizations a platform to use custom applications to analyse large amounts of data at a low cost and low risk in a secure environment. In the IaaS model, organizations can use services such as compute as a service, storage as a service, and virtual desktop infrastructure. Cloud deployment models include public, private and hybrid clouds.  The type of cloud a company uses depends on the company’s needs and resources. A cloud environment that is available to the public is called a public cloud which is not secure. In the private cloud, all services and resources are provided based on the needs of the organization, and the organization has total control over the services and resources. Hybrid cloud is a composition of private and public cloud. Organizations can improve their efficiency by employing public cloud services for all non-sensitive operations. A private cloud can be used for resources and services that need to be secure.

One of the primary uses of cloud computing is data storage. With cloud storage, data is stored on multiple third-party servers, rather than on the dedicated servers used in traditional networked data storage. The traditional storage solutions have typically been direct attached storage (DAS) [Storage, disk or tape, is directly attached by a cable to the computer processor] and Storage Area Network (SAN) [Storage resides on a dedicated network]. With the proliferation of local area networks, the use of clustered Network Attached Storage (NAS) has increased. Although clustered network attached storage provide easy access to data while maintaining high performance, easy management, and maximum scalability, clustered NAS storage is an expensive prospect for a small to medium size business.  Hence, an increasing number of companies and organizations move their data to cloud storage providers.

Processing of big datasets in an efficient way is a clear need for many organizations. Hadoop MapReduce is one of the popular big data processing models and it is the key to achieve better scalability and performance for processing big data. Ease-of-use, scalability, and failover are important properties of Hadoop Map Reduce. One of the main advantages of Hadoop MapReduce is that non-expert users can easily run analytical tasks over big data. Users can control on how input datasets are processed. Users code their queries using Java rather than SQL. So, it is easy to use for a larger number of developers.

In sum, cloud computing can be considered as an attractive technology platform for developing and deploying big data analysis. The key value from big data comes not from the raw data but from the processing and analysis of it and the insights, products and services that emerge from analysis.

By Mojgan Afshari

About Mojgan Afshari

Mojgan Afshari is a senior lecturer in the Department of Educational Management, Planning and Policy at the University of Malaya. She earned a Bachelor of Science in Industrial Applied Chemistry from Tehran, Iran. Then, she completed her Master’s degree in Educational Administration. After living in Malaysia for a few years, she pursued her PhD in Educational Administration with a focus on ICT use in education from the University Putra Malaysia.She currently teaches courses in managing change and creativity and statistics in education at the graduate level. Her research areas include teaching and learning with ICT, school technology leadership, Educational leadership, and creativity. She is a member of several professional associations and editor of the Journal of Education. She has written or co-authored articles in the following journals: Journal of Technology, Pedagogy and Education, The Turkish Online Journal of Educational Technology, International Journal of Education and Information Technologies, International Journal of Instruction, International Journal of Learning, European Journal of Social Sciences, Asia Pacific Journal of Cancer Prevention, Life Science Journal, Australian Journal of Basic and Applied Sciences, Scientific Research and Essays.

View All Articles

One Response to Transforming Raw Data Into Meaningful Useful Information

  1. Thanks very much for this explanation it has finally driven home some of the work we’ve done in information Processes at school. This is exactly what i needed.

E-Commerce Advances For Savvy Marketers

E-Commerce Advances For Savvy Marketers

Digital Marketing Platforms Advertising and marketing techniques have progressed rapidly in the last decade with both channel focus and the direction of content shifting considerably due primarily to advances in cloud technology. Gartner’s Magic Quadrant for Digital Commerce 2016 singles out a few ecommerce providers who are topping their sector in both ability to execute…

The Lighter Side Of The Cloud – Energy Battle

The Lighter Side Of The Cloud – Energy Battle

By David Fletcher Please feel free to share our comics via social media networks such as Twitter, Facebook, LinkedIn, Instagram, Pinterest. Clear attribution (Twitter example: via@cloudtweaks) to our original comic sources is greatly appreciated.

Recent Articles - Posted by
Cloud Comings and Goings

Cloud Comings and Goings

Cloud Power Amazon Web Services – the giant of cloud computing – is on track to do $10 Billion in revenue this year. Yet, rumors swirl that Apple may take a huge chunk of business away from them and Dropbox has definitely left AWS. Is something wrong at AWS? Wait, Salesforce.com (SFDC) – the granddaddy of…

Digital Transformation: Not Just For Large Enterprises Anymore

Digital Transformation: Not Just For Large Enterprises Anymore

Digital Transformation Digital transformation is the acceleration of business activities, processes, and operational models to fully embrace the changes and opportunities of digital technologies. The concept is not new; we’ve been talking about it in one way or another for decades: paperless office, BYOD, user experience, consumerization of IT – all of these were stepping…

Connecting the Digital Dots with the Internet of Things

Connecting the Digital Dots with the Internet of Things

The IoT Explosion In The Cross-Industry Category Gartner estimates that 6.4 billion Internet of Things (IoT) devices will be in use in 2016, nearly a third more than last year, and with attentive patrons such as Samsung, recently committing to invest $1.2 billion into IoT research in the US over four years, we can happily…

Cloud Computing Offers Key Benefits For Small, Medium Businesses

Cloud Computing Offers Key Benefits For Small, Medium Businesses

Cloud Computing Benefits A growing number of small and medium businesses in the United States rely on as a means of deploying mission-critical software products. Prior to the advent of cloud-based products — software solutions delivered over the Internet – companies were often forced to invest in servers and other products to run software and…

The Global Rise of Cloud Computing

The Global Rise of Cloud Computing

The Global Rise of Cloud Computing Despite the rapid growth of cloud computing, the cloud still commands a small portion of overall enterprise IT spending. Estimates I’ve seen put the percentage between 5% and 10% of the slightly more than $2 trillion (not including telco) spent worldwide in 2014 on enterprise IT. Yet growth projections…

Cloud Infographic – Cloud Computing And SMEs

Cloud Infographic – Cloud Computing And SMEs

Cloud Computing And SMEs SMEs (Small/Medium Sized Enterprises) make up the bulk of businesses today. Most cloud based applications created today are geared toward the SME market. Accounting, Storage, Backup services are just a few of them. According to the European Commission, cloud based technology could help 80% of organisations reduce costs by 10-20%. This infographic provided…

Cloud Infographic – The Future (IoT)

Cloud Infographic – The Future (IoT)

The Future (IoT) By the year 2020, it is being predicted that 40 to 80 billion connected devices will be in use. The Internet of Things or IoT will transform your business and home in many truly unbelievable ways. The types of products and services that we can expect to see in the next decade…

5 Reasons Why Your Startup Will Grow Faster In The Cloud

5 Reasons Why Your Startup Will Grow Faster In The Cloud

Cloud Startup Fast-tracking Start-ups face many challenges, the biggest of which is usually managing growth. A start-up that does not grow is at constant risk of failure, whereas a new business that grows faster than expected may be hindered by operational constraints, such as a lack of staff, workspace and networks. It is an unfortunate…

The Questions of Privacy In The Internet of Things Revolution

The Questions of Privacy In The Internet of Things Revolution

Privacy in the Internet of Things Revolution The Internet of Things (IoT) has been promising a lot to consumers for a few years and now we’re really starting to see some of the big ideas come to fruition, which means an ever-growing conversation around data security and privacy. Big data comes with big responsibilities and…

Cloud Infographic: IoT For Automotive Deconstructed

Cloud Infographic: IoT For Automotive Deconstructed

IoT For Automotive Deconstructed The IoT automotive industry is moving rapidly with many exciting growth opportunities available. We’ve written about some of the risks and benefits as well as some of the players involved. One thing for certain as that the auto industry is starting to take notice and we can expect the implementation of a…