Transforming Raw Data Into Meaningful Useful Information

Transforming Raw Data Into Meaningful Useful Information

Transforming Raw Data Into Meaningful Useful Information

Advanced multimedia devices, social media services, sensor networks, and corporate information systems create continuously huge amounts of structured and unstructured data which are called big data. Transforming collected masses of raw data into meaningful and useful information is important for organizations. This knowledge helps managers to make smarter decisions and improve organization’s performance.

cloud_191-bigdata

The four dimensions of big data (volume, velocity, variety and value) present challenges to businesses such as how to store and manage data, how to effectively analyse data and gain value from big data. Recently, cloud computing has been recognized as a useful technology in handling big data for many of the organizations. “ Cloud Computing platforms provide easy access to a company’s high-performance computing and storage infrastructure through web services”. The driving forces behind cloud computing are: lower infrastructure and software costs, reliability, availability, compatibility, scalability, elasticity, risk reduction, high performance and specifiable configurability. These features make cloud computing a ubiquitous paradigm for deploying novel applications which were not economically feasible in a traditional enterprise infrastructure setting.

The cloud computing model consists of three delivery models which are Software as a service (SaaS), platform as a service (PaaS), and infrastructure as a service (IaaS). In Saas, users can use services to run software on the provider’s infrastructure; Paas provides organizations a platform to use custom applications to analyse large amounts of data at a low cost and low risk in a secure environment. In the IaaS model, organizations can use services such as compute as a service, storage as a service, and virtual desktop infrastructure. Cloud deployment models include public, private and hybrid clouds.  The type of cloud a company uses depends on the company’s needs and resources. A cloud environment that is available to the public is called a public cloud which is not secure. In the private cloud, all services and resources are provided based on the needs of the organization, and the organization has total control over the services and resources. Hybrid cloud is a composition of private and public cloud. Organizations can improve their efficiency by employing public cloud services for all non-sensitive operations. A private cloud can be used for resources and services that need to be secure.

One of the primary uses of cloud computing is data storage. With cloud storage, data is stored on multiple third-party servers, rather than on the dedicated servers used in traditional networked data storage. The traditional storage solutions have typically been direct attached storage (DAS) [Storage, disk or tape, is directly attached by a cable to the computer processor] and Storage Area Network (SAN) [Storage resides on a dedicated network]. With the proliferation of local area networks, the use of clustered Network Attached Storage (NAS) has increased. Although clustered network attached storage provide easy access to data while maintaining high performance, easy management, and maximum scalability, clustered NAS storage is an expensive prospect for a small to medium size business.  Hence, an increasing number of companies and organizations move their data to cloud storage providers.

Processing of big datasets in an efficient way is a clear need for many organizations. Hadoop MapReduce is one of the popular big data processing models and it is the key to achieve better scalability and performance for processing big data. Ease-of-use, scalability, and failover are important properties of Hadoop Map Reduce. One of the main advantages of Hadoop MapReduce is that non-expert users can easily run analytical tasks over big data. Users can control on how input datasets are processed. Users code their queries using Java rather than SQL. So, it is easy to use for a larger number of developers.

In sum, cloud computing can be considered as an attractive technology platform for developing and deploying big data analysis. The key value from big data comes not from the raw data but from the processing and analysis of it and the insights, products and services that emerge from analysis.

By Mojgan Afshari

About Mojgan Afshari

Mojgan Afshari is a senior lecturer in the Department of Educational Management, Planning and Policy at the University of Malaya. She earned a Bachelor of Science in Industrial Applied Chemistry from Tehran, Iran. Then, she completed her Master’s degree in Educational Administration. After living in Malaysia for a few years, she pursued her PhD in Educational Administration with a focus on ICT use in education from the University Putra Malaysia.She currently teaches courses in managing change and creativity and statistics in education at the graduate level. Her research areas include teaching and learning with ICT, school technology leadership, Educational leadership, and creativity. She is a member of several professional associations and editor of the Journal of Education. She has written or co-authored articles in the following journals: Journal of Technology, Pedagogy and Education, The Turkish Online Journal of Educational Technology, International Journal of Education and Information Technologies, International Journal of Instruction, International Journal of Learning, European Journal of Social Sciences, Asia Pacific Journal of Cancer Prevention, Life Science Journal, Australian Journal of Basic and Applied Sciences, Scientific Research and Essays.

View All Articles

One Response to Transforming Raw Data Into Meaningful Useful Information

  1. Thanks very much for this explanation it has finally driven home some of the work we’ve done in information Processes at school. This is exactly what i needed.

Comic
Using Cloud Technology In The Education Industry

Using Cloud Technology In The Education Industry

Education Tech and the Cloud Arguably one of society’s most important functions, teaching can still seem antiquated at times. Many schools still function similarly to how they did five or 10 years ago, which is surprising considering the amount of technical innovation we’ve seen in the past decade. Education is an industry ripe for innovation…

5% Of Companies Have Embraced The Digital Innovation Fostered By Cloud Computing

5% Of Companies Have Embraced The Digital Innovation Fostered By Cloud Computing

Embracing The Cloud We love the stories of big complacent industry leaders having their positions sledge hammered by nimble cloud-based competitors. Saleforce.com chews up Oracle’s CRM business. Airbnb has a bigger market cap than Marriott. Amazon crushes Walmart (and pretty much every other retailer). We say: “How could they have not seen this coming?” But, more…

What Futuristic Tech Will You See In Your Lifetime?

What Futuristic Tech Will You See In Your Lifetime?

Futuristic Tech The world and what people can do is increasingly being driven by technology. It has already shaped the world we live in, but over the next few decades it is set to shape the world in ways that we can barely imagine. There have already been some great leaps in IoT technology recently,…

The Lighter Side Of The Cloud – Hiding Spots

The Lighter Side Of The Cloud – Hiding Spots

By David Fletcher Please feel free to share our comics via social media networks such as Twitter, Facebook, LinkedIn, Instagram, Pinterest. Clear attribution (Twitter example: via@cloudtweaks) to our original comic sources is greatly appreciated.

Recent Articles - Posted by
Fintech Exploiting AI and Blockchain Technology

Fintech Exploiting AI and Blockchain Technology

AI and Blockchain Technology The field of artificial intelligence (AI) had progressed rapidly in the last ten years, though first recognized in the 1950s. From autonomous motor vehicles to digital personal assistants, the technology is making its way into a variety of industries, enabling better task automation, language processing, and data analytics. But more recently,…

Using Cloud Technology In The Education Industry

Using Cloud Technology In The Education Industry

Education Tech and the Cloud Arguably one of society’s most important functions, teaching can still seem antiquated at times. Many schools still function similarly to how they did five or 10 years ago, which is surprising considering the amount of technical innovation we’ve seen in the past decade. Education is an industry ripe for innovation…

Four Recurring Revenue Imperatives

Four Recurring Revenue Imperatives

Revenue Imperatives “Follow the money” is always a good piece of advice, but in today’s recurring revenue-driven market, “follow the customer” may be more powerful. Two recurring revenue imperatives highlight the importance of responding to, and cherishing customer interactions. Technology and competitive advantage influence the final two. If you’re part of the movement towards recurring…

Are Cloud Solutions Secure Enough Out-of-the-box?

Are Cloud Solutions Secure Enough Out-of-the-box?

Out-of-the-box Cloud Solutions Although people may argue that data is not safe in the Cloud because using cloud infrastructure requires trusting another party to look after mission critical data, cloud services actually are more secure than legacy systems. In fact, a recent study on the state of cloud security in the enterprise market revealed that…

Virtual Immersion And The Extension/Expansion Of Virtual Reality

Virtual Immersion And The Extension/Expansion Of Virtual Reality

Virtual Immersion And Virtual Reality This is a term I created (Virtual Immersion). Ah…the sweet smell of Virtual Immersion Success! Virtual Immersion© (VI) an extension/expansion of Virtual Reality to include the senses beyond visual and auditory. Years ago there was a television commercial for a bathing product called Calgon. The tagline of the commercial was Calgon…

Why Security Practitioners Need To Apply The 80-20 Rules To Data Security

Why Security Practitioners Need To Apply The 80-20 Rules To Data Security

The 80-20 Rule For Security Practitioners  Everyday we learn about yet another egregious data security breach, exposure of customer data or misuse of data. It begs the question why in this 21st century, as a security industry we cannot seem to secure our most valuable data assets when technology has surpassed our expectations in other regards.…

Why Hybrid Cloud Delivers Better Business Agility

Why Hybrid Cloud Delivers Better Business Agility

Why Hybrid Cloud Delivers Better Business Agility A CIO friend of mine once told me that a hybrid cloud model enables him to “own the base, rent the spike” when it comes to unplanned events. Let’s face it – maintaining unused infrastructure for rare or random IT events is expensive and unnecessary in a cloud…

5 Predictions For Education Technology

5 Predictions For Education Technology

Education Technology Although technology has fast influenced most sectors of our world, education is an area that’s lagged behind. Many classrooms still employ the one-to-many lecturing model wherein the average student is catered for while a few are left behind, and others bored. Recently, there’s been a drive to uncover how to use technology successfully…

Do Small Businesses Need Cloud Storage Service?

Do Small Businesses Need Cloud Storage Service?

Cloud Storage Services Not using cloud storage for your business yet? Cloud storage provides small businesses like yours with several advantages. Start using one now and look forward to the following benefits: Easy back-up of files According to Practicalecommerce, it provides small businesses with a way to back up their documents and files. No need…

Protecting Your Web Applications In A Hybrid Cloud Environment

Protecting Your Web Applications In A Hybrid Cloud Environment

Protecting Your Web Applications It’s no secret that organizations are embracing the cloud and all the benefits that it entails. Whether its cost savings, increased flexibility or enhanced productivity – businesses around the world are leveraging the cloud to scale their business and better serve their customers. They are using a variety of cloud solutions…

The Business of Security: Avoiding Risks

The Business of Security: Avoiding Risks

The Business of Security Security is one of those IT concerns that aren’t problematic until disaster strikes. It might be tomorrow, it could be next week or next year. The fact is that poor security leaves businesses wide open for data loss and theft. News outlets just skim the surface, but hackers cost business up…

The Storytelling Machine: Big Content and Big Data

The Storytelling Machine: Big Content and Big Data

Bridging The Gap Between Big Content and Big Data Advances in cloud computing, along with the big data movement, have transformed the business IT landscape. Leveraging the cloud, companies are now afforded on demand capacity and mobile accessibility to their business-critical systems and information. At the same time, the amount of structured and unstructured data…