Bill Schmarzo

Blockchain + Analytics: Enabling Smart IOT

Blockchain + Analytics

Autonomous cars are racing down the highway at speeds exceeding 100 MPH when suddenly a car a half-mile ahead blows out a tire sending dangerous debris across 3 lanes of traffic.  Instead of relying upon sending this urgent, time-critical distress information to the world via the cloud, the cars on that particular section of the highway use peer-to-peer, immutable communications to inform all vehicles in the area of the danger so that they can slow down and move to unobstructed lanes (while also sending a message to the nearest highway maintenance robots to remove the debris).

Figure 1: “I, Robot” Movie Scene of Autonomous Robots Cleaning Up Road Debris

Real-time analytics at the edges of the Internet of Things and the real-time communications between devices of different types, models and makes are going to be critical to realizing the operational and society benefits of smart cities, smart airports, smart hospitals, smart factories and the like.

While machine learning and reinforcement learning at the edges and deep learning at the core are key to driving system-wide intelligence, the ability to capture, communicate, share and build upon the system-wide “learnings and insights” at the “local level” is going to require a technology that exploits real-time, nearest neighbor, peer-to-peer, immutable communications. Hello Blockchain (see Figure 2)!

Figure 2:  Analytics + Blockchain = Smart

While there are many interesting aspects of Blockchain, the two that I find the most compelling for creating “smart” environments are:

  • Peer-to-peer, which is the ability to share access to data and information (analytics) without the need for a central server
  • Immutable communications, which is that the data and information is not susceptible to change.

Define Blockchain

A blockchain is a distributed file system in which blocks of information are linked together (“chained”) and secured using private key cryptography, ensuring only those with appropriate permission can edit the data. Because copies of the file are stored on multiple computer systems (distributed) and kept synchronized through the consensus of the network, they enable innovative solutions to problems involving tracking and ledgering transactions in a digital world.

Figure 3:  Source: http://www.ameerrosic.com/what-is-blockchain-finally-a-simple-guide/

Bottom-line is that blockchain enables low-cost, peer-to-peer communications without the added expense (and latency) of a cloud infrastructure.

Precision Agriculture Use Case

A recent BusinessWeek article titled “This Army of AI Robots Will Feed the World” discusses the implications of micro-robots in the application of plant-by-plant farming.  From the article:

“The implication of plant-by-plant—rather than field-by-field—farming is not just the prospect of vast reductions in chemical usage. It could also, in theory, end mono-cropping, which has become the new normal—cornfields and soybean fields as far as the eye can see—and has given rise to the kind of high-calorie, low-nutrient diets that are causing heart disease, obesity, and Type 2 diabetes. Mono-crops also leach soil nutrients and put food supplies at risk, because single-crop fields are more susceptible to blight and catastrophe. Modern farmers have been segregating crops in part because our equipment can’t handle more complexity. Robots that can tend plants individually could support intercropping—planting corn in with complementary crops such as soybeans and other legumes.”

As these micro-robots roll down the fields applying deep learning algorithms to make snap decisions about what pesticides and/or herbicides to use, and how much to use on an individual plant by plant basis, blockchain will play a critical role in ensuring communications between the micro-robots and the other farm implements of different types, models and manufacturers about the learnings or insights that are being gathered in real-time about crop health, damage and disease, including:

  • Is there a pattern to the pesticide and herbicide needs of the plants?
  • Do certain types of plants require more than normal pesticides and herbicides?
  • Are there any potential pesticide or herbicide “drift” problems that are having unexpected impact on neighboring plants?
  • Are there certain portions of the field where more or less crop damage is prevalent?
  • Which pesticides and herbicides seem to be delivering the best results?

These kinds of real-time insights can help the micro-robots to optimize the plant-by-plant treatments to drive optimal crop yield at minimal costs.

Role of Analytic Profiles or Digital Twins

What I find most interesting from a Big Data and Data Science perspective is the ability to build analytic profiles at the level of each individual plants. The micro-robots applying pesticides and herbicides can capture detailed performance and behavioral insights at the level of each individual plant.  These performance and behavioral plant, pesticide and herbicide insights can be aggregated to provide substantial financial, operational and ecological benefits such as:

  • Reduced use and overuse of pesticides and herbicides
  • Improved predictability in crop yield
  • Improved predictability in ideal harvesting time
  • Reduce crops lost to disease and distress
  • Optimize the mix of crops on a field-by-field basis
  • Reduce the time and effort required to care for a field
  • Save a whole bunch of money!

See the blog “Analytic Profiles: Key to Data Monetization” for more details on the Analytic Profiles concept.

Blockchain + Analytics has the potential to convert almost any environment (airports, train stations, malls, highways, schools, hospitals, factories, stores) into a “smart” environment where the learnings and insights from normal operations can be quickly and securely shared with “neighboring” devices to create a self-learning, self-correcting and self-adjusting environment. Now that’s smart!

By Bill Schmarzo

Bill Schmarzo

CTO, IoT and Analytics at Hitachi Vantara (aka “Dean of Big Data”)

Bill Schmarzo, author of “Big Data: Understanding How Data Powers Big Business” and “Big Data MBA: Driving Business Strategies with Data Science”. He’s written white papers, is an avid blogger and is a frequent speaker on the use of Big Data and data science to power an organization’s key business initiatives. He is a University of San Francisco School of Management (SOM) Executive Fellow where he teaches the “Big Data MBA” course. Bill also just completed a research paper on “Determining The Economic Value of Data”. Onalytica recently ranked Bill as #4 Big Data Influencer worldwide.

Bill has over three decades of experience in data warehousing, BI and analytics. Bill authored the Vision Workshop methodology that links an organization’s strategic business initiatives with their supporting data and analytic requirements. Bill serves on the City of San Jose’s Technology Innovation Board, and on the faculties of The Data Warehouse Institute and Strata.

Previously, Bill was vice president of Analytics at Yahoo where he was responsible for the development of Yahoo’s Advertiser and Website analytics products, including the delivery of “actionable insights” through a holistic user experience. Before that, Bill oversaw the Analytic Applications business unit at Business Objects, including the development, marketing and sales of their industry-defining analytic applications.

Bill holds a Masters Business Administration from University of Iowa and a Bachelor of Science degree in Mathematics, Computer Science and Business Administration from Coe College.

CONTRIBUTORS

Beacons Flopped, But They’re About to Flourish in the Future

Beacons Flopped, But They’re About to Flourish in the Future

Cloud Beacons Flying High When Apple debuted cloud beacons in 2013, analysts predicted 250 million devices capable of serving as ...
The Path to the Cloud: A Look at Different Approaches to Cloud Migration

The Path to the Cloud: A Look at Different Approaches to Cloud Migration

Different Approaches to Cloud Migration The public cloud has gained considerable momentum this past decade. Concerns about cost and security ...
Opportunities and Pitfalls When Hiring a Chief Data Officer

Opportunities and Pitfalls When Hiring a Chief Data Officer

The Chief Data Officer As part of their digital roadmap, organizations are increasingly taking advantage of big data and making ...
Digital Innovation Starts with a Digital Core

Digital Innovation Starts with a Digital Core

Digital Innovation A lot of times when the prevalent industry trends are discussed among industry folks, there are usually two ...
The Economics, Concepts and Fundamentals of Cloud Computing

The Economics, Concepts and Fundamentals of Cloud Computing

Fundamentals of Cloud Computing Addressing security concerns of the Public Cloud Enthusiasm for cloud computing has as much to do ...
How Automation is Changing the Digital Revolution

How Automation is Changing the Digital Revolution

Automated Digital Revolution While the exact moment it began is up for debate (opinions vary wildly on the matter, from ...
Chris

How to Avoid Becoming Another Cloud Security Statistic

Cloud Security Statistic Last year, Gartner predicted that, by 2020, 95 percent of all cloud security failures will be caused ...
Part 1 - How Cloud Apps Are Making Businesses More (and Less) Secure

Part 1 – How Cloud Apps Are Making Businesses More (and Less) Secure

Cloud Apps Security Today, more than ever before, employees are working while on-the-go. The ease with which a worker can ...
A Closer Look at the Hidden Costs of Collaboration Solutions

A Closer Look at the Hidden Costs of Collaboration Solutions

The Hidden Costs of Collaboration Solutions Collaboration technology is key to efficient communication and productivity for a dispersed and global ...
Matthew Cleaver

Dispelling the Myths of Cloud Solutions for the Small Business

Dispelling the Myths of Cloud Solutions As a business leader, migrating to the cloud can be overwhelming due to the ...