John Pientka

Will XAI Fix WMD? Or, No More Black Boxes!

Will XAI Fix WMD?

Why did I get turned down for a loan? Why is my insurance so expensive? Algorithms are the answer: black box formulas that determine so many aspects of today’s life. Critics call them WMD’s – Weapons of Math Destruction. But maybe there is relief in sight from XAI.

Algorithm –  An Arabic word from 825CE that has come down to us through the centuries to mean a series of steps to process input in such a way as to produce a desired outcome. Coupled with Big Data (another gift from our increasingly digital world) they have come to surround and saturate our lives. They cover everything from recommending things to buy or watch, to will you get a job, keep the one you have or even go to jail.

Designed by humans, they are opaque and often unintentionally embody human biases and prejudices. Author Cathy O’Neil exposes their harmful effects in her book – “Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy”. (Here is also her TED Talk.) Besides numerous examples she points out that algorithms are also driving class distinctions in our society. The masses get measured and processed by computer; the rich elite gets personal review and attention. It’s pretty sobering reading but things are getting worse.

O’Neil describes our current world where the most of these algorithms are designed by humans (hence their flawed nature). If we could hold their feet to the fire and expose hidden assumptions we stand a chance of fixing some of the issues. But as organizations increasingly turn to Artificial Intelligence (AI) to analyze big data and predict outcomes, they cannot even explain how the AI reaches its conclusions.

These are truly black boxes. Advocates promote them as tireless assistants that will make our lives and work easier while boosting our performance and accuracy. But they raise troubling questions. Should a doctor accept a diagnosis made by an AI when the machine cannot explain how it arrived at that diagnosis?

AI’s are not programmed. They are given a whole bunch of big data as input, given a goal to achieve and then turned loose. No one describes the steps – a program – that they should go through to arrive at the goal instead they learn from the inputs. Feels a little spooky doesn’t it? But, that’s how Google’s Deep Mind AlphaZero learned how to play world-class chess in four hours.

AI’s appear to see patterns that we humans do not pick up. In one notorious case a researcher’s AI appeared to predict whether an individual was straight or gay just from their picture! It can’t explain how it does it but it appears to be uncannily accurate.

That’s where a new trend is emerging. It’s called XAI or Transparent Artificial Intelligence. Deep machine learning performs an amazing number of recursive steps as it seeks patterns in the data provided as input. The XAI concept is for the machine to explain how it arrived at the particular chain that led to its conclusion.

Image Courtesy DARPA

An organization called AI Now, comprised of researchers from Google Open Research, Microsoft Research, and New York University, recently issued a call for 10 changes the A.I. community needs to make in 2017. At the top of that list: “Core public agencies, such as those responsible for criminal justice, healthcare, welfare, and education should no longer use ‘black box’ A.I. and algorithmic systems.”

I would add quite a few more actors beyond public agencies like those who assess credit worthiness, job qualifications, etc. Which ones would you recommend be added?

It’s funny but kind of tragic. We have trusted the “secret sauce” of algorithms designed by humans to operate on big data sets but when it comes to trusting machines – look out. Sigh! – Maybe it’s a round about way to get there but hopefully the rise of the machines will help us spread sunshine on this whole algorithm mess.

By John Pientka

John Pientka

John is currently the principal of Pientka and Associates which specializes in IT and Cloud Computing.

Over the years John has been vice president at CGI Federal, where he lead their cloud computing division. He founded and served as CEO of GigEpath, which provided communication solutions to major corporations. He has also served as president of British Telecom’s outsourcing arm Syncordia, vice president and general manager of a division at Motorola.

John has earned his M.B.A. from Harvard University as well as a bachelor’s degree from the State University in Buffalo, New York.

View Website

CONTRIBUTORS

As Enterprises Execute Their Digital Strategies, New Multi-cloud Landscape Emerge

As Enterprises Execute Their Digital Strategies, New Multi-cloud Landscape Emerge

The Multi-cloud Landscape The digital universe is expanding rapidly, and cloud computing is building the foundation for almost infinite use ...
How To Humanize Your Data (And Why You Need To)

How To Humanize Your Data (And Why You Need To)

How To Humanize Your Data The modern enterprise is digital. It relies on accurate and timely data to support the ...
Ransomware's Great Lessons

Ransomware’s Great Lessons

Ransomware The vision is chilling. It's another busy day. An employee arrives and logs on to the network only to ...
Have you Heard? The Chinese Cloud Is Coming!

Have you Heard? The Chinese Cloud Is Coming!

Alibaba challenges Amazon “Alibaba challenges Amazon in the Cloud marketplace!” Analysts are almost breathless in their commentary. What’s the real ...
How to Build a Top Level Data Science Team

How to Build a Top Level Data Science Team

Data Science Team Businesses today need to do more than merely acknowledge big data. They need to embrace data and ...
How to Start Incorporating Machine Learning in Enterprises

How to Start Incorporating Machine Learning in Enterprises

Incorporating Machine Learning in Enterprises The world is long past the Industrial Revolution, and now we are experiencing an era ...
Future Tech

Gartner’s Top 10 Predictions For IT In 2018 And Beyond

Gartner’s Top 10 Predictions For IT In 2018 In 2020, AI will become a positive net job motivator, creating 2.3M ...
The IoT-Connected Car of Today - Cases From Hertz, Nokia, NTT, Mojio & Concur Technologies

The IoT-Connected Car of Today – Cases From Hertz, Nokia, NTT, Mojio & Concur Technologies

The IoT-Connected Car of Today Imagine a world where your car not only drives itself, but also says intelligent things ...
Cross-Site Scripting - Why Is It A Serious Security Threat For Big Data Applications?

Cross-Site Scripting – Why Is It A Serious Security Threat For Big Data Applications?

Security Threat And Big Data Applications IBM, Amazon, Google, Yahoo, Microsoft - and the list goes on. All these leading ...
Gear Up for the Smart Video Revolution

Gear Up for the Smart Video Revolution

Smart Video Revolution The technology revolution promises to deliver a lot of rewards for organizations that take it by the ...

NEWS

Cogeco Peer 1 Adds Managed Microsoft Azure Services to Cloud Portfolio

Cogeco Peer 1 Adds Managed Microsoft Azure Services to Cloud Portfolio

Cogeco Peer 1 Adds Managed Microsoft Azure Services Flexible services optimize customer's Azure investments, handle the day-to-day management of the ...
DigitalOcean Announces New Compute Plans to Provide Best Price-to-Performance for Production Applications

DigitalOcean Announces New Compute Plans to Provide Best Price-to-Performance for Production Applications

Changes Position DigitalOcean as Most Competitive, Simple Pricing Solution in Cloud Infrastructure Industry NEW YORK, Jan. 16, 2018 (GLOBE NEWSWIRE) ...
Google classroom

Google to expand cloud infrastructure with new regions, submarine cables

(Reuters) - Alphabet Inc’s Google said on Tuesday it would add five regions and build three new submarine cables as ...