When Algorithms Go Awry

When Algorithms Go Awry

Personalization is a very effective marketing tool–the most successful entrepreneurs use their data to great effect to segment their marketing efforts, with the best going as far as to segment down to the very individual (think Amazon suggestions). Where it’s used just for the thrill of it, personalization provides awesome experiences, like apps finding the right neighborhood for you to live in, recommending you some cool music, new human connections, and so on.

However, these services and apps have to be very careful as the thing they’re dealing with–human personality–is nothing short of a minefield. For example, it’s innocuous, even if wasteful, if a vegetarian gets shown an ad for a steakhouse (well, depending on whom you ask), but you’ll be facing a uniquely enraged client if networking algorithms suggest adding the lover of their ex-spouse to their friends list. Not to mention that the client might not want to be personalized at all.

When personalization fails, why does it?

Often, personalization misses the mark because life is more complex than the developers had anticipated. If the code is not at fault–it is if ads tell you, “Find the best deals near Your_City”–it can happen because of unused data (the vegetarian has this preference in her profile but the devs didn’t use it); or perhaps the data is overused, like in cases where people get ads for treatment clinics after looking for cancer symptoms online. But sometimes, the trouble lies not in the data, but in the delivery.

The latter was the awful case when Facebook’s Year in Review–an app that turns your Facebook highlights into a year-long, illustrated narrative–showed web consultant and writer Eric Meyer a picture of his daughter, who had passed away earlier in the year. Many people, like Eric, simply didn’t want to see, not to mention use the service, but the developers didn’t anticipate this fact. Facebook’s Year in Review didn’t work for everyone, and the devs got so much flak precisely because the service was offered to everyone–a little choice would have saved a lot of bad publicity.

To conclude, even though personalization is used to great effect in marketing and helps developers create great services, as websites and services become catered to the individual it turns into a struggle for developers to ensure that no one will suffer, inadvertently, from the way a service or a website handles things. Meyer already acknowledged in a later blog post that this kind of error is all but unavoidable and that good people make it. But perhaps, instead of seeing this as an inevitable tradeoff, as many do, it should be seen as a problem to be solved.

By Lauris Veips

Tosin Vaithilingam
Divestitures: What to consider during the migration process "Divestitures require careful planning and execution, but they can create tremendous opportunities for companies to transform their businesses and unlock new growth potential." - Ginni Rometty, former ...
Josh Miramant
Benefits of a Data-First Culture When it comes to analytics solutions, centralization versus decentralization is one constant tension that’s plagued data architects for years now. Both options offer their own sets of advantages and disadvantages, ...
Gary Bernstein
Simplify Your Website Management with VPS Hosting VPS stands for Virtual Private Server, which is a type of web hosting service that allows businesses or individuals to host their websites and applications on a virtual ...
Rob Reinauer
The last few years have brought significant changes, adoption and innovation to the cloud space. As 2023 begins, there’s an opportunity to consider what’s in store for the year ahead. From hybrid and remote work ...
David Discenza
Four Ways to Improve Cybersecurity (Updated: December 9th, 2022 ) Cyber-attacks on businesses have become common place. In fact, it’s estimated that a cyber-attack occurs every 39 seconds. Who are the targets of these attacks? ...
Frank Suglia
Migrating Microsoft Office 2013 As of April 11, 2023, Microsoft will stop supporting Office 2013. The decision to end support for Office 2013 should come as no surprise. Over the past several years, Microsoft has ...
Steve Prentice
The Era of Microlearning Becoming employable and then staying employable requires ongoing, up to date knowledge, and this can become something of a dilemma. Many of us grew up with a traditional understanding of the ...
John Peluso
Save Your Organization on Cloud Costs Organizations of all sizes are currently navigating their plans to avoid the recent surge in cyber-attacks and data breaches and preparing for unforeseen setbacks. Building a sensible backup and ...