Big Data And Global Trend Monitoring: The Language Gap

Big Data and Global Trend Monitoring: The Language Gap

Data traces left by humans both on the internet and elsewhere allow marketers to find trending products; organizations can detect potential health hazards and epidemies; researchers can gain valuable insights on the way ideas spread; and so on. However, all of this depends on that they have access to a more or less complete dataset for the places or topics they are interested in.

Problems with acquiring fuller datasets

For one industry ‘trend’ is the operative word. Fashion, of course. Giants like Editd and WGSN are scaling the heights in fashion data analytics, empowering retailers to better control their prices (a practice that may very well translate to ‘less discounts’) and control their inventory. On top of having billions of data points on inventory, its past performance and prices from countless web stores, their Social Monitor feature delivers real-time updates aggregated from more than 800,000 fashion experts and influencers.

The inventory data points give real power to fashion experts across the globe. As for the Social Monitor, though, one might ask: how many languages does it speak? That is, it might be prudent to guess that their social trend insights are bound steadfastly to the English-tweeting world. If this doesn’t alarm you (it probably shouldn’t), implications of a graver nature following:

In an intriguing article on Foreign Policy, Kalev Leetaru states how HealthMap, the global, news-powered powered disease mapping project, actually missed the Ebola outbreak by a day after the World Health Organization was notified. The problem? “Ils ne parlent pas le français.” They [Big Data] don’t speak French. In many countries one or two local newspapers are published on the internet in English, and only minuscule parts of the rest are translated. Most never are.

HealthMap 

This is a serious hindrance for global Big Data initiatives of any kind. You can yield useful translations with Google Translate, but you can also get rubbish. A workaround could perhaps be found (at least in the Ebola outbreak case) in developing computer-readable standards for publishing important news concerning health hazards; but who’s to say that anyone would be willing to comply? Another workaround lies in crowdsourced translation, like in the Duolingo app where collective understanding provides accurate translations.

A simple solution doesn’t exist, but, as more and more nations join global data initiatives and develop their own, the language gap will be closer to being bridged. Some might object that the real beauty lies in that it never will.

By Lauris Veips

Virtana

Episode 8: Managing Cloud Strategy During the Chaos of 2020, Plus an Outlook for 2021

An Interview with Kash Shaikh, CEO of Virtana Companies are wrestling with the idea of moving to the cloud, staying on-prem or finding a hybrid solution. Kash Shaikh, the new CEO of Virtana, looks at ...
Mark Barrenechea

Security is Job 1: Machines vs. Machines

Digital is redefining cybercrime and cyberwarfare Cyberattacks today are multi-stage, hard to discover and highly targeted. Some security threats are accidental, stemming from unauthorized employee access. As much as 38% of attacks come from internal ...
Sangeeta Chhabra

What Accountants Should Know About The Cloud

Cloud Accounting Cloud technology has been at the top of the charts of new-age technologies for a long time now. Almost every industry in the world has started realizing its capabilities and integrating cloud strategies ...
Leonid Feinberg

9 Mistakes to Avoid When Choosing a Cloud

Mistakes to Avoid When Choosing a Cloud According to Gartner, the worldwide public cloud services market is forecast to grow 17% in 2020 to total $266.4 billion, up from $227.8 billion in 2019. While the ...
Isc2

Episode 2: Coronavirus Phishing Emails and Work-from-Home Meetings

Coronavirus Phishing Emails What to watch out for as scammers exploit pandemic panic, and tips on how to attend meetings while working from home. Working from home this week? There are a few challenges and ...
Human Resources

Web Optimization Could Transform Your Organization – A Cost Containment Strategy

A Cost Containment Strategy With more and more resources available in the cloud, it’s easy to lose track of your costs and handicap the whole project with an unexpected bill that shuts the whole thing ...