Header Ads

Alexa caught with her hands in the cookie jar

Fully Charged
Bloomberg

Hi everyone, it's Sarah Frier. Our most recent Bloomberg Businessweek cover story is about the artificially intelligent assistant devices that collect and parse clips of our voices—with some extra help from humans transcribing the audio. Big tech companies thought the practice would be a completely normal and expected evolution of all their other work in AI. But the contractors listening to the audio were uncomfortable with the intimacy of what they were hearing. They realized that consumers didn't know they were being recorded.

The responses to this story, and others Bloomberg has written this year, fall into similar categories. People who understand AI programming say that of course humans are behind the scenes—doesn't everybody know that? Consumers say no, everybody does not know this, and it's a problem.

So why is there such a disconnect? If you ask Facebook, it's because people think machines are smarter than they actually are. "Ten years ago it would be shocking to think a human wasn't reviewing it," Andrew Bosworth, the head of hardware at Facebook, tells me. "Now the expectation is that machines are more likely to be reviewing content than people. That's a real shift in consumer expectation." And he says Facebook—just like Amazon, Google, and Apple—was caught off guard by the outrage.

If consumers are over-estimating their machines, the companies' marketing is largely to blame. The phrases "artificial intelligence" and "machine learning" certainly imply human-free solutions, which the media hyped. When you buying these devices, you're told Alexa or Siri is responding, not that it's being fact-checked by thousands of real people who can hear your actual voice. Facebook told consumers that the more they used the machine-transcription service in its Facebook Messenger app, the smarter the machine would get. It didn't say that it was getting smarter because people in a contractor hub in Texas would have more voice samples to check for accuracy.

Bosworth, like others representing companies in our story, said language understanding is one of the hardest problems in technology. Without all these real examples of people talking, only certain kinds of people—the ones with the most common accents or speaking cadence—would be served well in a future voice-activated world. "You want these to be inclusive tools that work for everybody," Bosworth explained. Computers are looking at sounds, not words. "Subtle differences in tone, in frequency, in modulation, to humans are very similar but to computers are completely different."

That sounds like a laudable mission people might have volunteered for, if companies asked nicely and explained clearly what happens behind the scenes. So why didn't companies start to tell consumers what was happening until after transcribers told their stories to Bloomberg News?

Because the companies knew what they were doing was controversial, says Justin Brookman, director of privacy and technology policy at Consumer Reports. "They kind of got caught with their hands in the cookie jar."Sarah Frier

And here's what you need to know in global technology news:

Facebook, Google Drop Lower on Best Places to Work List 

arrow
Big tech companies like Facebook Inc. and Alphabet Inc.'s Google, long seen as some of the world's most desirable workplaces offering countless perks and employee benefits, are losing some of their shine.

Startup Robinhood Rolls Out Cash Management Service, a Year After Botched Launch

arrow

Robinhood Markets Inc. has finally launched its take on a bank account, albeit a very different version of the service it once hoped to offer. 

YouTube Outlaws Insults Based on Race and Sex, With Caveats

arrow
Google's YouTube video service expanded its definition of banned speech after months of criticism, saying it will now remove clips and comments that make "veiled or implied threats" against individuals or insult people based on attributes such as race and sexual orientation.
Flaws in Smartwatches on Amazon May Let Strangers Track Kidsarrow
Security researchers discovered vulnerabilities in cheap smartwatches for children that make it possible for strangers to override parental controls and track kids.
 

Like Bloomberg's Fully Charged? Subscribe for unlimited access to trusted, data-based journalism in 120 countries around the world and gain expert analysis from exclusive daily newsletters, The Bloomberg Open and The Bloomberg Close.

Before it's here, it's on the Bloomberg Terminal. Find out more about how the Terminal delivers information and analysis that financial professionals can't find anywhere else. Learn more.

 

No comments