The highlight of Google I/O keynote earlier this month was the reveal of Duplex, a system that can make calls to set up a salon appointment or a restaurant reservation for you by calling those places, chatting with a human and getting the job done.
That demo drew lots of laughs at the keynote, but after the dust settled, plenty of ethical questions popped up because of how Duplex tries to fake being human.
Over the course of the last few days, those were joined by questions from people like writer John Gruber about whether the demo was staged or edited.Axios then asked Google a few simple questions about the demo that Google has refused to answer.We have reached out to Google with a number of very specific questions about this and have not heard back.
As far as I can tell, the same is true for other outlets that have contacted the company.If you haven&t seen the demo, take a look at thisbefore you read on.So did Google fudge this demo Here is why people are asking and what we know so far:During his keynote, Google CEO Sundar Pichai noted multiple times that we were listening to real calls and real conversations (&What you will hear is the Google Assistant actually calling a real salon.&).
The company made the same claims in a blog post(&While sounding natural, these and other examples are conversations between a fully automatic computer system and real businesses.&).Google has so far declined to disclose the name of the businesses it worked with and whether it had permission to record those calls.
California is a two-consent state, so our understanding is that permission to record these calls would have been necessary (unless those calls were made to businesses in a state with different laws).
So on top of the ethics questions, there are also a few legal questions here.We have some clues, though.
In the blog post, Google Duplex lead Yaniv Leviathan and engineering manager Matan Kalman posted a picture of themselves eating a meal &booked through a call from Duplex.& Thanks to the wonder of crowdsourcing and a number of intrepid sleuths, we know that this restaurant was Hongs Gourmet in Saratoga, California.
We called Hongs Gourmet last night, but the person who answered the phone referred us to her manager, who she told us had left for the day.
(We&ll give it another try today.)Sadly, the rest of Google audio samples don&t contain any other clues as to which restaurants were called.What prompted much of the suspicion here is that nobody who answers the calls from the Assistant in Google samples identifies their name or the name of the business.
My best guess is that Google cut those parts from the conversations, but it hard to tell.
Some of the audio samples do however sound as if the beginning was edited out.Google clearly didn&t expect this project to be controversial.
The keynote demo was clearly meant to dazzle — and it did so in the moment because, if it really works, this technology represents the culmination of years of work on machine learning.
But the company clearly didn&t think through the consequences.My best guess is that Google didn&t fake these calls.
But it surely only presented the best examples of its tests.
That what you do in a big keynote demo, after all, even though in hindsight, showing the system fail or trying to place a live call would have been even better (remember Steve Job Starbucks call).For now, we&ll see if we can get more answers, but so far all of our calls and emails have gone unanswered.
Google could easily do away with all of those questions around Duplex by simply answering them, but so far, that not happening.Duplex shows Google failing at ethical and creative AI design