Did a human telemarketer fail the Turing test?

In the Turing test, a computer is supposed to convince a human interlocutor that it's human. In a recent odd phone interaction between Time Washington bureau chief Michael Scherer and Samantha West, a telemarketer, Samantha—who very likely is human—convinced Scherer and colleagues that she is a robot.

Here's how Zeke Miller and Denver Nicks put it in Time: “When Scherer asked point blank if she was a real person, or a computer-operated robot voice, she replied enthusiastically that she was real, with a charming laugh. But then she failed several other tests. When asked 'What vegetable is found in tomato soup?' she said she did not understand the question. When asked multiple times what day of the week it was yesterday, she complained repeatedly of a bad connection.”

Samantha was taking calls as well as making them, so the Time reporters called her back several times over the course of an hour and concluded she was definitely a robot because of the “pitch perfect” repetition of her comments. “Her goal,” the reporters note, “was to ask a series of questions about health coverage…and then transfer the potential customer to a real person who could close the sale.” (They've posted a couple audio clips of their talks with Samantha here.)

It seems like a simple case of a deceptive robot claiming to be a real person to help sell health insurance. Alexis C. Madrigal of the Atlantic, on listening to the Time clips, was so impressed with Samantha's sales prowess that he wondered, “Where could I buy such an interactive voicebot?” He doesn’t say why he wants one—perhaps to sell subscriptions to the Atlantic. In any event, he learned such a voicebot would be called an outbound interactive-voice-response (outbound IVR) system.

Then the trail went cold. With current technology, Madrigal found, outbound IVR supports limited interactivity—it can be used to confirm or reschedule a doctor's appointment, for example, but as Madrigal explains, it lacks the sophistication to pose as a general-purpose telephone sales person. “The queries that the editors launch at Samantha are pretty complex,” he writes, “and yet she comes back with an appropriate (if limited) response.”

Madrigal continues, “When I contacted outbound marketing companies and showed them the [Time] story with the clips, they all said they don't or can't do this sort of interactive voice response”—particularly given the limited bandwidth of the PSTN and the fact that latency problems during voice processing would impede the normal flow of conversation. Voice-recognition heavyweight Nuance denied involvement.

So what's going on? Madrigal's research led him to this theory: Americans tolerate a person with a non-American accent when they place a call for customer service or support, but they do not like receiving outbound telemarketing calls from people with foreign accents. Consequently, he suggests, Samantha is a real person who understands English but cannot speak it in an accent that would be acceptable to potential American customers. Therefore, she, or he, responds to a prospective customer by using a soundboard to play back one of a limited number of prerecorded phrases and sentences—accounting for the “pitch perfect” repetition the Time editors heard on their calls.

We may never learn for sure. Samantha is no longer answering the phone, and the website for the company she ostensibly worked for has been taken offline. That's odd, because a representative of the company insisted to the Time editors that as a condition of his talking to them they publish the phone number and website—he wanted the publicity.

If you're out there, Samantha, I'd love to chat. Call me maybe, but I am not in the market for health insurance.

More in Computers/cloud computing