Is Your IM Buddy Really a Computer? 288
audiovideodisco writes "Every year the Loebner Prize goes to the chatbot (and the corresponding human companion) that fares best on a Turing test administered by a panel of judges. Discover talked to Kevin Warwick, the professor who runs the competition, to get pointers on how one would go about detecting a bot. While there are some general approaches you can use, nothing is foolproof — and asking about Sarah Palin can be downright deceptive. One judge concluded an interlocutor was a bot because it didn't recognize Palin's name ... but it turned out the chatter was a French librarian who'd simply never heard of her." The chat transcripts show how difficult picking bot from non-bot is getting.
I have a way of dealing with this, (Score:5, Interesting)
On the occasion I get messaged by a random stranger that seems half way legit I just give them a Turing Test made up on the spot. It's usually something lame like "Joe and Pete were on a bus, Pete has four nickles Joe has six pennies between the two of them what type of vehicle were they on?". I usually apologize for that in advanced. The machines fail every time, but the best one I saw called me weird for saying it, asked what I meant, then about two minutes later gave me the right answer telling me a person was checking logs. (I was spending the time in between screwing with the bot)
even bots apparently can't spell (Score:5, Interesting)
Want to see some really clever bots in action? (Score:5, Interesting)
Want to see one in action?
AIM: livewirex31
Yahoo IM: greenlovex3
MSN: livewirex23@live.com
This isn't one of the better ones I have found, but I can see how it can fool most desperate individuals.
Re:Philosophical (Score:3, Interesting)
Good point! Most of my friends and I are all in the same arena when it comes to conversations. We'll talk about the latest distros, why Apple sucks or why Apple is great, why Linux sucks or why Linux is great, why Microsoft sucks, and what we thought of the end of Battlestar Galactica, and universal agreement that none of us would have a shot at Tricia Helfer.
But if someone asked any one of us about the NCAA tournament, we would be lost. I don't think any of us have seen a football game in years, apart from those on the TVs in bars making noise when we're trying to eat. But ask about C++ or Java or software engineering or hacking or networks and our answers would look like a robot quoting pages from textbooks. We might even answer the questions with fragments of code just to be funny. if (geekFunny() != regularHumanFunny()) { profit++; }
So if they can get an AI to make small talk (and not smalltalk) I'd probably want one just to handle all those awkward social situations where I'm the only one in the room not to know who's in the Super Bowl this year.
Re:I have a way of dealing with this, (Score:3, Interesting)
Re:I have a way of dealing with this, (Score:2, Interesting)
Can't you do it more subtly, as in steering the conversation to a relatively complicated topic, and requiring the conversation partner to actually reflect on your statements?
Re:even bots apparently can't spell (Score:5, Interesting)
Re:I have a way of dealing with this, (Score:5, Interesting)
I use an Adium Xtra which posts just this kind of test to anyone not on my contact list.
Fun fact: a Slashdotter from Finland was the first to pass the test.
Foolproof (Score:5, Interesting)
I've yet to find a single bot that has ever understood this demand:
Can you type this backwards, read it, and tell me the result, please? 'net sulp neetfif'
Assuming you have backup - Voight-Kampff Test (Score:3, Interesting)
Re:Philosophical (Score:5, Interesting)
It's somewhat philosophical, but I've often wondered why people really care about whether an interlocutor is a machine or not.
This is exactly the right question to ask. The answer varies a little, but the consistent purpose of AI improvement is that it represents an improvement in programming techniques which in turn make computers more useful. There are a wide variety of obvious uses, such as improving expert services like WebMD, improving technical support (the thingy is all black and the lights are flashing on and off on the little box,) and billing software.
Consider just a few other services that could benefit from AI:
Truly advanced AI offers the potential of giving everyone access to the support of a team of experts in any area they want to explore. Wikipedia combined with Google is already enough to answer 90% of the questions I have in minutes from anywhere I have access to a computer when only a few years ago it would have taken hours of research in a library. In the future I may be able to get even better answers and advice that I didn't even know to ask for due to programs that react and process information in ways that only humans can provide now.
Re:Not necessarily (Score:3, Interesting)
My experience has been that the perceived gender of the bot plays a great bit into the believable nature of the bot due to response expectations.
This, at least, only holds true with a male chatter and a 'female' bot - and I'm not talking about virtual sex chat or anything like that. A person can, for a substantial period of time, be tricked by a 'flirty' bot that comes across as a cute, dumb female. It's kind of funny to see a (sub-average intelligence, I'd guess) person hold a running dialog/virtual relationship for several months with a bot.
It's also much easier to trick someone when they don't know they're being tricked, and where there is no preconception of prior familiarity (IE, such as on an IRC 'chat' channel). It'd be a good tactic to employ by the FBI, I think.
Re:ways to combat it (Score:3, Interesting)
If speak in manner of Yoda you do, keep up with it a bot can not.
Re:Want to see some really clever bots in action? (Score:3, Interesting)
(10:37:00 AM) me: hi
(10:37:00 AM) livewirex31 is now known as Livewirex31.
(10:37:09 AM) Livewirex31: hey there. are you from cl ?
(10:37:22 AM) me: no, i never liked cl
(10:37:35 AM) Livewirex31: oh alright sorry if i type a little slow my pc is being weird. 23/f here what are you up to?
(10:37:52 AM) me: eating a baby
(10:38:00 AM) Livewirex31: cool. im a little bored and i was just hangin out.. sorry i didnt send a pic by the way.
FAIL
Re:Not necessarily (Score:2, Interesting)
The reverse can work too. Ages ago I built a bot that would answer chat attempts with randomly selected "fortune" quotes, stripped of their bylines and biased by the presence of nouns that matched those found in the other party's message. I left it running as my "away" message on the mainframe at a large university (where people would chat randomly to you all the time)
I didn't bother saving "my" side of the conversation , so I'm sure I missed some hilarious exchanges, but just reading the other side's messages shows that girls, in particular, would keep chatting with my bot far beyond the point where guys would realize it was a bot and give up.
My favorite was a girl who kept a running dialog going for nearly a day and a half. She would occasionally express surprise at how fast I could type (no delay in bot response) but otherwise seemed convinced that the bot was really human.
That conversation only ended when the bot apparently chose to say something incredibly offensive to her (I wish I knew what it was). She told the bot to "stop talking to me" several times, apparently never picking up on the fact that it auto-responded every time she tried to get the last word in.