IBM Strives For 'Superhuman' Speech Tech 289
robyn217 writes "IBM unveiled new speech recognition technology today that can comprehend the nuances of spoken English, translate it on the fly, and even create on-the-fly subtitles for foreign-language television programs. One of the projects perpetually monitors Arabic television stations, dynamically transcribing and translating any words spoken into English subtitles. Videos can then be viewed via a web browser, with all transcriptions indexed and searchable."
Which ... (Score:4, Interesting)
Re:Which ... (Score:3, Funny)
Re:Which ... (Score:2)
Re:Which ... (Score:2)
For simple example, blue in "the blue candle" cannot be a verb.
Re:Which ... (Score:5, Interesting)
Sometimes you need rather a large context to disambiguate: is this sentence part of a discussion on shore-front management, or spoken language understanding?
Re:Which ... (Score:2)
So do we. I can recognise the differences and meaning of "Which witch blew the blue candle" written - but if someone said it to me out of the blue (npi), I'd have to think through it a couple of times to parse it, because if said as intended - with matching sounds, to rely entirely on context inside the sentence to decipher which word is which, then I'd have as much problem as a computer. The semantic rules I was taught as a child are what enables
Re:Which ... (Score:3, Insightful)
Fantastic direction (Score:2)
We should encourage IBM to allow enough of the technology to 'escape' in order to enable other languages to be translated from speech into English. There should be some kind of open review of the translation involved, also. This can help prevent subtle errors in tr
Coherency? (Score:5, Insightful)
Still even at 80 percent how good is this translation. If that 20% is the important parts of speech You could still be left clueless. Even the best Machine translations of text I have seen always leaves the text a bit garbled and confusticated.
I don't know how much delay is implied in the phrase "on the fly" , but I personally don' think there could ever be real time translation for the following reason. Sentences in different languages have different sentence structures. While in English the verb is usually the second part, in other languages the verb comes many times last (German). For the translator to get the second word of a sentence, it would have to wait till the end, of what could be a long sentence. This necessarily adds delay.
Re:Coherency? (Score:4, Interesting)
since even "live" boradcasts are usually delayed several minutes for technical and legal reasons anyway, if this technology can get to the state where you're just one or two sentences behind real-life it will be effectively real-time anyway for almost all practical purposes.
Re:Coherency? (Score:2)
For the 80% part, it's good enough to get the gist of what is said. It won't compete with professional human translators, but it will make translation easily available for those who don't have access to a translator.
Re:Coherency? (Score:3, Funny)
Re:Coherency? (Score:2, Informative)
Not necessarily. An on-the-fly translator could translate words as it hears them filling in the translated words in the correct location in the sentence. In other words, the sentence doesn't have to be completed in order. It can dynamically expand to fit in new words.
If you listen to human translators doing on-the-fly translation you'll see this is h
Re:Coherency? (Score:3, Interesting)
You are going to have that problem whether it's a machine doing the translating or a human. As I understand it, interpreters of German get around this by some quick-thinking restructuring of the translated sentence, or they simply lag a half-sentence or so behind.
The real problem for machine translation is, and always has been, determining the sense of a word from context (indeed I recall a recent S
And German is an easy one (Score:5, Informative)
No, German also changes word order (Score:2)
For a human, the issue is that you can't interpret based on the phrase, so a human interpreter has quite a lot to do. The interesting thing is that experienced interpreters do this unconsciously.
I have been an admirin
I agree, it does (Score:2)
Generally, it is estimated that it takes an English speaker about twice as long to learn a languages from the Asian or Arabian groups as it does a European
Re:No, German also changes word order (Score:2)
Re:And German is an easy one (Score:2)
Anyway, in japanese, you forgot the fact that the verb is not even always present in the sentence (just guessed depending on the context), and that sometimes, with the exact same sentence, subject and object are switched depending on the context too.
This require some training to understand, I still did not mastered it well, and seeing lots of fansubs shows me that I'm not the only one that has not mastered this (and I'm not the worse).
I guess a machine would have a really
Re:Sorry to disagree. (Score:2)
Re:Coherency? (Score:2)
Still, the only thing faster or just as fast is a human translator for real time translation. Even then it is more or less based on the skill of the person doing the translating.
first? (Score:5, Funny)
Re:first? (Score:2)
Nuances (Score:4, Funny)
Subtitle: "All your base are belongs to us"
Re:Nuances (Score:2)
Sounds like a perfect translation success to me.
NSA Babelfish (Score:2, Funny)
(I'm sure that this eBabelfish is already installed - not in my ear - but on the telecommunication centers...)
Re:NSA Babelfish (Score:2)
BTW nice 'buty'
Foreign languages are complex... (Score:5, Insightful)
It's not until you learn another foreign language that you realise how complex languages are, and how subtle. Learning another language can literally change the way you think about things.
This type of technology will make people think they completely understand a foreign language, but they won't. Their understanding will be crude, without the subtleties and cultural understanding.
I can speak English and Spanish fluently, and if I watch an English film with Spanish subtitles I'm always thinking - damn, they missed a good joke there, they got that wrong, etc. (Equally so with a Spanish film with English subtitles). And film subtitles are done by professional translators. God only knows what a terrible job a computer would make of film translation.
Re:Foreign languages are complex... (Score:3, Insightful)
And how wierd sometimes. English for example loves to use the word "up" in all
sorts of unsuitable places:
give up
shut up
fed up
wash up
fuck up
laid up
muck up
turn up
free up
look up
make up
put up
screw up
hang up
wrap up
hold up
grow up
Wtf?
And home come we say "didn't he.." but in longhand its "did he not...". Shouldn't
it be "did not he"? Why does the "not" shift to the other side of the pronoun?
But then all la
Re:Foreign languages are complex... (Score:5, Funny)
Re:Foreign languages are complex... (Score:2)
Well, in this particular case dosen't "up" means what the word supose to mean?
Re:Foreign languages are complex... (Score:5, Funny)
Rocco: Fucking... What the fuck. Who the fuck fucked this fucking... How did you two fucking fucks...
[shouts]
Rocco: fuck!
Connor: Well, that certainly illustrates the diversity of the word.
Think that just about covers it...
Re:Foreign languages are complex... (Score:2)
But when did you last see anyone write either of these forms?
Re:Foreign languages are complex... (Score:3, Interesting)
One of the characters is shouting up to someone in their bedroom window. They don't respond to the shouting and the character says "H
Re:Foreign languages are complex... (Score:2)
Re:Foreign languages are complex... (Score:2)
Re:Foreign languages are complex... (Score:2)
Re:Foreign languages are complex... (Score:2)
An exemple of English / French I saw in a movie :
- Yeah but...
- What about my butt ?!
I don't remember at all how they translated that
Re:Foreign languages are complex... (Score:2)
I think it is more to do with the fact that they have to write the subtitles so that they can be read at the speed of the speech. And so they cannot go into subtleties. In fact often when there is fast dialogue they will miss whole phrases out.
Japanese and English are quite different (Score:3, Insightful)
Re:Foreign languages are complex... (Score:2, Insightful)
I'm not quite sure what you mean here not bother because of this technology?
I can't see anyone not wanting to bother learning a language because of this technology. Not unless it was a babelfish/universal translator type technology - i.e. basically invisible. In which case, what's the issue?
What are you going to do:
a) Walk around with a little device which translates with 60-80% accura
Re:Foreign languages are complex... (Score:2)
Perhaps you a not like most people... I often hear English only speaking people say there is no point in learning another language because everyone learns English these days. This just gives them another excuse.
Re:Foreign languages are complex... (Score:3, Insightful)
Can you see no good in a rough translation for some purposes?
Calculators have largely eliminated the need (an in some cases the ability) for people to do basic math. Therefore we should eliminate calculators before these people start believing that they comple
Re:Foreign languages are complex... (Score:2)
Of course.
But from the description I think this is being developed for military or intelligence work. In those fields, mistranslations can cause death. And unfortunately I think the current administration is unsophisticated enough to think that machine translation is better than (more expensive) human translation.
Re:Foreign languages are complex... (Score:3, Interesting)
I almost added "I just hope GWB doesn't decide to fire all his intell linguists based on this post" but it seemed kind of like bashing the Prez and i would never do that...
Cheers
Re:Foreign languages are complex... (Score:2)
Re:Foreign languages are complex... (Score:2)
Language is about more than just words, it's about phrases too. A speakers choice of words and phrases gives
Re:Foreign languages are complex... (Score:2)
Re:Foreign languages are complex... (Score:2)
OT, but that reminds me - I saw a docudrama (in English) a while back where you could tell the documentary bit from the drama bit because the actors spoke in a foreign language and were subtitled, while the actual interviewees who spoke in a foreign language had a spoke
Re:Foreign languages are complex... (Score:2)
On the other hand, there are cases where I just want to read something quiclkly, and putting the page
Ghee... (Score:4, Insightful)
Re:Ghee... (Score:2)
Funny you should mention that. I recall a US government department set up just after 9/11 which one of the things it would be working on was a handheld device that could translate from English to Arabic on the fly.
Only reason I recall this is because the logo of said department was the all seeing eye shining some kind of beam over the rest of the world. Prehaps someone with a better TFH then me has a link.
Re:Ghee... (Score:2)
If they REALLY want to test it properly... (Score:5, Funny)
have closed.
"Ye loooiii ahhh me jimmeh??! *belch* C'mere ya wee electrahnich bastid, I'll
shoo ye!"
It isn't worth it (Score:5, Funny)
On-The-Fly (Score:5, Informative)
I have read a lot of auto-translated documents and it is always a good laughter in terms of "crapslation cabaret". So far, there is no technology that could auto-translate a text document succesfully. The "80% success" is a myth - they just count how many words were found in the vocabulary, not how many of them were put into a good context. A "fly" translated as an insect would be accounted as a success!
Even if you are not a bot but a human being with some knowledge of the other language and culture, it's very easy to involuntary offend someone or just to make a ridiculous faux-pas. Polish and Czech languages, for example, are very much alike and use common roots for many words, but because of the way both languages evolved, some neutral terms on one side of the border have become offensive on the other side. Czechs evolved an euphemism for sexual intercourse based on the verb "to look for". Poles still use this word when they look for something, which leads to constant crapslation cabaret gags when a Polish tourist appears in a Czech town "looking for a parking lot". Now, auto-translate this...
Re:On-The-Fly (Score:2)
Still, for example the slang word use in Portugal for "traffic jam" (bicha) is the slang word in Brasil for "gay".
Talking about the congestion on the streets of Lisbon takes a whole new meaning in Brasil.
Re:On-The-Fly (Score:2)
English Translator3 www.techland.pl
Earlier versions didn't know the difference between a shower of rain and taking a shower for instance. although you still need to take care with Polish and polish the capital P makes a difference.
it does provide alternative translations so you can do a basic translation and apply a more appropriate translation.
It's getting old now so perhaps there has been an update.
Re:On-The-Fly (Score:2)
Re:On-The-Fly (Score:3, Insightful)
The problem is that why French/FR people will understand the expression, others like French/CA won't. And even if they did spec
IBM and Google cooperation to come? (Score:3, Interesting)
This won't make speech recognition mainstream (Score:4, Interesting)
Ben Shneiderman is the person who, in my opinion, articulates the best the limits of speech recognition [umd.edu].
One of my favorite phrases to explain this issue is: "You don't want to speak to a computer, because you can't speak and think at the same time". More precisely, speech utterance makes use of some modules in our brain which are required for planification too. Hence, you can't plan as well what to do next when you speak, which is a big hurdle in the type of intellectual activities one carries with a computer.
Re:This won't make speech recognition mainstream (Score:2)
Hmmm, this computer's going to have a hard time understanding you.
Justin.
Re:This won't make speech recognition mainstream (Score:2)
Re:This won't make speech recognition mainstream (Score:2)
J.
Awful default TTS (Score:4, Insightful)
What really bothers me is the state of Windows text-to-speech. The TTS that ships with the most popular operating system on Earth is easily trumped in understandability by a small third-party program I downloaded literally TWELVE YEARS AGO. I really wonder if M$ made some pact to give out crappy TTS so as not to stifle sales of some business partner's application.
This seems pretty ridiculous, but I'm at a loss as to why their text-to-speech programs are of 12-year-old quality.
I'm glad people are doing good speech research, (I know I've seen a demo of good IBM TTS somewhere) but I hope it finds its way into Windows someday.
Re:Awful default TTS (Score:2, Informative)
That said, in Microsoft Windows Vista (ETA 2019), the default TTS engine will be replaced by a new one sporting Anna [wikipedia.org]. Have heard her in the preview and I have to say, it's one hell of an improvement.
Re:Awful default TTS (Score:2)
money on making it any better. So long as it sort-of works then the marketing
droids have something apparently bleeding edge to waffle on about in the sales
pitch knowing full well very few people will use it and discover how crap it
is, and the ones who do are such a small percentage anyway that they won't care.
Re:Awful default TTS (Score:2)
What about SubHuman Speech? (Score:2)
American or English? (Score:3, Interesting)
I realize that Anericans and British (English at least ;o)) speak essentially the same language but I have yet to find any speech recognition software that can get more than roughly 85% of what I say correct. I have a fairly soft neutral english accent with pretty good enunciation so I would have expectd to be getting a recognition rate in the high 90%s. I'm wondering if, as most of this software is developed in the US, it is tuned specifically to pick up on english with a US accent? I realize that you train the software for your voice but AIUI all you are doing is tuning a basic speech model. Has anyone else had this problem or is it just me?
Re:American or English? (Score:3, Funny)
I cannot understand a word you're saying. What's with that accent?
Re:American or English? (Score:2)
I have virtually no accent at all, except for very mild British overtones, yet speech recogniti
Re:American or English? (Score:2)
That claim makes no sense whatsoever. You have a regional accent, it just happens to come close to the one you hear around you most commonly. I'm guessing it's a midwest accent, aka "General American", aka the US TV network announcer accent.
Re:Tip (Score:2)
I gave up on speech recognition as everything but a toy a while ago but your tip could lead to some interesting mistakes. Take for instance the sentence fragment "Runing to the door". If it is pronounced as you suggest it could easliy be misunderstood by the machine to be "run in to the door" which could have nasty consequences.
Oh oh oh. (Score:3, Funny)
So I'm sitting here thinking of how funny it was to the juvenile me back then, and how unfunny it seems right now. Oh well.
Not _that_ amazing (Score:2, Interesting)
The translation, on the other
Buyer beware (Score:5, Insightful)
Speech recognition is riddled with problems. From a computing side it's enormously processor intensive and memory hungry. From a computer side it's very com,plex code and the 'learning' process is fraught with problems - surnames, company names and locations are all very poorly recognised.
So don't rush to buy. Let the labs check it out first.
I'll just be happy if (Score:2)
Nintendogs: I've stopped trying to train my dog, its never going to happen.
Apple Speech: Only works if I use a terrible californian accent. Not worth the embarresment.
Nokia: Even with just one voice command, my girlfriends
Re:I'll just be happy if (Score:2)
funny this subject should come up... (Score:2, Interesting)
the training process definitely has its ups and downs. The more you work with it however, the more it becomes attenuated to your own speech patterns and moreover, the quirky words we use every day. I
Real-time eavesdropping (Score:2, Interesting)
Monitor all conversation.
Apply real-time text filters.
Assign live agents to priority eavesdropping.
Profit!
If you could apply a filter to listen in to any call what would it be?
Finally! (Score:2)
Translating Arab TV (Score:3, Informative)
I was in Kuwait and watched arab TV with english subtitles, it was enlightening to say the least. One long tribute to racism paid for by the Amir of Quatar. Only on arab TV will you see such trash as "the jews are descended from pigs".
Big deal, I can do that on my Apple ][ (Score:2)
10 PRINT "DEATH TO AMERICA";
20 GOTO 10
RUN
Speech Synthesis. (Score:2)
Excellent Product, Confused Reviewers (Score:2, Informative)
Dictation, however, is a completely different problem. There are far fewer constraints on what can be said, and the system makes errors as it picks through the possible choices. As a result, most dictation software requires training: the system will use your voic
Let's see it translate poems (Score:3, Interesting)
Re:Let's see it translate poems (Score:4, Interesting)
Anime fansubs! (Score:2)
What a boon this will be to those anime fansub groups who can't find decent translators, or at least translators who aren't overworked.
Thanks for the laugh! (Score:2)
I've been hearing this every 6 months for about the last, oh, thiry years.
Given that the state of the art in something much simpler, like automatic language translation, is pitifully inadequate, how likely is it IBM has conquered speech recognition AND translation?
Har har har.
S-to-T in hospitals (Score:2, Interesting)
this of
Live experiment with Dragon 8 (Score:4, Funny)
I can wreck a nice beach. I can recognize speech.
Well, Dragon Systems eight passed the beach test first try. Knowing the program, however, I did use pretty clear diction.
I use Dragon Systems and find it absolutely great. There are a few persistent errors. For example, It frequently fails to get "there" and " there" right on the first try. But the fly down menu system enables me to quickly correct the problem on the run. Certainly I pick it up on an edit. If IBM has something better than this -- and it sounds like they do -- then it must be pretty darn good. Of course, you have to insert the punctuation verbally. But that comes with a little practice -- provided that you know what to do in the first place.
It does take a little bit of investment in time. But not nearly as much as learning to type at seventy words a minute, which I can now do in dictation. I have added very little by way of customized commands etc. The program has done a lot of learning on its own.
Let's try once again: I can't recognize beach. I can recognize speech. Oops. Okay, it failed that time. Let's try one more time: I can wreck a nice beach. I can recognize speech. Well, the phrases have to be enunciated pretty clearly or the program has trouble.
Which which blew the blue candle. Failed on the second "which" the b*tch.
Okay, okay. I'll put the laundry in the dryer. No I am not just screwing around on Slashdot again I'm getting some work done down here. Just a minute. Just a MINUTE.
One trouble. You do have to put the mike to sleep during family discussions.
Re:Just what we need... (Score:5, Insightful)
I think you've got it the wrong way round haven't you? Did you mean to say "More opportunities for English speaking people to misinterpret Arabic media."?
Re:Just what we need... (Score:2)
Yeah, that too.
Re:Just what we need... (Score:2, Funny)
Pah. English-speaking people never misinterpret Arabic media. al-Jazeera is a terrorist front organisation and ought to be bombed, and that's all there is to it!
Re:Just what we need... (Score:4, Insightful)
Re:Just what we need... (Score:2)
And more importantly (for them) no pesky staff translators with a conscience leaking what they transcribed [bbc.co.uk] or the greater good.
~Pev
Re:Just what we need... (Score:3, Insightful)
Re:Opensource? (Score:3, Insightful)