Want to read Slashdot from your mobile device? Point it at m.slashdot.org and keep reading!

 



Forgot your password?
typodupeerror
×
Google Communications Software

Google's Assistant Is Now Bilingual (theverge.com) 78

Google has announced a new feature for Google Assistant: it's bilingual now. The digital assistant will automatically recognize what language is being spoken to it and respond appropriately -- all without requiring you to change any settings. The Verge reports: You'll be able to set up Assistant to understand and respond to any two of the following languages: English, German, French, Spanish, Italian, and Japanese. Google adds that it intends on "expanding to more languages in the coming months." The behind-the-scenes tech to make this happen is pretty interesting, as Google explains in an accompanying blog post. To make Assistant receptive to two languages simultaneously, the company created a new language-identification model (which it calls LangID) that runs as soon as the software detects speech.

Assistant actually runs LangID in parallel with two separate language processing models that try to transcribe what's been said in the user's two preset languages. Once LangID has identified the language, Assistant then cancels the incorrect transcription and routes all processing power to focus on the correct one. In order to speed up the process of identification, LangID doesn't just consider vocabulary; it also signals the frequency at which each language is used and the type of device it's used with.

This discussion has been archived. No new comments can be posted.

Google's Assistant Is Now Bilingual

Comments Filter:
  • Gets to detect all the languages in a house for the security services.
    • Gets to detect all the languages in a house for the security services.

      They can already make a good guess by looking at surnames.

  • Reading over the article it claims that this new update to Google Assistant can understand 6 languages.
  • by whoever57 ( 658626 ) on Thursday August 30, 2018 @06:26PM (#57228164) Journal

    The other day, the wife and I were watching a foreign language TV program. No dubbing, just subtitles. I think it was Swedish.

    Suddenly, Google Assistant on the wife's phone started. I have no idea what it heard that triggered it, but it wasn't English.

    Surely Google should know we speak English exclusively? So what's the point?

    • Suddenly, Google Assistant on the wife's phone started. I have no idea what it heard that triggered it, but it wasn't English.

      Most likely it was triggered by some random string of phonemes.

      Surely Google should know we speak English exclusively? So what's the point?

      I watch mostly English movies, but my wife is Chinese so we occasionally watch movies in Mandarin. So Netflix sees that we like "foreign movies" and fills our recommendation list with French, Italian, and German movies, rendering it useless.

    • by AmiMoJo ( 196126 )

      Have you tried enabling Voice Match in the settings? Then it will only respond to your voice rather than random people or sounds.

      You can also disable voice wake up except for in certain circumstances, like when you are in the car using Android Auto.

    • Surely Google should know we speak English exclusively? So what's the point?

      It's unlikely that it perceived what it heard as another language. This new bilingual feature only works if you set it up, and only with the second language that you choose. More likely, it just heard some phonemes that triggered the "Ok Google" detection, and then couldn't figure out what followed.

  • It understands both Ones AND Zeros!

  • Wonder if will speak Klingon, or better yet Tolkien Elvish.

    https://www.youtube.com/watch?... [youtube.com]

  • I really need Tamil for in-laws. They are in their 80s and it would be useful for them to be able to simply talk to turn on lights, etc.
  • The other day, I said something very simple to Google Assistant, and was rewarded with a string of 80% Chinese characters and 20% English words which I had not said. The English was probably wrong because it lacked context (as the rest of the sentence was flagrantly misparsed).

    Anyone know if I can opt out of this feature/bug? I assume they are viewing the world as their QA department, planning on the feature not working for a few years until they gather enough data to train the service to do a better job.

    • Anyone know if I can opt out of this feature/bug?

      Easiest way: Don't opt in.

      • by piojo ( 995934 )

        Anyone know if I can opt out of this feature/bug?

        Easiest way: Don't opt in.

        I did miss that in the summary, but in Asia (with an account created in the US) it seems to be the default to interpret in multiple languages. I most certainly never told Google Assistant that I speak Chinese, because I don't.

  • by mentil ( 1748130 ) on Thursday August 30, 2018 @10:32PM (#57229176)

    This presumably helps with code-switching [wikipedia.org], which bilingual people tend to do all-the-freaking-time. They'll start a sentence in one language, forget how to say something in that language (or don't like how it sounds in that one), then switch to another, sometimes for only a few words before switching back.

    • This presumably helps with code-switching [wikipedia.org], which bilingual people tend to do all-the-freaking-time. They'll start a sentence in one language, forget how to say something in that language (or don't like how it sounds in that one), then switch to another, sometimes for only a few words before switching back.

      No, it isn't that clever yet. I just tried it with a few sentences of mixed English and Spanish, and every time it assumed that the entire sentence was in one language, correctly understanding the part that was in that language and finding something phonetically close (ish) for the rest.

      I think what it's doing is submitting your words in parallel to all three systems: LangID and the two systems for the languages you have selected. LangID returns its best guess at the language you used, then Assistant gi

  • It's a cute idea, with an obvious implementation (running both language modules simultaneously). Presumably, part of the input into the language ID is also seeing which language module is successfully making sense of the input.

    However... We have a bilingual household (English/German), and part of the reality is also that the languages get mixed. There is always some word in the "other" language that is handy, or maybe you just can't find the word you're looking for. If you're free to talk to your devices in

  • But it refuses to work in more than 2 languages?

    • I think it's even more than those 6, but you can pick 2 out of these 6 that you will be able to use without manually switching the input language.

      In other words, these aren't the languages that are understood, but the ones that will be recognized. Which is quite a different thing if you keep in mind that current language recognition is based on a fixed dictionary and picking the word from it that comes closest to what the computer just heard.

Keep up the good work! But please don't ask me to help.

Working...