Sign Language Via Cell Phone

QuatumCrypto writes "A project is underway at the University of Washington to enable real-time sign language communication via cell phone. Because of the low-bandwidth wireless cell phone network, a new compression scheme is necessary to capture only the bare essential components of signing to minimize data transfer. Although text messaging is a viable alternative for everyone, signing — like speech — is a much faster and more convenient form of communication."

They're focusing on video...

[Mr2001]

But there's another problem with using sign language via cell phone. Look at the screen mock-up on that page - it shows the signers from the waist up. If your phone is far enough away that it can capture your whole body, how are you going to see the screen?

Also, they claim "The current wireless telephone network has inadvertently excluded over one million deaf or hard of hearing Americans", but it's easy to get a cell phone that supports TDD [phonescoop.com], just like a wired phone.

How do you hold the cell phone?

[niconorsk]

The technology for this is very cool and all, but I don't see it as very applicable to use with cell-phones. As far as I know requires the use of both hands, so you would have to put down your phone in a way that you can be seen and you can see the screen and lastly without holding it. This seems like an impossible proposition. But the technology in its own right could be very interesting, at least for desktop video-conferencing units.

Language-agnostic?

[Max Romantschuk]

I hope this compression scheme won't be tied to the semantics of a single sign language like ASL. There are plenty of other sign languages in the world, so hopefully this tech will be "language-agnostic", so to speak.

Re:TTY?

[KlaymenDK]

What is the benefit of this technology over TTY or using text messaging?

I don't know what you or the GP means (in a mobile phone context) by TTY, but there is one definite benefit: immediateness. That is, lack of latency in message delivery.

When you send text messages back and forth, there's a delay with every delivery. For the equivalent of speech, this would be like calling the moon. Plus, you have to go into the inbox and open new messages all the time -- not very conversation-like or, for that matter, IM-like.

Re:TTY?

[gEvil (beta)]

Well it seems the same effect can be achieved through a video conference...

And that's essentially what this article is about. Rather than using full-bandwidth video communication, they're trying to develop a compression algorithm that is better suited to signing (ie, capturing only the primary hand motions).

Just hack Wiimote!

[140Mandak262Jamuna]

Another big chance for Nintindo. Can they hack the Wiimote to translate sign language to text?