Forgot your password?
typodupeerror
Software GUI Input Devices

Designing a Practical UI For a Gesture-Based Interface 44

Posted by timothy
from the ok-but-I-definitely-am-sticking-with-steering-wheels dept.
An anonymous reader writes with a link to an intriguing account of the challenge of designing a close-range, hand and finger-based gesture recognition interface using 3D cameras. Things like this look good in science-fiction, but it's hard to create a gesture-based system that makes sense to the user and rejects gestures not meant for the computer.
This discussion has been archived. No new comments can be posted.

Designing a Practical UI For a Gesture-Based Interface

Comments Filter:
  • by bigattichouse (527527) on Monday February 04, 2013 @12:10PM (#42785911) Homepage

    I interpreted ASL in educational settings (High School, Freelance, University, Public, and even elementary.) for something like 6 or 7 years.

    My arms were ripped, and you could expect to burn several hundred calories (EASY) during a day of doing that. Also, I had learned the stretch properly thanks to some Aikido training.. and I still had some bad habits that caused me repetitive stress problems.

    Gestures are a novelty, and a lot of work for the user... I think there will be many blind alleys before they become natural.

    Some problems/ideas I see:
    1. Exhaustion - you waste a lot of energy
    2. "Namespaces" - you can make two gestures at once - geez... so you have a left hand gesture that tells the computer to listen (the ASL "Attention" one handed would work) + a command - maybe even "against" that hand. Its like a salute with your left hand vertical moving away from your face.
    3. Facial expressions are a HUGE part of ASL, probably not even considered. "WH" questions get eyebrows scrunched, other queries eyebrows up, puffed cheeks and all kinds of things...
    4. Security - I defy you to sign EXACTLY like someone else... It's possible, and easy in a mocking sense (High schoolers) - but I imagine a door that could see you carrying groceries and unlock combined with voice recog., or other simple things would be useful.

Our business in life is not to succeed but to continue to fail in high spirits. -- Robert Louis Stevenson

Working...