Stories
Slash Boxes
Comments

News for nerds, stuff that matters

Slashdot Log In

Log In

[ Create a new account ]

Wiimote Turns TV into Touchless MS Surface

Posted by CmdrTaco on Wed Jan 23, 2008 11:11 AM
from the now-thats-what-i'm-talking-about dept.
RemyBR writes "User interface project allows you to control objects on a display using gestures, working like Microsoft's Surface but without touching the screen at all. Inspired by Johnny Chung Lee's work, the system requires you to wear Minority Report-style gloves equipped with infrared emitters on your fingertips. A Wiimote on top of the display keeps track of these IR LEDs, while the software can read the motion down to two-finger pinching gestures for image zooming."
gui hardhack inputdev wii !surface
games gui
story

Related Stories

[+] Games: Wiimote as Multi-Touch Display Controller 107 comments
Tmack writes "While hard-hacks with the Wiimote are somewhat old news, this particular implementation is quite interesting. Using the infrared camera on the Wiimote, pens with LEDs instead of ink, and an LCD projector, Johnny Chung Lee of Carnegie Mellon University has created software to use them as a (relatively) cheap multi-touch display. Any surface onto which you can project becomes an interactive multi-touch display, as demonstrated in the video at the link. He has the software available for download, along with some other neat projects. Lee has also documented another impressive Wiimote hack.
[+] Hardware: Head Tracking w/ the Wiimote 169 comments
mrneutron2003 writes "This guy just doesn't know when to stop. Johnny Chung Lee graces us with yet another one of his inventive Wiimote projects. This time it involves using the Wiimote and a pair of inexpensive LED safety goggles (with the standard LED's replaced with InfraRed ones) to allow positional head tracking , achieving an effect similar to what is experienced with three dimensional displays and CAVE systems. The video dramatically illustrates the effect. Game developers take note. This simple little variation on infrared tracking could allow for some seriously immersive gameplay in the future." This guy deserves a medal.
This discussion has been archived. No new comments can be posted.
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
 Full
 Abbreviated
 Hidden
More | Login
Loading... please wait.
  • by techpawn (969834) on Wednesday January 23 2008, @11:14AM (#22153354) Journal

    the system requires you to wear Minority Report-style gloves
    come on! Don't toy with my emotions!!! Power glove man! System requires you to wear modified power gloves!
  • by kellyb9 (954229) on Wednesday January 23 2008, @11:18AM (#22153398)
    Nintendo turns your televisions into a Microsoft product!
  • Table (Score:5, Interesting)

    by pavon (30274) on Wednesday January 23 2008, @11:21AM (#22153450)
    Would it be possible to shine IR light through the edge of a plexiglass surface, and then when the user touches the surface it would cause the IR to scatter at that point creating a point source for the Wiimote to track?
    • That's crazy. Just crazy enough to work.

      Actually, I think it sounds like a great idea... I wish I had the parts and time to try things like that.

      Potential issue: Dust, fingerprints, etc... Wouldn't they also cause the same effect?

      Maybe there's a material that causes IR light (or even all light) to reflect (or reflect differently) in an area where force is applied?
    • Re: (Score:3, Interesting)

      Yea, pretty much the same theory behind most of the homemade FTIR boxes (google it, or check out the NUIgroup), instead of using a webcam with IR filter removed, just use a wiimote. The system doesn't provide the best tracking though.
  • If the video crashes at some point, a quick recap: it kinda works. You can see at certain points, the images get dropped and it looks like it doesn't totally track perfectly with where the fingers vs. screen are. However, it is an awesome technology and idea... maybe with a couple of remotes you could triangulate more precisely and get that true 'minority report' feel... just what i need for my tri-monitor setup :)
  • Wiimote (Score:3, Interesting)

    by MasaMuneCyrus (779918) on Wednesday January 23 2008, @11:57AM (#22153928)
    Why not just use the Wiimote itself as a remote control? It seems more fun and practical.
  • by Doc Ruby (173196) on Wednesday January 23 2008, @12:00PM (#22153964) Homepage Journal
    We're used to moving an actual thing around to do stuff. The physical reaction into our fingers is very important. The mouse gives a minimum, but the trackpad gives more. Touchless manual gestures don't keep the hands locked in a feedback loop with the virtual object, so they'll be clumsy.

    What I'm waiting for is a thin memory plastic layer over a touchscreen, that can raise bumps and edges defining onscreen GUIs. Vibrating gloves could be good for simulating textures, but there's no tech for simulating tensile or inertial force in virtual objects. Maybe some kind of eccentric gyroscope, but I've never seen one.
  • Updated video posted (Score:3, Informative)

    by cynergylabs (1225520) on Wednesday January 23 2008, @12:02PM (#22153992)
    An updated version of this video has been posted to the Cynergy Labs Site. http://labs.cynergysystems.com/ [cynergysystems.com]
  • by brent_linux (460882) on Wednesday January 23 2008, @12:15PM (#22154184) Homepage
    Ok I get it. You can make multitouch interfaces. I have made multitouch interfaces myself using a couple different methods.

    They aren't worth a damn though unless you have something to use them with. Where is the multitouch picture organizing software that I can display on my coffee table and let me family sort through the pictures. Where is the multitouch D&D program that will let me and my friends move our characters through a dungeon with miniatures? Where is the multitouch coloring book that I can put a bunch of kids on? Multitouch math races? Multitouch Chemical Compound manipulation?

    We need software. We have ways to interact now. We need things to interact with.
  • Two words (Score:5, Insightful)

    Two words: tired arms.

    Unfortunately, these sort of interfaces suffer from the same problems that doomed touch screen and light pens 20 years ago ("They can just touch the screen! How easy is that??") Users liked them at first, but holding your arm up is tiring. Try reaching out to your monitor and trace your Slashdot window for five minutes and see how long you last. It's *hard*.

    There's a reason people in the Old Days wrote on flat tables, and didn't write on easels. That's also why artists who do use easels typically do "stroke and rest" (and why cartoonists use a flatter table)

    A touch table is far superior for this sort of thing for that reason.

  • Rumble (Score:3, Insightful)

    I hope the gloves incorporate rumble. That's my favourite aspect of the Wii OS. Feeling that little bump when you scroll the cursor over a button is so tactile and tangible. It reinforces that you should immediately pay attention because you're about to execute a command.
  • by notanatheist (581086) on Wednesday January 23 2008, @01:00PM (#22154770) Homepage
    Please stop referring to any multi-touch device as being like the "Microsoft Surface". MS did not come up with the idea of a multi-touch display. They steal and buy 99+ % of their technologies. Let's get PC and stop giving credit where it isn't due. It is a "multi-touch" surface. Not an MS Surface. /rant
  • Not. (Score:4, Interesting)

    by no_opinion (148098) on Wednesday January 23 2008, @01:24PM (#22155094)
    I got to play with the Microsoft touch at CES. This is nothing like it. The MS table uses a camera underneath the screen, so it can do things like recognize physical objects. Imagine thumbing through artwork on the table, then putting your wireless MP3 player down on the table and dragging the artwork to it and having it wirelessly sync. Pretty cool, if you ask me. They demoed this at CES. Basically anything with a barcode can be recognized as a unique device. Without this type of physical object recognition, the Wii version is a poor substitute, besides the fact you can't actually use all 10 fingers (or 20, if there are two of you) at once.
  • by Seraphim_72 (622457) on Wednesday January 23 2008, @03:02PM (#22156604)
    http://www.youtube.com/watch?v=Jd3-eiid-Uw [youtube.com] Good lord this is cool. And he is right - bring on the games!!!!
  • urgh (Score:3, Funny)

    by Tom (822) on Wednesday January 23 2008, @04:17PM (#22157832) Homepage Journal
    Interesting, except for the constant microsoft advertisement. "I love flash, but we built this in silverlight (continue on to long rant about how great that is with no relation to the topic whatsoever)", or the "and since it's built in .net it can communicate with the Wiimote", err yes? What's that gotta do with .net? Then the "oh, look a picture of me at some microsoft meeting", and on and on. All that really got on my nerves about 3/4 through the video.

    • If you saw it three weeks ago, then why didn't you post it? Oh, you were too lazy? Then STFU.
      • Re: (Score:3, Insightful)

        If you saw it three weeks ago, then why didn't you post it? Oh, you were too lazy? Then STFU.

        Because I didn't think it was worth discussing on Slashdot? Perhaps because in the past when I've submitted what I thought was pretty cool shit it was rejected within minutes or rejected and then posted a few days later by someone else instead that had, what I felt to be, a lame writeup?

        But most of all it's because I can't stand the fact that some of the writeups are nothing more than blog advertisements that link
    • Re: (Score:3, Informative)

      Uhhh... no. This article links to a previous article, which links to the article you linked to. Each of these articles shows a progressive evolution of the concept. The article you linked to used reflective tape to accomplish the IR tracking. The article linked to by this article shows how to use a light pen for greater accuracy. THIS article combines the two approaches using IR equipped gloves to create a highly accurate touch surface.
    • And no thought magic for me please, hand is the highest interface I wanna go.
      Must... Resist... Joke...