Tangible Interfaces for Computers 158
Jesrad writes "A friend pointed me to this impressive demonstration of the SenseTable by James Patten, of the Tangible Media Group project of the MIT. This project aims at conceiving better human-machine interfaces by using the concept of physical objects that the user can manipulate, to represent abstract computer data and commands. The device looks and works a lot like what was envisioned in Minority Report, it uses pressure to track blocks on a sensitive surface, and feeds back to the user by superimposing graphical data. Want to change the volume of your MP3 player? Just put a block on it and turn like you would a radio knob. Menus and commands are accessed by moving a block along command hierarchy, represented in a simple tree, or by touching the command's name. So far it only lacks a device for text input, like a keyboard, but maybe voice recognition will replace it?"
Absolutely amazing (Score:2)
Star Trek IV (Score:3, Funny)
TECHNICIAN: Just use the keyboard!
SCOTTY: The keyboard? How quaint!
Or, alternatively, (Score:5, Interesting)
The typewriter interface has been with us for over a century. We've become accustomed to it.
I remember watching Minority Report and thinking "people don't like computers now. Do you think they'll be willing to learn such an obviously unintuitive and totally new interface?"
This seemed like it would be especially true outside the tech sector, such as, for instance, in law enforcement.
Remember that the only intuitive interface is the nipple. Everything else is learned. Some people may use this, yes, but I doubt most. I don't think most can deal with anything beyond using the mouse and keyboard.
Otherwise, the following things would be used, since they're faster even though they have a higher learning curve:
-mouse gestures would be HUGELY in use
-keyboard shortcuts would be known by almost everyone
-everyone would be using vi or emacs in a wysiwsg mode instead of wordpad/notepad/word.
-User interfaces with only a single type of action (clicky-clicky) wouldn't be popular.
When and if this is ever true of most of society, then we'll be ready for the new interfaces.
Re:Or, alternatively, (Score:1)
I disagree. Those things make using a keyboard and mouse harder, whereas new input devices could be easier to use than a keyboard and mouse. The reason no new technologies have been widely used is because they have no signif
Re:Or, alternatively, (Score:3, Funny)
A nipple is no good in it's current implimentation, which explains why I use a USB mouse with my Thinkpad. I find it very hard to suck on the nipple (Trackpoint), see the screen, and click the mouse buttons at the same time. Plus my boss accuses me of sleeping on the job due to "keyboard face".
Joy Button: So hot we had to make it red! (Score:2)
According to IBM's ad in Time magazine, it was "so hot we had to make it red". Ted made an even hotter version in the lab, that had TWO "joy buttons" -- one for each hand!
ONE joy button was so hot they made it red, but the TWO nipple keyboard was too hot even for IBM management to handle.
They tried to come up with a keyboard that was robust enough to withst
Re:Or, alternatively, (Score:3, Interesting)
A huge number of people have no idea what they're doing with a computer in their jobs, they simply are trained to press buttons and click a mouse in a certain set of steps in order to do what they need to do in order to get their paycheck. Really most office workers aren't much different than Pavlov's dogs.
On the other hand those peop
Re:Or, alternatively, (Score:1)
Re:Or, alternatively, (Score:3, Interesting)
I agree with you that the typewriter interface isn't going anywhere, but I don't agree with your reasoning.
These days, computer fear is dying. Go back to the 80's. How many people had computers? How many have computers today? Look at how kids use computers today, do you really think that they're suddenly not going to want to use them 30 years from now?
So why do I feel that the typewriter interface isn't go
It might work (Score:1)
Re:Or, alternatively, (Score:4, Insightful)
Stop repeating this crap. Have you ever watched a baby have to learn how to breast feed? There's a reflex there to get to the nipple, but actually doing the feeding isn't intuitive at all.
There are no intuitive interfaces, only ones which are similar to other interfaces you've already learnt how to use...
Re:Or, alternatively, (Score:2)
Two of them are young enough that I remember it, and besides, there's abundant scientific proof. I leave the burden of getting it on you since you're the one who doesn't believe, and I believe other readers will find this obvious.
Newborns automatically know all the mechanics of how to feed, defacate, and cry. Walking and crawling are also known to be built-in, though they don't take effect until babies are capable of doing it.
Re:Or, alternatively, (Score:2)
Re:Or, alternatively, (Score:2)
Funny. I remember thinking, "Boy would my arms and shoulders be sore after a few hours of that!"
I'll take the "lazy" keyboard/mouse interface any day of the week; I only have to twitch my fingers and wrists to get something done. The only interface lazier and more effective than the keyboard has got to be direct BCI (Brain Co
Re:Or, alternatively, (Score:2)
Re:Or, alternatively, (Score:2)
Mr. Garrison: IT gets over 300 miles to the gallon, and is safely capable of speeds of over 200 miles per hour.
Guests: Whoa. Wow.
Bill Gates: This will change everything.
Steve Jobs: We're going to have to rethnk cities!
Mr. Garrison: [puts on a helmet] Now, IT is easily operated using four flexigrip handles. Two of them are on each side. Left side for throttle, right side for steering. [operates each one as he describes it] The third flexigrip is gently i
Re:Absolutely amazing (Score:1)
For those who haven't noticed
Linux geeks... (Score:2)
And the Linux geeks will be using *40* year old Unix commands, raving about vi and the great CLI.
Keyboard implementation should be easy... (Score:2, Insightful)
One could even have different keyboard layouts being switchable with a knob... oh, wonder, wonder!
Feel free to add other irony below...
Re:Keyboard implementation should be easy... (Score:2, Interesting)
Aww (Score:1)
Re:Aww Slashdotted Already (Score:2)
Anyway, as for a pressure sensitive table, it sounds like a great idea but... I thought they were working on a table that read variances in the magnetic flux caused by hands moving over the table.
umm... (Score:3, Insightful)
Re:umm... (Score:2)
Combine with smoke screens ! (Score:2, Interesting)
Now when somebody asks... (Score:4, Funny)
You'll have to reply with "Well where did you leave it last?"
Oral audible hell (Score:5, Insightful)
Or maybe they'll just plug a keyboard into it? Voice recognition may well have its uses, especially as an accessibility technology, but as a general input device it's really a pretty poor idea.
Unless we're all supposed to sit in a cone of silence or something.
KFG
Re:Oral audible hell (Score:1)
Re:Oral audible hell (Score:1)
So long as you can touch type on it at 80 wpm, or even two finger "Columbus Method" at 40 wpm.
On screen "keyboards" suck. A lot. And hard too. Not to mention what they cost in Windex.
About the only thing worse is selecting words from a dictionary.
KFG
Re:Oral audible hell (Score:5, Funny)
int mane back maine back main bracket back ( int argh! see back back a r g c commet back , char star back ** a r g v ) brace back {
print f ( quote back "hello world") semicolon back
] no not that brace the other one back back back back back back back back }
Call me a skeptic (Score:5, Insightful)
Re:Call me a skeptic (Score:1, Troll)
like ms drones
they want all that cause they havent experienced anything else
i know i havent....
but would love the opportunity
Re:Call me a skeptic (Score:1, Insightful)
Lourens
Call ME a sceptic! (Score:2)
Re:Call me a skeptic (Score:1)
Re:Call me a skeptic (Score:4, Insightful)
Initially, that took lots of space, seemed a waste of resources, and you couldn't do much with it. Since then, resources have increased tremendously, new applications and methods have been developed that make good use of it, and people see the extra desk space as worthwhile. I don't know if the same might happen to the SenseTable, but I do know that if so, it won't be because it fits today's hardware, apps, and interfaces, but because it'll fit tomorrow's.
No,This is perfect for Dyslexics and others! (Score:4, Interesting)
And I should know, I am one.
For Dyslexics and people who have never used a computer before, a command line only interface is a MASSIVE hurdle. A GUI speeds up the time it takes a dyslexic to learn about computers by a factor of 10. A tactile user interface would IMHO speed up the learning (and normal human/computer interactions) by a factor of 1000.
For example I cannot spell, yet I'm asked to write the User Docs for my firms computer systems all the time. If I were in the land of Typewriters, I would probably not even have a job, let alone be asked to write for other people. So the GUI did for my computer interest, the same thing computers with spell check did to my Employability.
As a dyslexic, a TUI (Tactile User Interface) matched with a good 2D or 3D GUI is the Holy Grail.
In fact, a TUI would turn a 3D user interface into use full human/computer interaction method.
The Human brain is designed to work in a 3D space with tactile feedback. Anything else requires the brain to waste resources on "translator system" in order to use things like command line only interfaces. And for Dyslexics, everything is mucked up in "translation".
If computers had been command line only when I was in school, I would not have been interested in them and would not be doing what I am doing right now: Sitting in the office on Saturday night (I'm in London) Posting on Slashdot instead of ironing out the kinks these new computers that my firm just bought.
Wait...maybe GUI's are bad J:)
Re:No,This is perfect for Dyslexics and others! (Score:1)
I was thinking as a musician (which some might consier to be another result of mis-wiring in the brain
Re:No,This is perfect for Dyslexics and others! (Score:2)
As a programmer ... (Score:2)
For home use, voice response for controlling a/v, lights, etc, t
Talking to my computer... (Score:5, Funny)
I talk to my computer enough as it is. The day that it actually listens to me is that day that I'll have to rebuild it every other week, and red will be the day when it starts talking back to me.
Smarter robotic blocks (Score:2)
Audiopad (Score:4, Informative)
What I'm waiting for is for someone to combine that Linux HD of the PS2 and the EyeToy into a Minority Report type interface.
Re:Audiopad (Score:1)
Re:Audiopad (Score:1)
Now earlier in the comments fireboy1919 that it wouldn't work because people are unwilling to learn a new interface in addition to the ones they are already good at. I think for it to be successful it depends on the application of they system
Re:Audiopad (Score:1)
Re:Audiopad (Score:2)
Audiopad / Minority Report (Score:1)
the reason this work looks like the table in minority report is because john underkoffler, a former member of the same group at the media lab, was science & technology advisor for minority report and designed/spec'd/envisioned/whatever some of the devices used in the film. some of john's research on which that table was based:
http://tangible.media.mit.edu/projects/Lu m inous_Ro om/Luminous_Room.h
Is it any more tangible... (Score:4, Funny)
Re:Is it any more tangible... (Score:1, Funny)
Uhhh (Score:2)
Blah! Hogwash!
Exactly the Wrong Direction (Score:4, Interesting)
Re:Exactly the Wrong Direction (Score:2)
RSIs? (Score:1)
In addition it would certainly be nice to be able to have more than one focus point on your screen- especially in real time programs like audio and video production (even in non-realtime app, like if you've ever played with Reason you know what I mean). There's also something to be said for increased precision when you don't have to
It does not have to be hard. (Score:2)
Let's use our imagination just a little. First, imagine that screen tech gets cheap enough so that anyone can have a 4x8 foot screen. Make a desktop of that screen and you will wonder how anyone ever made themselves stare at a tiny monitor all day. Papers could be laid out so that you can stare at all of the material needed at once and virtual desktops would real
Tangible is not the right word.. (Score:5, Funny)
Voice recognition vs. keyboards (Score:3, Insightful)
Re:Voice recognition vs. keyboards (Score:2)
So a person with no training at all, given perfect voice recognition, could dictate faster than you could type after (presumably) a lot of typing practice.
Re:Voice recognition vs. keyboards (Score:1)
Your comment says it all. You don't write I haven't even learned to type without quote marks, because that's not true. The truth is that you have learned to type, albeit informally.
You, perhaps, are sure that a keyboard will be the most efficient input device you can ever hope to use. But I fail to see how that relates to the possibility of a more intuitive interface for future generations.
What does Doug think? (Score:4, Informative)
But a more dramatic example of the slowness of cultural change is the fact that I am typing this on a QWERTY keyboard. Dvorak [mwbrooks.com] has been around for years but still we type on devices that show their Victorian age heritage. Even when there is no need at all for the random shuffling of the alphabet across the current keyboard in the way we use it!
Another fine example is the red-headed stepchild of the Englebart revolution; the BAT [nanopac.com] keyboard. The BAT is supposedly easier to learn to use (I've never tried it myself) than a regular keyoard and is also supposedly more ergonomic than a keyboard, as well. It is aslo easier on the joints (or so they say). Now it's mostly sold for people who have Carpal Tunnel Syndrome and other injuries/disabilities. But it was originally thought to be a better method for input for everyone (injured/disabled or not) to use.
Englebart was right about most things (which were later refined by others into the form in which we now recognize them), but the BAT just never caught on. Too different, probably, from what people had already been using for over a century.
Re:What does Doug think? (Score:3, Interesting)
You know that this is all a myth, don't you? It is one of those "geek myths" people keep on repeating to each other without really bothering to check
Re:What does Doug think? (Score:2)
Re:What does Doug think? (Score:2)
Re:What does Doug think? (Score:2)
My story went like this:
1) Read that Dvorak was faster/better (told people).
2) Read that it wasn't (told people).
3) My wife tried Dvorak and said I should check it out. I told her it wasn't that great. I did some more research, found out it was (arguably) better and tried it.
4) Now my wife and I both use Dvorak exclusively.
All speed arguments aside, the main reason I changed my mind was that I found it to be more comfortable.
Paranoia and keyboards. (Score:2)
I have a simple question for you then. Why hasn't the Dvorak Simplified Keyboard penetrated the commercial market?
If you truly could increase speed by 20%-40%, then you can reduce your support staff by the same. Large corporations are not stupid; spending a month on training in exchange of the ability to get rid of almost half your typing pool would have been done all over the place. Yet, during the post-war boom, you have no significant increase of DSK. Nor were there mass layoffs of unneeded staff.
Is it
Re:Paranoia and keyboards. (Score:2)
As for commercial market penetration: who knows? There's plenty of arguably superior products that have gone the way of the Dodo.
As for corporate adoption: where do you get the idea that, if the speed increases are true, increased typing speed translates to a commensurate increase in overall productivity; or, that the initial resistance to adoption of equipment is the same as changing a basic, and arguably perfectly servicea
Re:Paranoia and keyboards. (Score:2)
What the hell are you on about?
Well, that's what I mean. A lot of Dvorak users seem to be worse than Mac users. (Yes, I know that it's impossible to be more fanatical than a Mac user. Bear with me.) It's almost as if I've insulted their faith.
As for corporate adoption: where do you get the idea that, if the speed increases are true, increased typing speed translates to a commensurate increase in overall productivity;
You've thrown me for a loop there. Isn't the point behind Dvorak increasing product
Re:Paranoia and keyboards. (Score:2)
Agreed. Although I'll admit to being an...afficianado, zealots are just annoying.
You've thrown me for a loop there. Isn't the point behind Dvorak increasing productivity?
I don't know if this is the focus of most Dvorak users. I've certainly heard it argued that Dvorak is faster, and I've b
Re:What does Doug think? (Score:2)
But I don't frequently alternate hands with my QWERTY. In fact, if you pay attention to what your hands are doing, it seems that your left hand does quite a bit more than your right. I kind of assumed that Dvorak fixed this by adjusting the balance.
titsss ! (Score:1)
Lemme get this straight (Score:1)
This sounds like something they may have invented before the mouse. Maybe back in the day it was a bunch of blocks all over your desk that you had to move, then eventually they all got consolidated into one universal interface de
Defense of tangible interfaces (Score:5, Insightful)
1) Media creation: Who still creates CAD drawings with a keyboard only? I used some early versions of Autocad that where keyboard-only -- they sucked. Sometimes a tangible pointer with a 1-to-1 interface mapping between a 2-D surface and the screen is superior. For artists, the use of an LCD graphics pad and pressure-sensitive stylus means much higher productivity and finer control. (I've even scene academic research suggesting that a two-mouse interface could improve productivity.)
2) Mapping to the Realworld: Go aboard an aircraft carrier and look at how they keep track of flight-deck operations. A miniature replica of the flight deck and miniature aircraft provide an intuitive 1-to-1 mapping between the model and the real-world. I'd bet that they could improve flight deck operations if those little aircraft moved automatically to reflect actual locations and if manual movements of aircraft spawned automatic commands to flight deck personel.
3) Multiuser interfaces: the demos of MIT's system that I have seen (a business-oriented supply chain visualization tool) leverage the table interface for multi-user applications. With the table, anyone around it can reach over and move a block. And everyone can easily see who moved the block.
The power of tangible interfaces is that they can help create a more literal mapping between a digital artifact and the real-world. Sometimes less abstraction leads to better ease-of-use.
Re:Defense of tangible interfaces (Score:1)
DISCLAIMER: I don't do CAD, don't really know anything about it.
Re:Defense of tangible interfaces (Score:2)
Just about everyone. I know many many many engineers and have worked in many engineering offices and I have yet to see a digitizer in any of them. With 3D CAD these days there are a few 3D manipulators, but the mouse works just great with a scroll wheel etc. In CAD you don't use your pointer to place lines, you use smart snapping and parameters to define the drawing using exact values.
Re:Defense of tangible interfaces: of CAD & mi (Score:2)
Just about everyone. I know many many many engineers and have worked in many engineering offices and I have yet to see a digitizer in any of them. With 3D CAD these days there are a few 3D manipulators, but the mouse works just great with a scroll wheel etc.
If you use the mouse, its not keyboard-only. The mouse is a tangible manipulator that provides a good correspondence between X-Y motion of the hand and X-Y motion on the screen. The
Fascination with voice recognition, what gives? (Score:3, Insightful)
I'm certainly not the first poster to comment on this, but I just don't understand why many assume voice input would be the preferred method? That it'd even be better than physical controls (be that keyboard, mouse, switches, joystick, whatever). There's enough aural noise in the environment, even without more; accidental commands, specificity, technical things... And except for niches where it does make sense (if one can not use his/her hands or even legs), there just doesn't seem to be much beyond 'coolness factor'? Just like you can get carpal tunnel syndrome, your throat can go sore etc.; there are no health benefits; people can generally point/click/type faster than talk; GUIs are multi-dimensional (2 currently), speech generally single-dimensional, so there's one less way to distinguish what was the target (ie. no location information)... and so on and on.
Now as to Star Trek and other sci-fi movies (including Minority Report), isn't it fairly obvious why voice input was/is used? It's the easy way to indicate what a character is inputting, and what are the results! Even if it wasn't for futuristic touch, it's so much better for needs of movies and tv series than, say, keyboard input (keyboard and mouse are only shown when realism is needed). Directors are in general experienced and smart professionals, and know that voice input is a very good solution for THEIR problems. Just like even though there hasn't been the need to stay on call for tracing to work for decades now, they still always imply it is, in crime series, just because that's a cheap (albeit unrealistic) trick to add some suspense to plot. Just don't assume they are prophets that show what future will be; just what works for them.
Re:Fascination with voice recognition, what gives? (Score:1)
Now as to Star Trek and other sci-fi movies (including Minority Report), isn't it fairly obvious why voice input was/is used? It's the easy way to indicate what a character is inputting, and what are the results!
At least four times an episode, some red shirt sitting at his little desk on the bridge thinks to himself, "Goddammit, Kirk, use your damn keyboard already."
Re:Voice Command vs. Voice Dictation (Score:2)
It's also not so much that I think existing options are perfect; but just like CRTs for displays, or combustion engine for powering cars, competition hasn't been able to improve on them enough to make them obsolete. Yet?
We've seen this before... (Score:2, Insightful)
Not that I'm doing anything down - my guess is they're now making more general use of the stuff they'd developed for Audiopad, or Audiopad was just the first a
does it mean (Score:1, Funny)
An intangible interface for computers (Score:2)
wooow it's ./ed!!! (Score:1)
slashdot managed an MIT web server! (the media lab's) That's not too bad for a saturday.
( the qt movi was embedded in the page, all 5MB of it...)
f
Yet another unimpressed reader (Score:1)
this is nothing that hasn't been done with touchscreens. this just takes wear and tear out of the equation.
Stargate SG-1 (Score:2)
Neato (Score:1, Funny)
This project aims at conceiving better human-machine interfaces by using the concept of physical objects that the user can manipulate, to represent abstract computer data and commands.
You mean they're going to invent the mouse and the keyboard? Awesome.
Re:Neato (Score:2)
Also a "tangible" input device: Touchstream kbd (Score:2, Interesting)
It's definitely very cool to move the text cursor around, directly linked to the movement of your left index + middle finger (seemingly), and to be able to cut/paste by "picking" text with thum
Minority Report / TMG Connection (Score:4, Informative)
John Underkoffler [mit.edu] is a former member of the Tangible Media Group, and was the science advisor [imdb.com] on the film.
Beware geeks designing interfaces.. (Score:3, Insightful)
Seriously, while this probably has niche applications (previous posters have mentioned a few that sound plausible) I don't see that it offers much to the conventional desktop user (a keyboard and mouse require much less movement than the shenanigans Tom Cruise got up to in the movie and, other than keeping office workers fit, these interfaces will just lower productivity).
So what about wearable computers? Something you wear on your belt with a head-mounted display, designed to be used while walking along? Well, to me it doesn't make much sense in this context either: again, if you end up requiring much odd movement on the user's part it won't work. In my opinion the future is far more likely to look like a next-generation of Canon's eye-controlled (pupil-tracking) autofocus system to control a pointer on some head-mounted display coupled with (in the short term) an interface that minimizes the need for text input together with some kind of finger-based character input device[0] or (longer term) speech recognition of a standard where the software doesn't need training and can cope with background noise[1].
[0] There was one mentioned on slashdot ages ago that looked a bit like a gripmaster (key for each finger plus the thumb), and text was typed by entering chords.
[1] Incidentally, how much research has been done on using stereo input to speech recognition programs to reduce background noise? I would have thought that would help quite a lot, albeit at the expense of CPU time.
Some mere fancy, others, well...WOW (Score:2)
Throughout time, there has been one hallmark of the existing user interface - despite the absence of any real tactile interface (save the keyboard), it's efficient. It seems like some of these interfaces strip away this efficiency and replace it with flexibility. This isn't a bad thing, but it does lead us to the point that for any given task, we'll need to decide if a given interface will provide the results we need.
I have to say that out of all the examples included on the MIT web site, the one I see wit
Hitchhikers Guide to the Galaxy (Score:1)
that was really a time-warp
spaceship? Arguing with the
waiter over the bill caused changes
in the space-time continuum, driving
the ship along.
New Essential Peripheral(s) (Score:1)
Simular concept in comicbook (Score:1)
Basically, he wore these little lcd projecter things over his eyes, and had a
pair of Minority Report gautlet things, and the information he needed was
superimposed in front of him, monitors, virtual keyboard, everything you need
floating right in front of you. He was able to type in the air, as if it were
actually there. Imagine being to intensity or decrease the
transparency of the controls, and you got something I would give a lot to play
Want your own? Too bad. (Score:2)
Also apparantly, the company was bought by LEGO, so there may be hope.
These guys [tudelft.nl] have all available info, including a link to the above MIT paper.
Creates more problems than it solves (Score:2)
Yes, it's cool to watch. But no:
1. You have to learn it. That round thingies are used for this, star-like thingies for that
2. Implementation shown is not logical. You either project supplemental interface from the top -- then any hand movement distorts it, or from the bottom, where hand movement and physical interface object distort/shadow it. Simple solution?
Make the object virtual.
Oh, wait. Isn't it the type of interface those hollywood designers made for Voyager, where you click, slide, a
old-style science fiction (Score:2)
Re:Oh this is soooo cool.. (Score:1)
Re: (Score:1)
Re:Oh this is soooo cool.. (Score:1)
Re:Oh this is soooo cool.. (Score:1)