Robot Swarm Control On Microsoft's Surface 106
zerOnIne writes "Dr. Mark Micire of UMass Lowell has built an intriguing new user interface on the Microsoft Surface, a multitouch-capable table computer. The interface is being used to control swarms of robots for disaster response, search, and rescue. One of the most interesting things about it is the intuitive tabletop joystick widget. Using a very fast hand-detection-and-identification algorithm, they can paint a touch joystick (dubbed the DREAM controller) directly underneath the hand. This joystick conforms to the size of the user's hand and tracks with hand movements, making sure that the control is always directly under the hand where the user expects it, even without haptic feedback. I've had a chance to go hands-on with this system, and I think it's truly remarkable."
Re:RTS games? (Score:4, Informative)
The problem with RTS games path finding vs robot path finding is that the games have a flawless description of the environment (the description IS the environment) and no inherent physical limitations on the driven device, only ones programmed in.
A real obstacle can move, can be hard to spot or misrecognized as non-obstacle, can resist traditional methods of surmounting it (say, is slippery or crumbles). A real robot has to deal with traction slipping, in route deviating due to slipping on the surface, limited acceleration and braking power, environment behaving against specs (tell a crumbling building to follow the computational model...), communication shortages and so on.
Also, this is a demo, to let people see how that works. I believe it could be done 20 times faster by an experienced operator doing actual work instead of a demo.
Re:Is it just me? (Score:3, Informative)
Re:Unbelievable (Score:3, Informative)
I've done disaster response. While robots may have some very limited applications, dogs and eyeballs and boots are better. You need lots of them and each one has to be thinking and looking on their own.
You are looking for survivors and making decisions that are not quantifiable at all. It'll be a long time before we can send out a "swarm" of robots into a disaster area and have them work as well as a trained dog or a trained SAR person.
Real robots too!!! (Score:1, Informative)
Check out his other videos. They have done this with real robots also.... http://www.youtube.com/watch?v=48A8vdJ68lI
Re:Unbelievable (Score:2, Informative)
The swarm of ground robots is a bit of a reach goal. Current applications of this include showing manpower and equipment (and current robotic resources, like UAVs). The idea being, issued orders to a person or vehicle's representation on the map will send orders to a communication device they posses. The map would also serve to display data that currently is compiled (slowly) onto paper maps. This way, the interface becomes useful for combining data and asset display that also allows orders to be issued to those assets.
(I work next door)
Controlling Home Robots from "Smart Surface" (Score:2, Informative)
Re:RTS games? (Score:4, Informative)
This demo was a simulation, so there really isn't that much difference from a good RTS. Motion control and local path planning are well understood.
While the demo looks cool, it is not really much different than the robot GUI I wrote for my robocup team that could control 10+ robots (real or simulated). It used a mouse and any number of ps3-style controllers. And yes, I got my ideas from RTS games, and some other teams had even better GUIs.
Also, it would have been nice if they didn't speed up the video, so we could better understand how well it worked. One thing I often find in touch interfaces is that selection is slower than you'd expect since you block the item with your finger. A mouse pointer is much smaller, and works well for skilled operators.
Re:VIRTUAL robot swarm control on MS surface (Score:3, Informative)
Not in this video, but they have controlled real robots, too:
http://www.youtube.com/watch?v=48A8vdJ68lI [youtube.com]