Software Brings Eye Contact To Video Chat, With a Little Help From Kinect 111
Zothecula writes "Skype has been around for ten years now. Once a science fiction dream, the video calling service has 300 million users making two billion minutes of video calls a day. One problem: most of them can't look each other in the eye. Claudia Kuster, a doctoral student at the Computer Graphics Laboratory ETH Zurich, and her team are developing a way to bring eye contact to Skype and similar video services with software that alters the caller's on-screen image to give the illusion that they're looking straight at the camera."
there's always looking right at the camera (Score:2)
Which is hardly a natural act, so you should position your camera just above your screen if possible because that's where you're looking, at your screen. :)
Re:there's always looking right at the camera (Score:4, Insightful)
Then you're not looking the other person in the eyes. Hence no "eye-contact."
Re: (Score:1)
If you're looking at the camera, then you're not seeing the other person, which defeats the purpose of a video chat.
Re: (Score:2)
Re: (Score:2)
You must be using a different slashdot than me because that's not my experience at all.
Re: (Score:2)
Re: (Score:2)
I don't know if this should be rated funny or insightful.
Re: (Score:2)
"I see in Slashdot the strongest and smartest men who've ever lived. I see all this potential, and I see squandering. God damn it, an entire generation pumping gas, waiting tables; slaves with white collars. Advertising has us chasing cars and clothes, working jobs we hate so we can buy shit we don't need. We're the middle children of history, man. No purpose or place. We have no Great War. No Great Depression. Our Great War's a spiritual war... our Great Depression is our lives. We've all been raised on te
Re:there's always looking right at the camera (Score:5, Funny)
Re: (Score:2)
Re: (Score:2)
Why isn't this done for video conferencing systems. would it be difficult to have a tiny camera embedded in the center of the screen? A small spot on the screen shouldn't be entirely too distracting. Would work great for this type of setup: http://www.zdnet.com/atlassian-builds-portal-for-video-chat-1339327884/ [zdnet.com]
Re: (Score:2)
You mean like how Every Acer, Samsung, Toshiba, macintosh, and dell has the camera on their laptops and all in one pc's?
Re: (Score:2)
I agreed that yes, I did remember that. I said that with MSN Messenger and some of the other new software we were actually getting pretty close.
She said, "I don't so much want to see the other person, as I want to be able to reach through and SLAP them!" The
That could easily be engineered... (Score:2)
Using an, umm, extension to the world-famous FUFME of yesterdecade.
(Oh, are you a newcomer? Well, their site is long gone, but you can start by reading http://www.dooyoo.co.uk/internet-sites/fufme-com/377859/ [dooyoo.co.uk] to see what it was all about)
Re: (Score:2)
They're all looking up, though, which would indicate that the camera is below the screen. Every setup I've seen puts the camera atop the screen, which makes more sense with regards to eye contact as the contact's eyes will be closer to the camera (and filming from slightly above is more flattering than filming from slightly below).
I've done a little video chatting and it never looks as dramatically awkward as the pictures they show. You can tell that the other person is looking at the screen and not the cam
Beta Preview (Score:1, Funny)
http://i.ebayimg.com/00/s/MTYwMFgxNTM1/z/0DkAAMXQHeBSD6I4/$(KGrHqIOKpMFIJv(N8KvBSD6I3QPTw~~60_35.JPG?set_id=880000500F
Aversion (Score:2)
I have an aversion to maintaining eye contact with people I don't completely trust, you insensitive clod!
Even if it is fake.
Re: (Score:1)
You just have to not activate the feature yourself. On the other hand, your peers will be relieved to have a more natural communication. I had a professor that while speaking with anyone never makes eye contact, looking to a corner of the ceiling... I cannot describe how disturbing that was.
Re: (Score:3)
I disagree, not looking at people in the eye during chat isn't weird at all. It's the way that video chat is done.
By permitting the computer to change your eyes, you solve one problem, while taking away the meaning with which your eyes communicate with people. Suddenly, you can't just roll your eyes without telling the computer that you want to roll your eyes as the computer isn't going to know that it should break eye contact.
If you happen to live in a culture where eye contact is maintained through out, t
Re: (Score:2)
I haven't video called much and it took a little bit of getting used to but then was OK. At appropriate times I'll look directly into the camera and the other person sees that. And vice versa. Works, and only a little awkward. This new software is nifty but unsettling in its own way. Until I use it I'll reserve judgement.
Re: (Score:2)
I've never had a problem with it, I just look at the screen as one is intended and focus on communicating. It's really freaky to be on video chat and focusing on the camera, it sounds like you were sitting too close to a camera with a screen that's too large. With my 11.6" screen, the difference between looking at the camera and looking at the screen is minimal.
If you've got a larger screen then you're likely going to have to sit further away in order for the effect to disappear.
Still, it's a damned sight b
Re: (Score:2)
Didn't say I had a problem with it, only that it was a bit of getting used to. Camera is in bezel of laptop's 17" screen; sometimes I'll be leaning back in my office chair, other times leaning forward to type some thing, once with my nose to the screen, "What are you doing?" "Seeing if you got more wrinkles that I do." At a comfortable viewing distance there's still around 5 degrees of separation eyes-to-camera, so that's the "getting used to." Also, with several people, we'll each look directly at the
Re: (Score:2)
This sounds a lot like people prior to video cameras becoming ubiquitous. If you've ever seen a Beatles film you'll know what I mean, it's all awkward because they're paying a ton of attention to the camera rather than just ignoring it and going about their business.
The video conferencing equipment is the same way, you're not supposed to be changing your behavior to suit the device, you're supposed to be looking on screen. I'm not sure how that would look weird, because it's never looked weird on any device
Re: (Score:2)
I'm not sure about the "supposed to" so much; so far people and I just do what seems natural to us, but I think I know what you mean.
If one could know that the Kinect is locked down then I'm all for it just 'cuz it's a nifty toy at the least. What these folks have done with it is way cool whether one wishes to use it or no.
My laptop cam has a light also but I'm not sophisticated enough to rest totally assured that the software I use reports correctly as to whether it and the microphone are on or off - offh
Re: (Score:2)
I had a professor that while speaking with anyone never makes eye contact, looking to a corner of the ceiling... I cannot describe how disturbing that was.
Having grown up very close to a deaf person, I've developed the tendency to stare at people's mouths when they speak.
You want disturbing? Try learning to lip read.
Sometimes the easy way is the better way (Score:4, Interesting)
Re: (Score:2)
Why not put a half-silvered mirror (plate beamsplitter) at a 45 degree angle to the screen, a piece of black velvet beyond the beamsplitter as a light trap, and point the camera so it sees your face reflected in the glass? Like a teleprompter.
Not a bad idea really. Software could remove the ghostly reflected face probably, and it would be a far better use of software than manufacturing where your eye is looking. That just sounds like it would look creepy.
Re: (Score:2)
Large size? I have one for my camera the size of an iphone.... which is because it uses an iphone for the teleprompter and the headphones remote as a text scroll control.
Works great even in bright sunlight and are common for use by many TV stations in the field now.
Re: (Score:2)
on an android phone? yes. but why do that. Use the iphone as a display and pipe the video from the laptop to the phone, then the video from the camera to the laptop. two wires and all is done. but has limited use. nobody outside of podcast recording care about eye line and eye contact.
Re: (Score:3)
Re: (Score:2)
Difficult to do on a phone or laptop but you'd make fortune.
Re: (Score:2)
It doesnt make or break a deal. I sell high end AV systems (They cost more than your house and your parents house) that use $15,000 or more Pro Videoconference systems. and they dont maintain eye contact. the camera is either mounted above or below the screen. and when you are using a 80" LCD the camera is WAY up there.
Re: (Score:3)
Creepy (Score:2)
Re: (Score:2)
Bourne Supremecy cam effects? That would rock.... well actually easy, just install the camera on a paint shaker.
Don't mess with the eyes (Score:5, Insightful)
They're putting out software that changes what your eyes look like so that it looks like you're not looking up a little bit. This will not work. It will make people's eyes look wrong and creepy. We are perfectly attuned to looking at eyes and anything that's a bit off will get noticed immediately. Start by fixing people's teeth or something but not the eyes.
Re: (Score:2)
Apparently they're actually moving the whole head to look like it's aiming at the camera, not just making the eyes look like they're aiming at the camera.
In most of the images, it looks reasonable, but in a few it just looks a bit off somehow.
Re: (Score:2)
Whatever. Tilting the face, changing angles and trying to make the eyes look like they're pointed a different direction will just look wrong. It sounds like wonderful technology but everyone's going to try it for five minutes and then turn it off because it looks creepy.
Re: (Score:2)
I'm completely with you. I was just pointing out what some people might see as a big difference between what you were talking about and what was actually happening. As I said, a couple of their sample images looked a bit off already, so I imagine it would look creepy as hell in practice.
Re: (Score:2)
In most of the images, it looks reasonable, but in a few it just looks a bit off somehow.
I'd call the latter a bit of an understatement: http://www.gizmag.com/skype-eye-contact/28843/pictures#3 [gizmag.com]
The left guy in the right picture looks like he's changed race or even species.
Considering that these are undoubtedly the cherrypicked best results and that the example images are low resolution, I'd say that the technology needs some more work. Having said that, there is nothing wrong with the idea in itself.
Re: (Score:2)
The Kinect gets 3D information. They can take the polygons mapped with the video image and apply small rotation from the picture of the other person onthe screen to the camera. You'll get some artifacts where you are exposing areas that the camera can't see, but maybe those can be filled in with surrounding pixels so you don't notice so much.
Re: (Score:2)
Or maybe they'll look like Terry Gilliam's cutout animations [youtube.com].
Might work if people look at screen not camera (Score:2)
Didn't RTFA of course but the smart way to do this is to start with video of someone actually looking at the person on the screen rather than the camera. That way camera sees an off angle but "correct" picture. that picture is then rotated so the remote video looks "right".
Re: (Score:2)
http://www.youtube.com/watch?v=7QrnwoO1-8A&list=TLtms-Tz7YPQk [youtube.com]
Given this demo from two years ago using a single hacked Kinect I have to believe that the technology is only going to improve. As long as the camera isn't occluded the 3D point data can be used to map sections of the 2D image onto a mesh created from the 3D point cloud. Then the camera can be virtually re-positioned and the scene rendered. Most of this is pretty easy using commodity hardware rendering engines.
Re: (Score:2)
I had to look it up, so it wasn't well-known to me, not being a specialist in human aesthetics and all like you, apparently.
Re: (Score:2)
Yes, I noticed that too. I guess they're exaggerating the problem to make their solution look better?
300 million users (Score:2)
That isn't eye contact (Score:2)
Altering the image doesn't provide eye contact. Eye contact is a palpable connection between two people, not just me staring into the eyes of an image. Unless it communicates the "connection" (for lack of a better word) created when you actually look someone in the eye, it's just a gimmick.
Re: (Score:2)
I use Skype all the time, and even pay for SkypeOut in spite of the money now going to one of my least favourite corporations on the planet.
That being said, this whole "eye contact" business sounds like a solution in search of a problem, brought on by someone's petty obsession with something that we other 600 million users don't seem to be bothered by.
Re: (Score:2)
Exactly. People who use video to talk regularly (like me) simply don't care. Like I said, a gimmick.
Re: (Score:2)
The Kinect does not use stereoscopy. It projects a IR laser grid (well, randomized) and then uses a single monochrome IR camera to see the grid and calculates depth from that. There are two cameras in the Kinect, an RGB camera and a monochrome IR camera, but only one is used for depth.
Looking someone straight in the eye (Score:1)
Re:Looking someone straight in the eye: eye roll (Score:3)
Re: (Score:2)
Tiny Embedded Cameras (Score:2)
Re: (Score:1)
Look into the camera (Score:2)
Paste a photo of tits next to the lens.
Which is false reality.. (Score:5, Interesting)
Most people do not make Eye contact when talking, people look at the other persons mouth mostly aiming the eyes at the center of the face. direct eye contact is seen as agressive even in the human species.
Re: (Score:2)
Only antisocial people are afraid of eye contact. It's normal for non-nerds to look eachother in the eyes, especially if they're friends. If they're enemies then yeah, eye contact is intimidating but not as intimidating as looking at the club you're going to beat them with. See wikipedia for more information: http://en.wikipedia.org/wiki/Eye_contact [wikipedia.org]
Re: (Score:2)
I suspect that watching the mouth move improves the comprehension of speech, even if you can't lip read.
Re: (Score:2)
The mouth and nose area are also important indicators of (micro)emotion ( http://www.apa.org/science/about/psa/2011/05/facial-expressions.aspx [apa.org] ), which could explain why many people (and women especially, I've noticed) regularly glance at that area when they are talking themselves. I believe it is to gauge the emotional reaction of the conversation partner to what they are saying.
See also:
http://theconversation.com/face-value-where-to-look-when-you-want-to-read-someone-11219 [theconversation.com]
Link to paper and video (Score:3)
It's a 2012 siggraph (Asia) paper. Here's the link with the video.
http://graphics.ethz.ch/publications/papers/paperKus12.php [graphics.ethz.ch]
Related: gaze-tracking hot at 2013 SIGGRAPH (Score:2)
why this technical overkill? (Score:2)
a few years back, i have seen a demo where they used 2 cameras at the sides of the screen, made some interpolation vodoo and voila, you could look at the screen AND have eye contact. Worked like a charm. I always wondered why nobody included this in their notebooks, as it also worked "one-sided" where the user on the other side did not have this setup.
Did anyone read the article? (Score:1)
The tech shifts the angle of the person, not just the eyes.
So, eye roll at will.
I have eyes! (Score:2)
Can it be set to give me a better view of women's cleavage while still making me look like I am making eye contact?
Re: (Score:3, Insightful)
Calling Obama "the left" is a joke.
Signed,
a Canadian.
Re: (Score:2)
What is funnier is the moron thinks that GW bush was a peace loving rights fighting for president. The REpubs here have short term memory problems as they forget that that scumbag president was the single most unamerican president ever. He signed the PATRIOT act.
Re: (Score:2)
Wah,... Republican doesnt want to admit his blessed leader is the scumbag that started it all... wah....