Stories
Slash Boxes
Comments
Search

News for nerds, stuff that matters

Slashdot Log In

Log In

Create Account  |  Retrieve Password

Software To Evaluate Facial Expressions Developed

Posted by Zonk on Thu Oct 25, 2007 12:54 PM
from the somebody's-watching-me dept.
Software Science
The Technology Review site has up an article on new software that can do quantitative analysis of facial expressions, detecting whether a person is smiling. The software was developed by the Omron Corporation, and can also estimate a subject's age and gender, or verify a person's identity from a database. Though the company doesn't yet know whether it plans to release the software commercially, there are a number of obvious applications. "Omron envisions the smile software being used in marketing, perhaps to evaluate consumers' reactions to a new product or to an advertising campaign. A smile checker could also help train customer-service staff to meet Japan's legendarily high standards ... A smile in isolation is easy to detect, but the bigger challenge is to develop systems that can recognize the concerto of facial actions that make up complex expressions like confusion, fear, and disgust." Thanks to jamie for the link.
+ -
story
This discussion has been archived. No new comments can be posted.
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.

Software To Evaluate Facial Expressions Developed 50 Comments More /

 Full
 Abbreviated
 Hidden
More
Loading... please wait.
  • great now my sexbot will know how im feeling
  • Wow. I need to get my mind out of the gutter today.
  • Confusion I can understand, just get the human interacting with the system.

    Disgust as well, the system just needs to show goatse or something.

    Fear is the simplest, it just takes an automatic gun and 20 seconds.
  • How long till this product is in an airport near you figuring out if you are happy. If you are not you get corn holed with extra screening because you must be a terrorist. Perhaps this software will be used at the exit to a bar. If you are too happy or too sad, you are drunk. What if this software is used allover the place and it is saved. An employer could search you and find out if you are typically a sad or happy person and you then do not get the job because you are a sad person. Or could this be used f
    • You, good sir, are way too paranoid. Also, you have cameraphobia
      • Oh no. I am just trying to fit in on Slashdot. Normally I would have the opposite views. I don't give a crap who takes a picture of me picking my nose. I Just tend to get trolled so I figured I would try something new. :) So yeah I don't care if they know if I am smiling.
    • What if they even use PEOPLE to gather that information, omfg !
      • OMFG! But this is a camera on every street corner. Not a Cop. Man I thought Slashdot loved the "Your invading my privacy stuff". Guess I found the one person who does not care about their privacy.
    • How long till this product is in an airport near you figuring out if you are happy. If you are not you get corn holed with extra screening because you must be a terrorist.

      Is that a happy grin or an evil grin? Is that a real poncho or a Sears poncho? I doubt this software can tell (no, I din't RTFA ass eye yam knot knew hear)

      Perhaps this software will be used at the exit to a bar. If you are too happy or too sad, you are drunk.

      Neither the bar owners nor the bartenders care if you're drunk, and the policeman

    • How long till this product is in an airport near you figuring out if you are happy. If you are not you get corn holed with extra screening because you must be a terrorist.
      You must be new to airports. The only happy people in them are likely be terrorists. Those are ones you want to screen. Any normal person finds airports to be the singular most hellish places on Earth.
    • If they could read your mind, they would. In lieu of that, they'll always go for the next best thing.

  • Metaverse (Score:3, Insightful)

    by FiloEleven (602040) on Thursday October 25 2007, @01:04PM (#21116747)
    In a much overlooked section of Snow Crash, Neal Stephenson postulated that the real key to making the Metaverse a place where things happen and where people want to interact with each other was the inclusion of facial expressions. I tend to agree with him - look at how emoticons are used on the web today; we've had articles about their usage bleeding into corporate culture to help people understand the intended subtext of a message. A bunch of avatars walking around with a fixed look on their faces makes for a boring virtual world and more miscommunication than communication. Facial expression replication (which does not necessarily include recognition, but I think it'll help immensely) will be needed before virtual worlds really take off for society at large.

    • Re: (Score:2, Interesting)

      by esecasco (1160055)
      I have to agree...this tech could find very good usage in video games. In multi-player it could definitely add an element of interaction for all gestures. For example, if it can detect a facial expression, why not a head movement, so instead of a radio button to say "yes" you can just nod, and have your character do the same. Shake, tilt your head, etc, etc. Also, the element of expression could add a new level of interaction, in conjuction with voice communication. From someone screaming angrily with

  • But will it detect sarcasm? (Score:5, Funny)

    by starglider29a (719559) on Thursday October 25 2007, @01:06PM (#21116783)
    A sarcastic smile? A sardonic smile? A wistful smile? A retail smile? The masked lie? "Mmmm... this casserole taste great, hunny"

    Or the smile that Ballmer uses when describing Vista's security or sales milestones? The smile that Verizon execs wear when they promise "unlimited..."???
    • A sarcastic smile? A sardonic smile? A wistful smile? A retail smile? The masked lie? "Mmmm... this casserole taste great, hunny"

      She will not need to use a computer to detect that, fool ;-)
    • They can try electronic scratch n' sniff, teaching it how to recognize smell.

      As for the chairs, be sure to give them motility, so they can watch for a ballmer tirade. Then, they can run away from him.
  • How can this system be used outside of law enforcement?

    • How can this system be used outside of law enforcement?
      A terrificly modern answer to the old "mood ring" craze?

    • Re: (Score:3, Interesting)

      by Speare (84249)

      How can this system be used outside of law enforcement?

      Sony has already developed a camera with a simpler form of "smile detection." If engaged, the camera will scan the scene for all subjects to smile and then allow the shutter sequence to fire. Seems really gimmicky (useless in practice) to me, but a new tickbox on the carton equates to sales.

      Sony Smile-Detecting Camera [usatoday.com]

      • I'd rather have a camera that detected when all the eyes were focused on it. Getting everyone to smile might be a tremendous feat, but getting everyone to simply look at the camera isn't as bad, and probably more important.
        • Hell, I'd take it if it could detect whether my eyes are open or closed... I have an incredible ability to blink just as the picture's taken, even when it's in broad daylight and there's no flash.
    • It could provide social cues for the mildly autistic and victims of brain injury who are incapable of interpreting facial expression.

    • Re: (Score:2, Insightful)

      by Froboz23 (690392)
      <Paranoia>
      There is a particularly scary application for this type of software. Imagine surveillance cameras scanning a political rally. (Putin's new Russia comes to mind, but you can insert your own favorite government here as you please.) An advanced system could detect dissent by individuals' facial expressions during the rally, and deal with it appropriately. Sometimes facial expressions happen subconsciously. You have to focus to maintain a poker-face.
      </Paranoia>

      From a computer-science
      • Rally schmally. You protester types always forget there's life outside political activism. If you really want to get people interested, why not posit a scenario such as "you might get labeled a ter'ist sympathizer for displaying negative emotions in the presence of american national symbols". Favorite team unlikely to win? Better keep a straight face while they're playing the anthem, buddy!

  • Analyze This! (Score:5, Funny)

    by Sponge Bath (413667) on Thursday October 25 2007, @01:09PM (#21116829)

    :-)

    Expression analyzed: Terrorist Alert!
    • You're software is off. Please adjust it to recognize the following faces:

      :-) civilian
      @:-) terrorist

      Facial profiling. Hurrah!
  • ...evaluate consumers' reactions to a new product or to an advertising campaign
    All this time, I thought marketing people didn't give a damn WHAT our reactions were to their campaigns.
    Oh, wait, I get it - smiles mean 'FAIL'. They'll look for the concerto of facial actions that make up complex expressions like confusion, fear, and disgust.
  • They could test the software by letting it count the smiles in an audience as they watch marketing managers being put to death in various off-beat and creative ways. A dunk tank full of piranha, rolls of toilet paper in a parachute pack...that sort of thing.
  • Come on even humans have difficulty telling the emotional state of someone who got botoxed ... How can the software tell?
  • This software is useless against certain [ytmnd.com] subjects.. [ytmnd.com]
  • This is not new , they have already put software like this in use for kids who have light autism. Some of these kids look at the mouth when other people speak so they miss the facial expression which conveys more than the tone of voice.

    the software, which is not perfect, tries to get what the other person is feeling by facial expression and they even have a camera pointing at their own face to let them know how to understand facial expressions by studying themselves.

  • Looking at the mouth, or eyes? (Score:3, Funny)

    by jackpot777 (1159971) on Thursday October 25 2007, @01:33PM (#21117179)
    Plenty of people smile with their mouth, but their eyes tell how happy they aren't.

    Probably why Japanese emoticons [pep.ne.jp] reflect their emotions with the eyes instead of the mouth.

    (^_^)(^_^)

    The mouth isn't smiling, but the eyes say PAAARTY!

    • (^_^)(^_^)
      That's a pretty strange pair... I'd be a little shocked to see them like that in real life.

      Normally what I see is:

      (.)(.)

      or if I'm at the right website,

      ( o )( o )
    • Except in the real world, Japanese often do not make eye contact while in conversation. This is for various reasons and of course a generalization with no doubt many exceptions, but compared to Westerners, they do make less eye contact. So if you were trying to imply that Japanese emoticons are an extension of the people, I would disagree. But they definitely show off emotion better than Western emoticons. It'd be interesting to trace their origins, I'm guessing they're mostly from manga/anime where a f
  • Seriously, "Omron Corporation" sounds like something out of a bad video game. Now to figure out what kind of bad video game and what they (really) do.
  • I wonder if it can distinguish between middle of a sexual climax vs. being in pain.
  • For the money it is costing them to develop this software, they could just pay some guy to look at people's facial expressions and say what they are...
  • there was an article about the TSA using this a few months ago.

    how many innocent citizens will they harass that are simply pissed off that they have to wait in line?

    how many nervous travelers are they going to waste time on?

    This is really the job of a human.

    the TSA is the biggest farce in the last 30 years.
  • Wake me when it can tell me why the Mona Lisa [google.com] is smiling.

  • and can also estimate a subject's age...
    if(face.oneSideDroops())
    ___stroke=true;
    if(stroke)
    ___minAge=60;
    if( ! face.movementDetected())
    ___minAge=90;
    minAge += 32 - teeth.count();

    See? It ain't so tough.
  • This is just what we've needed since 1966 - a way for the non-directional therapist to see facial expressions.
    • This will recognize the facial expression of "smiling". As long as a smile has a meaning within a culture, it will be of use (provided it works, of course). It operates based on things like (from TFA)

      the hallmarks of a smile--such as narrowed eyes, an open mouth, creases around the mouth, and wrinkles turning downward around the eyes So, it may be that in some places it detects discomfort and embarrassment, whereas in others it detects happiness. But to the extent that we all open our mouths and get wrinkl

All trademarks and copyrights on this page are owned by their respective owners. Comments are owned by the Poster. The Rest © 1997-2009 Geeknet, Inc.