Researchers Train AI To Map a Person's Facial Movements To Any Target Headshot (venturebeat.com) 15
What if you could manipulate the facial features of a historical figure, a politician, or a CEO realistically and convincingly using nothing but a webcam and an illustrated or photographic still image? From a report: A tool called MarioNETte that was recently developed by researchers at Seoul-based Hyperconnect accomplishes this, thanks in part to cutting-edge machine learning techniques. The researchers claim it outperforms all baselines even where there's "significant" mismatch between the face to be manipulated and the person doing the manipulating. MarioNETte is technically a face reenactment tool, in that it aims to synthesize a reenacted face animated by the movement of a person (a "driver") while preserving the face's (target's) appearance. It's not a new idea, but previous approaches either (1) required a few minutes of training data and could only reenact predefined targets, or (2) would distort the target's features when dealing with large poses.
MarioNETte advances the state of the art by incorporating three novel components: an image attention block, a target feature alignment, and a landmark transformer. The attention block allows the model to attend to relevant positions of mapped physical features, while the target feature alignment mitigates artifacts, warping, and distortion. As for the landmark transformer bit, it adapts the geometry of the driver's poses to that of the target without the need for labeled data, in contrast to approaches that require human-annotated examples. The researchers trained and tested MarioNETte using VoxCeleb1 and CelebV, two open source corpora of celebrity photos and videos.
MarioNETte advances the state of the art by incorporating three novel components: an image attention block, a target feature alignment, and a landmark transformer. The attention block allows the model to attend to relevant positions of mapped physical features, while the target feature alignment mitigates artifacts, warping, and distortion. As for the landmark transformer bit, it adapts the geometry of the driver's poses to that of the target without the need for labeled data, in contrast to approaches that require human-annotated examples. The researchers trained and tested MarioNETte using VoxCeleb1 and CelebV, two open source corpora of celebrity photos and videos.
Missunderstood Target Headshot (Score:3)
Re: (Score:3)
Well you could use this to process data from a video scope so that you are always shooting someone with face of someone you don't like. ;)
Re: (Score:2)
404 ... (Score:2)
The page was already removed from the 1st link.
Slashdotting is no longer what it was ... we used to get 5xx errors and timeouts instead of 404s
Re: (Score:2)
YouTube link extracted from a github link on that site:
https://www.youtube.com/embed/... [youtube.com]
URL Typo (Score:2)
The "NET" part of the name is missing in TFS' URL.
The correct url is :
https://hyperconnect.github.io... [github.io]
Correct Github Link (Score:2)
For anyone interested:
https://github.com/hyperconnec... [github.com]
Re: (Score:2)
And to the actual github.io site:
https://hyperconnect.github.io... [github.io]
So, what does this mean? (Score:2)
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
This is OLD tech (Score:1)