Programmer's Real-Time Deepfake Lets Him Impersonate Elon Musk on Zoom (vice.com) 39
Motherboard reports on a new open source program "that superimposes someone else's face onto yours in real-time, during video meetings."
Programmer Ali Aliev used the open-source code from the "First Order Motion Model for Image Animation," published on the arxiv preprint server earlier this year [and developed by researchers at the University of Trento in Italy as well as Snap]... With other face-swap technologies, like deepfakes, the algorithm is trained on the face you want to swap, usually requiring several images of the person's face you're trying to animate. This model can do it in real-time, by training the algorithm on similar categories of the target (like faces)...
Aliev made a video of himself as Elon Musk, pretending to join the wrong meeting, to demonstrate the tech. It's pretty clear that it's a fake, but the eyes and head move around well enough that it'd be a neat trick for a few seconds, before the rest of the call looks any closer.
He's released his program on GitHub, naming it "Avatarify". But Motherboard warns it requires "a bit of programming knowledge" plus a powerful gaming PC.
"You have to run Zoom or Skype, as well as streaming software and Avatarify at the same time, which takes a decent amount of computing power."
Aliev made a video of himself as Elon Musk, pretending to join the wrong meeting, to demonstrate the tech. It's pretty clear that it's a fake, but the eyes and head move around well enough that it'd be a neat trick for a few seconds, before the rest of the call looks any closer.
He's released his program on GitHub, naming it "Avatarify". But Motherboard warns it requires "a bit of programming knowledge" plus a powerful gaming PC.
"You have to run Zoom or Skype, as well as streaming software and Avatarify at the same time, which takes a decent amount of computing power."
Re: (Score:3)
Re: (Score:2)
Why not both?
Re: (Score:1)
I haven't seen a Snapchat filter that let's you swap selected faces and make movies. Although swapping genders and age is pretty amazing such that it seems a small leap to swapping faces.
Re: (Score:1)
I remember MSQRD app on iPhones could do this back in the day lol..
Re: (Score:1)
No, I guessed I missed that one. Those silly icons don't use English and I don't do enough e-socializing to pick up tips from others.
Re: (Score:2)
Snapchat filters basically track the location of your face. And apply a 3d model and have it stay in relative position. Some of the more advanced ones may put basic movement if you move your mouth.
However, a really good deep fake would require changing all your muscles and gestures to match the other person. Some people will show more or fewer teeth when they smile. Some people's eyes open wider or narrower than others. The skin may move differently due to age, and fat content. There is just a lot of da
Re: (Score:2)
We already have celebrity lookalikes. TBH I'm surprised that there are ones doing porn, with their faces marked up with dots to assist with the fakery.
Re:Uncanny (Score:4, Interesting)
Thing is, if you have a crap Internet Connection, you can see such low quality and artifacting all the time. Also, in larger meetings where there are 10+ faces of people streaming their webcam to the screen at the same time, each participant will occupy a tiny part of the screen, further blurring the difference.
Re: (Score:2)
You can already see this at work with deepfake videos. They just recompress them a few times so they look like a typical social media post that has been made on a phone pointed at a TV, converted to MOV, posted on Twitter, converted to GIF, reposted on Facebook, converted to AVI and copied by pointing another phone at the screen.
Any flaws in the fake are masked by the flaws in the video.
Re: (Score:2)
Re: (Score:2)
I think Running Man did it even before that.
Only missing Speech-to-Speech (Score:2)
All that is missing now is a way to take in a voice sequence and use the intonation from that as a cue for the neural net model when it generates the output voice in real time. Everyone is focused on Text-to-Speech stuff right now, but this Speech-to-Speech converter is probably easily doable right now. Expect to see this in like a year.
Re: (Score:2)
They've already made that but it only managed to change the tone/slur of the speech, not the manner of speaking. So it sounds like Obama doing a Trump impersonation or Trump doing an Obama impersonation. But it's a moving target, not that long ago we were impressed by "simple" texture swaps like horse to zebra and back. Now we're starting to figure out morphing both style and structure [githubusercontent.com]. It's still a bit more party tricks than reliably usable, but hey... it's cool.
Guy on the Right (Score:1)
It Explains Everything (Score:2)
Re: (Score:2)
Plausible deniability?
Re: Porn Experts to Advise Insurance Fraud (Score:2)
Personal experience as in you created digital child pornography or you're a lawyer who argued a case about this?
Re: (Score:1)
Personal experience as in you created digital child pornography or you're a lawyer who argued a case about this?
~ t4eXanadu
Personal experience as expressed in the second paragraph, not the first.
The reply you make is within a discourse that may be captured and classified from public scrutiny, or it may not. If your reply was not made in good faith, or by an oath to uphold the Constitution as your superior directs your service, at some future date, I'll accept your apology on the condition you dance on the pinhead of what Godel supposedly warned YoYo Ma about when becoming a naturalized citizen...but you must dance interpretiv
Not fun.. (Score:2)
I don't see this as fun, impersonating as someone else isn't fun. You know this type of software will be used to create problems for the original persons that are impersonated. A good example will be frauding older people into thinking they are videocalling with their siblings and asking for money (if you already look around when people fall for whatsapp or sms based fraud, what do you think will happen if they actually see the face and think they are talking to their family).
But the problem is that it's ha
Re: Not fun.. (Score:2)
Or maybe the existence of such software creates plausible deniability.
Re: (Score:1)
Or maybe the existence of such software creates plausible deniability.
~Vakuona
The poster to whom you're responding never interpreted the Violent Femmes' Big Hands.
Carry out your long division to what effected a British agent's confidence to conclude a pee-tape was actual, or what threats Epstein made? Or the rationalization to disappear him from custody with meager forensice evidence and testimony to sequester him in perpetuity through witness protection and make a deal with Ghislaine to identify his address book and personal writings? Epstein's access to world leaders is with a pr
What if... (Score:2)
...Elon him were to use it?
#beingElonMusk
Pre-photographic times (Score:1)
Not hard (Score:2)
Given that Musk already looks like bad CGI.
I'm helping by shrugging it off. (Score:2)