Ask Slashdot: Will Future TVs Be Able To DeepFake Actor Faces In Realtime? 65
dryriver writes: We've all seen the DeepFake videos on Youtube, where a different actor's face from the original is digitally inserted into a film scene. Some of these DeepFakes are actually quite convincing. DeepFakes are currently computationally intensive, but may one day happen in realtime on hardware custom made to accelerate the process. Now to the question: Will this "digital face swapping" be a realtime feature in future TVs some day? Will people be able to say to their TV "I don't like this actor/actress. Replace him/her with _actorname_ please"? Or watch a 100 Million Dollar movie with their own face on an actor's body, essentially making the TV owner the star of the movie playing? Will this perhaps become so normal some day that people in the future look back at our era and say "In those days, you couldn't choose which actors to watch any given piece of content with. Technology wasn't as advanced as it is today back then."?
No (Score:1)
Re: (Score:2)
Why?
Re: (Score:2)
Because Netflix, Amazon Prime, or Hulu will do it for you. Maybe even Disney (they probably already own every likeness of anyone in their movies).
Re: (Score:2)
Because right now it takes weeks of GPU time to train the machine to merge the faces. You need thousands to tens of thousands of images of both faces, at all sorts of angles and lighting with all of the facial expressions, mouth movements, eyebrows moving, etc.
Even if our processing power increases a thousandfold, just having a large enough of a training set is a problem. It's not something that you tend to have for anyone who's not really famous with hundreds of hours of time on camera.
While it might be po
Re: (Score:2)
Maybe in future they will film the show with tracking dots on the actors' faces so that it's easier to swap in pre-prepared face textures.
I'd like to see some shows come back with new actors replacing the old ones. Wouldn't even have to do a deepfake. Star Trek Continues is a great example of how that can work.
Re: (Score:3)
I wouldn't call it stupid.
I can see it as a great way to increase TV resolution without increasing broadcast bandwidth.
With 4k-8k, 16k displays the screen resolutions are going up exponentially. while broadcast bandwidth is more linear. Having a CPU real-time render images in these high resolutions could use less bandwidth than current compressed video can.
The reason why we were able to have 4k displays currently is due to video compression algorithms because we will a gigabit connection to get the display
Re: (Score:2)
Because that's stupid.
Not so fast!
Think of the Pr0n possibilities alone!
Re: (Score:2)
"Perhaps we could replace Bill Cosby as well so I could enjoy the Cosby show reruns again?"
Replace with whom?
Tracy Morgan?
Chris Rock?
Eddie Murphy?
Re: (Score:3)
Harvey Weinstein? Jeffery Epstein?
Re: (Score:2)
We have had other actors who were horrible people too where the public didn't boycott their shows.
I expect it is because of Cosby was set to a high standard (too high) to meet our expectations. Cosby, Catholic Church, Boy Scouts... Things that we suppose to feel inspired as a higher set of standards to be shown had a dark side which they spent a lot of time hiding.
Keep the actors' faces . . . (Score:2)
. . . but replace their bodies with Hentai figures.
This action might even save the doomed "Cats" movie.
And I might even finally watch some Disney flicks if I could do this.
As they are, I find them too sugary-sweet gooey-cutesy. Disney should go back to their roots, and cruelly kill Bambi's mother and other lovable stars in the film.
Re: (Score:2)
. . . but replace their bodies with Hentai figures.
This action might even save the doomed "Cats" movie.
And I might even finally watch some Disney flicks if I could do this.
As they are, I find them too sugary-sweet gooey-cutesy. Disney should go back to their roots, and cruelly kill Bambi's mother and other lovable stars in the film.
There are those who would say that "Cats" the movie already has actor's faces on Hentai bodies.
Re: (Score:3)
Hey, why is there a tentacle sliding up behind Taylor Swift? Whats going on .. OH MY GOD!!
Re: (Score:3)
There's more to it than that (Score:2)
Maybe for the redneck double-wide crowd, who are goin' "hey Martha, come see Taylor Swift's face on that-there girl from Fifty Shades of Grey." It seems to me that anyone with an appreciation of film would be dissatisfied by such deepfakes. The face may be someone else but the body still is not. The actor will still look and move and have the mannerisms consistent with the original actor, not the face rivited on.
Re: (Score:2)
Maybe for the redneck double-wide crowd, who are goin' "hey Martha, come see Taylor Swift's face on that-there girl from Fifty Shades of Grey." It seems to me that anyone with an appreciation of film would be dissatisfied by such deepfakes. The face may be someone else but the body still is not. The actor will still look and move and have the mannerisms consistent with the original actor, not the face rivited on.
Agreed. And there are actually awards for mastery of the acting craft - the Oscars for best/supporting actor and actress key among them. If you put another face on, say, Francis McDormand in 3 Billboards, it's just not going to be the same. Nor if you were to replace Woody Harrelson in that same flick for that matter.
In movies where casting doesn't matter, sure have at it. In other movies casting is everything and AI is not going to replicate that depth of emotion anytime soon.
You're not thinking broadly enough (Score:2)
Technology like this will allow anyone to play a part in a movie, then you just plaster a synthetic face over them. The copyright and trademark on the synth face will be owned by the movie studio [engadget.com], allowing them to own and control the fame generated for starring in a successful movie. Actors will be paid according to their acting ability, but because their real face is never seen and there are a lot more good ac
Re: (Score:2)
What's one of the biggest expenses in a blockbuster film? Paying multi-million dollar actors.
Just wait till the AI wants to unionize :-)
Seriously, while the OP's question deals with real time processing in the TV, we don't really need to wait for TVs to have the processing power for this. The state of CGI is pretty close that we could probably replace all the actors in TV and movies with convincing fakes now. Maybe we could do the same with music too.......
Hopefully I will be gone by the time virtual entertainers dominate all humanity's artistic endeavors.
Re: (Score:2)
Just wait till the AI wants to unionize :-)
AI will probably require some kind of electrochemistry for the foreseeable future, so that would be a bad idea.
Re: (Score:2)
SAG wouldn't allow Hollywood studios to do what you're suggesting so it's a non-starter.
Re: (Score:2)
It seems to me that anyone with an appreciation of film would be dissatisfied by such deepfakes.
Trust me, you don't know this audience. Their "appreciation of film" revolves how bouncy the tits are, and that's about as far as it goes. They'd pay for this.
Wanna put your hot, barely-legal neighbor in your favorite skin flick? Maybe a co-worker? Your kid's teacher?
Believe me, there are plenty of people who would pay for this kind of thing.
Re: (Score:2)
It seems to me that anyone with an appreciation of film would be dissatisfied by such deepfakes.
Trust me, you don't know this audience. Their "appreciation of film" revolves how bouncy the tits are, and that's about as far as it goes. They'd pay for this.
Wanna put your hot, barely-legal neighbor in your favorite skin flick? Maybe a co-worker? Your kid's teacher?
Believe me, there are plenty of people who would pay for this kind of thing.
I see the pr0n possibilities. And of course, new technology is driven by pr0n.
I weep for my fellow humans.
Re: (Score:2)
>> Maybe for the redneck double-wide crowd
Wow! You're some kind of racist aren't you? Nazi!
Obviously they will (Score:2)
Re: Obviously they will (Score:2)
Re: (Score:2)
Maybe the whole image will be, some day.
That's Hollywood's Official Wet Dream: 100% synthesized actors who don't have to be paid, but who can be licensed forever. And the mix & match possibilities are endless. Let the crossovers begin!
Re: (Score:2)
Mr & Mrs Everywhere (Score:3)
From John Brunner's "Stand on Zanzibar" https://en.wikipedia.org/wiki/... [wikipedia.org] "Another is a kind of interactive television that shows the viewer as part of the program ("Mr. & Mrs. Everywhere")." The book was written in 1968, taking place in 2010. So looks like Brunner was off by a decade for this particular technology.
Re: (Score:2)
Loved that book. Still do.
A horrible gritty future that looks like it's coming to pass. :(
Re: (Score:2)
"Christ, what an imagination I've got!"
More importantly... (Score:2)
Will Future AIs Be Able To DeepFake Slashdot Articles In Realtime?
Re: (Score:2)
Will Future AIs Be Able To DeepFake Slashdot Articles In Realtime?
Already being done. I am curious if a sophisticated enough AI could one day be developed to catch Slashdot dupes. (I personally doubt it.)
??? of course (Score:2)
Unless humanity halts scientific advances and starts into a permanent descent or just wipes itself out, of course. How long it will take is the only question.
This one is probably not that far. It's a trivial advancement.
The real future I'd like to see is when AI can create a story that I'm guaranteed to enjoy based on its up to the moment knowledge of me and then creates and shows it to me in real-time making real-time adjustments per my reactions. That one is a certainty too. Just a matter of when.
Re: (Score:1)
No. (Score:1)
DeepFakes are currently computationally intensive, but may one day happen in realtime on hardware custom made to accelerate the process.
First, there is literally no incentive for any industry to develop this hardware.
Second, custom ICs are expensive. Additional functionality is being added to "smartTVs" only because it can all be done in software. No additional parts are added to enable what could be computationally intensive features.
Third, this is a really dumb question and you should be embarrassed to have wasted people's time on it.
How deep in the sand is your head? (Score:2)
You mean there is no reason for any industry, *not* to develop live lying aka marketig aka PR aka lobbyism aka TV experts aka politics aka $youNameIt [dilbert.com] technology?
Re: (Score:2)
First, there is literally no incentive for any industry to develop this hardware.
LOL, those are some famous last words if I ever heard 'em.
Replace "hardware" with practically anything and that's what you're living in today. Cars, planes, cell phones, Spotify, streaming services, video doorbells, microwave meals, FM radio, Pet Rocks, GrubHub, etc. etc. etc.
Someone will pay for it, and that's the only incentive any company needs to develop something. In this case, "build it and they will come" is almost a no-brainer.
Re: No. (Score:1)
Why buy an unreliable automobile with its noxious fuel when we have horses? Besides carriage makers and buggywhip makers aren't going to just give up their livelihood to make way for this so-called progress. Maybe these automobiles will have important niche uses, but anyone can plainly see they'll never become our main form of transport.
You can do it NOW if you can afford the crunchfarm (Score:2)
In addition to any intra-frame parallelization, this is completely parallelizable at the frame level if you don't need to make an adjustment to the movement. If you can afford the crunch and can accept a one-frame latency you could do it right now. That would work fine for movies an live feeds. (We have that now with the compression algorithms and things like satellite radio's two-copy several-second delayed retransmission, to cover short outages like going under overpasses and through other dead spots.)
Re: (Score:2)
... this is completely parallelizable at the frame level if you don't need to make an adjustment to the movement.
Or otherwise look ahead to avoid some visible mistake.
Live already isn't live. (Score:2)
There is always a 10-15 minute delay, "for security reasons" (aka covering yo ass). So for this very purpose.
The question is, what you've got ready to fix things in those 10-15 minutes.
Probably if you do it in hardware. (Score:2)
Semi-custom chips where you just throw the weights for your face in, could do it in whatever the length of the wires is the signal has to travel through. Given a modern fab, that is anywhere between nothing and no time at all. ;)
Yes (Score:2)
People will be able to put their own face on popular movie actor.
Re: (Score:2)
Sex with your spouse - only you both have headsets that replace each others faces and bodies with the celebrity of your respective choices in real time.
I think I should start working on the venture capital pitch.
They aren't already? (Score:2)
Why then, do they all look and act so fake and plastic?
Surely, you are not suggesting there are real people like that out there! ... ;)
The Future is close (Score:1)
In the future, a TV programme will just be a series of instructions that the Player reproduces. That way the makers can simply update it whenever they wish. Every day items in the programme can be sponsored and swapped with impunity, lines of scripts can be updated so it remains current. It'll never get old.
Huge chunks of old programmes, thousands of hours, will be re-created as nostalgia
At first, these facilities will be done by the Producers in-house and watched by the Masses as we currently do today. But
Re: (Score:2)
"In the future, a TV programme will just be a series of instructions that the Player reproduces."
Multiple Identity Drag-In Instructions (MIDI)
Re: (Score:1)
Yes (Score:3)
Yes, because $$$$$$
WTF? (Score:2)
I just want POTV (Plain Old TV). Basically a monitor with HDMI inputs and a tuner for OTA broadcast. I'll add what else I want externally.
In films, though, the main thing is the play of ac (Score:1)
Video Games will do this... (Score:2)
the real question (Score:2)
is whether, in the future, robots will be able to abduct (rescue) people and deprogram them from the cult of celebrity worship. Teach the rescuees how to not give a shit what clothes some manufactured idol is wearing, who they're fucking, what stupid crap they do or say, what products they endorse, or anything else about them.
1981 movie 'Looker' (Score:2)
Models are getting plastic surgery, computer scanned, and then killed. This way their likenesses can be used in perpetuity without paying them. It's interesting that the concept is now almost a reality.
The movie really isn't that good and has two major plot holes...
1) The models are computer scanned and then told what features they need to have a plastic surgeon change. After the surgery they are then rescanned. Why can't the computer just make the millimeter changes on it's own?
2) They have computer genera
No (Score:2)
The problem is not well-defined. Plain texture swaps are well defined but geometric distortions are not. For example imagine a couple kissing, if you swap them for shorter/taller actors either the lips are off, the character models is distorted or the kiss needs to be fully re-imagined. If you look at deepfake videos they generally avoid any kind of interaction, it's just talking heads.
Not if DRM has anything to say about it (Score:2)
No. Not your TV. DRM won't allow it. But maybe on your PC someday.
Deepfake is too nice a word for this find another. (Score:2)
It's called the Boob Tube for a reason (Score:2)
Because it's passive entertainment. How many people actually use things they can use TODAY, like different aspect ratios or alternative angles on DVD/Blu-ray? TV is a mindless couch-surfing exercise, while making editorial decisions is hard work. Even if the technology existed most consumers wouldn't use it after playing with it once or twice, just as putting mustaches on your co-workers during a video conference call gets old fast. The vast majority of viewers (and others viewing the same screen--like the
Why put it in the TV? (Score:2)
it's just the face (Score:1)
there is supposedly more to acting than good looks.
Didn't we already see this ... (Score:2)
Christmas deepfake wish (Score:1)
Please change this movie to be something interesting.