A.I. can now create fake videos of people from a single picture
Researchers advance machine learning to create videos of people from single stills and paintings.
- Samsung researchers improve AI modeling to quickly create realistic (but fake) videos.
- The model uses "single-shot learning" to create videos from a single picture.
- The application of the tech could be in telepresence, video conferencing and gaming.
An AI can now take a single picture of a person's face and animate it convincingly. This can lead to animating paintings and photos but also add to the mistrust of images and deepfakes online.
The new method from researchers at the Samsung AI Center in Moscow incorporates facial landmarks from a source face into the facial data from the target face to animate it. The target face will do anything done by the source face, which can be any talking head.
What is different here from previous technology that has been developed to achieve this is the fact that rather than needing a lot of data (like video) to analyze, this approach called "single-shot learning" needs just one image of a person's face. The video that is generated from that can show the face making a range of expressions and speaking with reasonable credibility.
The animation of the "Mona Lisa" using source videos.
The new tech front loads the process of facial landmark recognition with a large amount of data from a bank of talking head videos. It then trains the model to be very efficient in connecting parts of the target face with the source.
The new AI also uses the Generative Adversarial Network, having two models compete against each other in creating a more "real" result.
Here’s how adversarial learning works:
Where can you use this technology, other than contributing to the epidemic of fake news that is sure to eventually affect personal relationships as much as the national conversations? "Such ability has practical applications for telepresence, including videoconferencing and multi-player games, as well as [the] special effects industry," Samsung said.
You can read the paper from the Samsung AI Center here.
- Top 6 fears about future technology - Big Think ›
- Nvidia's 'deepfake' technology creates human faces from scratch ... ›
Who is to blame for the U.S.'s dismal college graduation rate? "Radical" educator Dennis Littky has a hunch.
- COVID-19 has magnified the challenges that underserved communities face with regard to higher education, such as widening social inequality and sky-high tuition.
- At College Unbound, where I am president, we get to know students individually to understand what motivates them, so they can build a curriculum based on goals they want to achieve.
- My teaching mantra: Everything is permitted during COVID-19. Everything is permitted during COVID-19. Everything is permitted during COVID-19.
Meteorologists propose a stunning new explanation for the mysterious events in the Bermuda Triangle.
One of life's great mysteries, the Bermuda Triangle might have finally found an explanation. This strange region, that lies in the North Atlantic Ocean between Bermuda, Miami and San Juan, Puerto Rico, has been the presumed cause of dozens and dozens of mind-boggling disappearances of ships and planes.
Did you know that shifting to a positive perspective on aging can add 7.5 years to your life? Or that there is a provable U-curve of happiness that shows people get happier after age 50?
Sweden tops the ranking for the third year in a row.
What does COVID-19 mean for the energy transition? While lockdowns have caused a temporary fall in CO2 emissions, the pandemic risks derailing recent progress in addressing the world's energy challenges.