'Deep Nostalgia' AI brings old photos to life through animation

Using machine-learning technology, the genealogy company My Heritage enables users to animate static images of their relatives.

'Deep Nostalgia' AI brings old photos to life through animation
Deep Nostalgia/My Heritage
  • Deep Nostalgia uses machine learning to animate static images.
  • The AI can animate images by "looking" at a single facial image, and the animations include movements such as blinking, smiling and head tilting.
  • As deepfake technology becomes increasingly sophisticated, some are concerned about how bad actors might abuse the technology to manipulate the pubic.

A new service gives new life to the past by using artificial intelligence to convert static images into moving videos.

Called Deep Nostalgia, the service creates animations by using deep learning to analyze a single facial photo. Then, the system animates the facial image through a "driver" — a pre-determined sequence of movements and gestures, like blinking, smiling and head-turning. The process is completely automated, and the service enhances the images to make the animations run more smoothly.

Launched in February by the Israeli genealogy company My Heritage, some of Deep Nostalgia's early results are impressive.

My Heritage/Deep Nostalgia

But that's not to say the animations are perfect. As with most deep-fake technology, there's still an uncanny air to the images, with some of the facial movements appearing slightly unnatural. What's more, Deep Nostalgia is only able to create deepfakes of one person's face from the neck up, so you couldn't use it to animate group photos, or photos of people doing any sort of physical activity.

My Heritage/Deep Nostalgia

But for a free deep-fake service, Deep Nostalgia is pretty impressive, especially considering you can use it to create deepfakes of any face, human or not.

So, is creating deepfakes of long-dead people a bit creepy? Some people seem to think so.

"Some people love the feature with Deep Nostalgia ™ and consider it magical while others think it is scary and dislike it," My Heritage wrote on its website. "In fact, the results can be controversial and it is difficult to be indifferent to this technology. We invite you to create movies using this feature and share them on social media to see what your friends and relatives think. This feature is intended for nostalgic use, that is, to give life back to beloved ancestors."

Deep Nostalgia isn't the first project to create deepfakes from single images. In 2019, researchers working at the Samsung AI Center in Moscow published a paper describing how machine-learning techniques can produce deepfakes after "looking" at only one or a few images. Using a framework known as a generative adversarial network, the researchers trained a pair of computer models to compete with each other to create convincing deepfakes.

While the results from the Samsung researchers were impressive, the Deep Nostalgia project shows how deepfake technology is advancing at a rapid pace. As these tools have become increasingly sophisticated, media experts have raised concerns about how bad actors might use deepfakes and "cheap fakes" to manipulate the public.

My Heritage seemed to sense Deep Nostalgia's potential for abuse, writing:

"Please use this feature on your own historical photos and not on photos of living people without their consent."

‘Time is elastic’: Why time passes faster atop a mountain than at sea level

The idea of 'absolute time' is an illusion. Physics and subjective experience reveal why.

ESA
Surprising Science
  • Since Einstein posited his theory of general relativity, we've understood that gravity has the power to warp space and time.
  • This "time dilation" effect occurs even at small levels.
  • Outside of physics, we experience distortions in how we perceive time — sometimes to a startling extent.
Keep reading Show less

The cost of world peace? It's much less than the price of war

The world's 10 most affected countries are spending up to 59% of their GDP on the effects of violence.

Mario Tama/Getty Images
Politics & Current Affairs
  • Conflict and violence cost the world more than $14 trillion a year.
  • That's the equivalent of $5 a day for every person on the planet.
  • Research shows that peace brings prosperity, lower inflation and more jobs.
  • Just a 2% reduction in conflict would free up as much money as the global aid budget.
  • Report urges governments to improve peacefulness, especially amid COVID-19.
Keep reading Show less

The evolution of modern rainforests began with the dinosaur-killing asteroid

The lush biodiversity of South America's rainforests is rooted in one of the most cataclysmic events that ever struck Earth.

Velociraptor Dinosaur in the Rainforest

meen_na via Adobe Stock
Surprising Science
  • One especially mysterious thing about the asteroid impact, which killed the dinosaurs, is how it transformed Earth's tropical rainforests.
  • A recent study analyzed ancient fossils collected in modern-day Colombia to determine how tropical rainforests changed after the bolide impact.
  • The results highlight how nature is able to recover from cataclysmic events, though it may take millions of years.
Keep reading Show less
Quantcast