Once a week.
Subscribe to our weekly newsletter.
'Deep Nostalgia' AI brings old photos to life through animation
Using machine-learning technology, the genealogy company My Heritage enables users to animate static images of their relatives.
- Deep Nostalgia uses machine learning to animate static images.
- The AI can animate images by "looking" at a single facial image, and the animations include movements such as blinking, smiling and head tilting.
- As deepfake technology becomes increasingly sophisticated, some are concerned about how bad actors might abuse the technology to manipulate the pubic.
A new service gives new life to the past by using artificial intelligence to convert static images into moving videos.
Called Deep Nostalgia, the service creates animations by using deep learning to analyze a single facial photo. Then, the system animates the facial image through a "driver" — a pre-determined sequence of movements and gestures, like blinking, smiling and head-turning. The process is completely automated, and the service enhances the images to make the animations run more smoothly.
Launched in February by the Israeli genealogy company My Heritage, some of Deep Nostalgia's early results are impressive.
My Heritage/Deep Nostalgia
But that's not to say the animations are perfect. As with most deep-fake technology, there's still an uncanny air to the images, with some of the facial movements appearing slightly unnatural. What's more, Deep Nostalgia is only able to create deepfakes of one person's face from the neck up, so you couldn't use it to animate group photos, or photos of people doing any sort of physical activity.
My Heritage/Deep Nostalgia
But for a free deep-fake service, Deep Nostalgia is pretty impressive, especially considering you can use it to create deepfakes of any face, human or not.
I just ran the @Warcraft cover through the Deep Nostalgia Tool, and this happened... https://t.co/1eD3bb7fAN— Solitaire #The06 (@Solitaire #The06)1614590060.0
Generated with MyHeritage. #DeepNostalgia https://t.co/gNX3wLHsS8— Andrey Frolov (@Andrey Frolov)1614413388.0
So, is creating deepfakes of long-dead people a bit creepy? Some people seem to think so.
"Some people love the feature with Deep Nostalgia ™ and consider it magical while others think it is scary and dislike it," My Heritage wrote on its website. "In fact, the results can be controversial and it is difficult to be indifferent to this technology. We invite you to create movies using this feature and share them on social media to see what your friends and relatives think. This feature is intended for nostalgic use, that is, to give life back to beloved ancestors."
Deep Nostalgia isn't the first project to create deepfakes from single images. In 2019, researchers working at the Samsung AI Center in Moscow published a paper describing how machine-learning techniques can produce deepfakes after "looking" at only one or a few images. Using a framework known as a generative adversarial network, the researchers trained a pair of computer models to compete with each other to create convincing deepfakes.
While the results from the Samsung researchers were impressive, the Deep Nostalgia project shows how deepfake technology is advancing at a rapid pace. As these tools have become increasingly sophisticated, media experts have raised concerns about how bad actors might use deepfakes and "cheap fakes" to manipulate the public.
My Heritage seemed to sense Deep Nostalgia's potential for abuse, writing:
"Please use this feature on your own historical photos and not on photos of living people without their consent."
- Nvidia's 'deepfake' technology creates human faces from scratch ... ›
- Can deepfake technology actually benefit society? - Big Think ›
- Nvidia's 'deepfake' technology creates human faces from scratch ... ›
The idea of 'absolute time' is an illusion. Physics and subjective experience reveal why.
- Since Einstein posited his theory of general relativity, we've understood that gravity has the power to warp space and time.
- This "time dilation" effect occurs even at small levels.
- Outside of physics, we experience distortions in how we perceive time — sometimes to a startling extent.
Physics without time<p>In his book "The Order of Time," Italian theoretical physicist Carlo Rovelli suggests that our perception of time — our sense that time is forever flowing forward — could be a highly subjective projection. After all, when you look at reality on the smallest scale (using equations of quantum gravity, at least), time vanishes.</p><p style="margin-left: 20px;">"If I observe the microscopic state of things," writes Rovelli, "then the difference between past and future vanishes … in the elementary grammar of things, there is no distinction between 'cause' and 'effect.'"</p><p>So, why do we perceive time as flowing <em>forward</em>? Rovelli notes that, although time disappears on extremely small scales, we still obviously perceive events occur sequentially in reality. In other words, we observe entropy: Order changing into disorder; an egg cracking and getting scrambled.</p><p>Rovelli says key aspects of time are described by the second law of thermodynamics, which states that heat always passes from hot to cold. This is a one-way street. For example, an ice cube melts into a hot cup of tea, never the reverse. Rovelli suggests a similar phenomenon might explain why we're only able to perceive the past and not the future.</p><p style="margin-left: 20px;">"Any time the future is definitely distinguishable from the past, there is something like heat involved," Rovelli wrote for the <a href="https://www.ft.com/content/ce6ef7b8-429a-11e8-93cf-67ac3a6482fd" target="_blank"><em>Financial Times</em></a>. "Thermodynamics traces the direction of time to something called the 'low entropy of the past', a still mysterious phenomenon on which discussions rage."</p>
The strange subjectivity of time<p>Time moves differently atop a mountain than it does on a beach. But you don't need to travel any distance at all to experience strange distortions in your perception of time. In moments of life-or-death fear, for example, your brain would release large amounts of adrenaline, which would speed up your internal clock, causing you to perceive the outside world as moving slowly.<br></p><p>Another common distortion occurs when we focus our attention in particular ways.</p><p style="margin-left: 20px;">"If you're thinking about how time is <em>currently</em> passing by, the biggest factor influencing your time perception is attention," Aaron Sackett, associate professor of marketing at the University of St. Thomas, told <em><a href="https://gizmodo.com/why-does-time-slow-down-and-speed-up-1840133782" target="_blank">Gizmodo</a></em>.<em> "</em>The more attention you give to the passage of time, the slower it tends to go. As you become distracted from time's passing—perhaps by something interesting happening nearby, or a good daydreaming session—you're more likely to lose track of time, giving you the feeling that it's slipping by more quickly than before. "Time flies when you're having fun," they say, but really, it's more like "time flies when you're thinking about other things." That's why time will also often fly by when you're definitely <em>not</em> having fun—like when you're having a heated argument or are terrified about an upcoming presentation."</p><p>One of the most mysterious ways people experience time-perception distortions is through psychedelic drugs. In an interview with <a href="https://www.theguardian.com/books/2018/apr/14/carlo-rovelli-exploding-commonsense-notions-order-of-time-interview" target="_blank"><em>The Guardian</em></a>, Rovelli described a time he experimented with LSD.</p><p style="margin-left: 20px;">"It was an extraordinarily strong experience that touched me also intellectually," he said. "Among the strange phenomena was the sense of time stopping. Things were happening in my mind but the clock was not going ahead; the flow of time was not passing any more. It was a total subversion of the structure of reality."<br></p><p>It seems few scientists or philosophers believe time is completely an illusion.</p><p style="margin-left: 20px;">"What we call <em>time</em> is a rich, stratified concept; it has many layers," Rovelli told <em><a href="https://physicstoday.scitation.org/do/10.1063/PT.6.4.20190219a/full/" target="_blank">Physics Today</a>.</em> "Some of time's layers apply only at limited scales within limited domains. This does not make them illusions."</p>What <em>is</em> an illusion is the idea that time flows at an absolute rate. The river of time might be flowing forever forward, but it moves at different speeds, between people, and even within your own mind.
The world's 10 most affected countries are spending up to 59% of their GDP on the effects of violence.
- Conflict and violence cost the world more than $14 trillion a year.
- That's the equivalent of $5 a day for every person on the planet.
- Research shows that peace brings prosperity, lower inflation and more jobs.
- Just a 2% reduction in conflict would free up as much money as the global aid budget.
- Report urges governments to improve peacefulness, especially amid COVID-19.
The lush biodiversity of South America's rainforests is rooted in one of the most cataclysmic events that ever struck Earth.
- One especially mysterious thing about the asteroid impact, which killed the dinosaurs, is how it transformed Earth's tropical rainforests.
- A recent study analyzed ancient fossils collected in modern-day Colombia to determine how tropical rainforests changed after the bolide impact.
- The results highlight how nature is able to recover from cataclysmic events, though it may take millions of years.