Dream Machine, Luma Labs’ artificial intelligence, allowed an Internet user to animate paintings by great masters.
Paintings that come to life. The Girl with the Pearl Earring (Vermeer) who bursts out laughing, Napoleon who rushes on his white horse or the Forum Square which comes alive in Van Gogh’s painting. No, it’s not a new opus of the Night at the museumbut with a simple video posted on social networks.
In the short one minute production shared onthis Sunday, November 24, we can see around ten works, such as Café terrace in the evening (Van Gogh), the Desperate (Courbet) the man on the balcony (Caillebotte) or Bonaparte crossing the Great Saint-Bernard (Jacques-Louis David) come alive.
Dream Machine, concurrent de Sora?
The video, viewed 21,000 times, was made using Dream Machine, an artificial intelligence (AI) created by the Californian company Luma Labs. This tool, capable of generating ultra-realistic videos from “prompt”, that is to say a written instruction, is quite similar to Sorathe video generator designed by OpenAI.
Accessible for free to all, this AI is capable of “producing high-quality realistic and fantastic videos from textual instructions and images”, indicated the company upon its launch last June in a blog post. She was trained on videos to “generate physically accurate, coherent and action-packed scenes”.
Despite its capabilities, Dream Machine is still far from perfect. The tool has some limitations. If most of the animated characters in the paintings are quite realistic and make natural movements, the animation of the woman with the parasol by Claude Monet is quite blurry and the movements of the Gardeners of Caillebotte are jerky.
This is not the first time that an AI has been talked about on social networks. Last July, Kling AI, a tool developed by Kuaiying, a Chinese company specializing in video, managed to animate photos of stars with their younger doubles.
