The company behind one of the most popular image generation models you certainly know, Stable Diffusion, is taking it a step further. Instead of tackling images and producing incredible results, they are now onto the next challenge: movies.
More precisely, their new model called
The model is still a work in progress and has flaws, but still does a pretty cool style transfer from an image into a video, something that would’ve been impossible a few years or even months ago.
Even cooler, it also works with text. You can just say something like, “A dog with black spots on white fur.” And it will change a random dog into one that fits your need!