Stability AI, the developer behind Stable Diffusion, has announced a breakthrough in generative art with the release of Stable Video Diffusion. This new product, currently in a research preview, allows users to animate generative art from a single image, marking a significant advancement in the company’s mission to make generative AI accessible to everyone.
The Stable Video Diffusion tool comes in the form of two image-to-video models, capable of generating videos ranging from 14 to 25 frames, with speeds between 3 and 30 frames per second at a resolution of 576 × 1024. It features multi-view synthesis from a single frame, with fine-tuning capabilities on multi-view datasets. The models have demonstrated superiority in user preference studies compared to leading closed models in external evaluations.
However, the tool has certain limitations, including the generation of relatively short videos (less than 4 seconds), a lack of perfect photorealism, an inability to handle camera motion except for slow pans, no text control, and challenges in generating legible text or people and faces accurately.
Stable Video Diffusion is currently available for research purposes only and is not intended for real-world or commercial applications. Interested users can sign up for a waitlist to gain access to an upcoming web experience featuring a text-to-video interface. The tool aims to showcase potential applications in various sectors, including advertising, education, entertainment, and more.
You may be interested in our other articles about technology if you enjoyed this one:
- Windows 11 KB5031455 Update Woes: Installation Failures and Game Crashes
- How to Unlock UK Netflix with the Best VPN?
The release of Stable Video Diffusion follows the recent resignation of Stability AI’s vice president of audio, Ed Newton-Rex, over concerns related to the use of copyrighted content to train generative AI models. Despite challenges, Stability AI continues its pursuit of advancing generative AI technology, recognizing the potential of video generation to simplify content creation.