search
HomeTechnology peripheralsAIStable AI releases stable video diffusion model to generate videos based on images

IT House News on November 22, Stability AI, a startup company focused on developing artificial intelligence (AI) products, released its latest AI model - Stable Video Diffusion. This model can generate videos from existing images and is an extension of the previously released Stable Diffusion text-to-image model. It is also one of the few AI models on the market that can generate videos so far.

Stable AI releases stable video diffusion model to generate videos based on images

However, this model is not currently open to everyone. Stable Video Diffusion is currently in what Stability AI calls a “research preview” stage. Those who want to use this model must agree to some terms of use, which specify the intended use cases of Stable Video Diffusion (such as "educational or creative tools", "design and other artistic processes", etc.) and unintended use cases (such as " a factual or true expression of a person or event").

Stable video diffusion actually consists of two models - SVD and SVD-XT. SVD can convert static pictures into 14-frame 576×1024 pixel videos. SVD-XT uses the same structure, but the number of frames is increased to 24. Both can produce video at 3 to 30 frames per second

According to a white paper released by Stability AI along with Stable Video Diffusion, SVD and SVD-XT were initially trained on a dataset containing millions of videos and then on a smaller dataset Without "fine-tuning", this data set only has a few hundred thousand to about a million video clips. The source of these videos is not entirely clear, and the white paper suggests that many are from publicly available research data sets, so it is impossible to tell whether there are any copyright issues.

Both SVD and SVD-XT are capable of generating high-quality four-second videos, and judging from carefully selected samples on the Stability AI blog, the quality is comparable to the latest video generation models from Meta, Google, AI startup Runway, and Pika Labs AI-generated videos comparable to

Stable AI releases stable video diffusion model to generate videos based on images

IT House noticed that there are also limitations to the proliferation of stable videos. Stability AI is also very candid about this, saying the models cannot generate videos without motion or slow camera pans, cannot be controlled with text, cannot render text (at least not clearly), and cannot do it consistently "correctly" Generate faces and characters

Although in its early stages, Stability AI notes that these models are highly scalable and can be adapted to a variety of use cases such as generating 360-degree views of objects

Stability AI’s ultimate goal appears to be to commercialize it, saying Stable Video Diffusion has potential applications in “advertising, education, entertainment and other fields.”

The above is the detailed content of Stable AI releases stable video diffusion model to generate videos based on images. For more information, please follow other related articles on the PHP Chinese website!

Statement
This article is reproduced at:搜狐. If there is any infringement, please contact admin@php.cn delete
I Tried Vibe Coding with Cursor AI and It's Amazing!I Tried Vibe Coding with Cursor AI and It's Amazing!Mar 20, 2025 pm 03:34 PM

Vibe coding is reshaping the world of software development by letting us create applications using natural language instead of endless lines of code. Inspired by visionaries like Andrej Karpathy, this innovative approach lets dev

How to Use DALL-E 3: Tips, Examples, and FeaturesHow to Use DALL-E 3: Tips, Examples, and FeaturesMar 09, 2025 pm 01:00 PM

DALL-E 3: A Generative AI Image Creation Tool Generative AI is revolutionizing content creation, and DALL-E 3, OpenAI's latest image generation model, is at the forefront. Released in October 2023, it builds upon its predecessors, DALL-E and DALL-E 2

How to Use YOLO v12 for Object Detection?How to Use YOLO v12 for Object Detection?Mar 22, 2025 am 11:07 AM

YOLO (You Only Look Once) has been a leading real-time object detection framework, with each iteration improving upon the previous versions. The latest version YOLO v12 introduces advancements that significantly enhance accuracy

Top 5 GenAI Launches of February 2025: GPT-4.5, Grok-3 & More!Top 5 GenAI Launches of February 2025: GPT-4.5, Grok-3 & More!Mar 22, 2025 am 10:58 AM

February 2025 has been yet another game-changing month for generative AI, bringing us some of the most anticipated model upgrades and groundbreaking new features. From xAI’s Grok 3 and Anthropic’s Claude 3.7 Sonnet, to OpenAI’s G

Elon Musk & Sam Altman Clash over $500 Billion Stargate ProjectElon Musk & Sam Altman Clash over $500 Billion Stargate ProjectMar 08, 2025 am 11:15 AM

The $500 billion Stargate AI project, backed by tech giants like OpenAI, SoftBank, Oracle, and Nvidia, and supported by the U.S. government, aims to solidify American AI leadership. This ambitious undertaking promises a future shaped by AI advanceme

Sora vs Veo 2: Which One Creates More Realistic Videos?Sora vs Veo 2: Which One Creates More Realistic Videos?Mar 10, 2025 pm 12:22 PM

Google's Veo 2 and OpenAI's Sora: Which AI video generator reigns supreme? Both platforms generate impressive AI videos, but their strengths lie in different areas. This comparison, using various prompts, reveals which tool best suits your needs. T

Google's GenCast: Weather Forecasting With GenCast Mini DemoGoogle's GenCast: Weather Forecasting With GenCast Mini DemoMar 16, 2025 pm 01:46 PM

Google DeepMind's GenCast: A Revolutionary AI for Weather Forecasting Weather forecasting has undergone a dramatic transformation, moving from rudimentary observations to sophisticated AI-powered predictions. Google DeepMind's GenCast, a groundbreak

Which AI is better than ChatGPT?Which AI is better than ChatGPT?Mar 18, 2025 pm 06:05 PM

The article discusses AI models surpassing ChatGPT, like LaMDA, LLaMA, and Grok, highlighting their advantages in accuracy, understanding, and industry impact.(159 characters)

See all articles

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

AI Hentai Generator

AI Hentai Generator

Generate AI Hentai for free.

Hot Tools

SublimeText3 Mac version

SublimeText3 Mac version

God-level code editing software (SublimeText3)

MantisBT

MantisBT

Mantis is an easy-to-deploy web-based defect tracking tool designed to aid in product defect tracking. It requires PHP, MySQL and a web server. Check out our demo and hosting services.

MinGW - Minimalist GNU for Windows

MinGW - Minimalist GNU for Windows

This project is in the process of being migrated to osdn.net/projects/mingw, you can continue to follow us there. MinGW: A native Windows port of the GNU Compiler Collection (GCC), freely distributable import libraries and header files for building native Windows applications; includes extensions to the MSVC runtime to support C99 functionality. All MinGW software can run on 64-bit Windows platforms.

WebStorm Mac version

WebStorm Mac version

Useful JavaScript development tools

Safe Exam Browser

Safe Exam Browser

Safe Exam Browser is a secure browser environment for taking online exams securely. This software turns any computer into a secure workstation. It controls access to any utility and prevents students from using unauthorized resources.