Runway version of Sora released: high fidelity, super consistency, Gen-3 Alpha shocked netizens

Although the generated video is only about 10 seconds long, it seems to be comparable to all existing video generation models in terms of clarity, details, and character consistency.

Just now, AI video generation startup Runway launched a new video generation basic model Gen-3 Alpha. The model can create highly detailed videos with complex scene changes, multiple cinematic styles and detailed art direction.

Runway said the Gen-3 Alpha is the first in a series of upcoming models. Series models are trained on new infrastructure built for large-scale multi-modal training.

Gen-3 Alpha offers significant improvements in fidelity, consistency, and movement compared to Gen-2, and is a significant step toward building a universal world model.

In the blog, Runway emphasized that all videos of the Demo were generated using Gen-3 Alpha without any modification.

Many netizens said that Runway really shocked us again: Runway is back!

Pytorch lead Soumith Chintala believes that some of the build quality reaches Sora level.

Next, let us appreciate the effect generated by Runway video.

Prompt: Subtle reflections of a woman on the window of a train moving at hyper-speed in a Japanese city. .) Hint: An astronaut is running down an alley in Rio de Janeiro. (Prompt: An astronaut running through an alley in Rio de Janeiro.)

As can be seen from the Demo, the 10-second video generated by Runway has a sharpness, The details, character consistency and fidelity are all very well done. Let people ask: When can it be used?

Fine-grained timing control

Gen-3 Alpha is trained for highly descriptive, time-intensive subtitles, Enable imaginative scene transitions.

Tips: Close-up of an ant crawling out of its nest. The camera zooms out to reveal the neighborhood behind the hill. (Prompt: An extreme close-up shot of an ant emerging from its nest. The camera pulls back revealing a neighborhood beyond the hill.) Prompt: An FPV drone flies over the cliff of a castle. (Prompt: A FPV drone shot through a castle on a cliff.)

Generate more realistic human characters

Gen-3 Alpha excels at creating expressive human characters with a variety of movements, gestures, and emotions.

Tip: This is a cinematic wide-angle portrait of a man whose face is illuminated by light. (Prompt: A cinematic wide portrait of a man with his face lit by the glow of a TV.)Prompt: A middle-aged sad bald man suddenly becomes happy because of a curly hair and A pair of sunglasses suddenly fell on his head. (Prompt: A middle-aged sad bald man becomes happy as a wig of curly hair and sunglasses fall suddenly on his head.)

Artistic Creation

Gen-3 Alpha’s training is the result of an interdisciplinary team of research scientists, engineers, and artists working together to enable Gen-3 Alpha to understand and interpret a variety of art styles and film terminology.

Tips: At night, outside the window, a huge strange creature is walking in the dilapidated city, and a streetlight is dimly lit. (Prompt: View out a window of a giant strange creature walking in rundown city at night, one single street lamp dimly lighting the area.) Prompt: Time-lapse shooting, walking through the corridor with flickering lights. , a strip of silver fabric flew across the hallway. (Prompt: Hyperlapse shot through a corridor with flashing lights. A silver fabric flies through the entire corridor.)

INDUSTRY CUSTOMIZATION

Runway said customization of the Gen-3 series models allows for more stylized controls and more consistent characters, optimized for specific artistic and narrative requirements.

Tip: Over-the-shoulder shot of a woman running and looking at rockets in the distance. (Prompt: Over the shoulder shot of a woman running and watching a rocket in the distance.)Prompt: A profile photo of a woman, with fireworks blooming in the distance behind her. (Prompt: A side profile shot of a woman with fireworks exploding in the distance beyond her.) A few months after the release of Sora, more and more video generation models have appeared, such as recently The released Kuaishou Keling, Luma, and today’s Gen-3. But unfortunately, we cannot directly experience many products.

I believe that like text large models, there will be more and more video generation models, and we will be able to freely try these products.

^{Blog link: https://runwayml.com/blog/introducing-gen-3-alpha/}

The above is the detailed content of Runway version of Sora released: high fidelity, super consistency, Gen-3 Alpha shocked netizens. For more information, please follow other related articles on the PHP Chinese website!