Installation with just a few lines of code and unlimited free drawings: Stability AI announces the open source version of DreamStudio

Since the initial release of the text-to-image open source model Stable Diffusion, DreamStudio has been the primary interface for new models and features in Stability AI. To date, users have created millions of images with DreamStudio.

Recently, DreamStudio has also been upgraded to SDXL, enabling more detailed images and compositions than its predecessor, Stable Diffusion 2.1, and the ability to create descriptive images with shorter prompts.

For now, DreamStudio can already generate such images, and the effect is not inferior to Midjourney 5.1:

Although DreamStudio provides an image generation method with almost no threshold, it also has a condition: payment. The SDXL version is priced even higher.

## Moreover, for some developers who have passed the technical level, they also hope to be able to Make some application extensions based on DreamStudio.

Perhaps you heard the voices of netizens? Just now, Stability AI released the open source version of DreamStudio - StableStudio.

Open source address: https://github.com/Stability-AI /StableStudio

# "We believe that the best way to expand technology adoption is through open, community-driven development, rather than privatized iterations of closed-source products." Stability AI express.

In the company’s plans, StableStudio’s goal is to collaborate with the broader community to create a world-class user interface for generative AI that gives users full control. While DreamStudio will still be an implementation of StableStudio hosted by Stability, the ultimate goal is to foster a project that can transcend anything developed by a single company.

Specifically, what is the difference between StableStudio and DreamStudio?

Stability AI has made some adjustments to make the project more community-friendly. Including:

• The DreamStudio exclusive brand has been deleted;
• All online API calls have been replaced by the plug-in system, and users can easily replace them Backend;
• Removed account functions specific to Stability, such as billing, API key management, etc.

Extended features

DreamStudio was originally conceived as an animation studio for Disco Diffusion. After the release of Stable Diffusion in 2022, DreamStudio's focus shifted to image generation.

Inspired by the explosive conversation model this year, Stability AI released the open source LLM StableVicuna in April. StableStudio, the open source version of DreamStudio, will be combined with StableVicuna to launch a chat interface.

StableVicuna dialogue example.

"Stable Vicuna" generated by Stable Diffusion XL.

Stability AI states that StableStudio may be updated with the following features in the future:

• Local inference via WebGPU
• Local inference via stable-diffusion-webui
• Desktop installation
• ControlNet Tools

Installation and Usage

The StableStudio project is online on GitHub, including a quick installation method.

## Project address: https://github.com/Stability-AI/StableStudio

To use StableStudio, users need to install Node.js and Yarn first. Then clone the StableStudio repository as follows

<code>git clone https://github.com/Stability-AI/StableStudio.gitcd StableStudioyarnyarn dev</code>

By default, StableStudio runs on localhost:3000. Users need to prepare an API key to use the default Stability API plug-in; if not, they need to create an account on DreamStudio and obtain the key.

Mainstream model of image generation

Whether it is DreamStudio or the open source version of StableStudio, the basic model behind it is Stable Diffusion, the currently popular image generation model. Stable Diffusion is widely used for its ability to quickly generate high-quality images on consumer GPUs.

The technology of the Stable Diffusion model originated from a paper "High-Resolution Image Synthesis with Latent Diffusion Models" published in CVPR 2022. In order to train Stable Diffusion, the research team used 4,000 A100 Ezra-1 AI ultra-large clusters, and Stability AI Company provided these computing power.

In August 2022, Stability AI announced the release of Stable Diffusion and made it open source. In November, they released Stable Diffusion version 2.0. Now, Stable Diffusion has replaced GAN as the mainstream model in the field of image generation.

As an open source version of the product platform DreamStudio, StableStudio replaces all online API calls with a plug-in system, allowing users to easily Replacing the backend will further promote the development of the image generation field.

The above is the detailed content of Installation with just a few lines of code and unlimited free drawings: Stability AI announces the open source version of DreamStudio. For more information, please follow other related articles on the PHP Chinese website!