search
HomeTechnology peripheralsAIThe open source Stable Diffusion plug-in for PS is here: one-click AI brain supplement, ready to install and use

Stable Diffusion is a hot new technology in the AI ​​field this year. Thanks to the open source spirit of Stability AI, it has spawned many AI painting applications. Compared with the traditional painting method, the method of generating images based on text is simple to operate, and the drawing speed is also fast. Each generation will show a different effect.

With the development of technology, consumer-grade GPUs have been able to generate images in tens of seconds, and people have begun to consider using AI drawing capabilities for productivity. Since Stable Diffusion has long been open source, it makes sense for developers to use it to create drawing tools.

For example, the previous Automatic1111 is a commonly used network UI in the Stable Diffusion user community, but it is still not convenient enough for professional users who often use Photoshop.

The open source Stable Diffusion plug-in for PS is here: one-click AI brain supplement, ready to install and use

Now, with the help of Auto-Photoshop-StableDiffusion-Plugin, users can use the function of Automatic1111 Stable Diffusion directly in the most famous drawing software Photoshop, No need to switch between programs.

This means you can easily use Stable Diffusion AI in the familiar Photoshop environment, right out of the box. After installing this plugin, you can edit Stable Diffusion images using all your favorite tools and conveniently save them in Photoshop.

Project link: https://github.com/AbdullahAlfaraj/Auto-Photoshop-StableDiffusion-Plugin

Function introduction

Quick Test

1. Create a new project in PhotoShop.

2. Once the plugin is loaded, do not select or change anything. Just click the "Generate" button.

3. If you see an image of a cat being loaded onto the canvas, then everything is set up correctly.

txt2Img

1. Use the Rectangular Marquee Tool and select the square (1x1 scale)

a. In the selection tool, you can set the ratio to 512x512 or 512x768;

b. Just make sure that the selected ratio is equal to the size of the resulting image.

2. Write prompt and click "Generate".

3. The result will be resized to fit the selected area. But don't worry, the image will be loaded into PhotoShop as a Smart Object. So you can resize it without losing quality.

img2img

1. Select an image that is on its own layer.

a. If you want the generated image to be perfectly placed on the original image, optional "Ctrl-click" on the layer thumbnail.

2. Change the mode to "img2img" in the plugin UI.

3. Click the "Set Initial Image" button. If the image does not change to the selected layer. Clicking multiple times (the author is working on fixing this issue).

4. Click Generate.

inpaint

1. Change the plug-in mode to "inpaint".

2. Create a square selection on the image to be repaired:

a. Use the Rectangular Marquee Tool;

b. Or “ctrl click” the layer thumbnail.

3. Create a new layer and paint white within the selected area. Note that any white areas will be regenerated via Stable Diffusion.

4. Click the "Init Inpaint Mask" button.

a. Make sure you are still on the white layer before clicking;

b. After clicking, the plug-in will generate a suitable black and white mask. Mask and set it to the mask that Stable Diffusion wants to use.

c. It also creates a canvas snapshot under the selected area and uses this snapshot as the initial image.

5. Click the "Generate" button.

outpaint

1. Change plugin mode to Repair. Remember, "outpaint" is just a special case of repair.

2. Create a "rectangular selection" that intersects the image you want to expand.

3. Click "Init Outpaint Mask", this will:

a. Create a snapshot of the canvas under the selection, and It is used as the "initial image" of Stable Diffusion;

b. Create a black and white mask and use it as the "initial mask";

c. It will update the "Initial Image" and "Initial Mask" in the plug-in UI.

Some experiences

  • In order to get the best inpaint and outpaint effects, you must choose " stable-diffusion inpainting model".
  • img2img's "initial image" cannot have transparency.
  • Always check the Initial Image and Initial Mask in the plugin UI and make sure they match the layers on the canvas. If you want to adjust the mismatch, please do the following:
  • Select "group_mask" in the layers panel and click the "set init mask" button.
  • Select "group_init_image" in the layer panel and click the "set init image" button.
  • After selecting a model, you may need to wait for it to load into Stable Diffusion before you can click Generate.
  • Check if the progress bar is stuck at 0% or 1%: you can cancel/interrupt the request at any time if you think it's taking too long and want to regenerate again.
  • Do not open multiple PhotoShop documents, this will break the plug-in. Please work on one project at a time.

Questions about img2img, inpaint or outpaint

  • ##img2img, inpaint and outpaint Use photoshop's "quick export to png" function.
  • Random quick export to png gets corrupted, this is a known photoshop bug.

If you want to test whether the feature is broken and the cause of the problem, you can do the following:

  • Select one layer and right click on it and select quick export to png. If you get a window prompt, the quick export works fine. On the other hand if nothing happens then you need to restart photoshop and try the export function again until it works.
  • You can use this plugin when the export function is enabled, otherwise img2img, inpaint and outpaint will not work properly.
How to install

When running the plug-in for the first time:

1. Download the plug-in:

git clone https://github.com/AbdullahAlfaraj/Auto-Photoshop-StableDiffusion-Plugin.git

2. Run "start_server.bat" under "Auto-Photoshop-StableDiffusion-Plugin"

3. In the location where you installed automatic1111, Edit webui-user.bat and change this line:

set COMMANDLINE_ARGS=

set COMMANDLINE_ARGS= --api

这将允许插件与 automatic1111 项目进行通信。保存后关闭「webui-user.bat」文件,正常运行即可。

4、运行 photoshop。选择编辑→首选项→插件,确保选中「启用开发者模式」(Enable Developer Mod)选框。

5、安装官方的「Adobe UXP Developer Tool」,此工具会将插件添加到 photoshop:https://developer.adobe.com/photoshop/uxp/devtool/installation/

6、运行 Adobe UXP Developer Tool 并单击右上角的「添加插件」按钮。导航到「Auto-Photoshop-StableDiffusion-Plugin” 文件夹所在的位置并打开「manifest.json」

7、选择插件并点击 Actions → Load Selected,就完成了。

第二次及后续运行插件的步骤:

1、启动 「webui-user.bat」

2、启动 「start_server.bat」

3、启动 「Photoshop」

4、启动 「Adobe UXP Developer Tool」并加载插件

The above is the detailed content of The open source Stable Diffusion plug-in for PS is here: one-click AI brain supplement, ready to install and use. For more information, please follow other related articles on the PHP Chinese website!

Statement
This article is reproduced at:51CTO.COM. If there is any infringement, please contact admin@php.cn delete
7 Powerful AI Prompts Every Project Manager Needs To Master Now7 Powerful AI Prompts Every Project Manager Needs To Master NowMay 08, 2025 am 11:39 AM

Generative AI, exemplified by chatbots like ChatGPT, offers project managers powerful tools to streamline workflows and ensure projects stay on schedule and within budget. However, effective use hinges on crafting the right prompts. Precise, detail

Defining The Ill-Defined Meaning Of Elusive AGI Via The Helpful Assistance Of AI ItselfDefining The Ill-Defined Meaning Of Elusive AGI Via The Helpful Assistance Of AI ItselfMay 08, 2025 am 11:37 AM

The challenge of defining Artificial General Intelligence (AGI) is significant. Claims of AGI progress often lack a clear benchmark, with definitions tailored to fit pre-determined research directions. This article explores a novel approach to defin

IBM Think 2025 Showcases Watsonx.data's Role In Generative AIIBM Think 2025 Showcases Watsonx.data's Role In Generative AIMay 08, 2025 am 11:32 AM

IBM Watsonx.data: Streamlining the Enterprise AI Data Stack IBM positions watsonx.data as a pivotal platform for enterprises aiming to accelerate the delivery of precise and scalable generative AI solutions. This is achieved by simplifying the compl

The Rise of the Humanoid Robotic Machines Is Nearing.The Rise of the Humanoid Robotic Machines Is Nearing.May 08, 2025 am 11:29 AM

The rapid advancements in robotics, fueled by breakthroughs in AI and materials science, are poised to usher in a new era of humanoid robots. For years, industrial automation has been the primary focus, but the capabilities of robots are rapidly exp

Netflix Revamps Interface — Debuting AI Search Tools And TikTok-Like DesignNetflix Revamps Interface — Debuting AI Search Tools And TikTok-Like DesignMay 08, 2025 am 11:25 AM

The biggest update of Netflix interface in a decade: smarter, more personalized, embracing diverse content Netflix announced its largest revamp of its user interface in a decade, not only a new look, but also adds more information about each show, and introduces smarter AI search tools that can understand vague concepts such as "ambient" and more flexible structures to better demonstrate the company's interest in emerging video games, live events, sports events and other new types of content. To keep up with the trend, the new vertical video component on mobile will make it easier for fans to scroll through trailers and clips, watch the full show or share content with others. This reminds you of the infinite scrolling and very successful short video website Ti

Long Before AGI: Three AI Milestones That Will Challenge YouLong Before AGI: Three AI Milestones That Will Challenge YouMay 08, 2025 am 11:24 AM

The growing discussion of general intelligence (AGI) in artificial intelligence has prompted many to think about what happens when artificial intelligence surpasses human intelligence. Whether this moment is close or far away depends on who you ask, but I don’t think it’s the most important milestone we should focus on. Which earlier AI milestones will affect everyone? What milestones have been achieved? Here are three things I think have happened. Artificial intelligence surpasses human weaknesses In the 2022 movie "Social Dilemma", Tristan Harris of the Center for Humane Technology pointed out that artificial intelligence has surpassed human weaknesses. What does this mean? This means that artificial intelligence has been able to use humans

Venkat Achanta On TransUnion's Platform Transformation And AI AmbitionVenkat Achanta On TransUnion's Platform Transformation And AI AmbitionMay 08, 2025 am 11:23 AM

TransUnion's CTO, Ranganath Achanta, spearheaded a significant technological transformation since joining the company following its Neustar acquisition in late 2021. His leadership of over 7,000 associates across various departments has focused on u

When Trust In AI Leaps Up, Productivity FollowsWhen Trust In AI Leaps Up, Productivity FollowsMay 08, 2025 am 11:11 AM

Building trust is paramount for successful AI adoption in business. This is especially true given the human element within business processes. Employees, like anyone else, harbor concerns about AI and its implementation. Deloitte researchers are sc

See all articles

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

Video Face Swap

Video Face Swap

Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Tools

Safe Exam Browser

Safe Exam Browser

Safe Exam Browser is a secure browser environment for taking online exams securely. This software turns any computer into a secure workstation. It controls access to any utility and prevents students from using unauthorized resources.

SublimeText3 Linux new version

SublimeText3 Linux new version

SublimeText3 Linux latest version

MinGW - Minimalist GNU for Windows

MinGW - Minimalist GNU for Windows

This project is in the process of being migrated to osdn.net/projects/mingw, you can continue to follow us there. MinGW: A native Windows port of the GNU Compiler Collection (GCC), freely distributable import libraries and header files for building native Windows applications; includes extensions to the MSVC runtime to support C99 functionality. All MinGW software can run on 64-bit Windows platforms.

DVWA

DVWA

Damn Vulnerable Web App (DVWA) is a PHP/MySQL web application that is very vulnerable. Its main goals are to be an aid for security professionals to test their skills and tools in a legal environment, to help web developers better understand the process of securing web applications, and to help teachers/students teach/learn in a classroom environment Web application security. The goal of DVWA is to practice some of the most common web vulnerabilities through a simple and straightforward interface, with varying degrees of difficulty. Please note that this software

MantisBT

MantisBT

Mantis is an easy-to-deploy web-based defect tracking tool designed to aid in product defect tracking. It requires PHP, MySQL and a web server. Check out our demo and hosting services.