Home >Technology peripherals >AI >PAI x EasyPhoto, bid farewell to April Fool's Day and create a festive atmosphere with AI photos
Event address: https://developer.aliyun.com/topic/aigc_pai/newyear
The application of generative AI technology to produce real/like/beautiful personal photos in batches is very popular. The recently launched EasyPhoto, as an open source SD WebUI plug-in, provides a more flexible and easy-to-use development method. It has received attention and praise from a large number of developers. Users can quickly train the LoRA model by uploading several photos of the same person. , and combined with user-defined template pictures, finally generate true, realistic and beautiful portrait photos.
EasyPhoto is a Webui UI plug-in for generating AI portraits. Based on the StableDiffusion character customization method of Lora ControlNet, it supports low-code operations, customized styles, and built-in rich templates, allowing more developers to flexibly develop their own stylized artistic photo generation. This AIGC creation activity is based on Alibaba Cloud's artificial intelligence platform PAI. EasyPhoto is launched with low code and high efficiency, achieving the rapid generation of beautiful pictures with a festive atmosphere.
Based on this tutorial you can experience:
New users can receive trial resources of artificial intelligence platform PAI worth 10,000 yuan for free
Train a personal LoRA model based on interactive modeling PAI-DSW
Create new holiday AI photos, allowing you to experience the personalized atmosphere of Christmas, New Year and other holidays
Submit your works Redmi Watch3, Xiaomi Band 8, etc. to win exquisite gifts!
1. Preparation
1.1 Get the free trial rights of interactive modeling PAI-DSW
Go to the event page of this "hi 2024! AI New Year Photo Challenge" and receive the interactive modeling PAI-DSW product free trial resource package
1.2 Create PAI-DSW instance
4. Click to create an instance (as shown above)
5. Customize the input instance name, such as "easyphoto"
When choosing an instance model, you can consider using the GPU category ecs.gn6v-c8g1.2xlarge (supports resource package deduction) or ecs.gn7i-c8g1.2xlarge
(Support resource package deduction). If these two models are in stock, you can change the region to try, or choose another paid model (free trial is not supported).
7. Select the image, stable-diffusion-webui-develop:1.0.0-pytorch2.01-gpu-py310-cu117-ubuntu22.04
8. Click "Next"
9. Confirm [Resource Configuration] and [Mirror] as shown in the figure, click Create Instance;
10. Wait about 3-5 minutes, the instance status changes to "Running", and the instance creation is completed;
1.3 Open the EasyPhoto tutorial in PAI-DSW and experience zero-code AI development
2. Select the previously created instance and click on the instance name
3. Enter the notebook development interface, click the run button step by step; run 1. Environment installation cells in section (3 defined functions - download code - download model), you can download and install the presets The WebUI with the EasyPhoto plug-in, which is the model it relies on.
4. Run 2. Start the cell of the WebUI section to open the WebUI.
5. Click the generated link to enter WebUI
2. Start experiencing
You can use this tutorial to generate your own holiday photos/animations. We provide the following functions:
Generally speaking, the generation of character portraits/animations is divided into the following two steps:
Please refer to section 2.2 to generate pictures, and please refer to section 2.3 to generate videos.
2.1 Digital clone training
If you do not have 10 clear personal portrait photos, you can choose the Mona Lisa photo as a test. The download link for Mona Lisa photos is: https://pai-aigc-photog.oss-cn-hangzhou.aliyuncs.com/webui/mona.zip
We have built-in two base models in realistic/animation styles for you to choose from. You can also choose your own base model according to your preferences.
⚠️Please note that if there is a front-end disconnection as shown in the picture during the training process, don't worry, you can see the training progress in the notebook background. After training is completed, refresh the front-end page to perform model inference.
2.2 Photo Inference
You can use Photo Inference for image inference, we support:
2.2.1 Designated images of character portraits
⚠️ If the following prompt appears, please set the ControlNet number >= 4. Exit from the console and restart WebUI to set up.
2.2.2 Character portrait of specified text
* You can refer to the usage methods here to further train your own festival scenes and generate diverse portraits~
2.3 Video Inference
You can use Video Inference for video inference, we support:
2.3.1 Character animation of specified text
⚠️ We turn on lcm acceleration for video generation by default. You can turn off this option to use more generation steps to generate more detailed video results.
2.3.2 Character animation of specified image
2.3.3 Specify the character animation of the video
3. Resource cleanup and follow-up
3.1 Cleanup
3.2 Follow-up
During the trial validity period, you can continue to use DSW instances for model training and inference verification.
Attachment:
Welcome to co-build EasyPhoto, Github address: https://github.com/aigc-apps/sd-webui-EasyPhoto
Original link: https://developer.aliyun.com/article/1401917?utm_content=g_1000386818
This article is original content of Alibaba Cloud and may not be reproduced without permission.
The above is the detailed content of PAI x EasyPhoto, bid farewell to April Fool's Day and create a festive atmosphere with AI photos. For more information, please follow other related articles on the PHP Chinese website!