This README provides a step-by-step guide to download the repository, set up the required virtual environment named "PowerPaint" using conda, and run PowerPaint with or without ControlNet.
Feel free to try it and give it a star!โญ
April 7, 2024๐ฅ
April 6, 2024๐ฅ
- We have retrained a new PowerPaint, taking inspiration from Brushnet. The Online Demo has been updated accordingly. We plan to release the model weights and code as open source in the next few days.
- Tips: We preserve the cross-attention layer that was deleted by BrushNet for the task prompts input.
Object insertion | Object Removal | Shape-guided Object Insertion | Outpainting | |
---|---|---|---|---|
Original Image | ||||
Output |
December 22, 2023๐ง
- The logical error in loading ControlNet has been rectified. The
gradio_PowerPaint.py
file and Online Demo have also been updated.
December 18, 2023
Enhanced PowerPaint Model
- We are delighted to announce the release of more stable model weights. These refined weights can now be accessed on Hugging Face. The
gradio_PowerPaint.py
file and Online Demo have also been updated as part of this release.
![](https://private-user-images.githubusercontent.com/12782558/288625848-acd01391-c73f-4997-aafd-0869aebcc915.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjM2MzI0MzMsIm5iZiI6MTcyMzYzMjEzMywicGF0aCI6Ii8xMjc4MjU1OC8yODg2MjU4NDgtYWNkMDEzOTEtYzczZi00OTk3LWFhZmQtMDg2OWFlYmNjOTE1LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MTQlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODE0VDEwNDIxM1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTNmM2ZkN2RmZTMyODg4ZDFiZjExNzRhYTE0NDMwNzM1NzJhZWY2MWNhN2E1NzczZGNmYzBkNmJiNDEyNTUwOTQmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.18ypV7QmE_rlY1-l0qIzZVajiwiqt-oIufk3RdsXVgE)
# Clone the Repository
git clone https://github.com/zhuang2002/PowerPaint.git
# Navigate to the Repository
cd projects/powerpaint
# Create Virtual Environment with Conda
conda create --name PowerPaint python=3.9
conda activate PowerPaint
# Install Dependencies
pip install -r requirements.txt
python gradio_PowerPaint_BrushNet.py
# Create Models Folder
mkdir models
# Set up Git LFS
git lfs install
# Clone PowerPaint Model
git lfs clone https://huggingface.co/JunhaoZhuang/PowerPaint-v1/ ./models
python gradio_PowerPaint.py
This command will launch the Gradio interface for PowerPaint.
Feel free to explore and edit images with PowerPaint!
@misc{zhuang2023task,
title={A Task is Worth One Word: Learning with Task Prompts for High-Quality Versatile Image Inpainting},
author={Junhao Zhuang and Yanhong Zeng and Wenran Liu and Chun Yuan and Kai Chen},
year={2023},
eprint={2312.03594},
archivePrefix={arXiv},
primaryClass={cs.CV}
}