NerdyRodent

BrushNet

Added 2024-04-06 15:20:01 +0000 UTC

BrushNet is a great way to do inpainting. Below you can find all the links to the things used in the video, along with each command to copy & paste to get everything set up. Also included are the two different ComfyUI workflows used in the video. One has the standard masking setup, and one with instead uses depth maps as masks. In either workflow you can use your own masks too by connecting the mask node provided instead.

Video guide: https://youtu.be/X89IQop_0dM

== Links ==

https://github.com/TencentARC/BrushNet

https://huggingface.co/spaces/TencentARC/BrushNet

https://pytorch.org/

https://pixabay.com/photos/teddy-bear-toy-plush-stuffed-toy-1835598/

https://huggingface.co/spaces/abhishek/StableSAM/blob/main/sam_vit_h_4b8939.pth

== MS Windows Installer for BrushNet - 6-Apr-2024 ==

conda create --name brushnet python=3.10 -y

conda activate brushnet

brushnet-windows.bat

Note: Some MS Windows systems may not be able to route 0.0.0.0:12345, in which case simply use localhost:12345 instead

== Manual Setup / Install for BrushNet - 6-Apr-2024 ==

conda create --name brushnet python=3.10 -y

conda activate brushnet

git clone https://github.com/TencentARC/BrushNet.git

cd BrushNet

python -m pip install -U pip

pip install torch torchvision torchaudio

pip install -e .

cd examples/brushnet

pip install -r requirements.txt

cd ../..

== Converting Models ==

Example command for safetensors to diffusers:

python scripts/convert_original_stable_diffusion_to_diffusers.py --checkpoint_path /home/nerdy/github/ComfyUI/models/checkpoints/SD1.5/realcartoonRealistic_v14.safetensors --from_safetensors --dump_path ./data/ckpt/realcartoonRealistic_v14

== Inference ==

python examples/brushnet/app_brushnet.py