Skip to content

Commit 9f283b0

Browse files
authored
changed w&b report link (#6387)
1 parent 203724e commit 9f283b0

File tree

1 file changed

+8
-8
lines changed
  • examples/research_projects/multi_subject_dreambooth_inpainting

1 file changed

+8
-8
lines changed

examples/research_projects/multi_subject_dreambooth_inpainting/README.md

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -10,21 +10,21 @@ Please note that this project is not actively maintained. However, you can open
1010

1111
## 1. Data Collection: Make Prompt-Image-Mask Pairs
1212

13-
Earlier training scripts have provided approaches like random masking for the training images. This project provides a notebook for more precise mask setting.
13+
Earlier training scripts have provided approaches like random masking for the training images. This project provides a notebook for more precise mask setting.
1414

1515
The notebook can be found here: [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1JNEASI_B7pLW1srxhgln6nM0HoGAQT32?usp=sharing)
1616

1717
The `multi_inpaint_dataset.ipynb` notebook, takes training & validation images, on which the user draws masks and provides prompts to make a prompt-image-mask pairs. This ensures that during training, the loss is computed on the area masking the object of interest, rather than on random areas. Moreover, the `multi_inpaint_dataset.ipynb` notebook allows you to build a validation dataset with corresponding masks for monitoring the training process. Example below:
1818

1919
![train_val_pairs](https://drive.google.com/uc?id=1PzwH8E3icl_ubVmA19G0HZGLImFX3x5I)
2020

21-
You can build multiple datasets for every subject and upload them to the 🤗 hub. Later, when launching the training script you can indicate the paths of the datasets, on which you would like to finetune Stable Diffusion for inpaining.
21+
You can build multiple datasets for every subject and upload them to the 🤗 hub. Later, when launching the training script you can indicate the paths of the datasets, on which you would like to finetune Stable Diffusion for inpaining.
2222

2323
## 2. Train Multi Subject Dreambooth for Inpainting
2424

2525
### 2.1. Setting The Training Configuration
2626

27-
Before launching the training script, make sure to select the inpainting the target model, the output directory and the 🤗 datasets.
27+
Before launching the training script, make sure to select the inpainting the target model, the output directory and the 🤗 datasets.
2828

2929
```bash
3030
export MODEL_NAME="runwayml/stable-diffusion-inpainting"
@@ -52,7 +52,7 @@ accelerate launch train_multi_subject_dreambooth_inpaint.py \
5252

5353
### 2.3. Fine-tune text encoder with the UNet.
5454

55-
The script also allows to fine-tune the `text_encoder` along with the `unet`. It's been observed experimentally that fine-tuning `text_encoder` gives much better results especially on faces.
55+
The script also allows to fine-tune the `text_encoder` along with the `unet`. It's been observed experimentally that fine-tuning `text_encoder` gives much better results especially on faces.
5656
Pass the `--train_text_encoder` argument to the script to enable training `text_encoder`.
5757

5858
___Note: Training text encoder requires more memory, with this option the training won't fit on 16GB GPU. It needs at least 24GB VRAM.___
@@ -68,12 +68,12 @@ accelerate launch train_multi_subject_dreambooth_inpaint.py \
6868
--learning_rate=2e-6 \
6969
--max_train_steps=500 \
7070
--report_to_wandb \
71-
--train_text_encoder
71+
--train_text_encoder
7272
```
7373

7474
## 3. Results
7575

76-
A [![Weights & Biases](https://img.shields.io/badge/Weights%20&%20Biases-Report-blue)](https://wandb.ai/gzguevara/uncategorized/reports/Multi-Subject-Dreambooth-for-Inpainting--Vmlldzo2MzY5NDQ4) is provided showing the training progress by every 50 steps. Note, the reported weights & baises run was performed on a A100 GPU with the following stetting:
76+
A [![Weights & Biases](https://img.shields.io/badge/Weights%20&%20Biases-Report-blue)](https://wandb.ai/gzguevara/uncategorized/reports/Multi-Subject-Dreambooth-for-Inpainting--Vmlldzo2MzY5NDQ4?accessToken=y0nya2d7baguhbryxaikbfr1203amvn1jsmyl07vk122mrs7tnph037u1nqgse8t) is provided showing the training progress by every 50 steps. Note, the reported weights & baises run was performed on a A100 GPU with the following stetting:
7777

7878
```bash
7979
accelerate launch train_multi_subject_dreambooth_inpaint.py \
@@ -86,8 +86,8 @@ accelerate launch train_multi_subject_dreambooth_inpaint.py \
8686
--learning_rate=1e-6 \
8787
--max_train_steps=500 \
8888
--report_to_wandb \
89-
--train_text_encoder
89+
--train_text_encoder
9090
```
91-
Here you can see the target objects on my desk and next to my plant:
91+
Here you can see the target objects on my desk and next to my plant:
9292

9393
![Results](https://drive.google.com/uc?id=1kQisOiiF5cj4rOYjdq8SCZenNsUP2aK0)

0 commit comments

Comments
 (0)