Update README.md

README.md

@@ -25,7 +25,7 @@ tags:
 should probably proofread and complete it, then remove this comment. -->
 
 
-# SDXL LoRA DreamBooth - ariG23498/open-image-preferences-v1-sdxl-lora
+# Low Rank Adapted Supervised Fine Tuned Stable Diffusion XL
 
 <Gallery />
 
@@ -40,36 +40,49 @@ should probably proofread and complete it, then remove this comment. -->
 
 These are ariG23498/open-image-preferences-v1-sdxl-lora LoRA adaption weights for stabilityai/stable-diffusion-xl-base-1.0.
 
-The weights were trained  using [DreamBooth](https://dreambooth.github.io/).
+The weights were trained using [DreamBooth](https://github.com/ariG23498/diffusers/blob/aritra/sdxl-lora/examples/dreambooth/train_dreambooth_lora_sdxl.py) using the
+[open-image-preferences-v1-binarized](https://huggingface.co/datasets/data-is-better-together/open-image-preferences-v1-binarized) dataset.
 
-LoRA for the text encoder was enabled: False.
 
-Special VAE used for training: None.
+## Use with `diffusers`
 
-## Trigger words
+```py
+from diffusers import AutoPipelineForText2Image
+import torch
 
-You should use None to trigger the image generation.
-
-## Download model
-
-Weights for this model are available in Safetensors format.
-
-[Download](ariG23498/open-image-preferences-v1-sdxl-lora/tree/main) them in the Files & versions tab.
-
-
-
-## Intended uses & limitations
-
-#### How to use
-
-```python
-# TODO: add an example code snippet for running this diffusion pipeline
+pipeline = AutoPipelineForText2Image.from_pretrained(
+    "stabilityai/stable-diffusion-xl-base-1.0",
+    torch_dtype=torch.bfloat16
+).to('cuda')
+pipeline.load_lora_weights('ariG23498/open-image-preferences-v1-sdxl-lora', weight_name='pytorch_lora_weights.safetensors')
+prompt = "ENTER PROMPT"
+image = pipeline(prompt).images[0]
 ```
 
-#### Limitations and bias
-
-[TODO: provide examples of latent issues and potential remediations]
-
-## Training details
-
-[TODO: describe the data used to train the model]
+## Command to train the model
+
+```shell
+!accelerate launch examples/dreambooth/train_dreambooth_lora_sdxl.py \
+    --pretrained_model_name_or_path "stabilityai/stable-diffusion-xl-base-1.0" \
+    --dataset_name "data-is-better-together/open-image-preferences-v1-binarized" \
+    --hub_model_id "ariG23498/open-image-preferences-v1-sdxl-lora" \
+    --push_to_hub \
+    --output_dir "open-image-preferences-v1-sdxl-lora" \
+    --image_column "chosen" \
+    --caption_column "prompt" \
+    --mixed_precision="bf16" \
+    --resolution=1024 \
+    --train_batch_size=1 \
+    --repeats=1 \
+    --report_to="wandb"\
+    --gradient_accumulation_steps=1 \
+    --gradient_checkpointing \
+    --learning_rate=1.0 \
+    --text_encoder_lr=1.0 \
+    --optimizer="prodigy"\
+    --lr_scheduler="constant" \
+    --lr_warmup_steps=0 \
+    --rank=8 \
+    --checkpointing_steps=2000 \
+    --seed="0"
+```