You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: examples/research_projects/flux_lora_quantization/README.md
+3-2
Original file line number
Diff line number
Diff line change
@@ -5,7 +5,8 @@
5
5
6
6
This example shows how to fine-tune [Flux.1 Dev](https://huggingface.co/black-forest-labs/FLUX.1-dev) with LoRA and quantization. We show this by using the [`Norod78/Yarn-art-style`](https://huggingface.co/datasets/Norod78/Yarn-art-style) dataset. Steps below summarize the workflow:
7
7
8
-
* We precompute the text embeddings in `compute_embeddings.py` and serialize them into a parquet file.
8
+
* We precompute the text embeddings in `compute_embeddings.py` and serialize them into a parquet file.
9
+
* Even though optional, we load the T5-xxl in NF4 to further reduce the memory foot-print.
9
10
*`train_dreambooth_lora_flux_miniature.py` takes care of training:
10
11
* Since we already precomputed the text embeddings, we don't load the text encoders.
11
12
* We load the VAE and use it to precompute the image latents and we then delete it.
0 commit comments