Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TRAINING LORA please give more info #17

Open
Maelstrom2014 opened this issue Aug 9, 2024 · 1 comment
Open

TRAINING LORA please give more info #17

Maelstrom2014 opened this issue Aug 9, 2024 · 1 comment

Comments

@Maelstrom2014
Copy link

HI, thanx for excelent solution and resolution!
Plase give more information about training LORA:

  1. How much VRAM I need?
  2. How long it takes to train? epochs, how many pics I need?
  3. What resolution/aspects, of pics I need in dataset?
@catcathh
Copy link
Owner

catcathh commented Sep 2, 2024

Thanks for your interest.

  1. When training a LoRA , the VRAM usage is highly dependent on the image resolution. For instance, with an image resolution of 4096x4096, the VRAM requirement can reach approximately 60 GB on A100.
  2. For the cat example I provided, training took around 5,000 iterations.To optimize the process, you may first train the model at a lower base resolution (such as 1024x1024) and then fine-tune it on higher resolutions.
  3. Using ~ 10 images with varying resolutions and aspect ratios should be sufficient for effective training. I provide data used for lora at https://github.com/catcathh/UltraPixel/tree/main/figures/example_lora_cat.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants