v0.9.3.9 - bugfixes, better defaults
What's Changed
LyCORIS
- lycoris model card updates by @bghira in #820
- lycoris: resume should use less vram now by @bghira in #835
- update lycoris to dev branch, 3.0.1dev3 by @bghira in #828
- (#644) temporarily block training on multi-gpu setup with quanto + PEFT, inform user to go with lycoris instead by @bghira in #837
Flux
- Generate and store attention masks for T5 for flux by @AmericanPresidentJimmyCarter in #821
- backwards-compatible flux embedding cache masks by @bghira in #823
- remove clip warning by @bghira in #827
- fix quanto resuming by @bghira in #834
- (#864) add flux final export for full tune by @bghira in #871
- flux: mobius-style training via augmented guidance scale by @bghira in #880
- track flux cfg via wandb by @bghira in #881
Misc features
- add schedulefree optim w/ kahan summation by @bghira in #857
- schedulefree: return to previous stable settings and add a new preset for aggressive training by @bghira in #862
- (#519) add side by side comparison with base model by @bghira in #865
- wandb gallery mode by @bghira in #872
- combine the vae cache clear logic with bucket rebuild logic by @bghira in #879
Misc bug-fixes
- parquet add width and height columns by @frankchieng in #825
- quanto: remove warnings about int8/fp8 confusion as it happened so long ago now; add warning about int4 by @bghira in #826
- Fix caption_with_blip3.py on CUDA by @anhi in #833
- quanto + deepspeed minor fixes for multigpu training by @bghira in #839
- deepspeed sharding fixes by @bghira in #840
- fix: only run save full model on main process by @ErwannMillon in #838
- (#851) remove shard merge code on load hook by @bghira in #853
- csv backend updates by @williamzhuk in #645
- csv fixes by @bghira in #856
- fix validation image filename only using resolution from first img, and, unreadable/untypeable parenthesis by @bghira in #863
- sdxl: dtype inference followup fix by @bghira in #873
New Contributors
- @anhi made their first contribution in #833
- @ErwannMillon made their first contribution in #838
- @williamzhuk made their first contribution in #645
Full Changelog: v0.9.8.3.2...v0.9.3.9