Can this be tested in kohya_ss

[rafstahelin]

I'd like to try this for Stable Diffusion in Kohya_ss.

[cheald]

All you need to do is install the library, set optimizer_type = "schedulefree.AdamWScheduleFree" in your configuration, and add optimizer.train() after the call to train_util.get_optimizer(). Works like a charm.

[sdbds]

kohya-ss/sd-scripts#1250
Wait it merged into.

[rafstahelin]

@sdbds @cheald could you kindly suggest what basic settings to use with it? Additional parameters or optimiser args? Thanks!