Support inference with OFT networks#13692

Merged

AUTOMATIC1111 merged 26 commits intoAUTOMATIC1111:devfrom v0xie:network-oft

Nov 19, 2023

+157

Commits on Oct 19, 2023

Commits on Nov 2, 2023

test implementation based on kohaku diag-oft implementation
v0xie
committed
detect diag_oft type
v0xie
committed
no idea what i'm doing, trying to support both type of OFT, kblueleaf diag_oft has MultiheadAttn which kohya's doesn't?, attempt create new module based off network_lora.py, errors about tensor dim…
v0xie
committed

Commits on Nov 15, 2023

fix: ignore calc_scale() for COFT which has very small alpha
v0xie
committed

Commits on Nov 16, 2023

feat: LyCORIS/kohya OFT network support
v0xie
committed