Add ORPO Trainer + support HF metrics directly from chunked loss functions + fixes to avoid torch compile recompilations#429
Merged
ByronHsu merged 12 commits intomainfrom shisahni/orpo_integrateDec 6, 2024
+503-78
Commits
Commits on Dec 6, 2024
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
