Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[Transformer] fix ORPO loss for MOE models (#479)
## Summary Add missing MOE loss when specified in the trainer. - Hardware Type: <BLANK> - [x] run `make test` to ensure correctness - [x] run `make checkstyle` to ensure code style - [x] run `make test-convergence` to ensure convergence
- Loading branch information