You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
To fix GA bug, latest transformers no longer imports CrossEntropyLoss. Instead, it's wrapped in self.loss_function which can be traced back to here. So that current patching method doesn't work on latest transformers model.
🐛 Describe the bug
To fix GA bug, latest transformers no longer imports CrossEntropyLoss. Instead, it's wrapped in
self.loss_function
which can be traced back to here. So that current patching method doesn't work on latest transformers model.Note that labels and logits shifting operations are wrapped in
loss_function
as well, we need to take care of it when implementing new patching method.Reproduce
No response
Versions
none
The text was updated successfully, but these errors were encountered: