-
Notifications
You must be signed in to change notification settings - Fork 399
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Removing extra token classification metrics in backend #3045
Removing extra token classification metrics in backend #3045
Conversation
Codecov ReportPatch coverage:
Additional details and impacted files@@ Coverage Diff @@
## releases/1.8.0 #3045 +/- ##
==================================================
- Coverage 90.86% 90.75% -0.11%
==================================================
Files 208 208
Lines 11096 11067 -29
==================================================
- Hits 10082 10044 -38
- Misses 1014 1023 +9
Flags with carried forward coverage won't be shown. Click here to find out more.
☔ View full report in Codecov by Sentry. |
…gilla-io/argilla into cleaning-token-classification-metrics
Description
The purpose of this PR is to reduce the number of generated properties used for token classification metrics computation. Sometimes these extra properties raise index errors as described in issue #1499
With these changes, the
tokens_length
,token_lenght
,mention_lengh
, andentity_density
metrics will return no data from new servers.Refs #1499
Type of change
(Please delete options that are not relevant. Remember to title the PR according to the type of change)
How Has This Been Tested
Current tests have been adapted to the changes
Checklist