-
Notifications
You must be signed in to change notification settings - Fork 228
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Make an eval script for SQuaD #285
Comments
chenmoneygithub
added
type:Bug
Something isn't working
and removed
type:Bug
Something isn't working
labels
Aug 7, 2022
Is this issue specifically for the BERT example? |
It's for general purpose, I am thinking we should have some components for eval purposes. |
It might be good to build the script specifically for BERT right now, and then shuffle of the components as we get a better understanding of what we need. |
Assigning this to @aflah02 as I think you are the one actively working on this. |
yup thanks! |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
From a high level it is just a classification task, but there are some details to handle. The whole workflow can be described as:
answer_start
field, calculate theanswer_end
value, representing the index of start and end in the context.The text was updated successfully, but these errors were encountered: