fix: Multiple-E dataset fix go_test.go path for test execution #225
+3
−2
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Context along with reproducer described in the issue:
Resolves #224
When I checked the different values of language field can in in the dataset for different languages supported in the
multiple.py
, seems like all of them have the same name exceptgo
(Adding the repro and screenshot below for this statement).I tried to track the flow of problem['language'] field which I am changing in the PR to make sure it doesn't affect any other language, it seems like this field is only used in the containerized_eval.py to decide the evaluation script to execute and the file extension, and shouldn't affect other language.
I guess the additional fields and seperate handling of the go_test.go was done for different dataset revisions ?
Please let me know if the flow looks good.
Thanks !!