Code to run experiments over Multiple Choice QA with huggingface/transformers. A big part of the code comes from huggingface/transformers, so its license may apply (Apache v2).
- mc_transformers.py: Code to train/eval/test models over any collection with transfomers
- utils_mc.py: Contains processors specific to each MC QA collection (RACE, SWAG, EntranceExams...)
As I experiment with more MC collection and training modes (i.e.: tpu), support for more collections or more models is required. Instead of forking the whole transformers library I do it here.
This package was created with Cookiecutter and the audreyr/cookiecutter-pypackage project template.