Automatically create summary table after scripts/setfit/run_fewshot.py

[tomaarsen]

Closes #246

Hello!

Pull Request overview

• Automatically create summary table after scripts/setfit/run_fewshot.py.
• Resolve potential NameError in create_summary_table if the sample_sizes is an empty list.

Details

Note that create_summary_table.py is located one directory higher than run_fewshot.py. As a result, if we want to preserve that run_fewshot.py can be called like python run_fewshot.py from the scripts/setfit directory, then we must apply the following hack:

sys.path.insert(0, os.path.join(os.path.dirname(__file__), ".."))
from create_summary_table import create_summary_table

As opposed to the "normal" approach of:

from scripts.create_summary_table import create_summary_table

which would only work from the repository's root directory. All of these work due to the hack:

[path]/setfit/scripts/setfit> python run_fewshot.py
[path]/setfit/scripts> python setfit/run_fewshot.py
[path]/setfit> python scripts/setfit/run_fewshot.py

---

Furthermore, metric_name was only defined in a loop body, and then returned after the loop. If the list over which was being looped was empty, then this would cause a NameError, as metric_name was never defined. I've avoided that by also initializing the variable before the loop.

cc: @danielkorat

• Tom Aarsen

[danielkorat]

Thanks @tomaarsen !
What's the status of this PR?

[tomaarsen]

It's awaiting review/ready to merge. I tend not to merge my own PRs without someone's review.

[tomaarsen]

That said, if you're willing and able to provide a review, I'd appreciate it :)

[danielkorat]

@tomaarsen Sure, it was on my to do list :)

[danielkorat]

@tomaarsen Looks very good, thanks! Feel free to merge when possible.

[tomaarsen]

Wonderful! Thanks for the review.