[tooling] Vit comparison bench

[blefaudeux]

What does this PR do?

Closes #108
Gives a way to compare end to end with an optimized PyTorch implementation
Interesting takeaways already

Before submitting

• Did you have fun?
  • Make sure you had fun coding 🙃
• Did you read the contributor guideline?
• Was this discussed/approved via a Github issue? (no need for typos, doc improvements)
  • N/A
• Did you make sure to update the docs?
  • N/A
• Did you write any new necessary tests?
  • N/A
• Did you update the changelog? (if needed)
  • N/A

PR review

Anyone in the community is free to review the PR once the tests have passed.
If we didn't discuss your PR in Github issues there's a high chance it will not be merged.

[codecov-commenter]

Codecov Report

Merging #117 (9499a7a) into main (2d67cf2) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main     #117   +/-   ##
=======================================
  Coverage   87.22%   87.22%           
=======================================
  Files          49       49           
  Lines        2490     2490           
=======================================
  Hits         2172     2172           
  Misses        318      318           

Flag	Coverage Δ
Python	87.22% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 2d67cf2...9499a7a. Read the comment docs.

[dianaml0]

Really awesome to have!