[Partial Fix] Model pickability

[blefaudeux]

What does this PR do?

Touches #203, but not for all configurations for now

Before submitting

• Did you have fun?
  • Make sure you had fun coding 🙃
• Did you read the contributor guideline?
• Was this discussed/approved via a Github issue? (no need for typos, doc improvements)
  • N/A
• Did you make sure to update the docs?
  • N/A
• Did you write any new necessary tests?
  • N/A
• Did you update the changelog? (if needed)
  • N/A

PR review

Anyone in the community is free to review the PR once the tests have passed.
If we didn't discuss your PR in Github issues there's a high chance it will not be merged.

[blefaudeux]

cc @jramapuram

[codecov-commenter]

Codecov Report

Merging #204 (bdc05b3) into main (093224e) will increase coverage by 0.10%.
The diff coverage is 80.00%.

@@            Coverage Diff             @@
##             main     #204      +/-   ##
==========================================
+ Coverage   91.52%   91.62%   +0.10%     
==========================================
  Files          59       59              
  Lines        2996     2998       +2     
==========================================
+ Hits         2742     2747       +5     
+ Misses        254      251       -3     

Flag	Coverage Δ
Python	91.62% <80.00%> (+0.10%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
xformers/components/in_proj_container.py	76.31% <75.00%> (+1.99%)	⬆️
xformers/components/attention/blocksparse.py	94.20% <100.00%> (ø)
...rmers/components/feedforward/mixture_of_experts.py	92.42% <100.00%> (ø)
xformers/factory/block_factory.py	93.93% <0.00%> (+1.21%)	⬆️

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 093224e...bdc05b3. Read the comment docs.

[blefaudeux]

Submitting this for review already, and I'll try to find a solution for the triton parts in another PR

[jramapuram]

Many thanks @blefaudeux ! Appreciate the quick fix!