[hotfix] Init typo

[blefaudeux]

What does this PR do?

I don't think that fixes #219, but related (init not properly done). Caught when implementing #227, I think that we would need to add a proper explicit/programable init to the model factory to rule out any issue there.

In the meantime this must have been a typo, I'm not sure when it slipped in but does not make a lot of sense (biases are typically zero-init but linear weights are one-init for instance, this line would nuke that). This PR makes sure that by default the init values defined by the components are preserved

cc @jramapuram

Before submitting

• Did you have fun?
  • Make sure you had fun coding 🙃
• Did you read the contributor guideline?
• Was this discussed/approved via a Github issue? (no need for typos, doc improvements)
  • N/A
• Did you make sure to update the docs?
  • N/A
• Did you write any new necessary tests?
  • N/A
• Did you update the changelog? (if needed)
  • N/A

PR review

Anyone in the community is free to review the PR once the tests have passed.
If we didn't discuss your PR in Github issues there's a high chance it will not be merged.

[codecov-commenter]

Codecov Report

Merging #229 (80f4280) into main (dc80aeb) will decrease coverage by 0.01%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##             main     #229      +/-   ##
==========================================
- Coverage   91.72%   91.70%   -0.02%     
==========================================
  Files          60       60              
  Lines        3214     3208       -6     
==========================================
- Hits         2948     2942       -6     
  Misses        266      266              

Flag	Coverage Δ
Python	91.70% <ø> (-0.02%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
xformers/factory/model_factory.py	97.67% <ø> (-0.16%)	⬇️

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update dc80aeb...80f4280. Read the comment docs.

[blefaudeux]

landing, I hope that's ok @dianaml0, hotfix of sorts