v1.2.0 Add Mamba

Welcome 🐍 Codestral-Mamba and 🔢 Mathstral

pip install mistral-inference>=1.2.0

Codestral-Mamba

pip install packaging mamba-ssm causal-conv1d transformers

1. Download

export MAMBA_CODE=$HOME/7B_MAMBA_CODE
wget https://models.mistralcdn.com/codestral-mamba-7b-v0-1/codestral-mamba-7B-v0.1.tar
mkdir -p $MAMBA_CODE
tar -xf codestral-mamba-7B-v0.1.tar -C $MAMBA_CODE

2. Chat

mistral-chat $HOME/7B_MAMBA_CODE --instruct --max_tokens 256

Mathstral

1. Download

export MATHSTRAL=$HOME/7B_MATH
wget https://models.mistralcdn.com/mathstral-7b-v0-1/mathstral-7B-v0.1.tar
mkdir -p $MATHSTRAL
tar -xf mathstral-7B-v0.1.tar -C $MATHSTRAL

2. Chat

mistral-chat $HOME/7B_MATH --instruct --max_tokens 256

Blogs:
Blog Codestral Mamba 7B: https://mistral.ai/news/codestral-mamba/
Blog Mathstral 7B: https://mistral.ai/news/mathstral/

What's Changed

• add a note about GPU requirement by @sophiamyang in #158
• Add codestral by @patrickvonplaten in #164
• Update README.md by @patrickvonplaten in #165
• fixing type in README.md by @didier-durand in #175
• Fix: typo in ModelArgs: "infered" to "inferred" by @CharlesCNorton in #174
• fix: typo in LoRALoaderMixin: correct "multipe" to "multiple" by @CharlesCNorton in #173
• fix: Correct typo in classifier.ipynb from "alborithm" to "algorithm" by @CharlesCNorton in #167
• Fix: typo in error message for state_dict validation by @CharlesCNorton in #172
• fix: Correct misspelling in ModelArgs docstring by @CharlesCNorton in #171
• Update README.md by @patrickvonplaten in #168
• fix: typo in HF_TOKEN environment variable check message by @CharlesCNorton in #179
• Adding Issue/Bug template. by @pandora-s-git in #178
• typo in ModelArgs class docstring. by @CharlesCNorton in #183
• Update README.md by @Simontwice in #184
• Add mamba by @patrickvonplaten in #187

New Contributors

• @didier-durand made their first contribution in #175
• @CharlesCNorton made their first contribution in #174
• @pandora-s-git made their first contribution in #178
• @Simontwice made their first contribution in #184

Full Changelog: v1.1.0...v1.2.0