v0.2.4

What's Changed

• fix build on metal by returning Device by @rgbkrk in #642
• Add invite to Matrix chatroom by @EricLBuehler in #644
• Make sure we don't have dead links by @EricLBuehler in #647
• Fix more links by @EricLBuehler in #648
• Throughput for interactive mode by @EricLBuehler in #655
• Implement tool calling by @EricLBuehler in #649
• Fix device map check for paged attn by @EricLBuehler in #656
• Fix for mistral nemo in gguf by @EricLBuehler in #657
• Fix check of cache config when device mapping + PA by @EricLBuehler in #658
• Biollama in tool calling example by @EricLBuehler in #659
• Biollama in tool calling example by @EricLBuehler in #660
• Examples for simple tool calling by @EricLBuehler in #661
• Bump version to 0.2.4 by @EricLBuehler in #662

New Contributors

• @rgbkrk made their first contribution in #642

Full Changelog: v0.2.3...v0.2.4

MSRV

MSRV is 1.75

Install mistralrs-server 0.2.4

Install prebuilt binaries via shell script

curl --proto '=https' --tlsv1.2 -LsSf https://github.com/EricLBuehler/mistral.rs/releases/download/v0.2.4/mistralrs-server-installer.sh | sh

Download mistralrs-server 0.2.4

File	Platform	Checksum
mistralrs-server-aarch64-apple-darwin.tar.xz	Apple Silicon macOS	checksum
mistralrs-server-x86_64-apple-darwin.tar.xz	Intel macOS	checksum
mistralrs-server-x86_64-unknown-linux-gnu.tar.xz	x64 Linux	checksum