MLXKit is a Swift library that provides an OpenAI compatible API layer to MLX. MLXKit can be used to create MLX servers or incorporated in chat clients.
MLXKit is in development and not intented for production.
| OpenAI API | |
|---|---|
| ✅ | Chat completion |
| ✅ | Chat completion streaming |
| ❌ | Vision |
| ❌ | Text to speech |
| ❌ | Speech to text |
| ❌ | Moderation |
| ❌ | Images |
| ❌ | Assistants (beta) |
| ❌ | Embeddings |
| ❌ | Fine-tuning |
See MLX Community on HuggingFace
The MLXKit package can be built from Xcode or SwiftPM.
In Xcode you can add https://github.com/ronaldmannak/MLXkit as a package dependency.
- MLX is only available on devices running macOS >= 13.5 It is highly recommended to use macOS 14 (Sonoma)