Skip to content

v0.6.0

Compare
Choose a tag to compare
@github-actions github-actions released this 27 Nov 02:48
· 2020 commits to main since this release

πŸš€ Features

πŸ‘· Built-in distributed workers support: running completion / chat model worker on different process / machine.

image

πŸ’¬ Conversation history in chat playground.

image

🧰 Fixes and Improvements

  • Fix the slow repository indexing due to constraint memory arena in tantivy index writer.
  • Command line argument --model is now optional, so users can create a chat only instance.
  • New command line argument --parallelism to control the throughput and VRAM usage: #727
  • New api path/metrics endpoint for prometheus metrics collection.

πŸ’« New Contributors

Full Changelog: v0.5.5...v0.6.0