v0.18.0

Break Changing

Add custom request parameters based on patch, other than extra_fields

We used to add request parameters to models using extra_fields, but this approach lacked flexibility. We've now switched to a patch mechanism, which allows for customizing request parameters for one or more models.

The following examples enable web search functionality for all Cohere models.

  - type: cohere
    patches:
      ".*":
        request_body:
          connectors:
            - id: web-search

Remove all tokenizers

Different platforms may utilize varying tokenizers for their models, even across versions of the same model. For example, gpt-4 uses o200k_base while gpt-4-turbo and gpt-3.5-turbo employ cl100k_base.

AIChat supports 100 models, It's impossible to support all tokenizers, so we're removing them entirely and switching to a estimation algorithm.

Function Calling

Function calling supercharges LLMs by connecting them to external tools and data sources. This unlocks a world of possibilities, enabling LLMs to go beyond their core capabilities and tackle a wider range of tasks.

We have created a new repository to help you make the most of this feature: https://github.com/sigoden/llm-functions

Here's a glimpse of what function calling can do for you:

New Models

• gemini:gemini-1.5-flash-latest
• gemini-1.5-flash-preview-0514
• qianwen:qwen-long

Features

• Allow binding model to the role (#505)
• Remove tiktoken (#506)
• Support function calling (#514)
• Webui add toolbox(copy-bt/regenerate-btn) to message (#521)
• Webui operates independently from aichat (#527)
• Allow patching req body with client config (#534)

Bug Fixes

• No builtin roles if no roles.yaml (#509)
• Unexpect enter repl if have pipe-in but no text args (#512)
• Panic when check api error (#520)
• Webui issue with image (#523)
• Webui message body do not autoscroll to bottom sometimes (#525)
• JSON stream parser and refine client modules (#538)
• Bedrock issues (#544)

New Contributors

• @rolfwilms made their first contribution in #544
• @ProjectMoon made their first contribution in #549

Full Changelog: v0.17.0...v0.18.0