Skip to content

v1.0.0: New updates on SDK

Compare
Choose a tag to compare
@noble-varghese noble-varghese released this 08 Dec 16:08
· 521 commits to main since this release
v1.0.0
22192ff
This commit was created on github.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

Summary

We're pushing out some exciting new updates to Portkey's SDKs, APIs, and Configs.
Portkey's SDKs are upped to major version 1.0 bringing parity with the new OpenAI SDK structure and adding Portkey production features to it. We are also bringing native Langchain & Llamaindex integrations inside the SDK.

NOTE : This is a Breaking Change that Requires Migration.

Here's What's New:

  1. More extensible SDK that can be used with many more LLM providers
  2. Out-of-the-box support for streaming
  3. Completely follows OpenAI's SDK signature reducing your technical debt
  4. Native support for Langchain & Llamaindex within the SDK
  5. Support for the Portkey Feedback endpoint
  6. Support for Portkey Prompt Templates
  7. Older SDK versions to be deprecated soon

Configs 2.0

Here's What's New

  1. New concept of strategy instead of standalone mode. You can now build bespoke gateway strategies and nest them in a single config.
  2. You can also trigger a specific strategy on specific error codes.
  3. New concept of targets that replace options in the previous Config
  4. If you are adding virtual_key to the target array, you no longer need to add provider,Portkey will pick up the Provider directly from the Virtual Key!
  5. For Azure, only now pass the virtual_key - it takes care of all other Azure params like Deployment name, API version etc.

Check out the complete portkeys-december-migration for the complete list of changes usage details.

Assets 2
Loading
0 Join discussion