Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update arize_callback.py #6433

Merged
merged 11 commits into from
Jun 20, 2023
Merged

Update arize_callback.py #6433

merged 11 commits into from
Jun 20, 2023

Conversation

hakantekgul
Copy link
Contributor

@hakantekgul hakantekgul commented Jun 19, 2023

Arize released a new Generative LLM Model Type, adjusting the callback function to new logging.

Added arize imports, please delete if not necessary.

Specifically, this change makes sure that the prompt and response pairs from LangChain agents are logged into Arize as a Generative LLM model, instead of our previous categorical model. In order to do this, the callback functions collects the necessary data and passes the data into Arize using Python Pandas SDK.

Arize library, specifically pandas.logger is an additional dependency.

Notebook For Test: https://docs.arize.com/arize/resources/integrations/langchain

Who can review?
Tag maintainers/contributors who might be interested:

@hwchase17 - project lead

Tracing / Callbacks

@agola11

Fixed some issues with type annotations
@vercel
Copy link

vercel bot commented Jun 19, 2023

@hakantekgul is attempting to deploy a commit to the LangChain Team on Vercel.

A member of the Team first needs to authorize it.

@hakantekgul hakantekgul marked this pull request as ready for review June 19, 2023 18:00
@vowelparrot vowelparrot merged commit 6a157cf into langchain-ai:master Jun 20, 2023
This was referenced Jun 25, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants