Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Catch LLM Eval Failures #2272

Merged
merged 7 commits into from
Aug 31, 2024
Merged

Catch LLM Eval Failures #2272

merged 7 commits into from
Aug 31, 2024
+72 −49

Conversation

yuhongsun96
Copy link
Contributor

@yuhongsun96 yuhongsun96 commented Aug 30, 2024 •
edited by pablonyx
Loading

Description

Screenshot 2024-08-30 at 4 17 40 PM

How Has This Been Tested?

[Describe the tests you ran to verify your changes]

Accepted Risk

[Any know risks or failure modes to point out to reviewers]

Related Issue(s)

[If applicable, link to the issue(s) this PR addresses]

Checklist:

  • All of the automated tests pass
  • All PR comments are addressed and marked resolved
  • If there are migrations, they have been rebased to latest main
  • If there are new dependencies, they are added to the requirements
  • If there are new environment variables, they are added to all of the deployment methods
  • If there are new APIs that don't require auth, they are added to PUBLIC_ENDPOINT_SPECS
  • Docker images build and basic functionalities work
  • Author has done a final read through of the PR right before merge

@vercel Vercel
Copy link

vercel bot commented Aug 30, 2024 •
edited
Loading

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
internal-search ✅ Ready (Inspect) Visit Preview 💬 Add feedback Aug 30, 2024 11:32pm

@yuhongsun96 yuhongsun96 changed the title k Catch LLM Eval Failures Aug 30, 2024
@pablonyx pablonyx force-pushed the catch-eval-failures branch from d2ef374 to d442f09 Compare August 30, 2024 23:16
@yuhongsun96 yuhongsun96 merged commit f01027c into main Aug 31, 2024
6 of 7 checks passed
@yuhongsun96 yuhongsun96 deleted the catch-eval-failures branch August 31, 2024 00:43
@onimsha onimsha mentioned this pull request Sep 13, 2024
Merged
8 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@yuhongsun96 @pablonyx