Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Enhancement]: Add fail-safe logic to compute duration when running evaluations #2351

Conversation

aybruhm
Copy link
Member

@aybruhm aybruhm commented Dec 8, 2024

Description

This PR resolves an issue where evaluations fail in cloud.beta due to a missing metrics attribute in the SpanDTO. The issue stemmed from the templates using an outdated version of the SDK, which prevented the computation of duration and latency for evaluation runs, leading to errors.

The templates have been updated to use the latest SDK version. Additionally, a fail-safe logic has been implemented to compute the duration using the TimeDTO, ensuring evaluations can proceed without errors even if the metrics attribute is unavailable.

Related Issue

Closes AGE-1448

Copy link

vercel bot commented Dec 8, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
agenta ✅ Ready (Inspect) Visit Preview 💬 Add feedback Dec 8, 2024 10:39am
agenta-documentation ✅ Ready (Inspect) Visit Preview 💬 Add feedback Dec 8, 2024 10:39am

@jp-agenta jp-agenta merged commit 21fc7b1 into main Dec 9, 2024
11 checks passed
@jp-agenta jp-agenta deleted the feature/age-1448-sdk-x-evaluations-missing-metrics-attribute-in-spandto branch December 9, 2024 14:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request SDK size:S This PR changes 10-29 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants