Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Enhancement] Extend Backend to Support SDK base response version 3.0 for RAG Evaluators #2253

Conversation

aybruhm
Copy link
Member

@aybruhm aybruhm commented Nov 13, 2024

Description

This PR extends the backend to support the SDK BaseResponse version 3.0 for RAG evaluators.

Related Issue

Closes AGE-1288

…3.0 and improve nested value extraction

- Added handling for version 3.0 response structure.
- Introduced a helper function `get_nested_value` to safely retrieve nested values from dictionaries.
- Updated trace latency calculation for version 3.0 with microsecond precision.
- Enhanced handling of missing or unexpected fields in the response.
- Ensured backward compatibility with version 2.0 and generic responses.
Copy link

vercel bot commented Nov 13, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
agenta ❌ Failed (Inspect) Nov 19, 2024 1:51pm
agenta-documentation ✅ Ready (Inspect) Visit Preview 💬 Add feedback Nov 19, 2024 1:51pm

@dosubot dosubot bot added the size:L This PR changes 100-499 lines, ignoring generated files. label Nov 13, 2024
@aybruhm aybruhm changed the base branch from main to feature/age-1285-inline-traces-update-sdk-to-return-baseresponse-version30 November 13, 2024 17:13
@dosubot dosubot bot added enhancement New feature or request refactoring size:M This PR changes 30-99 lines, ignoring generated files. and removed size:L This PR changes 100-499 lines, ignoring generated files. labels Nov 13, 2024
@aybruhm aybruhm requested a review from jp-agenta November 13, 2024 17:14
…eresponse-version30' into feature/age-1288-inline-traces-update-backend-to-use-baseresponse-version30
…eresponse-version30' into feature/age-1288-inline-traces-update-backend-to-use-baseresponse-version30
…d extract field values from trace trees for BaseResponse v3.0, with backward compatibility
@dosubot dosubot bot added size:XL This PR changes 500-999 lines, ignoring generated files. and removed size:M This PR changes 30-99 lines, ignoring generated files. labels Nov 17, 2024
@aybruhm aybruhm changed the title [Enhancement]: Extend extract_result_from_response to Support Version 3.0 and Improve Error Handling [Enhancement] Extend Backend to Support SDK base response version 3.0 for RAG Evaluators Nov 18, 2024
@aybruhm aybruhm requested a review from jp-agenta November 18, 2024 07:46
@aybruhm aybruhm merged commit 438b87f into feature/age-1285-inline-traces-update-sdk-to-return-baseresponse-version30 Nov 19, 2024
7 of 9 checks passed
@aybruhm aybruhm deleted the feature/age-1288-inline-traces-update-backend-to-use-baseresponse-version30 branch November 19, 2024 14:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request refactoring size:XL This PR changes 500-999 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants