Add RAG end-to-end task and metrics to unitxt + clapNQ dataset for RAG end-to-end task #1048

benjaminsznajder · 2024-07-23T09:42:23Z

Currently, the RAG end-to-end (including indexing and retrieval + generation) is not in public catalog of unitxt.

We need to add:

metrics
tasks definitions.

In addition, the public dataset ClapNQ has to be added for writing the example code of RAG end-to-end

benjaminsznajder added the enhancement New feature or request label Jul 23, 2024

benjaminsznajder self-assigned this Jul 23, 2024

benjaminsznajder mentioned this issue Jul 23, 2024

Add end-to-end RAG example #966

Open

benjaminsznajder changed the title ~~Add RAG end-to-end task and metrics to unitxt~~ Add RAG end-to-end task and metrics to unitxt + clapNQ dataset for RAG end-to-end task Jul 23, 2024

benjaminsznajder linked a pull request Jul 23, 2024 that will close this issue

Benjams/add rag task card and metric #1044

Merged

benjaminsznajder closed this as completed in #1044 Jul 29, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add RAG end-to-end task and metrics to unitxt + clapNQ dataset for RAG end-to-end task #1048

Add RAG end-to-end task and metrics to unitxt + clapNQ dataset for RAG end-to-end task #1048

benjaminsznajder commented Jul 23, 2024 •

edited

Loading

Add RAG end-to-end task and metrics to unitxt + clapNQ dataset for RAG end-to-end task #1048

Add RAG end-to-end task and metrics to unitxt + clapNQ dataset for RAG end-to-end task #1048

Comments

benjaminsznajder commented Jul 23, 2024 • edited Loading

benjaminsznajder commented Jul 23, 2024 •

edited

Loading