Skip to content

Issues: explodinggradients/ragas

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

287 Open 720 Closed
287 Open 720 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Issues with await for language adapt bug Something isn't working module-testsetgen Module testset generation
#1925 opened Feb 14, 2025 by shawn-maxiao
1
Language adaptation for synthetic test data does not work bug Something isn't working module-testsetgen Module testset generation
#1923 opened Feb 14, 2025 by googan40
6
How to use TongYi's text-embedding-v1 embeddings model question Further information is requested
#1922 opened Feb 14, 2025 by LillyChen
2
SingleHopQuerySynthesizer::prepare_combinations() bug Something isn't working module-testsetgen Module testset generation question Further information is requested
#1917 opened Feb 11, 2025 by lryan599
Use compression when saving knowledge graphs enhancement New feature or request module-testsetgen Module testset generation
#1916 opened Feb 11, 2025 by lryan599
1
Wrong cache hits for LlamaIndexEmbeddingsWrapper bug Something isn't working
#1915 opened Feb 11, 2025 by triedel42
The metric NoiseSensitivity always timeout bug Something isn't working module-metrics this is part of metrics module question Further information is requested
#1914 opened Feb 11, 2025 by hsx1612727380
Changing instruction language yields upload error bug Something isn't working question Further information is requested
#1912 opened Feb 10, 2025 by emseoyk
1 task done
@jjmachan
2
Context Precision Calculation module-metrics this is part of metrics module question Further information is requested
#1905 opened Feb 5, 2025 by ishachinniah-hds
2
StatementGeneratorPrompt's instruction mentions "statements", but these are not part of inputs anymore bug Something isn't working module-metrics this is part of metrics module
#1904 opened Feb 5, 2025 by diegodebrito
1
Generator Testset Portuguese Support module-testsetgen Module testset generation question Further information is requested
#1902 opened Feb 5, 2025 by jpfcabral
1
ModuleNotFoundError: No module named 'ragas.testset.evolutions' bug Something isn't working module-testsetgen Module testset generation question Further information is requested
#1897 opened Feb 2, 2025 by sahlebrahim
3
Discord invite links are invalid bug Something isn't working
#1896 opened Feb 1, 2025 by carlosgsouza
@jjmachan
3
does it support deepseek question Further information is requested
#1895 opened Feb 1, 2025 by landhu
2
Incorrect calculation at ToolCallAccuracy bug Something isn't working module-metrics this is part of metrics module
#1893 opened Feb 1, 2025 by licux
2
Response Relevancy: TypeError: object of type 'StringPromptValue' has no len() answered 🤖 The question has been answered. Will be closed automatically if no new comments bug Something isn't working module-metrics this is part of metrics module
#1892 opened Jan 30, 2025 by ishachinniah-hds
@jjmachan
9
Instability in answer relevance score bug Something isn't working question Further information is requested
#1889 opened Jan 30, 2025 by laughinghugs
@jjmachan
1
difference between retrieved contexts and reference contexts question Further information is requested
#1882 opened Jan 26, 2025 by Sara-Hossny
3
Traces in evaluation result are only saving the last prompt per trace name bug Something isn't working module-metrics this is part of metrics module
#1871 opened Jan 22, 2025 by VladTabakovCortea
1
@jjmachan
6
Error while executing the code example in the Migration Guide Documentation bug Something isn't working module-metrics this is part of metrics module
#1866 opened Jan 22, 2025 by GenAI-Rocky
1
How can I evaluate image retrieval? question Further information is requested
#1859 opened Jan 21, 2025 by simjak
2
How can I evaluate Ollama models such as Llama 3.3 using RAGAS? question Further information is requested
#1857 opened Jan 20, 2025 by HaniaMo
4
Prompt ${xx_prompt} failed to parse output: The output parser failed to parse the output including retries. bug Something isn't working question Further information is requested
#1856 opened Jan 20, 2025 by hsx1612727380
1
ValueError: cannot reshape array of size 1024 into shape (3, newaxis) bug Something isn't working question Further information is requested
#1854 opened Jan 18, 2025 by hsx1612727380
5
About Exception raised in Job[]: TimeoutError() bug Something isn't working module-metrics this is part of metrics module
#1850 opened Jan 16, 2025 by erliang-sf
ProTip! Find all open issues with in progress development work with linked:pr.