-
Notifications
You must be signed in to change notification settings - Fork 38
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
P1-Retrieved Results Cache #33
Comments
@ronakice it seems like you are looking for volunteers for this one, I unassigned it so that people can pick |
Updating this with the following link: https://github.com/castorini/rank_llm_data |
Please interface with this! |
interested |
Something like: If it exists and matches md5 use it, else get it from rank_llm_data if there, else run retrieve. Eventually, the rerank_results can be added to rank_llm_data too for verification. But not priority for now. This will likely fall into place after we have a nice 2CR after #32 is mature |
This is super important so bumping to P1. More people want to repro the baselines before jumping into their own dataset and making them download SPLADE indexes every time is probably not optimal |
Provide important cached retrieve results as well as rerank results hosted elsewhere but documented here. I can perhaps do this sometime.
The text was updated successfully, but these errors were encountered: