Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BEIR dataset comparison -- adding queries2queries and queries2corpus comparison; Fixing bugs #1169

Open
wants to merge 13 commits into
base: master
Choose a base branch
from

Conversation

amyxie361
Copy link
Member

@amyxie361 amyxie361 commented May 12, 2022

fix bug and add query2query query2corpus comparison
New Feature:

  1. enable the columns and row come from different corpus (rows from queries and columns from corpus)

Bugs:

  1. for weighted_jaccard, should use cfs before filter
  2. previously, cfs = dfs = stats = {} will bound the objects together, split them in this pr
  3. default tokenizer should be bert-base-uncased

@amyxie361 amyxie361 changed the title Yuqingxie/q2q compare BEIR dataset comparison -- adding queries2queries and queries2corpus comparison; Fixing bugs May 12, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant