Code

WIP: Add DPR Training#273

Code

Closed

kolk wants to merge 23 commits intomasterdeepset-ai/haystack:masterfrom dpr_data_preprocessingdeepset-ai/haystack:dpr_data_preprocessingCopy head branch name to clipboard

+67,888-369

Commits

Commits on Jul 17, 2020

• WIP add eval for DPR

  tholor

  committed
  e258b72

  Copy full SHA for e258b72

Commits on Jul 20, 2020

• increase timeout for ES retrieval. add describe_documents()

  tholor

  committed
  03c991f

  Copy full SHA for 03c991f

• Update tutorials

  tholor

  committed
  9dae1e6

  Copy full SHA for 9dae1e6

• Add comment in tutorial

  tholor

  committed
  eff84ff

  Copy full SHA for eff84ff

Commits on Jul 21, 2020

• add basic tests for eval

  tholor

  committed
  1b0175b

  Copy full SHA for 1b0175b

• WIP refactor add_eval_data

  tholor

  committed
  15f5bc4

  Copy full SHA for 15f5bc4

Commits on Jul 22, 2020

• refactor retriever.eval() to use Label objects and allow open domain eval

  tholor

  committed
  fdc4720

  Copy full SHA for fdc4720

• refactor Document class. Introducing UUID

  tholor

  committed
  0d7944c

  Copy full SHA for 0d7944c

• refactor FARMReader.eval()

  tholor

  committed
  585d45b

  Copy full SHA for 585d45b

• fix ES and inmemory tests

  tholor

  committed
  2e2113c

  Copy full SHA for 2e2113c

Commits on Jul 23, 2020

• Refactor SQL store to comply with the changes

  tanaysoni

  committed
  58a00f7

  Copy full SHA for 58a00f7

• Refactor InMemory Document Store to comply with the changes

  tanaysoni

  committed
  7ebbe4c

  Copy full SHA for 7ebbe4c

• Update test fixtures

  tanaysoni

  committed
  83964e9

  Copy full SHA for 83964e9

• Fix breaking tests for reader

  tanaysoni

  committed
  c489f72

  Copy full SHA for c489f72

• Fix SQL query

  tanaysoni

  committed
  1a33498

  Copy full SHA for 1a33498

Commits on Jul 27, 2020

• Make eval comptabile with SQL and InMemory Document Stores

  tanaysoni

  committed
  74a4f2e

  Copy full SHA for 74a4f2e

• Add default index value

  tanaysoni

  committed
  55245bd

  Copy full SHA for 55245bd

Commits on Jul 29, 2020

• dpr json to squad json conversion

  kolk

  committed
  c587be7

  Copy full SHA for c587be7

Commits on Jul 30, 2020

• changed filename and arguments, added checks in find_answer_start

  kolk

  committed
  0f1fc63

  Copy full SHA for 0f1fc63

• removed testing lines

  kolk

  committed
  6608b93

  Copy full SHA for 6608b93

Commits on Aug 4, 2020

• tutorial 7: DPR training data preprocessing, find_answer_start bug fix in utils

  kolk

  committed
  9a3d1e2

  Copy full SHA for 9a3d1e2

• Bug fix for Tutorial7_Create_preprocessed_data_for_Dense_Retrieval_training.ipynb

  kolk

  committed
  28106e4

  Copy full SHA for 28106e4

Commits on Aug 11, 2020

• HFBertEncoder replaced with transformer DPR encoders

  kolk

  committed
  541c414

  Copy full SHA for 541c414