Code

Add Inline Math Support#517

Code

Merged

VikParuchuri merged 53 commits intodevVikParuchuri/marker:devfrom inline-mathVikParuchuri/marker:inline-mathCopy head branch name to clipboardFeb 13, 2025

+924-344

Commits

Commits on Jan 30, 2025

• Initial inline math support

  tarun-menta

  committed
  f695b49

  Copy full SHA for f695b49

• Run OCR on any missing lines from good pages

  tarun-menta

  committed
  c32eb88

  Copy full SHA for c32eb88

• Cleanup debug statements

  tarun-menta

  committed
  8c9a4fb

  Copy full SHA for 8c9a4fb

• Move line splitting for math boxes from surya into marker

  tarun-menta

  committed
  c7c7dcf

  Copy full SHA for c7c7dcf

Commits on Jan 31, 2025

• Update hashing

  tarun-menta

  committed
  6eb7e83

  Copy full SHA for 6eb7e83

• Refactor fully

  Show description for 834c097
  tarun-menta

  committed
  834c097

  Copy full SHA for 834c097

• Cleanup

  tarun-menta

  committed
  b075c9d

  Copy full SHA for b075c9d

• Refactor splitting logic and add support for character level splitting

  Show description for fd351dd
  tarun-menta

  committed
  fd351dd

  Copy full SHA for fd351dd

Commits on Feb 1, 2025

• Final refactor - Remove char processing logic

  tarun-menta

  committed
  cdd30ab

  Copy full SHA for cdd30ab

• Update test config with new model

  tarun-menta

  committed
  1ed58bf

  Copy full SHA for 1ed58bf

• Cleanup

  tarun-menta

  committed
  34381e6

  Copy full SHA for 34381e6

Commits on Feb 2, 2025

• Char level splicing of inline math into provider lines

  tarun-menta

  committed
  ce867b8

  Copy full SHA for ce867b8

• Merge remote-tracking branch 'origin/texify' into inline-math

  tarun-menta

  committed
  af2c09e

  Copy full SHA for af2c09e

Commits on Feb 3, 2025

• Update equation processor for inline

  tarun-menta

  committed
  1871067

  Copy full SHA for 1871067

• Update OCR and Line Builders

  tarun-menta

  committed
  96c95a2

  Copy full SHA for 96c95a2

Commits on Feb 4, 2025

• Better thresholds

  tarun-menta

  committed
  ddd0616

  Copy full SHA for ddd0616

• Fix tests; Include new builder in args

  tarun-menta

  committed
  9cbaae7

  Copy full SHA for 9cbaae7

• Fix OCR bug - Don't sort lines in RecognitionPredictor

  tarun-menta

  committed
  92e75f9

  Copy full SHA for 92e75f9

• Fix line merging

  tarun-menta

  committed
  a2457e4

  Copy full SHA for a2457e4

• Update text_extraction_method for blocks in OCRBuilder

  tarun-menta

  committed
  861fa91

  Copy full SHA for 861fa91

• Fix OCR+Provider line merging for rotated PDFs

  tarun-menta

  committed
  ffdad8c

  Copy full SHA for ffdad8c

• Set page extraction method in LineBuilder

  tarun-menta

  committed
  43ddda5

  Copy full SHA for 43ddda5

Commits on Feb 5, 2025

• Add flag for inline math instead of running every time

  tarun-menta

  committed
  f3d5e5b

  Copy full SHA for f3d5e5b

• Update test

  tarun-menta

  committed
  82668f3

  Copy full SHA for 82668f3

• Fix tests

  Show description for bbdae4b
  tarun-menta

  committed
  bbdae4b

  Copy full SHA for bbdae4b

Commits on Feb 6, 2025

• Update to new inline detection API

  tarun-menta

  committed
  f0e4745

  Copy full SHA for f0e4745

Commits on Feb 10, 2025

• Skip inline detection for documents with no equations

  tarun-menta

  committed
  0543dba

  Copy full SHA for 0543dba

• Store removed text in math spans

  Show description for 97537a3
  tarun-menta

  committed
  97537a3

  Copy full SHA for 97537a3

Commits on Feb 11, 2025

• Better heuristics for inline math

  Show description for 5037066
  tarun-menta

  committed
  5037066

  Copy full SHA for 5037066

• Cleanup

  tarun-menta

  committed
  162cc8b

  Copy full SHA for 162cc8b

• Ensure inline math is replaced by texify in the case of OCRed text linex

  tarun-menta

  committed
  c359915

  Copy full SHA for c359915

• Better config options

  tarun-menta

  committed
  5cd0f3a

  Copy full SHA for 5cd0f3a

• Fix tests

  tarun-menta

  committed
  4153056

  Copy full SHA for 4153056

• Merge dev

  VikParuchuri

  committed
  e7ac1df

  Copy full SHA for e7ac1df

• Improve efficiency

  VikParuchuri

  committed
  629f57a

  Copy full SHA for 629f57a

Commits on Feb 12, 2025

• Refactor linebuilder:

  VikParuchuri

  committed
  732da6d

  Copy full SHA for 732da6d

• Fix inline math merge

  VikParuchuri

  committed
  019b38a

  Copy full SHA for 019b38a

• Fix span bug

  VikParuchuri

  committed
  a5ff395

  Copy full SHA for a5ff395

• Filter out equation blocks

  VikParuchuri

  committed
  ebad33a

  Copy full SHA for ebad33a

• Improve filtering

  VikParuchuri

  committed
  27f3f7f

  Copy full SHA for 27f3f7f

• Fix OCR mode with math

  VikParuchuri

  committed
  832e096

  Copy full SHA for 832e096

• Fix tests, properly remove stray text

  VikParuchuri

  committed
  5c41a53

  Copy full SHA for 5c41a53

• Cleanup

  VikParuchuri

  committed
  c03ff98

  Copy full SHA for c03ff98

• Enable using texify for inline math

  VikParuchuri

  committed
  1054a4a

  Copy full SHA for 1054a4a

• Filter equation overlaps

  VikParuchuri

  committed
  ebe1024

  Copy full SHA for ebe1024

• Hopefully fix speed

  VikParuchuri

  committed
  64ebd1c

  Copy full SHA for 64ebd1c

• Make OCR less aggressive

  VikParuchuri

  committed
  dd799b5

  Copy full SHA for dd799b5

• Fix some perf regresions

  VikParuchuri

  committed
  9a9a61a

  Copy full SHA for 9a9a61a

• Fix OCR builder

  VikParuchuri

  committed
  ab910fa

  Copy full SHA for ab910fa

Commits on Feb 13, 2025

• Add tests

  VikParuchuri

  committed
  42d8ab9

  Copy full SHA for 42d8ab9

• Fix up layoutbuilder

  VikParuchuri

  committed
  b4c265e

  Copy full SHA for b4c265e

• Test fixes

  VikParuchuri

  committed
  c180554

  Copy full SHA for c180554

• Fix list issue, general cleanup

  VikParuchuri

  committed
  eabebb2

  Copy full SHA for eabebb2