Code

added handling for abbreviations#47

Code

Merged

thorunna merged 9 commits intomastermideind/Tokenizer:masterfrom correct-spacesmideind/Tokenizer:correct-spacesCopy head branch name to clipboardNov 13, 2023

+21-16

Commits

Commits on Nov 2, 2023

• added handling for abbreviations

  

  thorunna

  committed
  b123fbc

  Copy full SHA for b123fbc

• reversed formatting

  

  thorunna

  committed
  15d54ad

  Copy full SHA for 15d54ad

• added test cases for abbreviations

  

  thorunna

  committed
  7098dd3

  Copy full SHA for 7098dd3

• improved handling for abbreviations and degree symbols

  

  thorunna

  committed
  7696a27

  Copy full SHA for 7696a27

Commits on Nov 3, 2023

• added installation for regex module

  

  thorunna

  committed
  25649f6

  Copy full SHA for 25649f6

• reversed change

  

  thorunna

  committed
  877df42

  Copy full SHA for 877df42

• went back to re module

  

  thorunna

  committed
  e84e442

  Copy full SHA for e84e442

• old regex string, which was commented out, removed

  

  thorunna

  committed
  8a60543

  Copy full SHA for 8a60543

• updated regex string

  

  thorunna

  committed
  66ffce0

  Copy full SHA for 66ffce0