indic-tokenizer This repo has been deprecated. Please use https://github.com/ltrc/polyglot-tokenizer instead of this one. Contact Irshad Ahmad Bhat MS-CSE IIITH, Hyderabad irshad.bhat@research.iiit.ac.in