BNLP is a natural language processing toolkit for Bengali Language. This tool will help you to tokenize Bengali text, Embedding Bengali words, Embedding Bengali Document, Bengali POS Tagging, Bengali Name Entity Recognition, Bangla Text Cleaning for Bengali NLP purposes.
- Tokenization
- Embeddings
- Part of speech tagging
- Named Entity Recognition
- Text Cleaning
- Corpus
- Letters, vowels, punctuations, stopwords
pip install bnlp_toolkit
or Upgrade
pip install -U bnlp_toolkit
- Python: 3.8, 3.9, 3.10, 3.11
- OS: Linux, Windows, Mac
git clone https://github.com/sagorbrur/bnlp.git
cd bnlp
python setup.py install
from bnlp import BasicTokenizer
tokenizer = BasicTokenizer()
raw_text = "আমি বাংলায় গান গাই।"
tokens = tokenizer(raw_text)
print(tokens)
# output: ["আমি", "বাংলায়", "গান", "গাই", "।"]
Full documentation are available here
If you are using previous version of bnlp check the documentation archive
Check CONTRIBUTING.md page for details.
- Semantics Lab
- All the developers who are contributing to enrich Bengali NLP.