As you might already know, the main goal of the model in a text classification task is to categorize a text into one of the predefined labels or tags. we’re going to use the pre-trained BERT model to classify whether the text of Documents from Law Firms, Medical Documents etc. Which can be categorized into their belonging predicted categories based on the text in the Documents.