Skip to content
/ NLP Public

**Using Transformers Locally:** A comprehensive guide on how to use transformer models on your machine. This repository includes tutorials on text classification, detecting hate speech in Arabic, visualizing model behavior, and more. Perfect for NLP enthusiasts and data scientists looking to deepen their understanding of transformers.

Notifications You must be signed in to change notification settings

DanBaissa/NLP

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

82 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Using Transformers Locally

Welcome to Using Transformers Locally, a simple guide to using transformer models on your machine! This guide will walk you through the fundamental concepts, setup, and practical applications of transformers in natural language processing (NLP).

Introduction

Welcome to this guide on learning how to use transformer models locally. This guide will walk you through the fundamental concepts, setup, and practical applications of transformers in natural language processing (NLP).

Chapters

Chapter 1: Introduction to Learning Transformers

This chapter introduces the basics of transformer models and provides an overview of their applications in NLP.

Chapter 2: Text Classification with Transformers

This chapter covers text classification tasks using transformer models, demonstrating various NLP use cases.

Chapter 3: Example - Detecting Hate Speech in Arabic

This chapter provides a practical example of using transformers to detect hate speech in Arabic text.

Chapter 4a: Looking into the Black Box (Part 1)

Transformer models are often seen as black boxes. Here we visualize the attention mask to see the relations a model makes.

Chapter 4b: Looking into the Black Box (Part 2)

After visualizing the data in Part 1, we now extract the weights from a GPT model in Part 2, so we can learn how it makes its predictions.

Chapter 5: Example - Mamba the Future of NLP?

Here we explore the Mamba model and compare it to an 8B transformer model.

Chapter 6: Diagnosing Autism by Reading Simulated Doctors' Notes

In this project, I develop a pipeline to help doctors diagnose autism by simply reading their notes.

Chapter 7: Text to Image

Here we use Stable Diffusion to convert text to images. Have a crazy idea? Make it into a picture in seconds!

Chapter 8: Image to Text and Speech

In this project, we convert images to text. Since we turned the image to text, we may as well add TTS as well!

Resources

Here are some additional resources to help you deepen your understanding of transformer models:


By Daniel K Baissa

About

**Using Transformers Locally:** A comprehensive guide on how to use transformer models on your machine. This repository includes tutorials on text classification, detecting hate speech in Arabic, visualizing model behavior, and more. Perfect for NLP enthusiasts and data scientists looking to deepen their understanding of transformers.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages