Skip to content

G-Sohal/Generative-AI-Transformer

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

29 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

WiDS-2024

Welcome to Winter in Data Science Program! We are going to delve in the fascinating world of Machine learning and learn how to create a Generative AI model using the ideas first introduced to the world in the famous research paper, 'Attention is all you need'.
This README will guide you through the resources and materials provided in this repository to ensure a smooth and effective learning experience.

Table of Contents

  1. Week-1
    We'll be diving into the fundamentals of Python and essential data science libraries such as NumPy and Matplotlib.
  2. Week-2
    We'll be diving into the fundamentals of exactly how Neural Networks work and implementing some small scale
  3. Week-3
    We'll be diving into implementing the algorithms we have learnt using Tensorflow and then go onto making custom layers and doing some standard ML tasks like MNIST, Housing Pricing etc.
  4. Week-4 to 5
    We'll be diving into attention mechanisms and implementing them in tensorflow and then finally starting training a Small language model to generate shakesphere like text.
  5. BONUS WEEK
    We'll be trying to convert the current model we have into a token based model.

Getting Started

Clone this repository to your local machine using the following command:

git clone https://github.com/AdityaNeeraje/Generative-AI-Transformer.git

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Jupyter Notebook 100.0%