Skip to content

anant37289/self-builds

Repository files navigation

Building RNNs and Transformers using PyTorch

Description

This project focuses on exploring and implementing Recurrent Neural Networks (RNNs) and Transformer models using PyTorch. The aim is to understand the concepts and techniques related to these models like tokenization, word embeddings and positional/segment embeddings, gradient clipping and their application in machine translation.

Installation

To run the notebooks in this project, you need to have Python installed on your system. Additionally, you need to install the following Python libraries:

  • PyTorch

About

builds i did with D2L book

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published