Skip to content

Latest commit

 

History

History
43 lines (29 loc) · 2.2 KB

README.md

File metadata and controls

43 lines (29 loc) · 2.2 KB

CS224N: Natural Language Processing with Deep Learning

Stanford - Winter 2023

About

Overview

These are my solutions for the CS224N course assignments offered by Stanford University (Winter 2023). Written questions are explained in detail, the code is brief and commented. These solutions are heavily inspired by mantasu's repo and floriankark's repo.

Main sources (official)

Requirements

For conda users, the instructions on how to set-up the environment are given in the handouts. For pip users, I've gathered all the requirements in one file. Please set up the virtual environment and install the dependencies (for linux users):

$ python -m venv venv
$ source venv/bin/activate
$ pip install -r requirements.txt

You can install everything with conda too (see this). For code that requires Azure Virtual Machines, I was able to run everything successfully on Google Colab with a free account.

Note: Python 3.8 or newer should be used

Solutions

Structure

For every assignment, i.e., for directories assigment1 through assignment5, there is coding and written parts. The solutions.pdf files are generated from latex directories where the provided templates were filled while completing the questions in handout.pdf files and the code.

Assignments

  • A1: Exploring Word Vectors (Done)
  • A2: word2vec (Done)
  • A3: Dependency Parsing (Done)
  • A4: Neural Machine Translation with RNNs and Analyzing NMT Systems (Done)
  • A5: Self-Attention, Transformers, and Pretraining (Done)

Future works

  • Complete the minBERT project.