An introductory course for PyTorch.
Throughout this course we will be using:
- Python 3.6+.
- PyTorch 1.11.0
Lecture 0: Hello world, introduction to Jupyter, and PyTorch high-level overview
Lecture 1: Introduction to PyTorch: tensors, tensor operations, gradients, autodiff, and broadcasting
Lecture 2: Linear Regression via Gradient Descent using Numpy, Numpy + Autodiff, and PyTorch
Lecture 3: PyTorch nn.Modules alongside training and evaluation loop
Lecture 4: Implementation of a proof-of-concept Word2Vec in PyTorch
⏳ Bonus: Comparison of the computation efficiency between raw Python, Numpy, and PyTorch (+JIT)
🔥 PyTorch Challenges: a set of 27 mini-puzzles (extension of the ones proposed by Sasha Rush)
🌎 From Puzzles to Real Code: Examples of broadcasting in real word applications: wordpieces aggregation, clustered attention, attention statistics.