IU-Reinforcement-Learning-22-lab

Week01 - Introduction

By the end of this lab you are expected to:

• Have a quick review for the lecture 01.
• Understand the fundamental concepts of reinforcement learning and learn to test your algorithms with OpenAI gym.
• Training your first reinforcement learning model using stable-baselines3 , evaluate, test, use callbacks and learn how to save and load the RL models.

Week02 - Exploration and exploitation

In this lab you will implement several exploration strategies for simplest problem - bernoulli bandit.

Week03 - Markov Decision Process

By the end of this lab you will understand how Markov Reward Process and Markov Decision Process work. Also you will apply the direct solution to find the optimal policy.

Week04 - Dynamic Programming

Policy Iteration and Value Iteration algorithms.

Week05 - Model-Free Reinforcement Learning (MC Prediction)

Monte Carlo for Prediction.

Week06 - Model-Free Reinforcement Learning (TD Prediction)

Temporal Difference Prediction

Week07 - Model-Free Reinforcement Learning (Model-Free Control)

By the end of this lab you will understand the difference between Model-Free Prediction and Model-Free Control and you will be familiar with On-Policy vs Off-Policy Learning, and you will implement SARSA & Q-Learning algorithms from scratch.

References

Books

• Reinforcement learning: an introduction - The MIT Press (1998)
• Artificial Intelligence: A Modern Approach, 4th US ed.

Online materials

• https://hadovanhasselt.com/2016/01/12/ucl-course/
• https://github.com/huggingface/deep-rl-class
• https://github.com/nicknochnack/ReinforcementLearningCourse
• https://www.coursera.org/learn/unsupervised-learning-recommenders-reinforcement-learning
• https://ydata.yandex.com/course/reinforcement-learning
• https://stable-baselines3.readthedocs.io/en/master/
• https://github.com/CityAplons/rl-skoltech-course
• https://mpatacchiola.github.io/blog/