week10

Neuro-Evolution

Examples

• Flappy Bird - code, demo
• Steering for "food" - code, demo

Other NeuroEvolution examples

• Flappy Learning by @xviniette
• Asteroids Learning by @xviniette
• steering agent with p5.js by @lazoviccorp
• Snake NeuroEvolution by @emgoz, video demo
• NeuroEvolution playing Super Mario

References

• Evolving Neural Networks through Augmenting Topologies
• Evolving Novel Behaviors via Natural Selection
• Evolution 101: Neuroevolution by Danielle Whittaker
• NeuroEvolution on Wikipedia
• Neuroevolution of augmenting topologies aka NEAT on Wikipedia

ml5

Background

• tensorflow.js
• keras / layers API

ml5 library

• ml5 website
• ml5 github
• ml5 examples

Homework

• Final Project Proposals

Reinforcement Learning

References

• Demystifying Deep Reinforcement Learning by Tambet Matiisen
• Playing Atari with Deep Reinforcement Learning (original DeepMind paper, video)

Tools and Frameworks

• OpenAI gym
• REINFORCEjs

Examples / Tutorials

• Reinforcement Q-Learning Tutorial
• Udacity's Q Learning example (uses OpenAI gym)