Check out this work, neural renderer + RL works better https://github.com/hzwer/SARA_DDPG
A neural network that learns to draw digits by strokes
The environment relies on node.js and puppeteer
Needs tweaking to get it work
MNIST (left MNIST sample, middle generator output, right Draw Web App reconstruction)
Omniglot
