RL-Zoo3 v1.7.0 : Added support for python config files

Release 1.7.0 (2023-01-10)

SB3 v1.7.0, added support for python config files

We are currently creating an open source benchmark, please read openrlbenchmark/openrlbenchmark#7 if you want to help

Breaking Changes

• --yaml-file argument was renamed to -conf (--conf-file) as now python file are supported too
• Upgraded to SB3 >= 1.7.0 (changed net_arch=[dict(pi=.., vf=..)] to net_arch=dict(pi=.., vf=..))

New Features

• Specifying custom policies in yaml file is now supported (@Rick-v-E)
• Added monitor_kwargs parameter
• Handle the env_kwargs of render:True under the hood for panda-gym v1 envs in enjoy replay to match visualzation behavior of other envs
• Added support for python config file
• Tuned hyperparameters for PPO on Swimmer
• Added -tags/--wandb-tags argument to train.py to add tags to the wandb run
• Added a sb3 version tag to the wandb run

Bug fixes

• Allow python -m rl_zoo3.cli to be called directly
• Fixed a bug where custom environments were not found despite passing --gym-package when using subprocesses
• Fixed TRPO hyperparameters for MinitaurBulletEnv-v0, MinitaurBulletDuckEnv-v0, HumanoidBulletEnv-v0, InvertedDoublePendulumBulletEnv-v0 and InvertedPendulumSwingupBulletEnv

Documentation

Other

• scripts/plot_train.py plots models such that newer models appear on top of older ones.
• Added additional type checking using mypy
• Standardized the use of from gym import spaces