Skip to content

Commit

Permalink
Use gym-rs from git repo
Browse files Browse the repository at this point in the history
  • Loading branch information
yunjhongwu committed Dec 5, 2023
1 parent 7db0466 commit 5f0ae24
Show file tree
Hide file tree
Showing 3 changed files with 5 additions and 10 deletions.
7 changes: 1 addition & 6 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,12 +11,7 @@ The project implements the following algorithms:
- Soft Actor-Critic for Discrete Action (SAC-Discrete)

### Environment
This project uses [gym-rs](https://github.com/MathisWellmann/gym-rs) for simulating environments.
Note that the CartPole implementation in gym-rs may lead to slow convergence due to its extended initial state space.
To address this, apply the modification
from [this branch](https://github.com/yunjhongwu/gym-rs/tree/fix-cartpole-starting-state)
and replace `gym-rs = "0.3.0"` with `gym-rs = { path = "../../gym-rs" }` in [Cargo.toml](./burn-rl/Cargo.toml) to align the
initialization with the standard behavior of OpenAI Gym CartPole.
This project uses [gym-rs](https://github.com/MathisWellmann/gym-rs) for simulating environments. Users can create their own environment by implementing the `Environment` trait.

## References

Expand Down
4 changes: 2 additions & 2 deletions burn-rl/Cargo.toml
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ publish = false

[dependencies]
rand = "0.8.5"
burn = { version = "0.11.0", features = ["ndarray", "autodiff"] }
gym-rs = "0.3.0"
burn = { version = "0.11.1", features = ["ndarray", "autodiff"] }
gym-rs = { git = "https://github.com/MathisWellmann/gym-rs.git" }
ringbuffer = "0.15.0"
serde = { workspace = true }
4 changes: 2 additions & 2 deletions examples/Cargo.toml
Original file line number Diff line number Diff line change
Expand Up @@ -5,8 +5,8 @@ edition = "2021"
publish = false

[dependencies]
burn = { version = "0.11.0", features = ["ndarray", "autodiff"] }
burn-autodiff = "0.11.0"
burn = { version = "0.11.1", features = ["ndarray", "autodiff"] }
burn-autodiff = "0.11.1"
serde = { workspace = true }

burn-rl = { path = "../burn-rl" }
Expand Down

0 comments on commit 5f0ae24

Please sign in to comment.