Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[RLlib] Action masking example for new API stack. #46146

Merged
merged 9 commits into from
Jun 21, 2024
Merged

[RLlib] Action masking example for new API stack. #46146

merged 9 commits into from
Jun 21, 2024
+329 −284

Commits on Jun 19, 2024

  1. Implemented example for action masking. Added an 'unbatch(obs)' for '… 

    …add_env_reset' calls in 'SingleAgentEnvRunner' to deal with 'Dict' observation spaces.

Signed-off-by: simonsays1980 <simon.zehnder@gmail.com>
    @simonsays1980
    simonsays1980 committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    243d239 View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2024

  1. Included proposed changes from @sven1977's review. Added more docstri… 

    …ngs and comments. Added action-masking and autoregressive actions examples to the BUILD.

Signed-off-by: simonsays1980 <simon.zehnder@gmail.com>
    @simonsays1980
    simonsays1980 committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    00e1724 View commit details
    Browse the repository at this point in the history

  2. Removed old-(hybrid)-stack action masking example b/c hybrid stack wi… 

    …ll be deprecated in very near future.

Signed-off-by: simonsays1980 <simon.zehnder@gmail.com>
    @simonsays1980
    simonsays1980 committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    2b10d68 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into example-action-masking-new-stack

    @simonsays1980
    simonsays1980 committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    b8f07e4 View commit details
    Browse the repository at this point in the history

  4. Removed old action masking example paths from rllib.tests.yml. 

    Signed-off-by: simonsays1980 <simon.zehnder@gmail.com>
    @simonsays1980
    simonsays1980 committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    14e9fa1 View commit details
    Browse the repository at this point in the history

  5. Changed naming for autoregressive actions module to conform with acti… 

    …on masking module naming.

Signed-off-by: simonsays1980 <simon.zehnder@gmail.com>
    @simonsays1980
    simonsays1980 committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    79a8fb8 View commit details
    Browse the repository at this point in the history

  6. Added the action masking example script after renaming and ran the li… 

    …nter.

Signed-off-by: simonsays1980 <simon.zehnder@gmail.com>
    @simonsays1980
    simonsays1980 committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    d6918d5 View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2024

  1. Fixed an arguments bug in 'ActionMaskingRLM._compute_values' and a wr… 

    …ong name in the BUILD file.

Signed-off-by: simonsays1980 <simon.zehnder@gmail.com>
    @simonsays1980
    simonsays1980 committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    d2045af View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into example-action-masking-new-stack

    @simonsays1980
    simonsays1980 committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    641688e View commit details
    Browse the repository at this point in the history