Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[RLlib] Remove 2nd Learner ConnectorV2 pass from PPO (add new GAE Connector piece). Fix: "State-connector" would use seq_len=20. #47401

Merged
merged 17 commits into from
Aug 30, 2024
Merged

[RLlib] Remove 2nd Learner ConnectorV2 pass from PPO (add new GAE Connector piece). Fix: "State-connector" would use seq_len=20. #47401

merged 17 commits into from
Aug 30, 2024
+580 −551

Commits on Jun 7, 2024

  1. wip 

    Signed-off-by: sven1977 <svenmika1977@gmail.com>
    @sven1977
    sven1977 committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    e9ba7d9 View commit details
    Browse the repository at this point in the history

Commits on Jun 8, 2024

  1. wip 

    Signed-off-by: sven1977 <svenmika1977@gmail.com>
    @sven1977
    sven1977 committed Jun 8, 2024
    Configuration menu
    Copy the full SHA
    e0cb9c3 View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2024

  1. Merge branch 'master' of https://github.com/ray-project/ray into ppo_… 

    …remove_extra_learner_connector_pass

Signed-off-by: sven1977 <svenmika1977@gmail.com>

# Conflicts:
#	rllib/algorithms/algorithm.py
#	rllib/algorithms/algorithm_config.py
#	rllib/algorithms/ppo/ppo_learner.py
#	rllib/algorithms/ppo/tests/test_ppo_with_env_runner.py
#	rllib/algorithms/ppo/torch/ppo_torch_learner.py
#	rllib/algorithms/ppo/torch/ppo_torch_rl_module.py
#	rllib/connectors/common/batch_individual_items.py
#	rllib/connectors/common/numpy_to_tensor.py
#	rllib/connectors/learner/add_one_ts_to_episodes_and_truncate.py
#	rllib/core/learner/learner.py
#	rllib/core/learner/learner_group.py
#	rllib/core/learner/torch/torch_learner.py
    @sven1977
    sven1977 committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    609e76f View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2024

  1. wip 

    Signed-off-by: sven1977 <svenmika1977@gmail.com>
    @sven1977
    sven1977 committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    ce11f33 View commit details
    Browse the repository at this point in the history

  2. wip 

    Signed-off-by: sven1977 <svenmika1977@gmail.com>
    @sven1977
    sven1977 committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    be93c98 View commit details
    Browse the repository at this point in the history

  3. wip 

    Signed-off-by: sven1977 <svenmika1977@gmail.com>
    @sven1977
    sven1977 committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    5332a81 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' of https://github.com/ray-project/ray into ppo_… 

    …remove_extra_learner_connector_pass
    @sven1977
    sven1977 committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    90295fa View commit details
    Browse the repository at this point in the history

  5. wip 

    Signed-off-by: sven1977 <svenmika1977@gmail.com>
    @sven1977
    sven1977 committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    5721d04 View commit details
    Browse the repository at this point in the history

  6. wip 

    Signed-off-by: sven1977 <svenmika1977@gmail.com>
    @sven1977
    sven1977 committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    44ceb3a View commit details
    Browse the repository at this point in the history

  7. wip 

    Signed-off-by: sven1977 <svenmika1977@gmail.com>
    @sven1977
    sven1977 committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    be79a1c View commit details
    Browse the repository at this point in the history

  8. wip 

    Signed-off-by: sven1977 <svenmika1977@gmail.com>
    @sven1977
    sven1977 committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    f77d914 View commit details
    Browse the repository at this point in the history

  9. wip 

    Signed-off-by: sven1977 <svenmika1977@gmail.com>
    @sven1977
    sven1977 committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    8e1c359 View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2024

  1. wip 

    Signed-off-by: sven1977 <svenmika1977@gmail.com>
    @sven1977
    sven1977 committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    c956ed7 View commit details
    Browse the repository at this point in the history

  2. fixes 

    Signed-off-by: sven1977 <svenmika1977@gmail.com>
    @sven1977
    sven1977 committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    f09149d View commit details
    Browse the repository at this point in the history

  3. LINT 

    Signed-off-by: sven1977 <svenmika1977@gmail.com>
    @sven1977
    sven1977 committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    495e21b View commit details
    Browse the repository at this point in the history

  4. fix 

    Signed-off-by: sven1977 <svenmika1977@gmail.com>
    @sven1977
    sven1977 committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    6f83c00 View commit details
    Browse the repository at this point in the history

  5. fix 

    Signed-off-by: sven1977 <svenmika1977@gmail.com>
    @sven1977
    sven1977 committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    3ff6aac View commit details
    Browse the repository at this point in the history