Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[RLlib; Offline RL] Validate episodes before adding them to the buffer. #48083

Merged
merged 7 commits into from
Oct 21, 2024
Merged

[RLlib; Offline RL] Validate episodes before adding them to the buffer. #48083

merged 7 commits into from
Oct 21, 2024

Commits on Oct 17, 2024

  1. Added validation method for episodes to 'OfflinePreLearner', such tha… 

    …t no duplicates or fragments are added to the replay buffer b/c it cannot handle these. Furthermore, refined tests for 'OfflinePreLearner'.

Signed-off-by: simonsays1980 <simon.zehnder@gmail.com>
    @simonsays1980
    simonsays1980 committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    173e762 View commit details
    Browse the repository at this point in the history

  2. Added a validation for user settings that ensures that 'batch_mode=co… 

    …mplete_episodes' when recording episodes. This ensures that episodes can be read in again for training.

Signed-off-by: simonsays1980 <simon.zehnder@gmail.com>
    @simonsays1980
    simonsays1980 committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    6a609f1 View commit details
    Browse the repository at this point in the history

  3. Decreased iterations for recording and set test for prelearner to 'me… 

    …dium'.

Signed-off-by: simonsays1980 <simon.zehnder@gmail.com>
    @simonsays1980
    simonsays1980 committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    63c1ca9 View commit details
    Browse the repository at this point in the history

Commits on Oct 19, 2024

  1. Merge branch 'master' into offline-rl-handle-duplicates-in-buffer

    @simonsays1980
    simonsays1980 committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    b726bbd View commit details
    Browse the repository at this point in the history

Commits on Oct 21, 2024

  1. Added 'input_read_batch_size' to enable users to control for a differ… 

    …ent read batch size in case 'EpisodeType' or 'BatchType' data is stored in offline datasets. Added some docstrings.

Signed-off-by: simonsays1980 <simon.zehnder@gmail.com>
    @simonsays1980
    simonsays1980 committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    42ea05f View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into offline-rl-handle-duplicates-in-buffer

    @simonsays1980
    simonsays1980 committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    859ffd1 View commit details
    Browse the repository at this point in the history

  3. Added @sven1977's review. 

    Signed-off-by: simonsays1980 <simon.zehnder@gmail.com>
    @simonsays1980
    simonsays1980 committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    2c7e56b View commit details
    Browse the repository at this point in the history