Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Rl v3 parallel rollout #457

Merged
merged 25 commits into from
Jan 20, 2022
Merged

Rl v3 parallel rollout #457

merged 25 commits into from
Jan 20, 2022

Commits on Jan 5, 2022

  1. fixed rebase conflicts

    ysqyang committed Jan 5, 2022
    Configuration menu
    Copy the full SHA
    cea6004 View commit details
    Browse the repository at this point in the history

  2. renamed get_policy_func_dict to policy_creator

    ysqyang committed Jan 5, 2022
    Configuration menu
    Copy the full SHA
    d9011c1 View commit details
    Browse the repository at this point in the history

Commits on Jan 6, 2022

  1. unified worker interfaces

    ysqyang committed Jan 6, 2022
    Configuration menu
    Copy the full SHA
    53ab362 View commit details
    Browse the repository at this point in the history

  2. recovered some files

    ysqyang committed Jan 6, 2022
    Configuration menu
    Copy the full SHA
    9a4331b View commit details
    Browse the repository at this point in the history

  3. fixed merge conflicts

    ysqyang committed Jan 6, 2022
    Configuration menu
    Copy the full SHA
    f419451 View commit details
    Browse the repository at this point in the history

Commits on Jan 7, 2022

  1. dist training + cli code move

    ysqyang committed Jan 7, 2022
    Configuration menu
    Copy the full SHA
    bae164b View commit details
    Browse the repository at this point in the history

Commits on Jan 8, 2022

  1. fixed bugs

    yaqiu committed Jan 8, 2022
    Configuration menu
    Copy the full SHA
    2900805 View commit details
    Browse the repository at this point in the history

Commits on Jan 12, 2022

  1. added retry logic to client

    yaqiu committed Jan 12, 2022
    Configuration menu
    Copy the full SHA
    a45a797 View commit details
    Browse the repository at this point in the history

  2. 1. fixed hanging issue; 2. refactored workflows

    yaqiu committed Jan 12, 2022
    Configuration menu
    Copy the full SHA
    e9d30e3 View commit details
    Browse the repository at this point in the history

Commits on Jan 13, 2022

  1. 1. refactored CIM with various algos; 2. lint

    yaqiu committed Jan 13, 2022
    Configuration menu
    Copy the full SHA
    a1a44ad View commit details
    Browse the repository at this point in the history

  2. lint

    yaqiu committed Jan 13, 2022
    Configuration menu
    Copy the full SHA
    f9ebca2 View commit details
    Browse the repository at this point in the history

  3. added type hint

    yaqiu committed Jan 13, 2022
    Configuration menu
    Copy the full SHA
    3a46097 View commit details
    Browse the repository at this point in the history

  4. removed some logs

    yaqiu committed Jan 13, 2022
    Configuration menu
    Copy the full SHA
    e92620a View commit details
    Browse the repository at this point in the history

  5. lint

    yaqiu committed Jan 13, 2022
    Configuration menu
    Copy the full SHA
    ffc77c8 View commit details
    Browse the repository at this point in the history

  6. Make main.py more IDE friendly

    @lihuoran
    lihuoran committed Jan 13, 2022
    Configuration menu
    Copy the full SHA
    dade37c View commit details
    Browse the repository at this point in the history

Commits on Jan 14, 2022

  1. Make main.py more IDE friendly

    @lihuoran
    lihuoran committed Jan 14, 2022
    Configuration menu
    Copy the full SHA
    76f2131 View commit details
    Browse the repository at this point in the history

  2. Lint

    @lihuoran
    lihuoran committed Jan 14, 2022
    Configuration menu
    Copy the full SHA
    4aef249 View commit details
    Browse the repository at this point in the history

  3. fixed merge conflicts

    ysqyang committed Jan 14, 2022
    Configuration menu
    Copy the full SHA
    91d58ed View commit details
    Browse the repository at this point in the history

Commits on Jan 17, 2022

  1. load balancing dispatcher

    ysqyang committed Jan 17, 2022
    Configuration menu
    Copy the full SHA
    a6b753a View commit details
    Browse the repository at this point in the history

Commits on Jan 18, 2022

  1. added parallel rollout

    yaqiu committed Jan 18, 2022
    Configuration menu
    Copy the full SHA
    543bc87 View commit details
    Browse the repository at this point in the history

  2. lint

    yaqiu committed Jan 18, 2022
    Configuration menu
    Copy the full SHA
    33226b4 View commit details
    Browse the repository at this point in the history

Commits on Jan 19, 2022

  1. Tracker variable type issue; rename to env_sampler_creator;

    @lihuoran
    lihuoran committed Jan 19, 2022
    Configuration menu
    Copy the full SHA
    415fad3 View commit details
    Browse the repository at this point in the history

Commits on Jan 20, 2022

  1. Rl v3 parallel rollout follow ups (#458) 

    * AbsWorker & AbsDispatcher

* Pass env idx to AbsTrainer.record() method, and let the trainer to decide how to record experiences sampled from different worlds.

* Fix policy_creator reuse bug

* Format code

* Merge AbsTrainerManager & SimpleTrainerManager

* AC test passed

* Lint
    @lihuoran
    lihuoran authored Jan 20, 2022
    Configuration menu
    Copy the full SHA
    c03679f View commit details
    Browse the repository at this point in the history

  2. Remove AbsTrainer.build() method. Put all initialization operations i… 

    …nto __init__
    @lihuoran
    lihuoran committed Jan 20, 2022
    Configuration menu
    Copy the full SHA
    9f04b27 View commit details
    Browse the repository at this point in the history

  3. Redesign AC preprocess batches logic

    @lihuoran
    lihuoran committed Jan 20, 2022
    Configuration menu
    Copy the full SHA
    26fbf60 View commit details
    Browse the repository at this point in the history