-
Notifications
You must be signed in to change notification settings - Fork 152
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
MARO v0.3: a new design of RL Toolkit, CLI refactorization, and corresponding updates. #539
Commits on May 27, 2021
-
ysqyang committed
May 27, 2021 Configuration menu - View commit details
-
Copy full SHA for 3456b43 - Browse repository at this point
Copy the full SHA 3456b43View commit details
Commits on May 28, 2021
-
Configuration menu - View commit details
-
Copy full SHA for fe96364 - Browse repository at this point
Copy the full SHA fe96364View commit details -
updated images and refined doc
ysqyang committedMay 28, 2021 Configuration menu - View commit details
-
Copy full SHA for fed8467 - Browse repository at this point
Copy the full SHA fed8467View commit details -
ysqyang committed
May 28, 2021 Configuration menu - View commit details
-
Copy full SHA for 03bcb41 - Browse repository at this point
Copy the full SHA 03bcb41View commit details
Commits on May 31, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 6ef102f - Browse repository at this point
Copy the full SHA 6ef102fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 12ba200 - Browse repository at this point
Copy the full SHA 12ba200View commit details -
Configuration menu - View commit details
-
Copy full SHA for fda6ab5 - Browse repository at this point
Copy the full SHA fda6ab5View commit details -
ysqyang committed
May 31, 2021 Configuration menu - View commit details
-
Copy full SHA for f044471 - Browse repository at this point
Copy the full SHA f044471View commit details
Commits on Jun 1, 2021
-
ysqyang committed
Jun 1, 2021 Configuration menu - View commit details
-
Copy full SHA for 1692871 - Browse repository at this point
Copy the full SHA 1692871View commit details -
Merge branch 'v0.2_rl_refinement' of github.com:microsoft/maro into v…
…0.2_rl_refinement
ysqyang committedJun 1, 2021 Configuration menu - View commit details
-
Copy full SHA for e3cbe14 - Browse repository at this point
Copy the full SHA e3cbe14View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2a3e90d - Browse repository at this point
Copy the full SHA 2a3e90dView commit details
Commits on Jun 2, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 2e925ab - Browse repository at this point
Copy the full SHA 2e925abView commit details -
Configuration menu - View commit details
-
Copy full SHA for e3710e3 - Browse repository at this point
Copy the full SHA e3710e3View commit details -
refined actor to return only experiences for policies that received n…
…ew experiences
ysqyang committedJun 2, 2021 Configuration menu - View commit details
-
Copy full SHA for 03c26b8 - Browse repository at this point
Copy the full SHA 03c26b8View commit details -
Configuration menu - View commit details
-
Copy full SHA for aff0f44 - Browse repository at this point
Copy the full SHA aff0f44View commit details -
Configuration menu - View commit details
-
Copy full SHA for fba2ccf - Browse repository at this point
Copy the full SHA fba2ccfView commit details -
Configuration menu - View commit details
-
Copy full SHA for 8c05562 - Browse repository at this point
Copy the full SHA 8c05562View commit details -
Configuration menu - View commit details
-
Copy full SHA for ce155d4 - Browse repository at this point
Copy the full SHA ce155d4View commit details
Commits on Jun 3, 2021
-
Configuration menu - View commit details
-
Copy full SHA for cc0c555 - Browse repository at this point
Copy the full SHA cc0c555View commit details -
Configuration menu - View commit details
-
Copy full SHA for 74ede26 - Browse repository at this point
Copy the full SHA 74ede26View commit details -
Configuration menu - View commit details
-
Copy full SHA for 034e5bb - Browse repository at this point
Copy the full SHA 034e5bbView commit details -
1. moved exploration scheduling to rollout manager; 2. fixed bug in l…
…r schedule registration in core model; 3. added parallel policy manager prorotype
ysqyang committedJun 3, 2021 Configuration menu - View commit details
-
Copy full SHA for 13d7d9b - Browse repository at this point
Copy the full SHA 13d7d9bView commit details -
ysqyang committed
Jun 3, 2021 Configuration menu - View commit details
-
Copy full SHA for 5337aa9 - Browse repository at this point
Copy the full SHA 5337aa9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6dbfd36 - Browse repository at this point
Copy the full SHA 6dbfd36View commit details -
Configuration menu - View commit details
-
Copy full SHA for 146eeb6 - Browse repository at this point
Copy the full SHA 146eeb6View commit details -
Configuration menu - View commit details
-
Copy full SHA for a80f6c3 - Browse repository at this point
Copy the full SHA a80f6c3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 731bc59 - Browse repository at this point
Copy the full SHA 731bc59View commit details -
Configuration menu - View commit details
-
Copy full SHA for ebe5065 - Browse repository at this point
Copy the full SHA ebe5065View commit details
Commits on Jun 4, 2021
-
1. added parallel policy manager prototype; 2. used training ep for e…
…valuation episodes
ysqyang committedJun 4, 2021 Configuration menu - View commit details
-
Copy full SHA for 0549a14 - Browse repository at this point
Copy the full SHA 0549a14View commit details
Commits on Jun 9, 2021
-
refined parallel policy manager
ysqyang committedJun 9, 2021 Configuration menu - View commit details
-
Copy full SHA for 023a9d3 - Browse repository at this point
Copy the full SHA 023a9d3View commit details -
ysqyang committed
Jun 9, 2021 Configuration menu - View commit details
-
Copy full SHA for 5a57e01 - Browse repository at this point
Copy the full SHA 5a57e01View commit details -
fixed lint issues and CIM local learner bugs
ysqyang committedJun 9, 2021 Configuration menu - View commit details
-
Copy full SHA for 1f62f3a - Browse repository at this point
Copy the full SHA 1f62f3aView commit details -
deleted unwanted supply_chain test files
ysqyang committedJun 9, 2021 Configuration menu - View commit details
-
Copy full SHA for 6208d86 - Browse repository at this point
Copy the full SHA 6208d86View commit details -
revised default config for cim-dqn
ysqyang committedJun 9, 2021 Configuration menu - View commit details
-
Copy full SHA for 11ca4be - Browse repository at this point
Copy the full SHA 11ca4beView commit details
Commits on Jun 10, 2021
-
removed test_store.py as it is no longer needed
ysqyang committedJun 10, 2021 Configuration menu - View commit details
-
Copy full SHA for 36d4178 - Browse repository at this point
Copy the full SHA 36d4178View commit details
Commits on Jun 11, 2021
-
1. changed Actor class to rollout_worker function; 2. renamed algorit…
…hm to algorithms
ysqyang committedJun 11, 2021 Configuration menu - View commit details
-
Copy full SHA for 0fab08b - Browse repository at this point
Copy the full SHA 0fab08bView commit details -
ysqyang committed
Jun 11, 2021 Configuration menu - View commit details
-
Copy full SHA for 3b5faeb - Browse repository at this point
Copy the full SHA 3b5faebView commit details -
ysqyang committed
Jun 11, 2021 Configuration menu - View commit details
-
Copy full SHA for 7911162 - Browse repository at this point
Copy the full SHA 7911162View commit details
Commits on Jun 15, 2021
-
ysqyang committed
Jun 15, 2021 Configuration menu - View commit details
-
Copy full SHA for 4f2182f - Browse repository at this point
Copy the full SHA 4f2182fView commit details
Commits on Jun 16, 2021
-
added MultiProcessRolloutManager and MultiProcessTrainingManager
ysqyang committedJun 16, 2021 Configuration menu - View commit details
-
Copy full SHA for 2b1541b - Browse repository at this point
Copy the full SHA 2b1541bView commit details
Commits on Jun 17, 2021
-
ysqyang committed
Jun 17, 2021 Configuration menu - View commit details
-
Copy full SHA for 6392fcf - Browse repository at this point
Copy the full SHA 6392fcfView commit details
Commits on Jun 18, 2021
-
ysqyang committed
Jun 18, 2021 Configuration menu - View commit details
-
Copy full SHA for 5089f7c - Browse repository at this point
Copy the full SHA 5089f7cView commit details -
ysqyang committed
Jun 18, 2021 Configuration menu - View commit details
-
Copy full SHA for 41a7b27 - Browse repository at this point
Copy the full SHA 41a7b27View commit details -
ysqyang committed
Jun 18, 2021 Configuration menu - View commit details
-
Copy full SHA for 35cf25a - Browse repository at this point
Copy the full SHA 35cf25aView commit details -
[Feature] Prioritized Experience Replay (#355)
* added prioritized experience replay * deleted unwanted supply_chain test files * fixed import order * import fix * fixed lint issues * fixed import formatting * added note in docstring that rank-based PER has yet to be implemented Co-authored-by: ysqyang <v-yangqi@microsoft.com>
Configuration menu - View commit details
-
Copy full SHA for ceadf4f - Browse repository at this point
Copy the full SHA ceadf4fView commit details -
ysqyang committed
Jun 18, 2021 Configuration menu - View commit details
-
Copy full SHA for 248d1e4 - Browse repository at this point
Copy the full SHA 248d1e4View commit details -
Merge branch 'v0.2_rl_refinement' of github.com:microsoft/maro into v…
…0.2_rl_refinement
ysqyang committedJun 18, 2021 Configuration menu - View commit details
-
Copy full SHA for 721d91b - Browse repository at this point
Copy the full SHA 721d91bView commit details -
ysqyang committed
Jun 18, 2021 Configuration menu - View commit details
-
Copy full SHA for 85e304a - Browse repository at this point
Copy the full SHA 85e304aView commit details -
ysqyang committed
Jun 18, 2021 Configuration menu - View commit details
-
Copy full SHA for 2601970 - Browse repository at this point
Copy the full SHA 2601970View commit details
Commits on Jun 20, 2021
-
reorganized training folder structure
ysqyang committedJun 20, 2021 Configuration menu - View commit details
-
Copy full SHA for f72e884 - Browse repository at this point
Copy the full SHA f72e884View commit details -
ysqyang committed
Jun 20, 2021 Configuration menu - View commit details
-
Copy full SHA for 4f4d5bb - Browse repository at this point
Copy the full SHA 4f4d5bbView commit details -
ysqyang committed
Jun 20, 2021 Configuration menu - View commit details
-
Copy full SHA for 96b9cce - Browse repository at this point
Copy the full SHA 96b9cceView commit details
Commits on Jun 21, 2021
-
ysqyang committed
Jun 21, 2021 Configuration menu - View commit details
-
Copy full SHA for 78c225a - Browse repository at this point
Copy the full SHA 78c225aView commit details -
ysqyang committed
Jun 21, 2021 Configuration menu - View commit details
-
Copy full SHA for 9acae80 - Browse repository at this point
Copy the full SHA 9acae80View commit details -
restructured CIM-dqn sync code
ysqyang committedJun 21, 2021 Configuration menu - View commit details
-
Copy full SHA for 424cabb - Browse repository at this point
Copy the full SHA 424cabbView commit details
Commits on Jun 22, 2021
-
added policy version index and used it as a measure of experience sta…
…leness
ysqyang committedJun 22, 2021 Configuration menu - View commit details
-
Copy full SHA for 18f73f2 - Browse repository at this point
Copy the full SHA 18f73f2View commit details -
ysqyang committed
Jun 22, 2021 Configuration menu - View commit details
-
Copy full SHA for 49d93c2 - Browse repository at this point
Copy the full SHA 49d93c2View commit details -
ysqyang committed
Jun 22, 2021 Configuration menu - View commit details
-
Copy full SHA for bc96c5e - Browse repository at this point
Copy the full SHA bc96c5eView commit details -
switched log_dir and proxy_kwargs order
ysqyang committedJun 22, 2021 Configuration menu - View commit details
-
Copy full SHA for 1bb4b56 - Browse repository at this point
Copy the full SHA 1bb4b56View commit details
Commits on Jun 23, 2021
-
ysqyang committed
Jun 23, 2021 Configuration menu - View commit details
-
Copy full SHA for 20c6385 - Browse repository at this point
Copy the full SHA 20c6385View commit details
Commits on Jun 28, 2021
-
eval schedule sorted only when it's a list
ysqyang committedJun 28, 2021 Configuration menu - View commit details
-
Copy full SHA for 42c24ab - Browse repository at this point
Copy the full SHA 42c24abView commit details -
eval schedule sorted only when it's a list
ysqyang committedJun 28, 2021 Configuration menu - View commit details
-
Copy full SHA for 8db90d5 - Browse repository at this point
Copy the full SHA 8db90d5View commit details -
Configuration menu - View commit details
-
Copy full SHA for 81f574a - Browse repository at this point
Copy the full SHA 81f574aView commit details -
added docker scripts for cim-dqn
ysqyang committedJun 28, 2021 Configuration menu - View commit details
-
Copy full SHA for 5ad21e4 - Browse repository at this point
Copy the full SHA 5ad21e4View commit details
Commits on Jun 29, 2021
-
Configuration menu - View commit details
-
Copy full SHA for bb25e71 - Browse repository at this point
Copy the full SHA bb25e71View commit details -
refactored example folder structure and added workflow templates
ysqyang committedJun 29, 2021 Configuration menu - View commit details
-
Copy full SHA for a56d4c2 - Browse repository at this point
Copy the full SHA a56d4c2View commit details -
ysqyang committed
Jun 29, 2021 Configuration menu - View commit details
-
Copy full SHA for 2525327 - Browse repository at this point
Copy the full SHA 2525327View commit details
Commits on Jun 30, 2021
-
ysqyang committed
Jun 30, 2021 Configuration menu - View commit details
-
Copy full SHA for f427b07 - Browse repository at this point
Copy the full SHA f427b07View commit details -
ysqyang committed
Jun 30, 2021 Configuration menu - View commit details
-
Copy full SHA for b8dc7e4 - Browse repository at this point
Copy the full SHA b8dc7e4View commit details -
ysqyang committed
Jun 30, 2021 Configuration menu - View commit details
-
Copy full SHA for 92a51da - Browse repository at this point
Copy the full SHA 92a51daView commit details -
ysqyang committed
Jun 30, 2021 Configuration menu - View commit details
-
Copy full SHA for 31b68f3 - Browse repository at this point
Copy the full SHA 31b68f3View commit details -
ysqyang committed
Jun 30, 2021 Configuration menu - View commit details
-
Copy full SHA for bab8128 - Browse repository at this point
Copy the full SHA bab8128View commit details -
ysqyang committed
Jun 30, 2021 Configuration menu - View commit details
-
Copy full SHA for f964924 - Browse repository at this point
Copy the full SHA f964924View commit details -
ysqyang committed
Jun 30, 2021 Configuration menu - View commit details
-
Copy full SHA for f9ccf2a - Browse repository at this point
Copy the full SHA f9ccf2aView commit details -
ysqyang committed
Jun 30, 2021 Configuration menu - View commit details
-
Copy full SHA for 5ad3e54 - Browse repository at this point
Copy the full SHA 5ad3e54View commit details -
ysqyang committed
Jun 30, 2021 Configuration menu - View commit details
-
Copy full SHA for 916d8ad - Browse repository at this point
Copy the full SHA 916d8adView commit details -
ysqyang committed
Jun 30, 2021 Configuration menu - View commit details
-
Copy full SHA for 06c1cd3 - Browse repository at this point
Copy the full SHA 06c1cd3View commit details -
ysqyang committed
Jun 30, 2021 Configuration menu - View commit details
-
Copy full SHA for c17557c - Browse repository at this point
Copy the full SHA c17557cView commit details
Commits on Jul 1, 2021
-
ysqyang committed
Jul 1, 2021 Configuration menu - View commit details
-
Copy full SHA for ff76caa - Browse repository at this point
Copy the full SHA ff76caaView commit details -
ysqyang committed
Jul 1, 2021 Configuration menu - View commit details
-
Copy full SHA for 4842d16 - Browse repository at this point
Copy the full SHA 4842d16View commit details -
ysqyang committed
Jul 1, 2021 Configuration menu - View commit details
-
Copy full SHA for 35e55a7 - Browse repository at this point
Copy the full SHA 35e55a7View commit details -
ysqyang committed
Jul 1, 2021 Configuration menu - View commit details
-
Copy full SHA for ae1e93f - Browse repository at this point
Copy the full SHA ae1e93fView commit details -
refactored templates for easy merge with async PR
ysqyang committedJul 1, 2021 Configuration menu - View commit details
-
Copy full SHA for 04c53e6 - Browse repository at this point
Copy the full SHA 04c53e6View commit details -
added component names for rollout manager and policy manager
ysqyang committedJul 1, 2021 Configuration menu - View commit details
-
Copy full SHA for 1315f04 - Browse repository at this point
Copy the full SHA 1315f04View commit details -
fixed incorrect position to add last episode to eval schedule
ysqyang committedJul 1, 2021 Configuration menu - View commit details
-
Copy full SHA for de40647 - Browse repository at this point
Copy the full SHA de40647View commit details -
added max_lag option in templates
ysqyang committedJul 1, 2021 Configuration menu - View commit details
-
Copy full SHA for 360240f - Browse repository at this point
Copy the full SHA 360240fView commit details -
formatting edit in docker_compose_yml script
ysqyang committedJul 1, 2021 Configuration menu - View commit details
-
Copy full SHA for 315e85f - Browse repository at this point
Copy the full SHA 315e85fView commit details -
moved local learner and early stopper outside sync_tools
ysqyang committedJul 1, 2021 Configuration menu - View commit details
-
Copy full SHA for 953c873 - Browse repository at this point
Copy the full SHA 953c873View commit details -
refactored rl toolkit folder structure
ysqyang committedJul 1, 2021 Configuration menu - View commit details
-
Copy full SHA for ed9d44a - Browse repository at this point
Copy the full SHA ed9d44aView commit details
Commits on Jul 2, 2021
-
refactored rl toolkit folder structure
ysqyang committedJul 2, 2021 Configuration menu - View commit details
-
Copy full SHA for d2b433e - Browse repository at this point
Copy the full SHA d2b433eView commit details -
moved env_wrapper and agent_wrapper inside rl/learner
ysqyang committedJul 2, 2021 Configuration menu - View commit details
-
Copy full SHA for 9f799d4 - Browse repository at this point
Copy the full SHA 9f799d4View commit details -
ysqyang committed
Jul 2, 2021 Configuration menu - View commit details
-
Copy full SHA for f8cccca - Browse repository at this point
Copy the full SHA f8ccccaView commit details -
modified sc imports according to changes in rl toolkit folder structure
ysqyang committedJul 2, 2021 Configuration menu - View commit details
-
Copy full SHA for a4491a7 - Browse repository at this point
Copy the full SHA a4491a7View commit details -
ysqyang committed
Jul 2, 2021 Configuration menu - View commit details
-
Copy full SHA for 0906577 - Browse repository at this point
Copy the full SHA 0906577View commit details -
ysqyang committed
Jul 2, 2021 Configuration menu - View commit details
-
Copy full SHA for a13322b - Browse repository at this point
Copy the full SHA a13322bView commit details -
ysqyang committed
Jul 2, 2021 Configuration menu - View commit details
-
Copy full SHA for 8ec0282 - Browse repository at this point
Copy the full SHA 8ec0282View commit details -
Merge branch 'v0.2_rl_refinement' into v0.2_rl_refinement_sc
ysqyang committedJul 2, 2021 Configuration menu - View commit details
-
Copy full SHA for 56af26a - Browse repository at this point
Copy the full SHA 56af26aView commit details -
config change for testing sc scenario
ysqyang committedJul 2, 2021 Configuration menu - View commit details
-
Copy full SHA for 894c376 - Browse repository at this point
Copy the full SHA 894c376View commit details
Commits on Jul 4, 2021
-
ysqyang committed
Jul 4, 2021 Configuration menu - View commit details
-
Copy full SHA for 743e9f3 - Browse repository at this point
Copy the full SHA 743e9f3View commit details
Commits on Jul 5, 2021
-
* remote inference code draft * changed actor to rollout_worker and updated init files * removed unwanted import * updated inits * more async code * added async scripts * added async training code & scripts for CIM-dqn * changed async to async_tools to avoid conflict with python keyword * reverted unwanted change to dockerfile * added doc for policy server * addressed PR comments and fixed a bug in docker_compose_yml.py * fixed lint issue * resolved PR comment * resolved merge conflicts * added async templates * added proxy.close() for actor and policy_server * fixed incorrect position to add last episode to eval schedule * reverted unwanted changes * added missing async files * rm unwanted echo in kill.sh Co-authored-by: ysqyang <v-yangqi@microsoft.com>
Configuration menu - View commit details
-
Copy full SHA for 8e97adc - Browse repository at this point
Copy the full SHA 8e97adcView commit details -
renamed sync to synchronous and async to asynchronous to avoid confli…
…ct with keyword
ysqyang committedJul 5, 2021 Configuration menu - View commit details
-
Copy full SHA for fac6006 - Browse repository at this point
Copy the full SHA fac6006View commit details -
ysqyang committed
Jul 5, 2021 Configuration menu - View commit details
-
Copy full SHA for 0004dfe - Browse repository at this point
Copy the full SHA 0004dfeView commit details -
added missing policy version increment in LocalPolicyManager
ysqyang committedJul 5, 2021 Configuration menu - View commit details
-
Copy full SHA for 60a7423 - Browse repository at this point
Copy the full SHA 60a7423View commit details -
Merge remote-tracking branch 'origin/v0.2_rl_refinement' into v0.2_rl…
…_refinement_sc
ysqyang committedJul 5, 2021 Configuration menu - View commit details
-
Copy full SHA for c004697 - Browse repository at this point
Copy the full SHA c004697View commit details -
refined rollout manager recv logic
ysqyang committedJul 5, 2021 Configuration menu - View commit details
-
Copy full SHA for a163554 - Browse repository at this point
Copy the full SHA a163554View commit details -
ysqyang committed
Jul 5, 2021 Configuration menu - View commit details
-
Copy full SHA for 803faad - Browse repository at this point
Copy the full SHA 803faadView commit details -
moved supply_chain inside examples/rl
ysqyang committedJul 5, 2021 Configuration menu - View commit details
-
Copy full SHA for 0c10f36 - Browse repository at this point
Copy the full SHA 0c10f36View commit details
Commits on Jul 6, 2021
-
added sleep in distributed launcher to avoid hanging
ysqyang committedJul 6, 2021 Configuration menu - View commit details
-
Copy full SHA for 34b47a5 - Browse repository at this point
Copy the full SHA 34b47a5View commit details
Commits on Jul 7, 2021
-
updated api doc and rl toolkit doc
ysqyang committedJul 7, 2021 Configuration menu - View commit details
-
Copy full SHA for c41ca35 - Browse repository at this point
Copy the full SHA c41ca35View commit details -
refined dynamic imports using importlib
yaqiu committedJul 7, 2021 Configuration menu - View commit details
-
Copy full SHA for a2244b5 - Browse repository at this point
Copy the full SHA a2244b5View commit details
Commits on Jul 8, 2021
-
Merge branch 'master' into v0.2
Jinyu Wang authored and Jinyu Wang committedJul 8, 2021 Configuration menu - View commit details
-
Copy full SHA for edf9df4 - Browse repository at this point
Copy the full SHA edf9df4View commit details -
1. moved policy update triggers to policy manager; 2. added version c…
…ontrol in policy manager
yaqiu committedJul 8, 2021 Configuration menu - View commit details
-
Copy full SHA for 740efa7 - Browse repository at this point
Copy the full SHA 740efa7View commit details -
fixed a few bugs and updated cim RL example
yaqiu committedJul 8, 2021 Configuration menu - View commit details
-
Copy full SHA for c278693 - Browse repository at this point
Copy the full SHA c278693View commit details -
yaqiu committed
Jul 8, 2021 Configuration menu - View commit details
-
Copy full SHA for 455751a - Browse repository at this point
Copy the full SHA 455751aView commit details -
yaqiu committed
Jul 8, 2021 Configuration menu - View commit details
-
Copy full SHA for ef50957 - Browse repository at this point
Copy the full SHA ef50957View commit details
Commits on Jul 9, 2021
-
Merge remote-tracking branch 'origin/v0.2' into v0.2_rl_refinement
yaqiu committedJul 9, 2021 Configuration menu - View commit details
-
Copy full SHA for 9a04a99 - Browse repository at this point
Copy the full SHA 9a04a99View commit details -
added agent wrapper instantiation to workflows
yaqiu committedJul 9, 2021 Configuration menu - View commit details
-
Copy full SHA for 746f0f9 - Browse repository at this point
Copy the full SHA 746f0f9View commit details -
added agent wrapper instantiation to workflows
yaqiu committedJul 9, 2021 Configuration menu - View commit details
-
Copy full SHA for 18cd676 - Browse repository at this point
Copy the full SHA 18cd676View commit details -
removed abs_block and added max_prob option for DiscretePolicyNet and…
… DiscreteACNet
yaqiu committedJul 9, 2021 Configuration menu - View commit details
-
Copy full SHA for c5cf9df - Browse repository at this point
Copy the full SHA c5cf9dfView commit details -
fixed incorrect get_ac_policy signature for CIM
yaqiu committedJul 9, 2021 Configuration menu - View commit details
-
Copy full SHA for 1f3b590 - Browse repository at this point
Copy the full SHA 1f3b590View commit details -
moved exploration inside core policy
yaqiu committedJul 9, 2021 Configuration menu - View commit details
-
Copy full SHA for dd017d3 - Browse repository at this point
Copy the full SHA dd017d3View commit details
Commits on Jul 11, 2021
-
added state to exploration call to support context-dependent exploration
yaqiu committedJul 11, 2021 Configuration menu - View commit details
-
Copy full SHA for 98d0961 - Browse repository at this point
Copy the full SHA 98d0961View commit details -
updated sc example according to RL toolkit changes
yaqiu committedJul 11, 2021 Configuration menu - View commit details
-
Copy full SHA for 17f1655 - Browse repository at this point
Copy the full SHA 17f1655View commit details -
separated non_rl_policy_index and rl_policy_index in workflows
yaqiu committedJul 11, 2021 Configuration menu - View commit details
-
Copy full SHA for bbb6ba7 - Browse repository at this point
Copy the full SHA bbb6ba7View commit details -
Merge branch 'v0.2_rl_refinement' into v0.2_rl_refinement_sc
yaqiu committedJul 11, 2021 Configuration menu - View commit details
-
Copy full SHA for c70105d - Browse repository at this point
Copy the full SHA c70105dView commit details -
modified sc example code according to workflow changes
yaqiu committedJul 11, 2021 Configuration menu - View commit details
-
Copy full SHA for f004fba - Browse repository at this point
Copy the full SHA f004fbaView commit details -
modified sc example code according to workflow changes
yaqiu committedJul 11, 2021 Configuration menu - View commit details
-
Copy full SHA for 2be9114 - Browse repository at this point
Copy the full SHA 2be9114View commit details
Commits on Jul 12, 2021
-
added replay_agent_ids parameter to get_env_func for RL examples
yaqiu committedJul 12, 2021 Configuration menu - View commit details
-
Copy full SHA for 9b04ad5 - Browse repository at this point
Copy the full SHA 9b04ad5View commit details -
Merge branch 'v0.2_rl_refinement' into v0.2_rl_refinement_sc
yaqiu committedJul 12, 2021 Configuration menu - View commit details
-
Copy full SHA for c004323 - Browse repository at this point
Copy the full SHA c004323View commit details -
yaqiu committed
Jul 12, 2021 Configuration menu - View commit details
-
Copy full SHA for 700b149 - Browse repository at this point
Copy the full SHA 700b149View commit details -
added maro/simulator/scenarios/supply_chain as bind mount
yaqiu committedJul 12, 2021 Configuration menu - View commit details
-
Copy full SHA for b9afaef - Browse repository at this point
Copy the full SHA b9afaefView commit details
Commits on Jul 14, 2021
-
added post-step, post-collect, post-eval and post-update callbacks
yaqiu committedJul 14, 2021 Configuration menu - View commit details
-
Copy full SHA for 87066c9 - Browse repository at this point
Copy the full SHA 87066c9View commit details -
yaqiu committed
Jul 14, 2021 Configuration menu - View commit details
-
Copy full SHA for f0a29ef - Browse repository at this point
Copy the full SHA f0a29efView commit details -
yaqiu committed
Jul 14, 2021 Configuration menu - View commit details
-
Copy full SHA for 56fd2d6 - Browse repository at this point
Copy the full SHA 56fd2d6View commit details
Commits on Jul 15, 2021
-
yaqiu committed
Jul 15, 2021 Configuration menu - View commit details
-
Copy full SHA for cb533fa - Browse repository at this point
Copy the full SHA cb533faView commit details -
moved instantiation of policy manager inside simple learner
yaqiu committedJul 15, 2021 Configuration menu - View commit details
-
Copy full SHA for d2d66cd - Browse repository at this point
Copy the full SHA d2d66cdView commit details -
Merge branch 'v0.2_rl_refinement' into v0.2_rl_refinement_sc
yaqiu committedJul 15, 2021 Configuration menu - View commit details
-
Copy full SHA for 513ca40 - Browse repository at this point
Copy the full SHA 513ca40View commit details -
fixed env_wrapper get_reward signature
yaqiu committedJul 15, 2021 Configuration menu - View commit details
-
Copy full SHA for 07fba7a - Browse repository at this point
Copy the full SHA 07fba7aView commit details -
yaqiu committed
Jul 15, 2021 Configuration menu - View commit details
-
Copy full SHA for a9e6b11 - Browse repository at this point
Copy the full SHA a9e6b11View commit details -
Merge branch 'v0.2_rl_refinement' into v0.2_rl_refinement_sc
yaqiu committedJul 15, 2021 Configuration menu - View commit details
-
Copy full SHA for 1d5c242 - Browse repository at this point
Copy the full SHA 1d5c242View commit details -
removed get_eperience kwargs from env_wrapper
yaqiu committedJul 15, 2021 Configuration menu - View commit details
-
Copy full SHA for 8a84b11 - Browse repository at this point
Copy the full SHA 8a84b11View commit details -
Merge branch 'v0.2_rl_refinement' into v0.2_rl_refinement_sc
yaqiu committedJul 15, 2021 Configuration menu - View commit details
-
Copy full SHA for 2cc0f7b - Browse repository at this point
Copy the full SHA 2cc0f7bView commit details -
1. renamed step_callback to post_step in env_wrapper; 2. added get_ev…
…al_env_func to RL workflows
yaqiu committedJul 15, 2021 Configuration menu - View commit details
-
Copy full SHA for ec338fb - Browse repository at this point
Copy the full SHA ec338fbView commit details -
Merge branch 'v0.2_rl_refinement' into v0.2_rl_refinement_sc
yaqiu committedJul 15, 2021 Configuration menu - View commit details
-
Copy full SHA for 8f00dc7 - Browse repository at this point
Copy the full SHA 8f00dc7View commit details -
added rollout exp disribution option in RL examples
yaqiu committedJul 15, 2021 Configuration menu - View commit details
-
Copy full SHA for 1c94b62 - Browse repository at this point
Copy the full SHA 1c94b62View commit details -
yaqiu committed
Jul 15, 2021 Configuration menu - View commit details
-
Copy full SHA for 2b04cc0 - Browse repository at this point
Copy the full SHA 2b04cc0View commit details
Commits on Jul 16, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 36092c2 - Browse repository at this point
Copy the full SHA 36092c2View commit details -
Configuration menu - View commit details
-
Copy full SHA for b4f5afa - Browse repository at this point
Copy the full SHA b4f5afaView commit details -
yaqiu committed
Jul 16, 2021 Configuration menu - View commit details
-
Copy full SHA for 4252a0c - Browse repository at this point
Copy the full SHA 4252a0cView commit details -
1. made logger internal in learner; 2 removed logger creation in abs …
…classes
yaqiu committedJul 16, 2021 Configuration menu - View commit details
-
Copy full SHA for c2c1c62 - Browse repository at this point
Copy the full SHA c2c1c62View commit details -
yaqiu committed
Jul 16, 2021 Configuration menu - View commit details
-
Copy full SHA for be82de3 - Browse repository at this point
Copy the full SHA be82de3View commit details -
checked out supply chain test files from v0.2_sc
yaqiu committedJul 16, 2021 Configuration menu - View commit details
-
Copy full SHA for 0a05184 - Browse repository at this point
Copy the full SHA 0a05184View commit details
Commits on Jul 19, 2021
-
1. added missing model.eval() to choose_action; 2.added entropy featu…
…res to AC
yaqiu committedJul 19, 2021 Configuration menu - View commit details
-
Copy full SHA for c7bca77 - Browse repository at this point
Copy the full SHA c7bca77View commit details -
yaqiu committed
Jul 19, 2021 Configuration menu - View commit details
-
Copy full SHA for 81245dd - Browse repository at this point
Copy the full SHA 81245ddView commit details -
abbreviated coefficient to coeff
yaqiu committedJul 19, 2021 Configuration menu - View commit details
-
Copy full SHA for e56e9b8 - Browse repository at this point
Copy the full SHA e56e9b8View commit details
Commits on Jul 22, 2021
-
removed -dqn from job name in rl example config
yaqiu committedJul 22, 2021 Configuration menu - View commit details
-
Copy full SHA for 072d9de - Browse repository at this point
Copy the full SHA 072d9deView commit details -
yaqiu committed
Jul 22, 2021 Configuration menu - View commit details
-
Copy full SHA for 103eb40 - Browse repository at this point
Copy the full SHA 103eb40View commit details -
renamed image name for running rl examples
yaqiu committedJul 22, 2021 Configuration menu - View commit details
-
Copy full SHA for 9c5e135 - Browse repository at this point
Copy the full SHA 9c5e135View commit details
Commits on Jul 28, 2021
-
added get_loss interface for core policies
yaqiu committedJul 28, 2021 Configuration menu - View commit details
-
Copy full SHA for d96aa44 - Browse repository at this point
Copy the full SHA d96aa44View commit details
Commits on Jul 30, 2021
-
added policy manager in rl_toolkit.rst
yaqiu committedJul 30, 2021 Configuration menu - View commit details
-
Copy full SHA for 1f37369 - Browse repository at this point
Copy the full SHA 1f37369View commit details -
1. env_wrapper bug fix; 2. policy manager update logic refinement
yaqiu committedJul 30, 2021 Configuration menu - View commit details
-
Copy full SHA for 12ac058 - Browse repository at this point
Copy the full SHA 12ac058View commit details
Commits on Aug 3, 2021
-
refactored policy and algorithms
yaqiu committedAug 3, 2021 Configuration menu - View commit details
-
Copy full SHA for fc14e66 - Browse repository at this point
Copy the full SHA fc14e66View commit details
Commits on Aug 5, 2021
-
ysqyang committed
Aug 5, 2021 Configuration menu - View commit details
-
Copy full SHA for 7702eba - Browse repository at this point
Copy the full SHA 7702ebaView commit details
Commits on Aug 8, 2021
-
ysqyang committed
Aug 8, 2021 Configuration menu - View commit details
-
Copy full SHA for 704c17f - Browse repository at this point
Copy the full SHA 704c17fView commit details -
yaqiu committed
Aug 8, 2021 Configuration menu - View commit details
-
Copy full SHA for 56a54cb - Browse repository at this point
Copy the full SHA 56a54cbView commit details
Commits on Aug 9, 2021
-
fixed bugs in refactored policy interface
yaqiu committedAug 9, 2021 Configuration menu - View commit details
-
Copy full SHA for 0b57d70 - Browse repository at this point
Copy the full SHA 0b57d70View commit details -
yaqiu committed
Aug 9, 2021 Configuration menu - View commit details
-
Copy full SHA for cad2872 - Browse repository at this point
Copy the full SHA cad2872View commit details
Commits on Aug 11, 2021
-
yaqiu committed
Aug 11, 2021 Configuration menu - View commit details
-
Copy full SHA for 3ba96d4 - Browse repository at this point
Copy the full SHA 3ba96d4View commit details
Commits on Aug 17, 2021
-
policy interface and policy manager redesigned
yaqiu committedAug 17, 2021 Configuration menu - View commit details
-
Copy full SHA for 5f6c47c - Browse repository at this point
Copy the full SHA 5f6c47cView commit details
Commits on Aug 18, 2021
-
1. fixed bugs in ac and pg; 2. fixed bugs rl workflow scripts
yaqiu committedAug 18, 2021 Configuration menu - View commit details
-
Copy full SHA for cb8a355 - Browse repository at this point
Copy the full SHA cb8a355View commit details -
fixed bug in distributed policy manager
yaqiu committedAug 18, 2021 Configuration menu - View commit details
-
Copy full SHA for f0222a7 - Browse repository at this point
Copy the full SHA f0222a7View commit details -
yaqiu committed
Aug 18, 2021 Configuration menu - View commit details
-
Copy full SHA for c0a8480 - Browse repository at this point
Copy the full SHA c0a8480View commit details -
yaqiu committed
Aug 18, 2021 Configuration menu - View commit details
-
Copy full SHA for 3a10544 - Browse repository at this point
Copy the full SHA 3a10544View commit details -
yaqiu committed
Aug 18, 2021 Configuration menu - View commit details
-
Copy full SHA for 026bcd3 - Browse repository at this point
Copy the full SHA 026bcd3View commit details
Commits on Aug 19, 2021
-
1. trimmed rollout manager code; 2. added option to docker scripts
yaqiu committedAug 19, 2021 Configuration menu - View commit details
-
Copy full SHA for 00df5d8 - Browse repository at this point
Copy the full SHA 00df5d8View commit details
Commits on Aug 20, 2021
-
updated api doc for policy manager
yaqiu committedAug 20, 2021 Configuration menu - View commit details
-
Copy full SHA for 8619408 - Browse repository at this point
Copy the full SHA 8619408View commit details
Commits on Aug 23, 2021
-
1. simplified rl/learning code structure; 2. fixed bugs in rl example…
… docker script
yaqiu committedAug 23, 2021 Configuration menu - View commit details
-
Copy full SHA for ca7b0d9 - Browse repository at this point
Copy the full SHA ca7b0d9View commit details -
1. simplified rl example structure; 2. fixed lint issues
yaqiu committedAug 23, 2021 Configuration menu - View commit details
-
Copy full SHA for aefd3b5 - Browse repository at this point
Copy the full SHA aefd3b5View commit details
Commits on Aug 25, 2021
-
further rl toolkit code simplifications
yaqiu committedAug 25, 2021 Configuration menu - View commit details
-
Copy full SHA for db99ce2 - Browse repository at this point
Copy the full SHA db99ce2View commit details
Commits on Aug 26, 2021
-
more numpy-based optimization in RL toolkit
yaqiu committedAug 26, 2021 Configuration menu - View commit details
-
Copy full SHA for b3a244d - Browse repository at this point
Copy the full SHA b3a244dView commit details
Commits on Aug 27, 2021
-
moved replay buffer inside policy
yaqiu committedAug 27, 2021 Configuration menu - View commit details
-
Copy full SHA for 505cf4e - Browse repository at this point
Copy the full SHA 505cf4eView commit details -
yaqiu committed
Aug 27, 2021 Configuration menu - View commit details
-
Copy full SHA for af1eed6 - Browse repository at this point
Copy the full SHA af1eed6View commit details
Commits on Aug 29, 2021
-
numpy optimization and associated refactoring
yaqiu committedAug 29, 2021 Configuration menu - View commit details
-
Copy full SHA for e924495 - Browse repository at this point
Copy the full SHA e924495View commit details
Commits on Aug 31, 2021
-
extracted shaping logic out of env_sampler
ysqyang committedAug 31, 2021 Configuration menu - View commit details
-
Copy full SHA for 7c407a4 - Browse repository at this point
Copy the full SHA 7c407a4View commit details -
fixed bug in CIM shaping and lint issues
yaqiu committedAug 31, 2021 Configuration menu - View commit details
-
Copy full SHA for 07a051b - Browse repository at this point
Copy the full SHA 07a051bView commit details
Commits on Sep 1, 2021
-
preliminary implemetation of parallel batch inference
yaqiu committedSep 1, 2021 Configuration menu - View commit details
-
Copy full SHA for 6a027fa - Browse repository at this point
Copy the full SHA 6a027faView commit details
Commits on Sep 2, 2021
-
fixed bug in ddpg transition recording
ysqyang committedSep 2, 2021 Configuration menu - View commit details
-
Copy full SHA for fde7895 - Browse repository at this point
Copy the full SHA fde7895View commit details -
put get_state, get_env_actions, get_reward back in EnvSampler
yaqiu committedSep 2, 2021 Configuration menu - View commit details
-
Copy full SHA for b9010ef - Browse repository at this point
Copy the full SHA b9010efView commit details
Commits on Sep 5, 2021
-
simplified exploration and core model interfaces
yaqiu committedSep 5, 2021 Configuration menu - View commit details
-
Copy full SHA for aa69409 - Browse repository at this point
Copy the full SHA aa69409View commit details
Commits on Sep 6, 2021
-
yaqiu committed
Sep 6, 2021 Configuration menu - View commit details
-
Copy full SHA for 2dbf3c3 - Browse repository at this point
Copy the full SHA 2dbf3c3View commit details -
added improve() interface for RLPolicy for single-thread support
yaqiu committedSep 6, 2021 Configuration menu - View commit details
-
Copy full SHA for f136e3c - Browse repository at this point
Copy the full SHA f136e3cView commit details
Commits on Sep 7, 2021
-
fixed simple policy manager bug
yaqiu committedSep 7, 2021 Configuration menu - View commit details
-
Copy full SHA for 92561f6 - Browse repository at this point
Copy the full SHA 92561f6View commit details
Commits on Sep 11, 2021
-
yaqiu committed
Sep 11, 2021 Configuration menu - View commit details
-
Copy full SHA for 013d0fb - Browse repository at this point
Copy the full SHA 013d0fbView commit details -
yaqiu committed
Sep 11, 2021 Configuration menu - View commit details
-
Copy full SHA for 8f652b4 - Browse repository at this point
Copy the full SHA 8f652b4View commit details -
yaqiu committed
Sep 11, 2021 Configuration menu - View commit details
-
Copy full SHA for 8dd708f - Browse repository at this point
Copy the full SHA 8dd708fView commit details
Commits on Sep 12, 2021
-
yaqiu committed
Sep 12, 2021 Configuration menu - View commit details
-
Copy full SHA for 971fd04 - Browse repository at this point
Copy the full SHA 971fd04View commit details -
reverted to simple policy manager as default
yaqiu committedSep 12, 2021 Configuration menu - View commit details
-
Copy full SHA for bf3cadb - Browse repository at this point
Copy the full SHA bf3cadbView commit details
Commits on Sep 14, 2021
-
1. unified single-thread and distributed mode in learning_loop.py; 2.…
… updated api doc for algorithms and rst for rl toolkit
yaqiu committedSep 14, 2021 Configuration menu - View commit details
-
Copy full SHA for e89b6db - Browse repository at this point
Copy the full SHA e89b6dbView commit details -
fixed lint issues and updated rl toolkit images
yaqiu committedSep 14, 2021 Configuration menu - View commit details
-
Copy full SHA for 3738bd1 - Browse repository at this point
Copy the full SHA 3738bd1View commit details
Commits on Sep 15, 2021
-
ysqyang committed
Sep 15, 2021 Configuration menu - View commit details
-
Copy full SHA for 69c5a56 - Browse repository at this point
Copy the full SHA 69c5a56View commit details -
Merge branch 'v0.2_rl_refinement' of github.com:microsoft/maro into v…
…0.2_rl_refinement
ysqyang committedSep 15, 2021 Configuration menu - View commit details
-
Copy full SHA for 372d44c - Browse repository at this point
Copy the full SHA 372d44cView commit details -
added back agent2policy for general workflow use
yaqiu committedSep 15, 2021 Configuration menu - View commit details
-
Copy full SHA for 9030200 - Browse repository at this point
Copy the full SHA 9030200View commit details
Commits on Sep 16, 2021
-
V0.2 rl refinement dist (#377)
* Support `slice` operation in ExperienceSet * Support naive distributed policy training by proxy * Dynamically allocate trainers according to number of experience * code check * code check * code check * Fix a bug in distributed trianing with no gradient * Code check * Move Back-Propagation from trainer to policy_manager and extract trainer-allocation strategy * 1.call allocate_trainer() at first of update(); 2.refine according to code review * Code check * Refine code with new interface * Update docs of PolicyManger and ExperienceSet * Add images for rl_toolkit docs * Update diagram of PolicyManager * Refine with new interface * Extract allocation strategy into `allocation_strategy.py` * add `distributed_learn()` in policies for data-parallel training * Update doc of RL_toolkit * Add gradient workers for data-parallel * Refine code and update docs * Lint check * Refine by comments * Rename `trainer` to `worker` * Rename `distributed_learn` to `learn_with_data_parallel` * Refine allocator and remove redundant code in policy_manager * remove arugments in allocate_by_policy and so on
Configuration menu - View commit details
-
Copy full SHA for f2dd5c0 - Browse repository at this point
Copy the full SHA f2dd5c0View commit details
Commits on Sep 17, 2021
-
Merge branch 'v0.2_rl_refinement' of github.com:microsoft/maro into v…
…0.2_rl_refinement
ysqyang committedSep 17, 2021 Configuration menu - View commit details
-
Copy full SHA for 1a70410 - Browse repository at this point
Copy the full SHA 1a70410View commit details -
added checkpointing for simple and multi-process policy managers
ysqyang committedSep 17, 2021 Configuration menu - View commit details
-
Copy full SHA for 5f70b65 - Browse repository at this point
Copy the full SHA 5f70b65View commit details -
1. bug fixes in checkpointing; 2. removed version and max_lag in roll…
…out manager
yaqiu committedSep 17, 2021 Configuration menu - View commit details
-
Copy full SHA for 7b76dce - Browse repository at this point
Copy the full SHA 7b76dceView commit details -
added missing set_state and get_state for CIM policies
yaqiu committedSep 17, 2021 Configuration menu - View commit details
-
Copy full SHA for c1d9871 - Browse repository at this point
Copy the full SHA c1d9871View commit details -
yaqiu committed
Sep 17, 2021 Configuration menu - View commit details
-
Copy full SHA for fc59379 - Browse repository at this point
Copy the full SHA fc59379View commit details
Commits on Sep 22, 2021
-
yaqiu committed
Sep 22, 2021 Configuration menu - View commit details
-
Copy full SHA for f23fdc6 - Browse repository at this point
Copy the full SHA f23fdc6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 78a2cb8 - Browse repository at this point
Copy the full SHA 78a2cb8View commit details -
1. simplified workflow config; 2. added comments to CIM shaping
yaqiu committedSep 22, 2021 Configuration menu - View commit details
-
Copy full SHA for f8f2e6a - Browse repository at this point
Copy the full SHA f8f2e6aView commit details -
yaqiu committed
Sep 22, 2021 Configuration menu - View commit details
-
Copy full SHA for 0b5fcd1 - Browse repository at this point
Copy the full SHA 0b5fcd1View commit details -
1. added algorithm type setting in CIM config; 2. added try-except cl…
…ause for initial policy state loading
yaqiu committedSep 22, 2021 Configuration menu - View commit details
-
Copy full SHA for 190802f - Browse repository at this point
Copy the full SHA 190802fView commit details
Commits on Sep 24, 2021
-
1. moved post_step callback inside env sampler; 2. updated README for…
… rl workflows
yaqiu committedSep 24, 2021 Configuration menu - View commit details
-
Copy full SHA for 6e941a4 - Browse repository at this point
Copy the full SHA 6e941a4View commit details -
yaqiu committed
Sep 24, 2021 Configuration menu - View commit details
-
Copy full SHA for 1edd4c4 - Browse repository at this point
Copy the full SHA 1edd4c4View commit details
Commits on Sep 26, 2021
-
* added part of vm scheduling RL code * refined vm env_wrapper code style * added DQN * added get_experiences func for ac in vm scheduling * added post_step callback to env wrapper * moved Aiming's tracking and plotting logic into callbacks * added eval env wrapper * renamed AC config variable name for VM * vm scheduling RL code finished * updated README * fixed various bugs and hard coding for vm_scheduling * uncommented callbacks for VM scheduling * Minor revision for better code style * added part of vm scheduling RL code * refined vm env_wrapper code style * vm scheduling RL code finished * added config.py for vm scheduing * vm example refactoring * fixed bugs in vm_scheduling * removed unwanted files from cim dir * reverted to simple policy manager as default * added part of vm scheduling RL code * refined vm env_wrapper code style * vm scheduling RL code finished * added config.py for vm scheduing * resolved rebase conflicts * fixed bugs in vm_scheduling * added get_state and set_state to vm_scheduling policy models * updated README for vm_scheduling with RL Co-authored-by: yaqiu <v-yaqiu@microsoft.com> Co-authored-by: Huoran Li <huoranli@microsoft.com>
Configuration menu - View commit details
-
Copy full SHA for 2b4d4eb - Browse repository at this point
Copy the full SHA 2b4d4ebView commit details -
* Refine test scripts & pending_order_daily logic * Refactor code for better code style: complete type hint, correct typos, remove unused items. Refactor code for better code style: complete type hint, correct typos, remove unused items. * Polish test_supply_chain.py * update import format * Modify vehicle steps logic & remove outdated test case * Optimize imports * Optimize imports * Lint error * Lint error * Lint error * Add SupplyChainAction * Lint error Co-authored-by: Jinyu Wang <Wang.Jinyu@microsoft.com>
Configuration menu - View commit details
-
Copy full SHA for 3a928b9 - Browse repository at this point
Copy the full SHA 3a928b9View commit details
Commits on Oct 9, 2021
-
yaqiu committed
Oct 9, 2021 Configuration menu - View commit details
-
Copy full SHA for ea7fdde - Browse repository at this point
Copy the full SHA ea7fddeView commit details -
fixed bug in ParallelAgentWrapper
yaqiu committedOct 9, 2021 Configuration menu - View commit details
-
Copy full SHA for c1f8faf - Browse repository at this point
Copy the full SHA c1f8fafView commit details
Commits on Oct 10, 2021
-
1. fixed lint issues; 2. refined main script in workflows
yaqiu committedOct 10, 2021 Configuration menu - View commit details
-
Copy full SHA for cf1430a - Browse repository at this point
Copy the full SHA cf1430aView commit details -
yaqiu committed
Oct 10, 2021 Configuration menu - View commit details
-
Copy full SHA for 485ffd7 - Browse repository at this point
Copy the full SHA 485ffd7View commit details -
restored default config for rl example
yaqiu committedOct 10, 2021 Configuration menu - View commit details
-
Copy full SHA for 4e1d37c - Browse repository at this point
Copy the full SHA 4e1d37cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5b21e67 - Browse repository at this point
Copy the full SHA 5b21e67View commit details
Commits on Oct 11, 2021
-
refined env var processing in policy manager workflow
yaqiu committedOct 11, 2021 Configuration menu - View commit details
-
Copy full SHA for 868bd53 - Browse repository at this point
Copy the full SHA 868bd53View commit details
Commits on Oct 12, 2021
-
added hasattr check in agent wrapper
yaqiu committedOct 12, 2021 Configuration menu - View commit details
-
Copy full SHA for 12ffd98 - Browse repository at this point
Copy the full SHA 12ffd98View commit details -
yaqiu committed
Oct 12, 2021 Configuration menu - View commit details
-
Copy full SHA for c0bae0b - Browse repository at this point
Copy the full SHA c0bae0bView commit details
Commits on Oct 13, 2021
-
Configuration menu - View commit details
-
Copy full SHA for a5ddfd5 - Browse repository at this point
Copy the full SHA a5ddfd5View commit details
Commits on Oct 14, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 0f2f83e - Browse repository at this point
Copy the full SHA 0f2f83eView commit details
Commits on Dec 6, 2021
-
Minor PR. Prepare to merge latest master branch into v0.3 branch. (#412)
* Prepare to merge master_mirror * Lint error * Minor
Configuration menu - View commit details
-
Copy full SHA for 6a1179c - Browse repository at this point
Copy the full SHA 6a1179cView commit details
Commits on Dec 8, 2021
-
Merge latest master into v0.3 (#426)
* update docker hub init (#367) * update docker hub init * replace personal account with maro-team * update hello files for CIM * update docker repository name * update docker file name * fix bugs in notebook, rectify docs * fix doc build issue * remove docs from playground; fix citibike lp example Event issue * update the exampel for vector env * update vector env example * update README due to PR comments * add link to playground above MARO installation in README * fix some typos Co-authored-by: Jinyu Wang <Wang.Jinyu@microsoft.com> * update package version * update README for package description * update image links for pypi package description * update image links for pypi package description * change the input topology schema for CIM real data mode (#372) * change the input topology schema for CIM real data mode * remove unused importing * update test config file correspondingly * add Exception for env test * add cost factors to cim data dump * update CimDataCollection field name * update field name of data collection related code * update package version * adjust interface to reflect actual signature (#374) Co-authored-by: Jeremy Reynolds <jeremr@microsoft.com> * update dataclasses requirement to setup * fix: fixing spelling grammarr * fix: fix typo spelling code commented and data_model.rst * Fix Geo vis IP address & SQL logic bugs. (#383) Fix Geo vis IP address & SQL logic bugs (issue [352](#352) and [314](#314)). * Fix the "Wrong future stop tick predictions" bug (#386) * Propose my new solution Refine to the pre-process version . * Optimize import * Fix reset random seed bug (#387) * update the reset interface of Env and BE * Try to fix reset routes generation seed issue * Refine random related logics. * Minor refinement * Test check * Minor * Remove unused functions so far * Minor Co-authored-by: Jinyu Wang <jinywan@microsoft.com> * update package version * Add _init_vessel_plans in business_engine.reset (#388) * update package version * change the default solver used in Citibike OnlineLP example, from GLPK to CBC (#391) Co-authored-by: Jinyu Wang <Wang.Jinyu@microsoft.com> * Refine `event_buffer/` module (#389) * Core & Business Engine code refinement (#392) * First version * Optimize imports * Add typehint * Lint check * Lint check * add higher python version (#398) * add higher python version * update pytorch version * update torchvision version Co-authored-by: Jinyu Wang <Wang.Jinyu@microsoft.com> * CIM scenario refinement (#400) * Cim scenario refinement (#394) * CIM refinement * Fix lint error * Fix lint error * Cim test coverage (#395) * Enrich tests * Refactor CimDataGenerator * Refactor CIM parsers * Minor refinement * Fix lint error * Fix lint error * Fix lint error * Minor refactor * Type * Add two test file folders. Make a slight change to CIM BE. * Lint error * Lint error * Remove unnecessary public interfaces of CIM BE * Cim disable auto action type detection (#399) * Haven't been tested * Modify document * Add ActionType checking * Minor * Lint error * Action quantity should be a position number * Modify related docs & notebooks * Minor * Change test file name. Prepare to merge into master. * . * Minor test patch * Add `clear()` function to class `SimRandom` (#401) * Add SimRandom.clear() * Minor * Remove commented codes * Lint error * update package version * Minor * Remove docs/source/examples/multi_agent_dqn_cim.rst * Update .gitignore * Update .gitignore Co-authored-by: Jinyu-W <53509467+Jinyu-W@users.noreply.github.com> Co-authored-by: Jinyu Wang <Wang.Jinyu@microsoft.com> Co-authored-by: Jinyu Wang <jinywan@microsoft.com> Co-authored-by: Jeremy Reynolds <jeremy.reynolds@microsoft.com> Co-authored-by: Jeremy Reynolds <jeremr@microsoft.com> Co-authored-by: slowy07 <slowy.arfy@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for ff0f706 - Browse repository at this point
Copy the full SHA ff0f706View commit details
Commits on Jan 24, 2022
-
Change
Env.set_seed()
logic (#456)* Change Env.set_seed() logic * Redesign CIM reset logic; fix lint issues; * Lint * Seed type assertion
Configuration menu - View commit details
-
Copy full SHA for 8a25f9e - Browse repository at this point
Copy the full SHA 8a25f9eView commit details
Commits on Mar 4, 2022
-
Configuration menu - View commit details
-
Copy full SHA for 526627c - Browse repository at this point
Copy the full SHA 526627cView commit details
Commits on Mar 7, 2022
-
* added daemon=True for multi-process rollout, policy manager and inference * removed obsolete files * [REDO][PR#406]V0.2 rl refinement taskq (#408) * Add a usable task_queue * Rename some variables * 1. Add ; 2. Integrate related files; 3. Remove * merge `data_parallel` and `num_grad_workers` into `data_parallelism` * Fix bugs in docker_compose_yml.py and Simple/Multi-process mode. * Move `grad_worker` into marl/rl/workflows * 1.Merge data_parallel and num_workers into data_parallelism in config; 2.Assign recently used workers as possible in task_queue. * Refine code and update docs of `TaskQueue` * Support priority for tasks in `task_queue` * Update diagram of policy manager and task queue. * Add configurable `single_task_limit` and correct docstring about `data_parallelism` * Fix lint errors in `supply chain` * RL policy redesign (V2) (#405) * Drafi v2.0 for V2 * Polish models with more comments * Polish policies with more comments * Lint * Lint * Add developer doc for models. * Add developer doc for policies. * Remove policy manager V2 since it is not used and out-of-date * Lint * Lint * refined messy workflow code * merged 'scenario_dir' and 'scenario' in rl config * 1. refined env_sampler and agent_wrapper code; 2. added docstrings for env_sampler methods * 1. temporarily renamed RLPolicy from polivy_v2 to RLPolicyV2; 2. merged env_sampler and env_sampler_v2 * merged cim and cim_v2 * lint issue fix * refined logging logic * lint issue fix * reversed unwanted changes * . . . . ReplayMemory & IndexScheduler ReplayMemory & IndexScheduler . MultiReplayMemory get_actions_with_logps EnvSampler on the road EnvSampler Minor * LearnerManager * Use batch to transfer data & add SHAPE_CHECK_FLAG * Rename learner to trainer * Add property for policy._is_exploring * CIM test scenario for V3. Manual test passed. Next step: run it, make it works. * env_sampler.py could run * env_sampler refine on the way * First runnable version done * AC could run, but the result is bad. Need to check the logic * Refine abstract method & shape check error info. * Docs * Very detailed compare. Try again. * AC done * DQN check done * Minor * DDPG, not tested * Minors * A rough draft of MAAC * Cannot use CIM as the multi-agent scenario. * Minor * MAAC refinement on the way * Remove ActionWithAux * Refine batch & memory * MAAC example works * Reproduce-able fix. Policy share between env_sampler and trainer_manager. * Detail refinement * Simplify the user configed workflow * Minor * Refine example codes * Minor polishment * Migrate rollout_manager to V3 * Error on the way * Redesign torch.device management * Rl v3 maddpg (#418) * Add MADDPG trainer * Fit independent critics and shared critic modes. * Add a new property: num_policies * Lint * Fix a bug in `sum(rewards)` * Rename `MADDPG` to `DiscreteMADDPG` and fix type hint. * Rename maddpg in examples. * Preparation for data parallel (#420) * Preparation for data parallel * Minor refinement & lint fix * Lint * Lint * rename atomic_get_batch_grad to get_batch_grad * Fix a unexpected commit * distributed maddpg * Add critic worker * Minor * Data parallel related minorities * Refine code structure for trainers & add more doc strings * Revert a unwanted change * Use TrainWorker to do the actual calculations. * Some minor redesign of the worker's abstraction * Add set/get_policy_state_dict back * Refine set/get_policy_state_dict * Polish policy trainers move train_batch_size to abs trainer delete _train_step_impl() remove _record_impl remove unused methods a minor bug fix in maddpg * Rl v3 data parallel grad worker (#432) * Fit new `trainer_worker` in `grad_worker` and `task_queue`. * Add batch dispatch * Add `tensor_dict` for task submit interface * Move `_remote_learn` to `AbsTrainWorker`. * Complement docstring for task queue and trainer. * Rename train worker to train ops; add placeholder for abstract methods; * Lint Co-authored-by: GQ.Chen <v-guanchen@microsoft.com> * [DRAFT] distributed training pipeline based on RL Toolkit V3 (#450) * Preparation for data parallel * Minor refinement & lint fix * Lint * Lint * rename atomic_get_batch_grad to get_batch_grad * Fix a unexpected commit * distributed maddpg * Add critic worker * Minor * Data parallel related minorities * Refine code structure for trainers & add more doc strings * Revert a unwanted change * Use TrainWorker to do the actual calculations. * Some minor redesign of the worker's abstraction * Add set/get_policy_state_dict back * Refine set/get_policy_state_dict * Polish policy trainers move train_batch_size to abs trainer delete _train_step_impl() remove _record_impl remove unused methods a minor bug fix in maddpg * Rl v3 data parallel grad worker (#432) * Fit new `trainer_worker` in `grad_worker` and `task_queue`. * Add batch dispatch * Add `tensor_dict` for task submit interface * Move `_remote_learn` to `AbsTrainWorker`. * Complement docstring for task queue and trainer. * dsitributed training pipeline draft * added temporary test files for review purposes * Several code style refinements (#451) * Polish rl_v3/utils/ * Polish rl_v3/distributed/ * Polish rl_v3/policy_trainer/abs_trainer.py * fixed merge conflicts * unified sync and async interfaces * refactored rl_v3; refinement in progress * Finish the runnable pipeline under new design * Remove outdated files; refine class names; optimize imports; * Lint * Minor maddpg related refinement * Lint Co-authored-by: Default <huo53926@126.com> Co-authored-by: Huoran Li <huoranli@microsoft.com> Co-authored-by: GQ.Chen <v-guanchen@microsoft.com> Co-authored-by: ysqyang <v-yangqi@microsoft.com> * Miner bug fix * Coroutine-related bug fix ("get_policy_state") (#452) * fixed rebase conflicts * renamed get_policy_func_dict to policy_creator * deleted unwanted folder * removed unwanted changes * resolved PR452 comments Co-authored-by: ysqyang <v-yangqi@microsoft.com> * Quick fix * Redesign experience recording logic (#453) * Two not important fix * Temp draft. Prepare to WFH * Done * Lint * Lint * Calculating advantages / returns (#454) * V1.0 * Complete DDPG * Rl v3 hanging issue fix (#455) * fixed rebase conflicts * renamed get_policy_func_dict to policy_creator * unified worker interfaces * recovered some files * dist training + cli code move * fixed bugs * added retry logic to client * 1. refactored CIM with various algos; 2. lint * lint * added type hint * removed some logs * lint * Make main.py more IDE friendly * Make main.py more IDE friendly * Lint * Final test & format. Ready to merge. Co-authored-by: ysqyang <v-yangqi@microsoft.com> Co-authored-by: yaqiu <v-yaqiu@microsoft.com> Co-authored-by: Huoran Li <huoranli@microsoft.com> * Rl v3 parallel rollout (#457) * fixed rebase conflicts * renamed get_policy_func_dict to policy_creator * unified worker interfaces * recovered some files * dist training + cli code move * fixed bugs * added retry logic to client * 1. refactored CIM with various algos; 2. lint * lint * added type hint * removed some logs * lint * Make main.py more IDE friendly * Make main.py more IDE friendly * Lint * load balancing dispatcher * added parallel rollout * lint * Tracker variable type issue; rename to env_sampler_creator; * Rl v3 parallel rollout follow ups (#458) * AbsWorker & AbsDispatcher * Pass env idx to AbsTrainer.record() method, and let the trainer to decide how to record experiences sampled from different worlds. * Fix policy_creator reuse bug * Format code * Merge AbsTrainerManager & SimpleTrainerManager * AC test passed * Lint * Remove AbsTrainer.build() method. Put all initialization operations into __init__ * Redesign AC preprocess batches logic Co-authored-by: ysqyang <v-yangqi@microsoft.com> Co-authored-by: yaqiu <v-yaqiu@microsoft.com> Co-authored-by: Huoran Li <huoranli@microsoft.com> * MADDPG performance bug fix (#459) * Fix MARL (MADDPG) terminal recording bug; some other minor refinements; * Restore Trainer.build() method * Calculate latest action in the get_actor_grad method in MADDPG. * Share critic bug fix * Rl v3 example update (#461) * updated vm_scheduling example and cim notebook * fixed bugs in vm_scheduling * added local train method * bug fix * modified async client logic to fix hidden issue * reverted to default config * fixed PR comments and some bugs * removed hardcode Co-authored-by: ysqyang <v-yangqi@microsoft.com> Co-authored-by: yaqiu <v-yaqiu@microsoft.com> * Done (#462) * Rl v3 load save (#463) * added load/save feature * fixed some bugs * reverted unwanted changes * lint * fixed PR comments Co-authored-by: ysqyang <v-yangqi@microsoft.com> Co-authored-by: yaqiu <v-yaqiu@microsoft.com> * RL Toolkit data parallelism revamp & config utils (#464) * added load/save feature * fixed some bugs * reverted unwanted changes * lint * fixed PR comments * 1. fixed data parallelism issue; 2. added config validator; 3. refactored cli local * 1. fixed rollout exit issue; 2. refined config * removed config file from example * fixed lint issues * fixed lint issues * added main.py under examples/rl * fixed lint issues Co-authored-by: ysqyang <v-yangqi@microsoft.com> Co-authored-by: yaqiu <v-yaqiu@microsoft.com> * RL doc string (#465) * First rough draft * Minors * Reformat * Lint * Resolve PR comments * Rl type specific env getter (#466) * 1. type-sensitive env variable getter; 2. updated READMEs for examples * fixed bugs * fixed bugs * bug fixes * lint Co-authored-by: ysqyang <v-yangqi@microsoft.com> Co-authored-by: yaqiu <v-yaqiu@microsoft.com> * Example bug fix * Optimize parser.py * Resolve PR comments * Rl config doc (#467) * 1. type-sensitive env variable getter; 2. updated READMEs for examples * added detailed doc * lint * wording refined * resolved some PR comments * resolved more PR comments * typo fix Co-authored-by: ysqyang <v-yangqi@microsoft.com> Co-authored-by: ysqyang <ysqyang@gmail.com> Co-authored-by: ysqyang <v-yangqi@microsoft.com> Co-authored-by: yaqiu <v-yaqiu@microsoft.com> * RL online doc (#469) * Model, policy, trainer * RL workflows and env sampler doc in RST (#468) * First rough draft * Minors * Reformat * Lint * Resolve PR comments * 1. type-sensitive env variable getter; 2. updated READMEs for examples * Rl type specific env getter (#466) * 1. type-sensitive env variable getter; 2. updated READMEs for examples * fixed bugs * fixed bugs * bug fixes * lint Co-authored-by: ysqyang <v-yangqi@microsoft.com> Co-authored-by: yaqiu <v-yaqiu@microsoft.com> * Example bug fix * Optimize parser.py * Resolve PR comments * added detailed doc * lint * wording refined * resolved some PR comments * rewriting rl toolkit rst * resolved more PR comments * typo fix * updated rst Co-authored-by: Huoran Li <huoranli@microsoft.com> Co-authored-by: Default <huo53926@126.com> Co-authored-by: ysqyang <v-yangqi@microsoft.com> Co-authored-by: yaqiu <v-yaqiu@microsoft.com> * Finish docs/source/key_components/rl_toolkit.rst * API doc * RL online doc image fix (#470) * resolved some PR comments * fix * fixed PR comments * added numfig=True setting in conf.py for sphinx Co-authored-by: ysqyang <v-yangqi@microsoft.com> * Resolve PR comments * Add example github link Co-authored-by: ysqyang <ysqyang@gmail.com> Co-authored-by: ysqyang <v-yangqi@microsoft.com> Co-authored-by: yaqiu <v-yaqiu@microsoft.com> * Rl v3 pr comment resolution (#474) * added load/save feature * 1. resolved pr comments; 2. reverted maro/cli/k8s * fixed some bugs Co-authored-by: ysqyang <v-yangqi@microsoft.com> Co-authored-by: yaqiu <v-yaqiu@microsoft.com> Co-authored-by: yaqiu <v-yaqiu@microsoft.com> Co-authored-by: GQ.Chen <v-guanchen@microsoft.com> Co-authored-by: ysqyang <ysqyang@gmail.com> Co-authored-by: ysqyang <v-yangqi@microsoft.com>
Configuration menu - View commit details
-
Copy full SHA for 696f5b5 - Browse repository at this point
Copy the full SHA 696f5b5View commit details
Commits on Mar 9, 2022
-
* Change all Logger in RL to LoggerV2 * TrainerManager => TrainingManager * Add Trainer suffix to all algorithms * Finish docs * Update interface names * Minor fix
Configuration menu - View commit details
-
Copy full SHA for 7b3d78a - Browse repository at this point
Copy the full SHA 7b3d78aView commit details
Commits on Mar 31, 2022
-
Configuration menu - View commit details
-
Copy full SHA for 00fbcee - Browse repository at this point
Copy the full SHA 00fbceeView commit details
Commits on Apr 22, 2022
-
Cherry pick RL changes from
sc_refinement
(latest commit:2a4869
) (……#509) * Cherry pick RL changes from sc_refinement (2a4869) * Limit time display precision
Configuration menu - View commit details
-
Copy full SHA for 0e11ae9 - Browse repository at this point
Copy the full SHA 0e11ae9View commit details
Commits on Apr 24, 2022
-
RL incremental refactor (#501)
* Refactor rollout logic. Allow multiple sampling in one epoch, so that we can generate more data for training. AC & PPO for continuous action policy; refine AC & PPO logic. Cherry pick RL changes from GYM-DDPG Cherry pick RL changes from GYM-SAC Minor error in doc string * Add min_n_sample in template and parser * Resolve PR comments. Fix a minor issue in SAC.
Configuration menu - View commit details
-
Copy full SHA for 1219513 - Browse repository at this point
Copy the full SHA 1219513View commit details
Commits on May 10, 2022
-
* CIM passed * Update workers * Refine annotations * VM passed * Code formatting. * Minor import loop issue * Pass batch in PPO again * Remove Scenario * Complete docs * Minor * Remove segment * Optimize logic in RLComponentBundle * Resolve PR comments * Move 'post methods from RLComponenetBundle to EnvSampler
Configuration menu - View commit details
-
Copy full SHA for 333986f - Browse repository at this point
Copy the full SHA 333986fView commit details
Commits on May 16, 2022
-
Add method to get mapping of available tick to frame index (#415)
* add method to get mapping of available tick to frame index * fix lint issue * fix naming issue
Configuration menu - View commit details
-
Copy full SHA for ae83ac0 - Browse repository at this point
Copy the full SHA ae83ac0View commit details
Commits on May 18, 2022
-
Cherry pick from sc_refinement (#527)
* Cherry pick from sc_refinement * Cherry pick from sc_refinement
Configuration menu - View commit details
-
Copy full SHA for 10b9c02 - Browse repository at this point
Copy the full SHA 10b9c02View commit details
Commits on May 25, 2022
-
Refine
terminal
/next_agent_state
logic (#531)* Optimize RL toolkit * Fix bug in terminal/next_state generation * Rewrite terminal/next_state logic again * Minor renaming * Minor bug fix * Resolve PR comments
Configuration menu - View commit details
-
Copy full SHA for 0d132cc - Browse repository at this point
Copy the full SHA 0d132ccView commit details
Commits on May 31, 2022
-
* update docker hub init (#367) * update docker hub init * replace personal account with maro-team * update hello files for CIM * update docker repository name * update docker file name * fix bugs in notebook, rectify docs * fix doc build issue * remove docs from playground; fix citibike lp example Event issue * update the exampel for vector env * update vector env example * update README due to PR comments * add link to playground above MARO installation in README * fix some typos Co-authored-by: Jinyu Wang <Wang.Jinyu@microsoft.com> * update package version * update README for package description * update image links for pypi package description * update image links for pypi package description * change the input topology schema for CIM real data mode (#372) * change the input topology schema for CIM real data mode * remove unused importing * update test config file correspondingly * add Exception for env test * add cost factors to cim data dump * update CimDataCollection field name * update field name of data collection related code * update package version * adjust interface to reflect actual signature (#374) Co-authored-by: Jeremy Reynolds <jeremr@microsoft.com> * update dataclasses requirement to setup * fix: fixing spelling grammarr * fix: fix typo spelling code commented and data_model.rst * Fix Geo vis IP address & SQL logic bugs. (#383) Fix Geo vis IP address & SQL logic bugs (issue [352](#352) and [314](#314)). * Fix the "Wrong future stop tick predictions" bug (#386) * Propose my new solution Refine to the pre-process version . * Optimize import * Fix reset random seed bug (#387) * update the reset interface of Env and BE * Try to fix reset routes generation seed issue * Refine random related logics. * Minor refinement * Test check * Minor * Remove unused functions so far * Minor Co-authored-by: Jinyu Wang <jinywan@microsoft.com> * update package version * Add _init_vessel_plans in business_engine.reset (#388) * update package version * change the default solver used in Citibike OnlineLP example, from GLPK to CBC (#391) Co-authored-by: Jinyu Wang <Wang.Jinyu@microsoft.com> * Refine `event_buffer/` module (#389) * Core & Business Engine code refinement (#392) * First version * Optimize imports * Add typehint * Lint check * Lint check * add higher python version (#398) * add higher python version * update pytorch version * update torchvision version Co-authored-by: Jinyu Wang <Wang.Jinyu@microsoft.com> * CIM scenario refinement (#400) * Cim scenario refinement (#394) * CIM refinement * Fix lint error * Fix lint error * Cim test coverage (#395) * Enrich tests * Refactor CimDataGenerator * Refactor CIM parsers * Minor refinement * Fix lint error * Fix lint error * Fix lint error * Minor refactor * Type * Add two test file folders. Make a slight change to CIM BE. * Lint error * Lint error * Remove unnecessary public interfaces of CIM BE * Cim disable auto action type detection (#399) * Haven't been tested * Modify document * Add ActionType checking * Minor * Lint error * Action quantity should be a position number * Modify related docs & notebooks * Minor * Change test file name. Prepare to merge into master. * . * Minor test patch * Add `clear()` function to class `SimRandom` (#401) * Add SimRandom.clear() * Minor * Remove commented codes * Lint error * update package version * add branch v0.3 to github workflow * update github test workflow * Update requirements.dev.txt (#444) Added the versions of dependencies and resolve some conflicts occurs when installing. By adding these version number it will tell you the exact. * Bump ipython from 7.10.1 to 7.16.3 in /notebooks (#460) Bumps [ipython](https://github.com/ipython/ipython) from 7.10.1 to 7.16.3. - [Release notes](https://github.com/ipython/ipython/releases) - [Commits](ipython/ipython@7.10.1...7.16.3) --- updated-dependencies: - dependency-name: ipython dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Add & sort requirements.dev.txt Co-authored-by: Jinyu-W <53509467+Jinyu-W@users.noreply.github.com> Co-authored-by: Jinyu Wang <Wang.Jinyu@microsoft.com> Co-authored-by: Jinyu Wang <jinywan@microsoft.com> Co-authored-by: Jeremy Reynolds <jeremy.reynolds@microsoft.com> Co-authored-by: Jeremy Reynolds <jeremr@microsoft.com> Co-authored-by: slowy07 <slowy.arfy@gmail.com> Co-authored-by: solosilence <abhishekkr23rs@gmail.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for a3dade7 - Browse repository at this point
Copy the full SHA a3dade7View commit details
Commits on Jun 1, 2022
-
Configuration menu - View commit details
-
Copy full SHA for cdadbc9 - Browse repository at this point
Copy the full SHA cdadbc9View commit details -
Configuration menu - View commit details
-
Copy full SHA for e0209d6 - Browse repository at this point
Copy the full SHA e0209d6View commit details -
Configuration menu - View commit details
-
Copy full SHA for c135e73 - Browse repository at this point
Copy the full SHA c135e73View commit details -
Configuration menu - View commit details
-
Copy full SHA for fb77545 - Browse repository at this point
Copy the full SHA fb77545View commit details -
Configuration menu - View commit details
-
Copy full SHA for c144c3b - Browse repository at this point
Copy the full SHA c144c3bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 0d6ac99 - Browse repository at this point
Copy the full SHA 0d6ac99View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5ce9e4c - Browse repository at this point
Copy the full SHA 5ce9e4cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 2e4b436 - Browse repository at this point
Copy the full SHA 2e4b436View commit details