Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Adding updates for Quadrotor #166

Open
wants to merge 262 commits into
base: main
Choose a base branch
from
Open

Adding updates for Quadrotor #166

wants to merge 262 commits into from
This pull request is big! We’re only showing the most recent 250 commits.

Commits on Jul 10, 2023

  1. edit bash file with correct arg name

    @middleyuan
    middleyuan committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    84830df View commit details
    Browse the repository at this point in the history

  2. add another host in gpmpc_hpo.sh

    @middleyuan
    middleyuan committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    e69e048 View commit details
    Browse the repository at this point in the history

  3. change to new dir in gpmpc_hpo.sh

    @middleyuan
    middleyuan committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    097e1c2 View commit details
    Browse the repository at this point in the history

Commits on Jul 11, 2023

  1. 1. fix a small bug 2. add test_train_gpmpc_cartpole

    @middleyuan
    middleyuan committed Jul 11, 2023
    Configuration menu
    Copy the full SHA
    405dcea View commit details
    Browse the repository at this point in the history

  2. add a hpo parallelism test

    @middleyuan
    middleyuan committed Jul 11, 2023
    Configuration menu
    Copy the full SHA
    549ff3e View commit details
    Browse the repository at this point in the history

  3. saving before runing hpo

    @middleyuan
    middleyuan committed Jul 11, 2023
    Configuration menu
    Copy the full SHA
    81b5602 View commit details
    Browse the repository at this point in the history

  4. I think the bug is that it reaches thee goal in the first step.

    @middleyuan
    middleyuan committed Jul 11, 2023
    Configuration menu
    Copy the full SHA
    a5ad5f2 View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2023

  1. 1. PPO configs. 2. Make cartpole init states harder. 3. First version… 

    … of JSRL on PPO.
    @middleyuan
    middleyuan committed Jul 18, 2023
    Configuration menu
    Copy the full SHA
    ce4d75e View commit details
    Browse the repository at this point in the history

  2. Re-organize a bit (file name, remove __init__.py in test folders).

    @middleyuan
    middleyuan committed Jul 18, 2023
    Configuration menu
    Copy the full SHA
    b40566c View commit details
    Browse the repository at this point in the history

Commits on Jul 22, 2023

  1. 1. HPO strategies. 2. test on hpo for ppo. 3. another way to save che… 

    …ckpoint in ppo.py. 4. Boolean var in ppo_sampler.
    @middleyuan
    middleyuan committed Jul 22, 2023
    Configuration menu
    Copy the full SHA
    23f571d View commit details
    Browse the repository at this point in the history

Commits on Jul 24, 2023

  1. update gitignore

    @middleyuan
    middleyuan committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    802edb6 View commit details
    Browse the repository at this point in the history

  2. change configs

    @middleyuan
    middleyuan committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    02d1c33 View commit details
    Browse the repository at this point in the history

  3. update bash for hpo on gpmpc

    @middleyuan
    middleyuan committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    20d3a7f View commit details
    Browse the repository at this point in the history

  4. add prior arg in gpmpc_sampler

    @middleyuan
    middleyuan committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    ad96f6f View commit details
    Browse the repository at this point in the history

  5. 1. HPO effort evaluations. 2. Bash file for hpo strategy evalution.

    @middleyuan
    middleyuan committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    5318c25 View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2023

  1. update dependencies

    @middleyuan
    middleyuan committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    924d3b3 View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2023

  1. add the freedom to choose between random sampler and TPE sampler.

    @middleyuan
    middleyuan committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    14ae2aa View commit details
    Browse the repository at this point in the history

Commits on Aug 3, 2023

  1. 1. add strategy 5. 2. add unit test accordingly.

    @middleyuan
    middleyuan committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    c0b1b34 View commit details
    Browse the repository at this point in the history

  2. 1. prior configs. 2. update eval.py, sen.sh, and .gitifonore.

    @middleyuan
    middleyuan committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    f5c3a5a View commit details
    Browse the repository at this point in the history

Commits on Aug 4, 2023

  1. gpmpc hpo strategy study

    @middleyuan
    middleyuan committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    0e1248a View commit details
    Browse the repository at this point in the history

Commits on Aug 7, 2023

  1. refactor the code

    @middleyuan
    middleyuan committed Aug 7, 2023
    Configuration menu
    Copy the full SHA
    a0feec7 View commit details
    Browse the repository at this point in the history

Commits on Aug 8, 2023

  1. 1. hpo on sac. 2. add activation arg in sac and fix a small bug.

    @middleyuan
    middleyuan committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    bd39347 View commit details
    Browse the repository at this point in the history

  2. fix typos

    @middleyuan
    middleyuan committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    4342b2a View commit details
    Browse the repository at this point in the history

Commits on Aug 9, 2023

  1. change to two jobs

    @middleyuan
    middleyuan committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    1e1f7cf View commit details
    Browse the repository at this point in the history

  2. change num of repetitions to make sure it at least has same num of sa… 

    …mples as s2.
    @middleyuan
    middleyuan committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    b087c87 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'hpo-on-ppo' into hpo-on-sac

    @middleyuan
    middleyuan committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    59b4220 View commit details
    Browse the repository at this point in the history

  4. reduce the budget

    @middleyuan
    middleyuan committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    4c22c86 View commit details
    Browse the repository at this point in the history

Commits on Aug 10, 2023

  1. toy example

    @middleyuan
    middleyuan committed Aug 10, 2023
    Configuration menu
    Copy the full SHA
    fe02a65 View commit details
    Browse the repository at this point in the history

Commits on Aug 11, 2023

  1. consider 4 version of noisy functions.

    @middleyuan
    middleyuan committed Aug 11, 2023
    Configuration menu
    Copy the full SHA
    3d33487 View commit details
    Browse the repository at this point in the history

Commits on Aug 13, 2023

  1. include var study

    @middleyuan
    middleyuan committed Aug 13, 2023
    Configuration menu
    Copy the full SHA
    714a76d View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2023

  1. improve visualization in toy examples

    @middleyuan
    middleyuan committed Aug 14, 2023
    Configuration menu
    Copy the full SHA
    2663cde View commit details
    Browse the repository at this point in the history

  2. updated visualization improvement in toy examples.

    @middleyuan
    middleyuan committed Aug 14, 2023
    Configuration menu
    Copy the full SHA
    249a284 View commit details
    Browse the repository at this point in the history

  3. change naming

    @middleyuan
    middleyuan committed Aug 14, 2023
    Configuration menu
    Copy the full SHA
    e03cb33 View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2023

  1. final experiment setup

    @middleyuan
    middleyuan committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    ee29967 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'hpo-on-ppo' into hpo-on-sac

    @middleyuan
    middleyuan committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    3a6448d View commit details
    Browse the repository at this point in the history

  3. final experiment setup

    @middleyuan
    middleyuan committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    831e186 View commit details
    Browse the repository at this point in the history

  4. modify seeding

    @middleyuan
    middleyuan committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    452937d View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2023

  1. Ignore runtime error for hpo

    @middleyuan
    middleyuan committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    7b4a844 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'hpo-on-ppo' into hpo-on-gpmpc

    @middleyuan
    middleyuan committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    bfd6f21 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'hpo-on-sac' into hpo-on-gpmpc

    @middleyuan
    middleyuan committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    e310829 View commit details
    Browse the repository at this point in the history

  4. merge from sac

    @middleyuan
    middleyuan committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    c45e3e4 View commit details
    Browse the repository at this point in the history

  5. fix a bug in hpo_sampler.py

    @middleyuan
    middleyuan committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    8596fc8 View commit details
    Browse the repository at this point in the history

  6. final design to show possible lower compute time.

    @middleyuan
    middleyuan committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    df01b80 View commit details
    Browse the repository at this point in the history

  7. 1. hpo on ddpg. 2. fix a small bug in ddpg_utils.

    @middleyuan
    middleyuan committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    9faae33 View commit details
    Browse the repository at this point in the history

  8. relax the threshold

    @middleyuan
    middleyuan committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    de90501 View commit details
    Browse the repository at this point in the history

Commits on Sep 1, 2023

  1. relax the threshold

    @middleyuan
    middleyuan committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    4322f67 View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2023

  1. make rl_hpo_strategy_eval.sh automatic.

    @middleyuan
    middleyuan committed Sep 4, 2023
    Configuration menu
    Copy the full SHA
    038f046 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'hpo-on-ppo' into hpo-on-sac

    @middleyuan
    middleyuan committed Sep 4, 2023
    Configuration menu
    Copy the full SHA
    4703d8b View commit details
    Browse the repository at this point in the history

  3. Merge branch 'hpo-on-ppo' into hpo-on-ddpg

    @middleyuan
    middleyuan committed Sep 4, 2023
    Configuration menu
    Copy the full SHA
    807e358 View commit details
    Browse the repository at this point in the history

  4. fix a bug in rl_hpo_strategy_eval.sh

    @middleyuan
    middleyuan committed Sep 4, 2023
    Configuration menu
    Copy the full SHA
    6590134 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'hpo-on-ppo' into hpo-on-sac

    @middleyuan
    middleyuan committed Sep 4, 2023
    Configuration menu
    Copy the full SHA
    8c594c3 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'hpo-on-ppo' into hpo-on-ddpg

    @middleyuan
    middleyuan committed Sep 4, 2023
    Configuration menu
    Copy the full SHA
    87cbd1e View commit details
    Browse the repository at this point in the history

  7. add gpmpc_hpo_strategy_eval.sh

    @middleyuan
    middleyuan committed Sep 4, 2023
    Configuration menu
    Copy the full SHA
    8211c52 View commit details
    Browse the repository at this point in the history

  8. fix a small bug

    @middleyuan
    middleyuan committed Sep 4, 2023
    Configuration menu
    Copy the full SHA
    26536e9 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2023

  1. fix the budget (trial) bug in configs.

    @middleyuan
    middleyuan committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    5bca27a View commit details
    Browse the repository at this point in the history

  2. prepare comparing hpo strategy on gpmpc

    @middleyuan
    middleyuan committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    f083b64 View commit details
    Browse the repository at this point in the history

  3. fix a bug in gpmpc_hpo_strategy.sh

    @middleyuan
    middleyuan committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    bed32ce View commit details
    Browse the repository at this point in the history

  4. fix bugs in bash files

    @middleyuan
    middleyuan committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    9503398 View commit details
    Browse the repository at this point in the history

  5. fix the trial bug in config

    @middleyuan
    middleyuan committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    6cd934f View commit details
    Browse the repository at this point in the history

  6. fix a function bug in eval.py

    @middleyuan
    middleyuan committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    ecb27b1 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'hpo-on-ppo' into hpo-on-ddpg

    @middleyuan
    middleyuan committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    69d416b View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2023

  1. 1. add hpo resume functionality. 2. make eval function more general.

    @middleyuan
    middleyuan committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    a1b0756 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'hpo-on-ppo' into hpo-on-sac

    @middleyuan
    middleyuan committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    c88e7e7 View commit details
    Browse the repository at this point in the history

  3. update configs

    @middleyuan
    middleyuan committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    a9aa83b View commit details
    Browse the repository at this point in the history

  4. make main.sh general

    @middleyuan
    middleyuan committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    7f791aa View commit details
    Browse the repository at this point in the history

  5. Merge branch 'hpo-on-ppo' into hpo-on-sac

    @middleyuan
    middleyuan committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    d8d047b View commit details
    Browse the repository at this point in the history

  6. Merge branch 'hpo-on-ppo' into hpo-on-ddpg

    @middleyuan
    middleyuan committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    1e16f06 View commit details
    Browse the repository at this point in the history

  7. resume previous config with trial increasd.

    @middleyuan
    middleyuan committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    c4a8ded View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2023

  1. fix the sorting bug.

    @middleyuan
    middleyuan committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    80e59ec View commit details
    Browse the repository at this point in the history

  2. Merge branch 'hpo-on-ppo' into hpo-on-ddpg

    @middleyuan
    middleyuan committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    1a3a98a View commit details
    Browse the repository at this point in the history

  3. Merge branch 'hpo-on-ppo' into hpo-on-sac

    @middleyuan
    middleyuan committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    43387d5 View commit details
    Browse the repository at this point in the history

  4. fix sorting bug

    @middleyuan
    middleyuan committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    952b267 View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2023

  1. a small bug fixed

    @middleyuan
    middleyuan committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    7f62195 View commit details
    Browse the repository at this point in the history

  2. fix a bug on computing reward

    @middleyuan
    middleyuan committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    d5109f4 View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2023

  1. Merge branch 'hpo-on-ppo' into hpo-on-gpmpc

    @middleyuan
    middleyuan committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    1618395 View commit details
    Browse the repository at this point in the history

  2. adsd resume functionality

    @middleyuan
    middleyuan committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    778128b View commit details
    Browse the repository at this point in the history

  3. edit main bash file and fix some typos

    @middleyuan
    middleyuan committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    61ea053 View commit details
    Browse the repository at this point in the history

  4. simply assign zero if numerical issues happen during HPO

    @middleyuan
    middleyuan committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    1caae68 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'hpo-on-ppo' into hpo-on-gpmpc

    @middleyuan
    middleyuan committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    8583978 View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2023

  1. adjust eval

    @middleyuan
    middleyuan committed Sep 16, 2023
    Configuration menu
    Copy the full SHA
    f9f701d View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2023

  1. change to boxenplot

    @middleyuan
    middleyuan committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    5caf0c6 View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2023

  1. fix typo

    @middleyuan
    middleyuan committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    eea138a View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2023

  1. add reliable_stats

    @middleyuan
    middleyuan committed Sep 24, 2023
    Configuration menu
    Copy the full SHA
    362ea75 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'hpo-on-gpmpc' into hpo-on-ppo

    @middleyuan
    middleyuan committed Sep 24, 2023
    Configuration menu
    Copy the full SHA
    3649c44 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'hpo-on-ddpg' into hpo-on-ppo

    @middleyuan
    middleyuan committed Sep 24, 2023
    Configuration menu
    Copy the full SHA
    d6e0b08 View commit details
    Browse the repository at this point in the history

  4. update outdated configs

    @middleyuan
    middleyuan committed Sep 24, 2023
    Configuration menu
    Copy the full SHA
    55624cd View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'origin/hpo-on-sac' into hpo-on-ppo

    @middleyuan
    middleyuan committed Sep 24, 2023
    Configuration menu
    Copy the full SHA
    6e9bbc9 View commit details
    Browse the repository at this point in the history

Commits on Oct 5, 2023

  1. update jupyter notebooks

    @middleyuan
    middleyuan committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    02d75ad View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2023

  1. update jupyter notebooks.

    @middleyuan
    middleyuan committed Oct 23, 2023
    Configuration menu
    Copy the full SHA
    00f6608 View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2023

  1. final update for appendix

    @middleyuan
    middleyuan committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    b5749d0 View commit details
    Browse the repository at this point in the history

  2. update readme

    @middleyuan
    middleyuan committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    e4d616d View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2023

  1. fix typo

    @middleyuan
    middleyuan committed Oct 25, 2023
    Configuration menu
    Copy the full SHA
    ef29146 View commit details
    Browse the repository at this point in the history

Commits on Mar 21, 2024

  1. add training test on 2D quadrotor

    @middleyuan
    middleyuan committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    7a191a5 View commit details
    Browse the repository at this point in the history

Commits on Apr 10, 2024

  1. 1. clean up code for ppo controller, hyperparameter module. 2. Test o… 

    …ut package dependencies and MySQL database.
    @middleyuan
    middleyuan committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    47f1598 View commit details
    Browse the repository at this point in the history

  2. test training with given optimized hp files.

    @middleyuan
    middleyuan committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    83ec989 View commit details
    Browse the repository at this point in the history

  3. 1. test hpo with and without MySQL. 2. update README.

    @middleyuan
    middleyuan committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    e890c04 View commit details
    Browse the repository at this point in the history

  4. remove discrepancy of readme.

    @middleyuan
    middleyuan committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    e9499cd View commit details
    Browse the repository at this point in the history

  5. update readme

    @middleyuan
    middleyuan committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    c45a975 View commit details
    Browse the repository at this point in the history

Commits on Apr 15, 2024

  1. 1. remove 'pandas' and 'seaborn' in package dependencies. 2. move tes… 

    …ts to tests. 3. write comments in batch GP in GPMPC controller. 4. move experiments in examples.
    @middleyuan
    middleyuan committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    8350b63 View commit details
    Browse the repository at this point in the history

  2. -

    @middleyuan
    middleyuan committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    ee9ec34 View commit details
    Browse the repository at this point in the history

  3. update config_overrides in examples of rl

    @middleyuan
    middleyuan committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    a260695 View commit details
    Browse the repository at this point in the history

Commits on Apr 16, 2024

  1. run pre-commit hooks to improve linting

    @middleyuan
    middleyuan committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    13ef164 View commit details
    Browse the repository at this point in the history

  2. 1. ignore W503 and W504 as they conflict in pre-commit-config. 2. run… 

    … and pass this version of pre-commit hooks.
    @middleyuan
    middleyuan committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    3bbd0ba View commit details
    Browse the repository at this point in the history

  3. add activation config to the examples that use RL.

    @middleyuan
    middleyuan committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    56f2738 View commit details
    Browse the repository at this point in the history

Commits on Apr 17, 2024

  1. 1. standardize hpo template in the examples. 2. remove _learn(). 3. a… 

    …dd an example of hpo for gpmpc.
    @middleyuan
    middleyuan committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    ba837c5 View commit details
    Browse the repository at this point in the history

  2. run pre-commit hooks.

    @middleyuan
    middleyuan committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    51c601e View commit details
    Browse the repository at this point in the history

  3. add gpmpc hpo test without using mysql

    @middleyuan
    middleyuan committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    fb572f2 View commit details
    Browse the repository at this point in the history

Commits on Apr 19, 2024

  1. 1. update config of cartpole task. 2. add max_steps and exponentiated… 

    … avg return in base_experiment.py. 3. use BaseExperiment class in hpo example 3. add hp study bash script and jupyter notebook for gpmpc.
    @middleyuan
    middleyuan committed Apr 19, 2024
    Configuration menu
    Copy the full SHA
    c5fbeed View commit details
    Browse the repository at this point in the history

Commits on Apr 22, 2024

  1. 1. add bash files to automate hpo pipeline for gpmpc. 2. update gpmpc… 

    … config. 3. add done_on_max_steps in base_experiment.py. 4. remove _run() and use BaseExperiment in hpo.
    @middleyuan
    middleyuan committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    f8e3d0c View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/main' into hpo

    @middleyuan
    middleyuan committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    1f62d3b View commit details
    Browse the repository at this point in the history

  3. match .gitignore to upstram/main.

    @middleyuan
    middleyuan committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    ffb29de View commit details
    Browse the repository at this point in the history

  4. update .gitignore

    @middleyuan
    middleyuan committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    5cf3247 View commit details
    Browse the repository at this point in the history

  5. 1. update rl config. 2. add rl hpo bash script.

    @middleyuan
    middleyuan committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    e395dc1 View commit details
    Browse the repository at this point in the history

  6. add main.sh for rl hpo.

    @middleyuan
    middleyuan committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    3bbe225 View commit details
    Browse the repository at this point in the history

  7. fix typo

    @middleyuan
    middleyuan committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    764fae5 View commit details
    Browse the repository at this point in the history

  8. fix relative path.

    @middleyuan
    middleyuan committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    2d3c644 View commit details
    Browse the repository at this point in the history

  9. fix typo

    @middleyuan
    middleyuan committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    60f934f View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2024

  1. add rl hpo bash scripts

    @middleyuan
    middleyuan committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    54c9ded View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2024

  1. record all data in BaseExperiment class.

    @middleyuan
    middleyuan committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    087f3b3 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'hpo-dev' into unified-quadrotor-interface

    @middleyuan
    middleyuan committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    f8d3eb4 View commit details
    Browse the repository at this point in the history

Commits on Apr 29, 2024

  1. first version of 2D quadrotor with attitude control

    @middleyuan
    middleyuan committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    6dae1d3 View commit details
    Browse the repository at this point in the history

Commits on Apr 30, 2024

  1. working version of PID as position control

    @middleyuan
    middleyuan committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    f52f81b View commit details
    Browse the repository at this point in the history

Commits on May 3, 2024

  1. 1. Both PPO and PID is working. 2. Tune the objective function and ch… 

    …ange the constraint bounds.
    @middleyuan
    middleyuan committed May 3, 2024
    Configuration menu
    Copy the full SHA
    af8b3c6 View commit details
    Browse the repository at this point in the history

Commits on May 7, 2024

  1. 1. improve sac. 2. introduce magic number that works both for sac and… 

    … ppo.
    @middleyuan
    middleyuan committed May 7, 2024
    Configuration menu
    Copy the full SHA
    f4ab93d View commit details
    Browse the repository at this point in the history

Commits on May 8, 2024

  1. tune sac on quadrotor for better performance.

    @middleyuan
    middleyuan committed May 8, 2024
    Configuration menu
    Copy the full SHA
    de4558f View commit details
    Browse the repository at this point in the history

Commits on May 13, 2024

  1. 1. new hpo configs with rmse as the objective. 2. turning q and r int… 

    …o tunable hyperparameters.
    @middleyuan
    middleyuan committed May 13, 2024
    Configuration menu
    Copy the full SHA
    448a511 View commit details
    Browse the repository at this point in the history

Commits on May 14, 2024

  1. default HPs for GPMPC on quadrotor 2D task.

    @middleyuan
    middleyuan committed May 14, 2024
    Configuration menu
    Copy the full SHA
    046b81d View commit details
    Browse the repository at this point in the history

  2. add configs for gpmpc on 2D quadrotor with attitude controller.

    @middleyuan
    middleyuan committed May 14, 2024
    Configuration menu
    Copy the full SHA
    5fcfa9b View commit details
    Browse the repository at this point in the history

Commits on May 15, 2024

  1. new trick on sac

    @middleyuan
    middleyuan committed May 15, 2024
    Configuration menu
    Copy the full SHA
    ce9662f View commit details
    Browse the repository at this point in the history

  2. improve sac using the new trick.

    @middleyuan
    middleyuan committed May 15, 2024
    Configuration menu
    Copy the full SHA
    46eee1a View commit details
    Browse the repository at this point in the history

  3. edit quadrotor_2D.sh

    @middleyuan
    middleyuan committed May 15, 2024
    Configuration menu
    Copy the full SHA
    b4508bb View commit details
    Browse the repository at this point in the history

Commits on May 21, 2024

  1. add submodule

    @middleyuan
    middleyuan committed May 21, 2024
    Configuration menu
    Copy the full SHA
    a9dba8c View commit details
    Browse the repository at this point in the history

  2. add submodule

    @middleyuan
    middleyuan committed May 21, 2024
    Configuration menu
    Copy the full SHA
    621f06d View commit details
    Browse the repository at this point in the history

Commits on May 27, 2024

  1. initial commit for erahbo.

    @middleyuan
    middleyuan committed May 27, 2024
    Configuration menu
    Copy the full SHA
    359ec1b View commit details
    Browse the repository at this point in the history

Commits on May 28, 2024

  1. update submodule.

    @middleyuan
    middleyuan committed May 28, 2024
    Configuration menu
    Copy the full SHA
    79e7014 View commit details
    Browse the repository at this point in the history

  2. update script for specifying max processes.

    @middleyuan
    middleyuan committed May 28, 2024
    Configuration menu
    Copy the full SHA
    8e71901 View commit details
    Browse the repository at this point in the history

  3. update submodule.

    @middleyuan
    middleyuan committed May 28, 2024
    Configuration menu
    Copy the full SHA
    dbfb011 View commit details
    Browse the repository at this point in the history

Commits on May 29, 2024

  1. change target_kl and entropy_coef to log scale.

    @middleyuan
    middleyuan committed May 29, 2024
    Configuration menu
    Copy the full SHA
    ae50011 View commit details
    Browse the repository at this point in the history

  2. update submodule.

    @middleyuan
    middleyuan committed May 29, 2024
    Configuration menu
    Copy the full SHA
    4c50db0 View commit details
    Browse the repository at this point in the history

Commits on May 30, 2024

  1. change ppo hp search space.

    @middleyuan
    middleyuan committed May 30, 2024
    Configuration menu
    Copy the full SHA
    b848d94 View commit details
    Browse the repository at this point in the history

Commits on May 31, 2024

  1. change hp search space back to the original setting.

    @middleyuan
    middleyuan committed May 31, 2024
    Configuration menu
    Copy the full SHA
    8229ba3 View commit details
    Browse the repository at this point in the history

Commits on Jun 1, 2024

  1. 1. gpmpc loading for gp models. 2. plot func in hpo_experiment.py

    @middleyuan
    middleyuan committed Jun 1, 2024
    Configuration menu
    Copy the full SHA
    cdf5a19 View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2024

  1. merge from mingxuan's acados gpmpc.

    @middleyuan
    middleyuan committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    280c414 View commit details
    Browse the repository at this point in the history

  2. test

    @svsawant
    svsawant committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    4714b3f View commit details
    Browse the repository at this point in the history

Commits on Jun 10, 2024

  1. TD3 + quad attitude interface with pitch rate

    @svsawant
    svsawant committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    2048b44 View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2024

  1. training sh file

    @svsawant
    svsawant committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    aac36b9 View commit details
    Browse the repository at this point in the history

  2. add 3D rk4 sim env

    @MingxuanChe
    MingxuanChe committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    84b90a8 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'benchmark' of github.com:middleyuan/safe-control-gym in… 

    …to benchmark
    @MingxuanChe
    MingxuanChe committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    040ab7f View commit details
    Browse the repository at this point in the history

  4. Revert "add 3D rk4 sim env" 

    This reverts commit 84b90a8.
    @MingxuanChe
    MingxuanChe committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    020a4f8 View commit details
    Browse the repository at this point in the history

  5. add quad dyn sim and rk4 sim option

    @MingxuanChe
    MingxuanChe committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    e6dbcd7 View commit details
    Browse the repository at this point in the history

  6. remove time printing

    @MingxuanChe
    MingxuanChe committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    fc44788 View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2024

  1. add cartpole model-based method config

    @MingxuanChe
    MingxuanChe committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    196b6f1 View commit details
    Browse the repository at this point in the history

Commits on Jul 10, 2024

  1. Merge remote-tracking branch 'origin/hpo-dev' into benchmark

    @middleyuan
    middleyuan committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    ca803c0 View commit details
    Browse the repository at this point in the history

Commits on Jul 11, 2024

  1. update identified pitch model

    @MingxuanChe
    MingxuanChe committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    9f6417a View commit details
    Browse the repository at this point in the history

  2. Merge branch 'benchmark' of github.com:middleyuan/safe-control-gym in… 

    …to benchmark
    @MingxuanChe
    MingxuanChe committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    aa4090a View commit details
    Browse the repository at this point in the history

Commits on Jul 12, 2024

  1. add contraction lqr for 2D quad

    @MingxuanChe
    MingxuanChe committed Jul 12, 2024
    Configuration menu
    Copy the full SHA
    dc38b67 View commit details
    Browse the repository at this point in the history

Commits on Jul 15, 2024

  1. move attitude ctrl to env

    @MingxuanChe
    MingxuanChe committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    7051207 View commit details
    Browse the repository at this point in the history

  2. fix acados gp mpc constructor

    @MingxuanChe
    MingxuanChe committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    b698369 View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2024

  1. add discrete-time tracking

    @MingxuanChe
    MingxuanChe committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    c7591d8 View commit details
    Browse the repository at this point in the history

  2. update attitude ctrl env setup

    @MingxuanChe
    MingxuanChe committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    c16c2ad View commit details
    Browse the repository at this point in the history

Commits on Jul 19, 2024

  1. update attitude ctrl env setups

    @MingxuanChe
    MingxuanChe committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    f286295 View commit details
    Browse the repository at this point in the history

Commits on Jul 22, 2024

  1. Merge branch 'benchmark' of github.com:middleyuan/safe-control-gym in… 

    …to benchmark
    @MingxuanChe
    MingxuanChe committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    d30e96c View commit details
    Browse the repository at this point in the history

Commits on Jul 24, 2024

  1. HPO support for ilqr, gpmpc, gpmpc_acados, and ppo on cartpole. Corre… 

    …sponding unittests are checked and passed.
    @middleyuan
    middleyuan committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    c805b9f View commit details
    Browse the repository at this point in the history

  2. 1. add pandas dependency required for hpo. 2. add hpo.sh.

    @middleyuan
    middleyuan committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    6f8d056 View commit details
    Browse the repository at this point in the history

  3. bug fix for trial counting.

    @middleyuan
    middleyuan committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    abdaaba View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2024

  1. tracking lqr clean-up

    @MingxuanChe
    MingxuanChe committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    938fe19 View commit details
    Browse the repository at this point in the history

Commits on Jul 29, 2024

  1. fix lqr tracking step count

    @MingxuanChe
    MingxuanChe committed Jul 29, 2024
    Configuration menu
    Copy the full SHA
    5e3b74a View commit details
    Browse the repository at this point in the history

Commits on Jul 30, 2024

  1. add sparse GP option

    @MingxuanChe
    MingxuanChe committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    bc026ac View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2024

  1. add sysID simulator

    @MingxuanChe
    MingxuanChe committed Aug 1, 2024
    Configuration menu
    Copy the full SHA
    b544f6a View commit details
    Browse the repository at this point in the history

  2. fix ilqr max steps

    @MingxuanChe
    MingxuanChe committed Aug 1, 2024
    Configuration menu
    Copy the full SHA
    3ef1b45 View commit details
    Browse the repository at this point in the history

  3. update quad params and cartpole default constraints

    @MingxuanChe
    MingxuanChe committed Aug 1, 2024
    Configuration menu
    Copy the full SHA
    f014dd8 View commit details
    Browse the repository at this point in the history

Commits on Aug 4, 2024

  1. update batch gp naming

    @MingxuanChe
    MingxuanChe committed Aug 4, 2024
    Configuration menu
    Copy the full SHA
    9d8b67f View commit details
    Browse the repository at this point in the history

Commits on Aug 5, 2024

  1. udpate gpmpc plotting scripts

    @MingxuanChe
    MingxuanChe committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    cd0065a View commit details
    Browse the repository at this point in the history

Commits on Aug 6, 2024

  1. fix sparse GP val setting and ocp reset; add timing deco

    @MingxuanChe
    MingxuanChe committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    a19e8e4 View commit details
    Browse the repository at this point in the history

  2. update gpmpc plotting

    @MingxuanChe
    MingxuanChe committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    b97e372 View commit details
    Browse the repository at this point in the history

Commits on Aug 8, 2024

  1. fix sim seeding

    @MingxuanChe
    MingxuanChe committed Aug 8, 2024
    Configuration menu
    Copy the full SHA
    efc4389 View commit details
    Browse the repository at this point in the history

  2. minor fix plotting length

    @MingxuanChe
    MingxuanChe committed Aug 8, 2024
    Configuration menu
    Copy the full SHA
    2e3ead9 View commit details
    Browse the repository at this point in the history

Commits on Aug 9, 2024

  1. add nonlinear prior for gpmpc

    @MingxuanChe
    MingxuanChe committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    5869545 View commit details
    Browse the repository at this point in the history

Commits on Aug 11, 2024

  1. fix linearization point

    @MingxuanChe
    MingxuanChe committed Aug 11, 2024
    Configuration menu
    Copy the full SHA
    361064f View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2024

  1. update mpc for hardware training

    @MingxuanChe
    MingxuanChe committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    13d2acf View commit details
    Browse the repository at this point in the history

Commits on Aug 21, 2024

  1. rmse fix for ppo and sac

    @svsawant
    svsawant committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    3330b23 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'benchmark' of github.com:middleyuan/safe-control-gym in… 

    …to benchmark
    @svsawant
    svsawant committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    a512448 View commit details
    Browse the repository at this point in the history

Commits on Aug 23, 2024

  1. update tracking task config for HPO

    @MingxuanChe
    MingxuanChe committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    eb282ec View commit details
    Browse the repository at this point in the history

  2. Merge branch 'benchmark' of github.com:middleyuan/safe-control-gym in… 

    …to benchmark
    @MingxuanChe
    MingxuanChe committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    464b774 View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2024

  1. fix typo in config indent

    @MingxuanChe
    MingxuanChe committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    d6c357d View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2024

  1. add hpo for ilqr with safety filter.

    @middleyuan
    middleyuan committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    77ea61b View commit details
    Browse the repository at this point in the history

  2. update configs and unittest for training quadrotor_2D_attitude.

    @middleyuan
    middleyuan committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    e02b4ea View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2024

  1. update gpmpc acados config for HPO

    @MingxuanChe
    MingxuanChe committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    307e5a6 View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2024

  1. hpo works for ilqr, gpmpc, and ppo.

    @middleyuan
    middleyuan committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    86b1788 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'benchmark' of https://github.com/middleyuan/safe-contro… 

    …l-gym into benchmark
    @middleyuan
    middleyuan committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    c270800 View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2024

  1. 1. add exponentiated mse metric. 2. add seed to control env randoness… 

    … in ilqr. 3. update configs.
    @middleyuan
    middleyuan committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    7466b80 View commit details
    Browse the repository at this point in the history

  2. add disturbance force for dys_si option with euler update

    @MingxuanChe
    MingxuanChe committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    9433e48 View commit details
    Browse the repository at this point in the history

  3. update ilqr hardware compatibility

    @MingxuanChe
    MingxuanChe committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    d2b3cfb View commit details
    Browse the repository at this point in the history

  4. Merge branch 'benchmark' of github.com:middleyuan/safe-control-gym in… 

    …to benchmark
    @MingxuanChe
    MingxuanChe committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    089ec7c View commit details
    Browse the repository at this point in the history

  5. minor updates

    @MingxuanChe
    MingxuanChe committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    28232e5 View commit details
    Browse the repository at this point in the history

  6. initial traj and radar plot script

    @MingxuanChe
    MingxuanChe committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    be526a5 View commit details
    Browse the repository at this point in the history

  7. update hand-tune hp; update quad sim and plotting scripts

    @MingxuanChe
    MingxuanChe committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    b413965 View commit details
    Browse the repository at this point in the history

  8. add data for test hull plotting

    @MingxuanChe
    MingxuanChe committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    c36c2b5 View commit details
    Browse the repository at this point in the history

  9. add data for test hull plotting

    @MingxuanChe
    MingxuanChe committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    93301d9 View commit details
    Browse the repository at this point in the history

  10. Merge branch 'benchmark' of github.com:middleyuan/safe-control-gym in… 

    …to benchmark
    @MingxuanChe
    MingxuanChe committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    f99d6cd View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2024

  1. add more detailed logging in hpo.

    @middleyuan
    middleyuan committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    22051a6 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'benchmark' of https://github.com/middleyuan/safe-contro… 

    …l-gym into benchmark
    @middleyuan
    middleyuan committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    f4f6f2b View commit details
    Browse the repository at this point in the history

  3. fix config saving for hpo.

    @middleyuan
    middleyuan committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    fe1fa54 View commit details
    Browse the repository at this point in the history

  4. updated configs for ppo

    @svsawant
    svsawant committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    098653a View commit details
    Browse the repository at this point in the history

  5. updated configs for ppo

    @svsawant
    svsawant committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    1200107 View commit details
    Browse the repository at this point in the history

  6. add standard SE kernel

    @MingxuanChe
    MingxuanChe committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    773dbeb View commit details
    Browse the repository at this point in the history

  7. update MPC solver failure handeling; terminal cost and ancilliary gai… 

    …n; open-loop sol plotting
    @MingxuanChe
    MingxuanChe committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    fc5b982 View commit details
    Browse the repository at this point in the history

  8. add noise robustness test and plotting

    @MingxuanChe
    MingxuanChe committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    6471397 View commit details
    Browse the repository at this point in the history

  9. small fix for rmse compute for ppo and sac

    @svsawant
    svsawant committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    b9bdadf View commit details
    Browse the repository at this point in the history

  10. Revert "small fix for rmse compute for ppo and sac" 

    This reverts commit b9bdadf.
    @svsawant
    svsawant committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    e00213b View commit details
    Browse the repository at this point in the history

  11. Merge remote-tracking branch 'origin/benchmark' into benchmark

    @svsawant
    svsawant committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    533ef60 View commit details
    Browse the repository at this point in the history

  12. small fix for rmse compute for ppo and sac

    @svsawant
    svsawant committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    2e8120b View commit details
    Browse the repository at this point in the history

  13. small fix for rmse compute for ppo and sac 2

    @svsawant
    svsawant committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    0c6f142 View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2024

  1. small fix for faster simulation in quad

    @svsawant
    svsawant committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    1ddd2fd View commit details
    Browse the repository at this point in the history

  2. fix 2

    @svsawant
    svsawant committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    1085d71 View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2024

  1. Set done_on_max_steps to False during HPO.

    @middleyuan
    middleyuan committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    d759cdb View commit details
    Browse the repository at this point in the history

  2. Merge branch 'benchmark' of https://github.com/middleyuan/safe-contro… 

    …l-gym into benchmark
    @middleyuan
    middleyuan committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    618ae9d View commit details
    Browse the repository at this point in the history

  3. change hyperparameter search space for ppo to avoid batch zero error … 

    …and consider default hyperparmeters.
    @middleyuan
    middleyuan committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    a9fd4b9 View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2024

  1. lqr clean up

    @svsawant
    svsawant committed Sep 14, 2024
    Configuration menu
    Copy the full SHA
    b779bfc View commit details
    Browse the repository at this point in the history

  2. learning from ilqr trajectory as reference

    @svsawant
    svsawant committed Sep 14, 2024
    Configuration menu
    Copy the full SHA
    bc2a962 View commit details
    Browse the repository at this point in the history

  3. add prior info for ilqr

    @MingxuanChe
    MingxuanChe committed Sep 14, 2024
    Configuration menu
    Copy the full SHA
    ea98928 View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2024

  1. Merge branch 'benchmark' of github.com:middleyuan/safe-control-gym in… 

    …to benchmark
    @MingxuanChe
    MingxuanChe committed Sep 15, 2024
    Configuration menu
    Copy the full SHA
    d78d42d View commit details
    Browse the repository at this point in the history

  2. fix ilqr feasible traj setup

    @MingxuanChe
    MingxuanChe committed Sep 15, 2024
    Configuration menu
    Copy the full SHA
    40d2dd4 View commit details
    Browse the repository at this point in the history

  3. udpate gp training result plotting

    @MingxuanChe
    MingxuanChe committed Sep 15, 2024
    Configuration menu
    Copy the full SHA
    5f92e50 View commit details
    Browse the repository at this point in the history

  4. GPcollection level input normalize; update GP training plotting

    @MingxuanChe
    MingxuanChe committed Sep 15, 2024
    Configuration menu
    Copy the full SHA
    dee3a44 View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2024

  1. 1. add Vizier option. 2. add parallel_job option in hpo.sh. 3. add tr… 

    …aj plotting script.
    @middleyuan
    middleyuan committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    a8c32d7 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'benchmark' of https://github.com/middleyuan/safe-contro… 

    …l-gym into benchmark
    @middleyuan
    middleyuan committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    101002f View commit details
    Browse the repository at this point in the history

  3. 1. update dependencies. 2. distinguish discrete and categorical hyper… 

    …parameters.
    @middleyuan
    middleyuan committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    951a7b2 View commit details
    Browse the repository at this point in the history

  4. 1. fix type issue in hpo. 2. change space to log scale for learning r… 

    …ate.
    @middleyuan
    middleyuan committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    228c07a View commit details
    Browse the repository at this point in the history

  5. Merge branch 'benchmark' of github.com:middleyuan/safe-control-gym in… 

    …to benchmark
    @MingxuanChe
    MingxuanChe committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    67f09fc View commit details
    Browse the repository at this point in the history

  6. set done_on_max_steps to False.

    @middleyuan
    middleyuan committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    472c2f3 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'benchmark' of github.com:middleyuan/safe-control-gym in… 

    …to benchmark
    @MingxuanChe
    MingxuanChe committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    7aa3940 View commit details
    Browse the repository at this point in the history

  8. rollback quad ref to only x-z ref

    @MingxuanChe
    MingxuanChe committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    af8f1b1 View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2024

  1. small fixes to ppo, sac and td3

    @svsawant
    svsawant committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    fb75194 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/benchmark' into benchmark

    @svsawant
    svsawant committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    781505d View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2024

  1. 1. avoid evaluation during hpo for ppo. 2. Save trials and plot for V… 

    …izier. 3. improve parallel computes for Vizier.
    @middleyuan
    middleyuan committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    35696db View commit details
    Browse the repository at this point in the history

  2. Merge branch 'benchmark' of https://github.com/middleyuan/safe-contro… 

    …l-gym into benchmark
    @middleyuan
    middleyuan committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    5972ea8 View commit details
    Browse the repository at this point in the history

  3. improve logging during hpo.

    @middleyuan
    middleyuan committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    017d9d3 View commit details
    Browse the repository at this point in the history

  4. change database to SQLite.

    @middleyuan
    middleyuan committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    930b63d View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2024

  1. Prepare for deploying on cluster: 1. add weights & Biases. 2. improve… 

    … logging. 3. change PPO search space. 4. make cost parameters independent. 5. save intermediate results during HPO. 6. two packages tested on iLQR, GPMPC, and PPO.
    @middleyuan
    middleyuan committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    68bcb87 View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2024

  1. Merge remote-tracking branch 'middleyuan/benchmark' into developmental

    @svsawant
    svsawant committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    b8094e3 View commit details
    Browse the repository at this point in the history

  2. small fix 1

    @svsawant
    svsawant committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    f75a85a View commit details
    Browse the repository at this point in the history

  3. Auto stash before merge of "middleyuan/benchmark" and "developmental"

    @svsawant
    svsawant committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    fcc5bae View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2024

  1. fixes for config files, etc.

    @svsawant
    svsawant committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    f11c62d View commit details
    Browse the repository at this point in the history

  2. updated models for safe explorer ppo

    @svsawant
    svsawant committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    a1e1572 View commit details
    Browse the repository at this point in the history

  3. fix 2

    @svsawant
    svsawant committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    a523715 View commit details
    Browse the repository at this point in the history

  4. fix 3

    @svsawant
    svsawant committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    7530482 View commit details
    Browse the repository at this point in the history

Commits on Sep 28, 2024

  1. gitignore update

    @svsawant
    svsawant committed Sep 28, 2024
    Configuration menu
    Copy the full SHA
    f716ce9 View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2024

  1. WIP on developmental

    @svsawant
    svsawant committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    5828716 View commit details
    Browse the repository at this point in the history

  2. add ilqr hardware compatibility code; add traj stet reset

    @MingxuanChe
    MingxuanChe committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    f4cfce8 View commit details
    Browse the repository at this point in the history