Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Hydra exploration #703

Open
wants to merge 25 commits into
base: master
Choose a base branch
from
Open

Hydra exploration #703

wants to merge 25 commits into from

Commits on Jun 1, 2023

  1. First draft with somehwat working airl configured using Hydra.

    @ernestum
    ernestum committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    993e059 View commit details
    Browse the repository at this point in the history

  2. Use recursive calls and introduce random number generator config.

    @ernestum
    ernestum committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    1328c2a View commit details
    Browse the repository at this point in the history

  3. Split up AILR config in AIRL creation and AIRL run config. Also move … 

    …most of the interpolation magic into the main script and rename some util modules to make clear what they do.
    @ernestum
    ernestum committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    a72a25d View commit details
    Browse the repository at this point in the history

  4. Make inline imports to speed up shell completion.

    @ernestum
    ernestum committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    89214d9 View commit details
    Browse the repository at this point in the history

  5. Add type annotations, fix typing issues, add comments.

    @ernestum
    ernestum committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    edd12c4 View commit details
    Browse the repository at this point in the history

  6. Remove env_test.py

    @ernestum
    ernestum committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    c014dfb View commit details
    Browse the repository at this point in the history

  7. Add code for policy evaluation.

    @ernestum
    ernestum committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    6c2b3a1 View commit details
    Browse the repository at this point in the history

  8. Move airl configuration to it's own file and restructure the main run… 

    … file
    @ernestum
    ernestum committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    fe0bc1d View commit details
    Browse the repository at this point in the history

  9. Add checkpoint saving.

    @ernestum
    ernestum committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    2906d55 View commit details
    Browse the repository at this point in the history

  10. Use the hydra chdir feature to store logs in the output directory.

    @ernestum
    ernestum committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    f1366e6 View commit details
    Browse the repository at this point in the history

  11. Remove defaults parameter from register_configs, introduce a air_ru… 

    …n.yaml and assemble the airl run config when registering in the config store.
    @ernestum
    ernestum committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    cb92c33 View commit details
    Browse the repository at this point in the history

  12. Define cartpole and pendulum envs as structured configs.

    @ernestum
    ernestum committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    b8221ab View commit details
    Browse the repository at this point in the history

  13. Ensure PPO on disk does not inherit from PPO and loads from an absolu… 

    …te path.
    @ernestum
    ernestum committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    0912138 View commit details
    Browse the repository at this point in the history

  14. Remove low default number of steps for generated trajectories and mov… 

    …e that to the config file.
    @ernestum
    ernestum committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    a0c0d98 View commit details
    Browse the repository at this point in the history

  15. Introduce default_environment to the register_configs functions, remo… 

    …ve the global demonstrations field and rename the global venv field to environment.
    @ernestum
    ernestum committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    1ff9aa1 View commit details
    Browse the repository at this point in the history

  16. Move registering the expert policy as a sub-call to registering the t… 

    …rajectories.
    @ernestum
    ernestum committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    e37fd4c View commit details
    Browse the repository at this point in the history

  17. Update the airl_sweep.yaml

    @ernestum
    ernestum committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    59c2b08 View commit details
    Browse the repository at this point in the history

  18. Update the airl_sweep.yaml

    @ernestum
    ernestum committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    244eed0 View commit details
    Browse the repository at this point in the history

  19. Add airl_optuna.yaml

    @ernestum
    ernestum committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    ff0028f View commit details
    Browse the repository at this point in the history

  20. Formatting, typing and documentation fixes. Also the implicit seed de… 

    …pendency was pulled out of the utils and made explicit in airl.py
    @ernestum
    ernestum committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    ca632a8 View commit details
    Browse the repository at this point in the history

  21. Swtich from Hydra call to hydra instantiate.

    @ernestum
    ernestum committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    1738822 View commit details
    Browse the repository at this point in the history

  22. Add type ignore reason.

    @ernestum
    ernestum committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    5638222 View commit details
    Browse the repository at this point in the history

  23. Dont' allow variable horizon for AIRL by default.

    @ernestum
    ernestum committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    efe3b90 View commit details
    Browse the repository at this point in the history

  24. Simplify the class configurations using enums.

    @ernestum
    ernestum committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    5915a80 View commit details
    Browse the repository at this point in the history

  25. Fix bug in type ignore reason.

    @ernestum
    ernestum committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    6760104 View commit details
    Browse the repository at this point in the history