{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":272375615,"defaultBranch":"master","name":"Actor-critic-with-stability-guarantee","ownerLogin":"rickstaa","currentUserCanPush":false,"isFork":true,"isEmpty":false,"createdAt":"2020-06-15T07:52:24.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/17570430?v=4","public":true,"private":false,"isOrgOwned":false},"refInfo":{"name":"","listCacheKey":"v0:1708007092.0","currentOid":""},"activityList":{"items":[{"before":"7505a83093b3c5baa3f96b827a066ac14616f47d","after":"de68c2c741cab42b54e92e766b8491092a2f2dc7","ref":"refs/heads/rstaa2024","pushedAt":"2024-03-06T14:48:17.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"rickstaa","name":"Rick Staa","path":"/rickstaa","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/17570430?s=80&v=4"},"commit":{"message":"fix(compOscillator): fix incorrect environment interactions","shortMessageHtmlLink":"fix(compOscillator): fix incorrect environment interactions"}},{"before":"073ab91e9c4cbff0478251862f60b1964a467b6a","after":null,"ref":"refs/heads/rstaa2024_test","pushedAt":"2024-02-15T14:24:52.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"rickstaa","name":"Rick Staa","path":"/rickstaa","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/17570430?s=80&v=4"}},{"before":"82d09b2fa03beb5f4483714033ec772e9c4cbee0","after":"7505a83093b3c5baa3f96b827a066ac14616f47d","ref":"refs/heads/rstaa2024","pushedAt":"2024-02-15T14:24:40.000Z","pushType":"push","commitsCount":7,"pusher":{"login":"rickstaa","name":"Rick Staa","path":"/rickstaa","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/17570430?s=80&v=4"},"commit":{"message":"Merge branch 'rstaa2024' of github.com:rickstaa/Actor-critic-with-stability-guarantee into rstaa2024","shortMessageHtmlLink":"Merge branch 'rstaa2024' of github.com:rickstaa/Actor-critic-with-sta…"}},{"before":null,"after":"073ab91e9c4cbff0478251862f60b1964a467b6a","ref":"refs/heads/rstaa2024_test","pushedAt":"2024-02-15T14:22:47.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"rickstaa","name":"Rick Staa","path":"/rickstaa","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/17570430?s=80&v=4"},"commit":{"message":"fix(fetchReach): resolve code inconsistencies in Han et al.'s\nimplementation\n\nThis commit addresses two critical issues discovered in the codebase for\nrunning the FetchReach environment as implemented by Han et al.:\n\n- Corrected reference to the info variable for checking episode\ncompletion status.\n- Ensured the absolute value of the fetch reward is taken to maintain\nLyapunov conditions.\n\nThese fixes enhance the reliability and stability of the FetchReach\nenvironment in the provided implementation.","shortMessageHtmlLink":"fix(fetchReach): resolve code inconsistencies in Han et al.'s"}},{"before":"c15967aa32f71abd99ea1fb0ce938cf384266dc7","after":"82d09b2fa03beb5f4483714033ec772e9c4cbee0","ref":"refs/heads/rstaa2024","pushedAt":"2024-02-15T14:15:36.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"rickstaa","name":"Rick Staa","path":"/rickstaa","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/17570430?s=80&v=4"},"commit":{"message":"fix(minitaur): align cost with Han et al. 2020\n\nThis commit ensures the cost function used in the Minitaur\nenvironment aligns with the one described in [Han et al.\n2020](https://arxiv.org/abs/2004.14288).","shortMessageHtmlLink":"fix(minitaur): align cost with Han et al. 2020"}},{"before":"02efa60196b55f26ce1b34700e13963408f8f7da","after":"2a73ee02872fb92a3ec5559c034c780e6854a2ba","ref":"refs/heads/fix_minitaur_cost","pushedAt":"2024-02-15T14:14:42.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"rickstaa","name":"Rick Staa","path":"/rickstaa","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/17570430?s=80&v=4"},"commit":{"message":"fix(minitaur): align cost with Han et al. 2020\n\nThis commit ensures the cost function used in the Minitaur\nenvironment aligns with the one described in [Han et al.\n2020](https://arxiv.org/abs/2004.14288).","shortMessageHtmlLink":"fix(minitaur): align cost with Han et al. 2020"}},{"before":null,"after":"02efa60196b55f26ce1b34700e13963408f8f7da","ref":"refs/heads/fix_minitaur_cost","pushedAt":"2024-02-15T14:14:09.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"rickstaa","name":"Rick Staa","path":"/rickstaa","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/17570430?s=80&v=4"},"commit":{"message":"fix(minitaur): align cost with Han et al. 2020\n\nThis commit ensures the cost function that is used in the Minitaur\nenvironment aligns with the one described in [Han et al.\n2020](https://arxiv.org/abs/2004.14288).","shortMessageHtmlLink":"fix(minitaur): align cost with Han et al. 2020"}},{"before":"3a6190fe79a0dc2d08ebc3c1a4a497e91b045ec6","after":"c15967aa32f71abd99ea1fb0ce938cf384266dc7","ref":"refs/heads/rstaa2024","pushedAt":"2024-02-15T13:23:45.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"rickstaa","name":"Rick Staa","path":"/rickstaa","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/17570430?s=80&v=4"},"commit":{"message":"fix(swimmer): align cost function with Han et al. 2020\n\nThis commit ensures the swimmer environment uses the same cost function\nas was decribed in [Han et al. 2020](https://arxiv.org/abs/2004.14288).","shortMessageHtmlLink":"fix(swimmer): align cost function with Han et al. 2020"}},{"before":"85ee4c3829ce092f063af095c298b2cf4db7ab53","after":"448165d737fed996f369591b320aae787f411427","ref":"refs/heads/fix_swimmer_cost","pushedAt":"2024-02-15T13:23:17.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"rickstaa","name":"Rick Staa","path":"/rickstaa","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/17570430?s=80&v=4"},"commit":{"message":"fix(swimmer): align cost function with Han et al. 2020\n\nThis commit ensures the swimmer environment uses the same cost\nfunction described in [Han et al. 2020](https://arxiv.org/abs/2004.14288).","shortMessageHtmlLink":"fix(swimmer): align cost function with Han et al. 2020"}},{"before":"f69537a02d3298c0994a5bc81ceb17c8ae5495c7","after":"85ee4c3829ce092f063af095c298b2cf4db7ab53","ref":"refs/heads/fix_swimmer_cost","pushedAt":"2024-02-15T13:22:09.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"rickstaa","name":"Rick Staa","path":"/rickstaa","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/17570430?s=80&v=4"},"commit":{"message":"fix(swimmer): align cost function with Han et al. 2020\n\nThis commit ensures the swimmer environment uses the same cost function\ndescribed in [Han et al. 2020](https://arxiv.org/abs/2004.14288).","shortMessageHtmlLink":"fix(swimmer): align cost function with Han et al. 2020"}},{"before":null,"after":"f69537a02d3298c0994a5bc81ceb17c8ae5495c7","ref":"refs/heads/fix_swimmer_cost","pushedAt":"2024-02-15T13:21:28.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"rickstaa","name":"Rick Staa","path":"/rickstaa","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/17570430?s=80&v=4"},"commit":{"message":"fix(swimmer): align cost function with Han et al. 2020\n\nThis commit ensures the swimmer environment uses the same cost function\nas was decribed in [Han et al. 2020](https://arxiv.org/abs/2004.14288).","shortMessageHtmlLink":"fix(swimmer): align cost function with Han et al. 2020"}},{"before":"0e7a9892ec4150f85add72f95bf2a0458d091bd9","after":"3a6190fe79a0dc2d08ebc3c1a4a497e91b045ec6","ref":"refs/heads/rstaa2024","pushedAt":"2024-02-15T11:43:08.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"rickstaa","name":"Rick Staa","path":"/rickstaa","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/17570430?s=80&v=4"},"commit":{"message":"test(fetchReach): include FetchReach validation scripts\n\nThis commit introduces FetchReach validation scripts, facilitating\ntesting of the FetchReachCost environment within the\n[stable-gym](https://github.com/rickstaa/stable-gym) package against the\nversion implemented in this repository. The precision level is set to 2\nsignificant digits to accommodate discrepancies resulting from changes\nin the underlying Mujoco simulator between the gym versions utilized by\nthe two packages.","shortMessageHtmlLink":"test(fetchReach): include FetchReach validation scripts"}},{"before":"57757113e529490e3411d60ca143bdaf51e29984","after":"3c97b630cc86c23ef493e19c3451ed9038e52933","ref":"refs/heads/fix_fetchreach","pushedAt":"2024-02-15T08:44:51.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"rickstaa","name":"Rick Staa","path":"/rickstaa","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/17570430?s=80&v=4"},"commit":{"message":"fix(fetchReach): resolve code inconsistencies in Han et al.'s\nimplementation\n\nThis commit addresses two critical issues discovered in the codebase for\nrunning the FetchReach environment as implemented by Han et al.:\n\n- Corrected reference to the info variable for checking episode\ncompletion status.\n- Ensured the absolute value of the fetch reward is taken to maintain\nLyapunov conditions.\n\nThese fixes enhance the reliability and stability of the FetchReach\nenvironment in the provided implementation.","shortMessageHtmlLink":"fix(fetchReach): resolve code inconsistencies in Han et al.'s"}},{"before":null,"after":"57757113e529490e3411d60ca143bdaf51e29984","ref":"refs/heads/fix_fetchreach","pushedAt":"2024-02-15T08:43:55.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"rickstaa","name":"Rick Staa","path":"/rickstaa","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/17570430?s=80&v=4"},"commit":{"message":"fix(fetchReach): resolve code inconsistencies in Han et al.'s\nimplementation\n\nThis commit addresses two critical issues discovered in the codebase for\nrunning the FetchReach environment as implemented by Han et al.:\n\n- Corrected reference to the info variable for checking episode\ncompletion status.\n- Ensured the absolute value of the fetch reward is taken to maintain\nLyapunov conditions.\n\nThese fixes enhance the reliability and stability of the FetchReach\nenvironment in the provided implementation.","shortMessageHtmlLink":"fix(fetchReach): resolve code inconsistencies in Han et al.'s"}},{"before":"2d47b85ebd7f7b76025332a158e7b1192878d1e9","after":"7a59f8fb9eacc53f7774d841f45a68e51223fcf5","ref":"refs/heads/add_docker","pushedAt":"2024-02-15T08:41:13.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"rickstaa","name":"Rick Staa","path":"/rickstaa","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/17570430?s=80&v=4"},"commit":{"message":"docs: remove fork admonition and add env section\n\nThis commit removed the fork admonition which is not needed on the\nupstream. It also adds a new section explaining which files correspond\nto the environments used in the paper.","shortMessageHtmlLink":"docs: remove fork admonition and add env section"}},{"before":"34b599575f6736df49797674b46b330758eda360","after":"2d47b85ebd7f7b76025332a158e7b1192878d1e9","ref":"refs/heads/add_docker","pushedAt":"2024-02-15T08:38:41.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"rickstaa","name":"Rick Staa","path":"/rickstaa","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/17570430?s=80&v=4"},"commit":{"message":"docs: add lyapunov candidate documentation\n\nThis commit adds a section that explains how to change the Lyapunov\ncandidate from a infinite horizon to the finite horizon (MPC-based) version.","shortMessageHtmlLink":"docs: add lyapunov candidate documentation"}},{"before":"817520946a49a8318f4be7562a895df3b081f3bc","after":"34b599575f6736df49797674b46b330758eda360","ref":"refs/heads/add_docker","pushedAt":"2024-02-15T08:34:54.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"rickstaa","name":"Rick Staa","path":"/rickstaa","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/17570430?s=80&v=4"},"commit":{"message":"docs: fix admonitions syntax","shortMessageHtmlLink":"docs: fix admonitions syntax"}},{"before":"79eaa03a929bdf0656d7a836fb3324f1fc734f4c","after":"817520946a49a8318f4be7562a895df3b081f3bc","ref":"refs/heads/add_docker","pushedAt":"2024-02-15T08:32:07.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"rickstaa","name":"Rick Staa","path":"/rickstaa","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/17570430?s=80&v=4"},"commit":{"message":"docs: simplify docker run command\n\nThis commit streamlines the Docker run command, eliminating the need for\ndirect interaction with the container.","shortMessageHtmlLink":"docs: simplify docker run command"}},{"before":"73c90008a8918e1156fb2629ed4b83ade522c81f","after":"79eaa03a929bdf0656d7a836fb3324f1fc734f4c","ref":"refs/heads/add_docker","pushedAt":"2024-02-15T08:28:33.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"rickstaa","name":"Rick Staa","path":"/rickstaa","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/17570430?s=80&v=4"},"commit":{"message":"docs: simplify docker run command\n\nThis commit streamlines the Docker run command, eliminating the need for\ndirect interaction with the container.","shortMessageHtmlLink":"docs: simplify docker run command"}},{"before":"0dd9a3054e5fad401e235cb6e62d33c2bb449a74","after":"73c90008a8918e1156fb2629ed4b83ade522c81f","ref":"refs/heads/add_docker","pushedAt":"2024-02-15T08:27:38.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"rickstaa","name":"Rick Staa","path":"/rickstaa","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/17570430?s=80&v=4"},"commit":{"message":"fix(cartpole): make cost function compatible with paper","shortMessageHtmlLink":"fix(cartpole): make cost function compatible with paper"}},{"before":"073ab91e9c4cbff0478251862f60b1964a467b6a","after":"0e7a9892ec4150f85add72f95bf2a0458d091bd9","ref":"refs/heads/rstaa2024","pushedAt":"2024-02-15T08:24:44.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"rickstaa","name":"Rick Staa","path":"/rickstaa","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/17570430?s=80&v=4"},"commit":{"message":"fix(fetchReach): resolve code inconsistencies in Han et al.'s\nimplementation\n\nThis commit addresses two critical issues discovered in the codebase for\nrunning the FetchReach environment as implemented by Han et al.:\n\n- Corrected reference to the info variable for checking episode\ncompletion status.\n- Ensured the absolute value of the fetch reward is taken to maintain\nLyapunov conditions.\n\nThese fixes enhance the reliability and stability of the FetchReach\nenvironment in the provided implementation.","shortMessageHtmlLink":"fix(fetchReach): resolve code inconsistencies in Han et al.'s"}},{"before":null,"after":"a9289fb6315ede28be4a685e7aa90623058fc6ae","ref":"refs/heads/fix_oscillator_action_space","pushedAt":"2024-02-15T08:19:42.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"rickstaa","name":"Rick Staa","path":"/rickstaa","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/17570430?s=80&v=4"},"commit":{"message":"fix(oscillator): fix oscillator observation space\n\nThis commit ensures the observation space is in line with the\nobservation space used in [Han et al.\n2020](https://arxiv.org/abs/2004.14288).","shortMessageHtmlLink":"fix(oscillator): fix oscillator observation space"}},{"before":"a26d1698d5b053b6f3e328242739e12e597aa22c","after":"073ab91e9c4cbff0478251862f60b1964a467b6a","ref":"refs/heads/rstaa2024","pushedAt":"2024-02-14T21:13:53.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"rickstaa","name":"Rick Staa","path":"/rickstaa","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/17570430?s=80&v=4"},"commit":{"message":"fix(fetchReach): resolve code inconsistencies in Han et al.'s\nimplementation\n\nThis commit addresses two critical issues discovered in the codebase for\nrunning the FetchReach environment as implemented by Han et al.:\n\n- Corrected reference to the info variable for checking episode\ncompletion status.\n- Ensured the absolute value of the fetch reward is taken to maintain\nLyapunov conditions.\n\nThese fixes enhance the reliability and stability of the FetchReach\nenvironment in the provided implementation.","shortMessageHtmlLink":"fix(fetchReach): resolve code inconsistencies in Han et al.'s"}},{"before":"4a2f08870154181ec67744a9d31d61388d6669e5","after":"a26d1698d5b053b6f3e328242739e12e597aa22c","ref":"refs/heads/rstaa2024","pushedAt":"2024-02-14T15:44:48.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"rickstaa","name":"Rick Staa","path":"/rickstaa","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/17570430?s=80&v=4"},"commit":{"message":"fix(fetchReach): resolve code inconsistencies in Han et al.'s\nimplementation\n\nThis commit addresses two critical issues discovered in the codebase for\nrunning the FetchReach environment as implemented by Han et al.:\n\n- Corrected reference to the info variable for checking episode\ncompletion status.\n- Ensured the absolute value of the fetch reward is taken to maintain\nLyapunov conditions.\n\nThese fixes enhance the reliability and stability of the FetchReach\nenvironment in the provided implementation.","shortMessageHtmlLink":"fix(fetchReach): resolve code inconsistencies in Han et al.'s"}},{"before":"80178dc7230e0432c8803dd7a0bd899430d7ef86","after":"4a2f08870154181ec67744a9d31d61388d6669e5","ref":"refs/heads/rstaa2024","pushedAt":"2024-02-14T08:36:33.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"rickstaa","name":"Rick Staa","path":"/rickstaa","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/17570430?s=80&v=4"},"commit":{"message":"refactor: align hyperparameters with Han et al. 2020\n\nThis commit ensures that the Oscillator and OscillatorComp\nhyperparameters align with the ones given in the paper of [Han et al.\n2020](https://arxiv.org/abs/2004.14288).","shortMessageHtmlLink":"refactor: align hyperparameters with Han et al. 2020"}},{"before":"69c08a86e23df0b59777f842f3e043e4207aa298","after":"80178dc7230e0432c8803dd7a0bd899430d7ef86","ref":"refs/heads/rstaa2024","pushedAt":"2024-02-08T16:07:03.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"rickstaa","name":"Rick Staa","path":"/rickstaa","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/17570430?s=80&v=4"},"commit":{"message":"docs: simplify docker run command\n\nThis commit streamlines the Docker run command, eliminating the need for\ndirect interaction with the container.","shortMessageHtmlLink":"docs: simplify docker run command"}},{"before":"e89814cb7ce7b7eda0a52531b0bba7a9b5a86cb3","after":"69c08a86e23df0b59777f842f3e043e4207aa298","ref":"refs/heads/rstaa2024","pushedAt":"2024-02-06T21:51:15.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"rickstaa","name":"Rick Staa","path":"/rickstaa","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/17570430?s=80&v=4"},"commit":{"message":"feat: Implementation of Han et al.'s 2020 Hyperparameters\n\nThis commit introduces changes to the codebase to incorporate the\nhyperparameters outlined in the Han et al. 2020 article. In particular,\nadjustments have been made in the `variant.py` file to ensure alignment\nwith the parameters discussed in the article. Furthermore, for the sake\nof numerical stability, the initial value of $\\lambda$ has been set to\n0.99.","shortMessageHtmlLink":"feat: Implementation of Han et al.'s 2020 Hyperparameters"}},{"before":"b567d2d5452e8525192028efaac331cd402cedf5","after":null,"ref":"refs/heads/add_oscillator_validation_scripts","pushedAt":"2024-02-01T13:03:59.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"rickstaa","name":"Rick Staa","path":"/rickstaa","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/17570430?s=80&v=4"}},{"before":"0e559765be8251eaa1547002aad293f99f561d8e","after":"e89814cb7ce7b7eda0a52531b0bba7a9b5a86cb3","ref":"refs/heads/rstaa2024","pushedAt":"2024-02-01T13:03:55.000Z","pushType":"pr_merge","commitsCount":2,"pusher":{"login":"rickstaa","name":"Rick Staa","path":"/rickstaa","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/17570430?s=80&v=4"},"commit":{"message":"Merge pull request #1 from rickstaa/add_oscillator_validation_scripts\n\nfeat: add oscillator validation scripts","shortMessageHtmlLink":"Merge pull request #1 from rickstaa/add_oscillator_validation_scripts"}},{"before":"dea5eb0cde46a9aff3e2b4546c26a78011b20ccc","after":"b567d2d5452e8525192028efaac331cd402cedf5","ref":"refs/heads/add_oscillator_validation_scripts","pushedAt":"2024-02-01T13:03:48.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"rickstaa","name":"Rick Staa","path":"/rickstaa","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/17570430?s=80&v=4"},"commit":{"message":"feat: add oscillator validation scripts\n\nThis commit adds the oscillator validation scripts and fixes the action\nspace in the oscillator environments.","shortMessageHtmlLink":"feat: add oscillator validation scripts"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAEDg2pHQA","startCursor":null,"endCursor":null}},"title":"Activity · rickstaa/Actor-critic-with-stability-guarantee"}