{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":159752575,"defaultBranch":"master","name":"cherry","ownerLogin":"learnables","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2018-11-30T01:46:38.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/54878124?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1687743885.0","currentOid":""},"activityList":{"items":[{"before":"5c3962deccfb8024f2e22cbe2f4e552821fe48ae","after":"9610c0d364c57f930298e88089c757587bcb68da","ref":"refs/heads/gh-pages","pushedAt":"2023-06-26T01:43:21.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"seba-1511","name":"Séb Arnold","path":"/seba-1511","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/626253?s=80&v=4"},"commit":{"message":"Deployed f4164a5 with MkDocs version: 1.2.4","shortMessageHtmlLink":"Deployed f4164a5 with MkDocs version: 1.2.4"}},{"before":"5f9675455f02933518d16d2533312464d494e148","after":"5c3962deccfb8024f2e22cbe2f4e552821fe48ae","ref":"refs/heads/gh-pages","pushedAt":"2023-06-26T01:35:30.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"seba-1511","name":"Séb Arnold","path":"/seba-1511","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/626253?s=80&v=4"},"commit":{"message":"Deployed 18a1269 with MkDocs version: 1.2.4","shortMessageHtmlLink":"Deployed 18a1269 with MkDocs version: 1.2.4"}},{"before":"18a12695f00635c423039d9647a4afc7cf2e3715","after":"f4164a53dcc762ac5ce53a761fb54f3f69847f90","ref":"refs/heads/master","pushedAt":"2023-06-26T01:34:55.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"seba-1511","name":"Séb Arnold","path":"/seba-1511","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/626253?s=80&v=4"},"commit":{"message":"v0.2.0: Policy, Value Functions, and more Algorithms (#39)\n\n* Improve support for vectorized environments.\r\n\r\n* Remove some hacks.\r\n\r\n* Add vectorized experience replay, many small improvements.\r\n\r\n* Fix lint.\r\n\r\n* Fix runner tests and Makefile.\r\n\r\n* Bring Fixes from Jumping (#40)\r\n\r\n* Update parameters for NatureFeatures.\r\n\r\n* Update TRPO for non-contiguous tensors.\r\n\r\n* More fixes.\r\n\r\n* Clean fix for change of memory layout in PT 1.6.0\r\n\r\n* Add mean and mode to TanhNormal distribution.\r\n\r\n* Add device and device_env to Torch wrapper.\r\n\r\n* Fix device when flattening a replay.\r\n\r\n* Remove pdb from logger.\r\n\r\n* ExpReplay: implement getstate and setstate\r\n\r\n* Add test for replay.flatten(), faster implementation.\r\n\r\n* Fix replay test.\r\n\r\n* Update reward normalizer.\r\n\r\n* More fixes for RewardNormalizer.\r\n\r\n* Reward normalizer handles vectorized envs.\r\n\r\n* Accelerate creation of Transitions.\r\n\r\n* Cosmetics\r\n\r\n* Add wandb to pybullet.\r\n\r\n* Add nsteps samplgin to experience replay + tests.\r\n\r\n* Add nn.Policy (needs docs) and Normal, Categorical distributions (need docs).\r\n\r\n* Add line_search to trpo.\r\n\r\n* Add algorithm arguments, update LinearValue lstsq.\r\n\r\n* Add device to Transition fields.\r\n\r\n* Do not assume default device in Torch wrapper.\r\n\r\n* Add cherry.nn.MLP\r\n\r\n* Remove gym.wrappers.Monitor.\r\n\r\n* Add Closer, make compatible with gym 0.23.0\r\n\r\n* Add DrQ and SAC updates.\r\n\r\n* Fix unit tests.\r\n\r\n* Fix Transition.device for vectorized envs.\r\n\r\n* Update algorithms.\r\n\r\n* tests: Fix MemorizeDigits registration.\r\n\r\n* tests: Fix actor-critic integration indentation.\r\n\r\n* Add DrQv2.\r\n\r\n* Add initial ActionValue API.\r\n\r\n* Fix robotics init, Twin action value.\r\n\r\n* Add nn.Lambda.\r\n\r\n* Remove std reduction in DrQv2.\r\n\r\n* Update docs to MkDocs Material.\r\n\r\n* docs: Add cherry.models.md\r\n\r\n* Add cherry.nn.md\r\n\r\n* Add some docs.\r\n\r\n* Finish converting to new docs.\r\n\r\n* Add docs for nn.init.\r\n\r\n* Bump version to 0.2.0\r\n\r\n* Monkey-patch old wrappers.\r\n\r\n* Update logo link.\r\n\r\n* Update logo path.\r\n\r\n* Fix linting.\r\n\r\n* Slightly update README.md, and add StateValue abstract class.\r\n\r\n* Add td3 example on mujoco.\r\n\r\n* Update offpolicy mujoco example.\r\n\r\n* Update action-value API.\r\n\r\n* Add PPO update.\r\n\r\n* Update Mujoco offpolicy training.\r\n\r\n* Update algorithms docs.\r\n\r\n* Algorithm arguments are mappings too.\r\n\r\n* Reformat.\r\n\r\n* Add initial DMC example.\r\n\r\n* Minor clean up.\r\n\r\n* DrQ on DMC now running.\r\n\r\n* Add DMC sweeps.\r\n\r\n* Remove TODO.\r\n\r\n* Fix wrong error raised in Policy forward.\r\n\r\n* Clean Makefile, add gym requirements for dev.\r\n\r\n* Clean up DMC example.\r\n\r\n* Use log_alpha provided to SAC.\r\n\r\n* Update a2c, ppo, trpo docs.\r\n\r\n* Docs for DDPG.\r\n\r\n* Write TD3 docs.\r\n\r\n* Update docs for DrQ, SAC, TRPO, DDPG, and A2C.\r\n\r\n* Write DrQv2 and PPO docs.\r\n\r\n* Remove RandomShiftsAug from algorithms docs.\r\n\r\n* Fix non-learnable log_alpha in DrQ.\r\n\r\n* Detach log_alpha when non-learnable in DrQ.\r\n\r\n* Update changeleog\r\n\r\n* Fix linting.\r\n\r\n* Fix CI.\r\n\r\n* Change ci95 factor to 1.96 instead of 2.0.\r\n\r\n* Add DMC sweep results.\r\n\r\n* Update DMC plots.\r\n\r\n* Update dmc examples README.md with results.\r\n\r\n* Remove individual DMC figures.\r\n\r\n* Update README.md\r\n\r\nInitial changes to the examples in README.\r\n\r\n* Update README.md\r\n\r\n* Update first part of README.md\r\n\r\n* Add experience replay example.\r\n\r\n* Update README.md\r\n\r\n* Write final algorithm example.\r\n\r\n* Edit algorithm readme example.\r\n\r\n* Edit readme.\r\n\r\n* Fix CI.\r\n\r\n* Fix gym version in CI.\r\n\r\n* Fix gym version in CI.\r\n\r\n* Update readme and CI.\r\n\r\n* CI: update setuptools version\r\n\r\n* CI: change gym install command.\r\n\r\n* CI: try another gym version.\r\n\r\n* Update python_unittest.yaml\r\n\r\n* Fix more tests.\r\n\r\n* Fix more tests.\r\n\r\n* Fixes encoding in setup.py (#42)\r\n\r\n* Fix wrong linear scaling in ActionSpaceScaler (#46)\r\n\r\n* Add DrQ and SAC updates.\r\n\r\n---------\r\n\r\nCo-authored-by: 3DAlgoLab <83936830+3DAlgoLab@users.noreply.github.com>\r\nCo-authored-by: gwwo <108167525+gwwo@users.noreply.github.com>","shortMessageHtmlLink":"v0.2.0: Policy, Value Functions, and more Algorithms (#39)"}},{"before":"4efc895f9ffb4003b26011e9ec41ec0c2ca2272d","after":"4e5f23dd0a7db660c7f79c7b92a88d7275368b2b","ref":"refs/heads/dev","pushedAt":"2023-06-26T01:34:41.000Z","pushType":"push","commitsCount":4,"pusher":{"login":"seba-1511","name":"Séb Arnold","path":"/seba-1511","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/626253?s=80&v=4"},"commit":{"message":"Merge branch 'master' into dev","shortMessageHtmlLink":"Merge branch 'master' into dev"}},{"before":"83ba51944669923b2636729abd4ae30a8fd56fbf","after":"4efc895f9ffb4003b26011e9ec41ec0c2ca2272d","ref":"refs/heads/dev","pushedAt":"2023-06-26T01:16:29.000Z","pushType":"push","commitsCount":3,"pusher":{"login":"seba-1511","name":"Séb Arnold","path":"/seba-1511","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/626253?s=80&v=4"},"commit":{"message":"Add DrQ and SAC updates.","shortMessageHtmlLink":"Add DrQ and SAC updates."}},{"before":"cd915567897e09d7abbe62e14d0a47442e55fae8","after":"83ba51944669923b2636729abd4ae30a8fd56fbf","ref":"refs/heads/dev","pushedAt":"2023-06-26T00:09:52.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"seba-1511","name":"Séb Arnold","path":"/seba-1511","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/626253?s=80&v=4"},"commit":{"message":"Fix more tests.","shortMessageHtmlLink":"Fix more tests."}},{"before":"d3dd8ee61929aac4a405d04660e2ef6c49d8dd69","after":"cd915567897e09d7abbe62e14d0a47442e55fae8","ref":"refs/heads/dev","pushedAt":"2023-06-25T23:37:09.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"seba-1511","name":"Séb Arnold","path":"/seba-1511","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/626253?s=80&v=4"},"commit":{"message":"Fix more tests.","shortMessageHtmlLink":"Fix more tests."}},{"before":"c9c260bacc4e641b86bb29f5b6b9664ba4d299cf","after":"d3dd8ee61929aac4a405d04660e2ef6c49d8dd69","ref":"refs/heads/dev","pushedAt":"2023-06-25T17:16:36.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"seba-1511","name":"Séb Arnold","path":"/seba-1511","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/626253?s=80&v=4"},"commit":{"message":"Update python_unittest.yaml","shortMessageHtmlLink":"Update python_unittest.yaml"}},{"before":"ebba65ee60740d0fc5293b948d92a8432ba5a64e","after":"c9c260bacc4e641b86bb29f5b6b9664ba4d299cf","ref":"refs/heads/dev","pushedAt":"2023-06-25T09:38:44.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"seba-1511","name":"Séb Arnold","path":"/seba-1511","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/626253?s=80&v=4"},"commit":{"message":"CI: try another gym version.","shortMessageHtmlLink":"CI: try another gym version."}},{"before":"b8e90163866349ecd1bbbf4601b3d40751b3dc59","after":"ebba65ee60740d0fc5293b948d92a8432ba5a64e","ref":"refs/heads/dev","pushedAt":"2023-06-25T09:36:37.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"seba-1511","name":"Séb Arnold","path":"/seba-1511","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/626253?s=80&v=4"},"commit":{"message":"CI: change gym install command.","shortMessageHtmlLink":"CI: change gym install command."}},{"before":"d7a15c124f9d69a41467b8763774752683907be8","after":"b8e90163866349ecd1bbbf4601b3d40751b3dc59","ref":"refs/heads/dev","pushedAt":"2023-06-25T09:26:09.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"seba-1511","name":"Séb Arnold","path":"/seba-1511","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/626253?s=80&v=4"},"commit":{"message":"CI: update setuptools version","shortMessageHtmlLink":"CI: update setuptools version"}},{"before":"e087ef6946bc1a552d814f7acfc76e8da607576a","after":"5f9675455f02933518d16d2533312464d494e148","ref":"refs/heads/gh-pages","pushedAt":"2023-06-25T09:24:20.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"seba-1511","name":"Séb Arnold","path":"/seba-1511","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/626253?s=80&v=4"},"commit":{"message":"Deployed d7a15c1 with MkDocs version: 1.2.4","shortMessageHtmlLink":"Deployed d7a15c1 with MkDocs version: 1.2.4"}},{"before":"003850f2618c32bd3b68eeb27c12ac9b3fa73bd3","after":"d7a15c124f9d69a41467b8763774752683907be8","ref":"refs/heads/dev","pushedAt":"2023-06-25T09:22:33.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"seba-1511","name":"Séb Arnold","path":"/seba-1511","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/626253?s=80&v=4"},"commit":{"message":"Update readme and CI.","shortMessageHtmlLink":"Update readme and CI."}},{"before":"b1dcd2ec5366e0d8519ba73e75fcfc8d3ab2c226","after":"003850f2618c32bd3b68eeb27c12ac9b3fa73bd3","ref":"refs/heads/dev","pushedAt":"2023-06-25T09:18:24.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"seba-1511","name":"Séb Arnold","path":"/seba-1511","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/626253?s=80&v=4"},"commit":{"message":"Fix gym version in CI.","shortMessageHtmlLink":"Fix gym version in CI."}},{"before":"c96c08e68f4ae1e2a0a22f3f976062a89fbacd01","after":"e087ef6946bc1a552d814f7acfc76e8da607576a","ref":"refs/heads/gh-pages","pushedAt":"2023-06-25T09:14:12.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"seba-1511","name":"Séb Arnold","path":"/seba-1511","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/626253?s=80&v=4"},"commit":{"message":"Deployed b1dcd2e with MkDocs version: 1.2.4","shortMessageHtmlLink":"Deployed b1dcd2e with MkDocs version: 1.2.4"}},{"before":"7874e7d596bf5c3004e069666a12b24ae03f5a27","after":"b1dcd2ec5366e0d8519ba73e75fcfc8d3ab2c226","ref":"refs/heads/dev","pushedAt":"2023-06-25T09:13:36.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"seba-1511","name":"Séb Arnold","path":"/seba-1511","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/626253?s=80&v=4"},"commit":{"message":"Fix gym version in CI.","shortMessageHtmlLink":"Fix gym version in CI."}},{"before":"8a7913dbf788ac7bce546519a988daa1c1cc997f","after":"7874e7d596bf5c3004e069666a12b24ae03f5a27","ref":"refs/heads/dev","pushedAt":"2023-06-25T09:08:56.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"seba-1511","name":"Séb Arnold","path":"/seba-1511","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/626253?s=80&v=4"},"commit":{"message":"Fix CI.","shortMessageHtmlLink":"Fix CI."}},{"before":"36399ba0328c3fb0837813fc50c3af534cab5a2d","after":"8a7913dbf788ac7bce546519a988daa1c1cc997f","ref":"refs/heads/dev","pushedAt":"2023-06-25T08:59:50.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"seba-1511","name":"Séb Arnold","path":"/seba-1511","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/626253?s=80&v=4"},"commit":{"message":"Edit algorithm readme example.","shortMessageHtmlLink":"Edit algorithm readme example."}},{"before":"1afcb7ec2a1ceed87fec4911c5912ba6e2fbb11d","after":"36399ba0328c3fb0837813fc50c3af534cab5a2d","ref":"refs/heads/dev","pushedAt":"2023-06-25T08:49:21.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"seba-1511","name":"Séb Arnold","path":"/seba-1511","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/626253?s=80&v=4"},"commit":{"message":"Write final algorithm example.","shortMessageHtmlLink":"Write final algorithm example."}},{"before":"3676dcf0e8221f90f4074c69a5e0c9bf8515dad0","after":"1afcb7ec2a1ceed87fec4911c5912ba6e2fbb11d","ref":"refs/heads/dev","pushedAt":"2023-06-25T08:08:17.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"seba-1511","name":"Séb Arnold","path":"/seba-1511","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/626253?s=80&v=4"},"commit":{"message":"Update README.md","shortMessageHtmlLink":"Update README.md"}},{"before":"5189d3ff36879e0e50657e6d8e6302d537741084","after":"3676dcf0e8221f90f4074c69a5e0c9bf8515dad0","ref":"refs/heads/dev","pushedAt":"2023-06-25T06:57:32.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"seba-1511","name":"Séb Arnold","path":"/seba-1511","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/626253?s=80&v=4"},"commit":{"message":"Add experience replay example.","shortMessageHtmlLink":"Add experience replay example."}},{"before":"47257982fda6a867ae198240b837b21eda50c38e","after":"5189d3ff36879e0e50657e6d8e6302d537741084","ref":"refs/heads/dev","pushedAt":"2023-06-25T06:18:17.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"seba-1511","name":"Séb Arnold","path":"/seba-1511","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/626253?s=80&v=4"},"commit":{"message":"Update first part of README.md","shortMessageHtmlLink":"Update first part of README.md"}},{"before":"50debd567ef39aa019645e01f05fbc58dee9c39f","after":"47257982fda6a867ae198240b837b21eda50c38e","ref":"refs/heads/dev","pushedAt":"2023-06-25T00:24:05.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"seba-1511","name":"Séb Arnold","path":"/seba-1511","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/626253?s=80&v=4"},"commit":{"message":"Update README.md","shortMessageHtmlLink":"Update README.md"}},{"before":"a483aec6e26491db4d20c7d264bdf8aa83f47362","after":"50debd567ef39aa019645e01f05fbc58dee9c39f","ref":"refs/heads/dev","pushedAt":"2023-06-25T00:21:42.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"seba-1511","name":"Séb Arnold","path":"/seba-1511","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/626253?s=80&v=4"},"commit":{"message":"Update README.md\n\nInitial changes to the examples in README.","shortMessageHtmlLink":"Update README.md"}},{"before":"5751c6b8852eeba23b4c39af08a0e4e07fa27b1d","after":"a483aec6e26491db4d20c7d264bdf8aa83f47362","ref":"refs/heads/dev","pushedAt":"2023-06-24T23:57:15.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"seba-1511","name":"Séb Arnold","path":"/seba-1511","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/626253?s=80&v=4"},"commit":{"message":"Remove individual DMC figures.","shortMessageHtmlLink":"Remove individual DMC figures."}},{"before":"891b836e55a024eaced29ea655817ccc6931cb84","after":"5751c6b8852eeba23b4c39af08a0e4e07fa27b1d","ref":"refs/heads/dev","pushedAt":"2023-06-24T23:49:18.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"seba-1511","name":"Séb Arnold","path":"/seba-1511","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/626253?s=80&v=4"},"commit":{"message":"Update dmc examples README.md with results.","shortMessageHtmlLink":"Update dmc examples README.md with results."}},{"before":"2ea812fdc6a608ca88c819110fcd274378e30080","after":"891b836e55a024eaced29ea655817ccc6931cb84","ref":"refs/heads/dev","pushedAt":"2023-06-24T23:41:49.000Z","pushType":"push","commitsCount":3,"pusher":{"login":"seba-1511","name":"Séb Arnold","path":"/seba-1511","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/626253?s=80&v=4"},"commit":{"message":"Update DMC plots.","shortMessageHtmlLink":"Update DMC plots."}},{"before":"5c71f686b10c47aab7ffb75ce8720c3f81dfff47","after":"2ea812fdc6a608ca88c819110fcd274378e30080","ref":"refs/heads/dev","pushedAt":"2023-06-19T20:05:14.679Z","pushType":"push","commitsCount":1,"pusher":{"login":"seba-1511","name":"Séb Arnold","path":"/seba-1511","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/626253?s=80&v=4"},"commit":{"message":"Fix CI.","shortMessageHtmlLink":"Fix CI."}},{"before":"4fd4e94ec640b9f58b829206be61329055f6fc92","after":"c96c08e68f4ae1e2a0a22f3f976062a89fbacd01","ref":"refs/heads/gh-pages","pushedAt":"2023-06-19T07:56:17.335Z","pushType":"push","commitsCount":1,"pusher":{"login":"seba-1511","name":"Séb Arnold","path":"/seba-1511","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/626253?s=80&v=4"},"commit":{"message":"Deployed 5c71f68 with MkDocs version: 1.2.4","shortMessageHtmlLink":"Deployed 5c71f68 with MkDocs version: 1.2.4"}},{"before":"84c6398dfe3461e71cb3705824c1e0690bbac49b","after":"5c71f686b10c47aab7ffb75ce8720c3f81dfff47","ref":"refs/heads/dev","pushedAt":"2023-06-19T07:55:26.486Z","pushType":"push","commitsCount":2,"pusher":{"login":"seba-1511","name":"Séb Arnold","path":"/seba-1511","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/626253?s=80&v=4"},"commit":{"message":"Fix linting.","shortMessageHtmlLink":"Fix linting."}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"Y3Vyc29yOnYyOpK7MjAyMy0wNi0yNlQwMTo0MzoyMS4wMDAwMDBazwAAAANIs7oW","startCursor":"Y3Vyc29yOnYyOpK7MjAyMy0wNi0yNlQwMTo0MzoyMS4wMDAwMDBazwAAAANIs7oW","endCursor":"Y3Vyc29yOnYyOpK7MjAyMy0wNi0xOVQwNzo1NToyNi40ODYxMzlazwAAAANENM_P"}},"title":"Activity · learnables/cherry"}