{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":528972838,"defaultBranch":"main","name":"oslo","ownerLogin":"EleutherAI","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2022-08-25T18:28:51.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/68924597?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1691322021.0","currentOid":""},"activityList":{"items":[{"before":"21ef4a1ab6e2ee5bc256b1d24feab0dec2bf4a00","after":"d7c4e32e766a99cc9d56533bc090570360dc8b2a","ref":"refs/heads/main","pushedAt":"2023-09-09T08:06:57.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"yhna940","name":"YH","path":"/yhna940","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/100389977?s=80&v=4"},"commit":{"message":"[Fix] Refactor ZeRO Directory Structure (#211)\n\n## Title\r\n\r\n- [Fix] Refactor ZeRO Directory Structure\r\n\r\n## Description\r\n\r\n- This PR restructures the zero directory under\r\n`oslo/torch/nn/parallel/data_parallel/zero` to enhance code organization\r\nand readability. The changes align the implementation with the\r\narchitecture of our project, providing a more logical separation between\r\ndifferent components and functionalities.\r\n\r\n- Organized heterogeneous components (Inspired by PatrickStar) into the\r\n`hetero` subdirectory, centralizing related code and improving\r\nmaintainability.\r\n\r\n- Update to Zero Optimizer Wrapper Interface:\r\n\r\n> In the existing Zero optimizer, we were not sharding the optimizer\r\nstate, so the wrapper interface has been updated accordingly. My sincere\r\napologies for any confusion or inconvenience this change may cause, and\r\nI urge reviewers to assess this modification to ensure alignment with\r\nour project's requirements.\r\n\r\n- Renaming FULL_SHARD to PatrickStar Algorithm:\r\n\r\n> Please note that the previously termed FULL_SHARD strategy was, in\r\nfact, implementing the PatrickStar algorithm. PatrickStar is a novel\r\napproach to parallel training of pre-trained models via chunk-based\r\nmemory management, leveraging CPU-GPU heterogeneous memory space. It has\r\ndemonstrated significant advantages in model scaling and execution\r\nspeed.\r\n> \r\n> However, I felt that the name \"PatrickStar\" did not adequately convey\r\nthe specific characteristics of this approach. Therefore, I have taken\r\nthe liberty to rename it as \"hetero,\" reflecting the heterogeneous\r\nmemory utilization. I genuinely value the reviewers' opinions on this\r\nnaming choice and kindly ask for your feedback. If a more suitable name\r\ncan be agreed upon, I will happily update it accordingly.\r\n\r\n## Linked Issues\r\n\r\n- N/A","shortMessageHtmlLink":"[Fix] Refactor ZeRO Directory Structure (#211)"}},{"before":"4cb1ae0410dd9b6ffa08543768de1c43ff6dd95f","after":"21ef4a1ab6e2ee5bc256b1d24feab0dec2bf4a00","ref":"refs/heads/main","pushedAt":"2023-08-14T06:51:21.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"hyunwoongko","name":"Kevin Ko","path":"/hyunwoongko","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/38183241?s=80&v=4"},"commit":{"message":"Feature/auto model test (#213)\n\n## Title\r\n\r\n- Add auto model test code about model training, inference, merge\r\n\r\n## Description\r\n\r\n- Auto encoder model, Auto regressive model, Seq2seq model test \r\n- Only test command sh \"script.sh\" and you can see that\r\n\"./tests/test_script/run_{train|inference|merg}.sh\" file\r\n- if use model traning, you would install wnadb library and login, take\r\nsecret key\r\n\r\n## Linked Issues\r\n\r\n- resolved #00\r\n\r\n---------\r\n\r\nCo-authored-by: hyungrak.kim ","shortMessageHtmlLink":"Feature/auto model test (#213)"}},{"before":"6f7093ccca12781ec060f1d9a309001a8bfc7935","after":"6b9643b4e698d3b8407f12a383dd8c803cc4d5a4","ref":"refs/heads/feature/auto_model_test","pushedAt":"2023-08-06T11:46:48.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"koliaok","name":"hyungrak kim","path":"/koliaok","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/13493100?s=80&v=4"},"commit":{"message":"rm dataset download","shortMessageHtmlLink":"rm dataset download"}},{"before":null,"after":"6f7093ccca12781ec060f1d9a309001a8bfc7935","ref":"refs/heads/feature/auto_model_test","pushedAt":"2023-08-06T11:40:21.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"koliaok","name":"hyungrak kim","path":"/koliaok","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/13493100?s=80&v=4"},"commit":{"message":"Add auto model test","shortMessageHtmlLink":"Add auto model test"}},{"before":"00e3be56446df37a0372a93a094863ffc89a2f8b","after":"4cb1ae0410dd9b6ffa08543768de1c43ff6dd95f","ref":"refs/heads/main","pushedAt":"2023-08-05T18:24:30.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"hyunwoongko","name":"Kevin Ko","path":"/hyunwoongko","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/38183241?s=80&v=4"},"commit":{"message":" Give num_concurrent as argument (#212)\n\n## Title\r\n\r\nGive num_concurrent as argument\r\n\r\n## Description\r\n\r\n- Simple change in pipeline parallel. Give num_concurrent as argument.","shortMessageHtmlLink":" Give num_concurrent as argument (#212)"}},{"before":null,"after":"3eee345292e5ae2effecfc13f33bf7625963054a","ref":"refs/heads/feature/pp-num_concurrent-as-argument","pushedAt":"2023-08-03T12:14:39.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"jinwonkim93","name":"김진원","path":"/jinwonkim93","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/26476095?s=80&v=4"},"commit":{"message":"num_concurrent as argument","shortMessageHtmlLink":"num_concurrent as argument"}},{"before":"adbee704f9313eedc371ee28c3bc5a46360e4eda","after":"f36e9d7eb9067b657e9b09edfb62c8798a81cc9b","ref":"refs/heads/auto_model_test","pushedAt":"2023-08-01T17:44:38.000Z","pushType":"push","commitsCount":7,"pusher":{"login":"koliaok","name":"hyungrak kim","path":"/koliaok","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/13493100?s=80&v=4"},"commit":{"message":"merge origin main","shortMessageHtmlLink":"merge origin main"}},{"before":"633d7b7cc70dfd11487cf6464533b9f4049baca5","after":"adbee704f9313eedc371ee28c3bc5a46360e4eda","ref":"refs/heads/auto_model_test","pushedAt":"2023-08-01T17:34:36.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"koliaok","name":"hyungrak kim","path":"/koliaok","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/13493100?s=80&v=4"},"commit":{"message":"gpt2, gpt-neo-1.3B","shortMessageHtmlLink":"gpt2, gpt-neo-1.3B"}},{"before":"516582d1d23a1bfae63294973947f420d11b31f7","after":"633d7b7cc70dfd11487cf6464533b9f4049baca5","ref":"refs/heads/auto_model_test","pushedAt":"2023-08-01T16:52:00.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"koliaok","name":"hyungrak kim","path":"/koliaok","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/13493100?s=80&v=4"},"commit":{"message":"Remove tests_deprecated directory","shortMessageHtmlLink":"Remove tests_deprecated directory"}},{"before":"effe425da077531168691366d90cceba538b0c9d","after":"f81b236c8293c2a610e3cfdae0ad8d5f0c9203f8","ref":"refs/heads/ohwi/pp4-test","pushedAt":"2023-07-28T06:28:37.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"ohwi","name":null,"path":"/ohwi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22569365?s=80&v=4"},"commit":{"message":"temp checkpoint","shortMessageHtmlLink":"temp checkpoint"}},{"before":null,"after":"effe425da077531168691366d90cceba538b0c9d","ref":"refs/heads/ohwi/pp4-test","pushedAt":"2023-07-28T06:27:47.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"ohwi","name":null,"path":"/ohwi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22569365?s=80&v=4"},"commit":{"message":"Merge branch 'main' into ohwi/pp-use-message-queue","shortMessageHtmlLink":"Merge branch 'main' into ohwi/pp-use-message-queue"}},{"before":"f16c73bc5893cd6cefe65e70acf6d88428a324e1","after":"00e3be56446df37a0372a93a094863ffc89a2f8b","ref":"refs/heads/main","pushedAt":"2023-07-24T02:25:07.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"hyunwoongko","name":"Kevin Ko","path":"/hyunwoongko","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/38183241?s=80&v=4"},"commit":{"message":"[Fix] rpc not working on aws (#209)\n\n## Title\r\n\r\nFix rpc bug on AWS\r\n\r\n\r\n## Description\r\n\r\n- rpc.TensorPipeRpcBackendOptions returns an error when run on AWS.\r\n\r\n\r\n\r\n\r\nrelated issues\r\n- https://github.com/pytorch/pytorch/issues/65022\r\n- https://github.com/pytorch/tensorpipe/issues/413\r\n- https://github.com/pytorch/pytorch/issues/65093\r\n- https://github.com/pytorch/pytorch/issues/65022\r\n\r\n## Linked Issues\r\n\r\n- resolved #00","shortMessageHtmlLink":"[Fix] rpc not working on aws (#209)"}},{"before":null,"after":"4ef1e406e152358e34c304441b5877d6cf57a88a","ref":"refs/heads/bugfix_rpc_aws","pushedAt":"2023-07-19T11:20:34.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"jinwonkim93","name":"김진원","path":"/jinwonkim93","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/26476095?s=80&v=4"},"commit":{"message":"[Fix] rpc not working on aws","shortMessageHtmlLink":"[Fix] rpc not working on aws"}},{"before":null,"after":"c26b68741a1eed5d8ce207fc59bd3a2138953e62","ref":"refs/heads/203-flashattn","pushedAt":"2023-07-13T14:31:44.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"dyanos","name":null,"path":"/dyanos","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2949252?s=80&v=4"},"commit":{"message":"applied flash attention","shortMessageHtmlLink":"applied flash attention"}},{"before":"5e14dd6ac03a3fb96bd1ae6e8dae08a0cfd431f4","after":"f16c73bc5893cd6cefe65e70acf6d88428a324e1","ref":"refs/heads/main","pushedAt":"2023-07-12T17:06:53.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"hyunwoongko","name":"Kevin Ko","path":"/hyunwoongko","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/38183241?s=80&v=4"},"commit":{"message":"[Feature] Enhance Distributed Data Parallel wrapper with ZeRO (#207)\n\n## Title\r\n\r\n- [Feature] Enhance Distributed Data Parallel wrapper with ZeRO\r\n\r\n## Description\r\n\r\nThis PR introduces a significant enhancement to the Distributed Data\r\nParallel (DDP) wrapper in the OSLO library. It adds the capability to\r\nutilize different sharding strategies during distributed training,\r\nallowing better control over memory footprint across multiple GPUs or\r\nmachines.\r\n\r\nHere are the key changes:\r\n\r\n1. **Sharding Strategy Enum**: A new enum `ShardingStrategy` is\r\nintroduced, which includes `SHARD_OP`, `SHARD_GRAD_OP`, and `FULL_SHARD`\r\noptions. These determine how model parameters and optimizer states are\r\npartitioned across GPUs.\r\n\r\n2. **DistributedDataParallel Changes**: The signature of the\r\n`DistributedDataParallel` function is updated to incorporate these new\r\nsharding strategies, along with additional configuration parameters for\r\nthe model and optimizer wrappers. This function now returns a tuple of\r\nthe wrapped module and optimizer (if applicable).\r\n\r\nThese changes will enable users to utilize various sharding strategies\r\nduring their distributed training tasks, providing better control and\r\noptimization of memory usage across GPUs.\r\n\r\n**Note**: For `SHARD_OP`, `SHARD_GRAD_OP`, and `FULL_SHARD` strategies,\r\nit is mandatory to provide an optimizer.\r\n\r\n## Linked Issues\r\n\r\n- N/A","shortMessageHtmlLink":"[Feature] Enhance Distributed Data Parallel wrapper with ZeRO (#207)"}},{"before":"062f7e69e94cab09d5af23b5f4fe570d79dea813","after":"5e14dd6ac03a3fb96bd1ae6e8dae08a0cfd431f4","ref":"refs/heads/main","pushedAt":"2023-07-12T17:05:22.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"hyunwoongko","name":"Kevin Ko","path":"/hyunwoongko","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/38183241?s=80&v=4"},"commit":{"message":"[Add] copyright for ZeRO3 (#208)\n\n## Title\r\n\r\n- [Add] copyright for ZeRO3\r\n\r\n## Description\r\n\r\n- N/A\r\n\r\n## Linked Issues\r\n\r\n- N/A","shortMessageHtmlLink":"[Add] copyright for ZeRO3 (#208)"}},{"before":"5a10b5d1e1485f035d0f509934bb255e088d8fbf","after":"062f7e69e94cab09d5af23b5f4fe570d79dea813","ref":"refs/heads/main","pushedAt":"2023-07-12T06:11:23.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"hyunwoongko","name":"Kevin Ko","path":"/hyunwoongko","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/38183241?s=80&v=4"},"commit":{"message":"[Fix] Change the logger of ZeRO3 (#206)\n\n## Title\r\n\r\n- [Fix] Change the logger of ZeRO3\r\n\r\n## Description\r\n\r\n- Change the logger of FSDP to consider distributed state\r\n\r\n## Linked Issues\r\n\r\n- N/A","shortMessageHtmlLink":"[Fix] Change the logger of ZeRO3 (#206)"}},{"before":"1eb0d6c777e8d26d2dbcbd4ee3325002eabc17fc","after":"5a10b5d1e1485f035d0f509934bb255e088d8fbf","ref":"refs/heads/main","pushedAt":"2023-07-12T06:11:14.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"hyunwoongko","name":"Kevin Ko","path":"/hyunwoongko","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/38183241?s=80&v=4"},"commit":{"message":"[Add] ZeRO3 unit test (#205)\n\n## Title\r\n\r\n- [Add] ZeRO3 unit test\r\n\r\n## Description\r\n\r\n- A simple test code for zero redundancy optimizer strategy 3 has been\r\nintroduced.\r\n\r\n## Linked Issues\r\n\r\n- N/A","shortMessageHtmlLink":"[Add] ZeRO3 unit test (#205)"}},{"before":"7c69e70ced6ffa75e5a24f0bfb3c045793b6f965","after":"1eb0d6c777e8d26d2dbcbd4ee3325002eabc17fc","ref":"refs/heads/main","pushedAt":"2023-07-12T06:11:01.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"hyunwoongko","name":"Kevin Ko","path":"/hyunwoongko","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/38183241?s=80&v=4"},"commit":{"message":"Ohwi/pp use message queue (#204)\n\n## Title\r\n\r\n- Merge Pipeline parallel using a message queue\r\n\r\n## Description\r\n\r\n- Development of pipeline parallel\r\n- Some works are left\r\n\r\n---------\r\n\r\nCo-authored-by: jinwonkim93 ","shortMessageHtmlLink":"Ohwi/pp use message queue (#204)"}},{"before":"effe425da077531168691366d90cceba538b0c9d","after":"16ebae4223d373da1fc0e16b5272cbe720f4ddb2","ref":"refs/heads/ohwi/pp-use-message-queue","pushedAt":"2023-07-11T14:54:13.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"jinwonkim93","name":"김진원","path":"/jinwonkim93","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/26476095?s=80&v=4"},"commit":{"message":"apply pre-commit","shortMessageHtmlLink":"apply pre-commit"}},{"before":"8a1e5ffcaa6e8aa6891dbc5d1d246de32cf07c75","after":"effe425da077531168691366d90cceba538b0c9d","ref":"refs/heads/ohwi/pp-use-message-queue","pushedAt":"2023-07-02T05:52:18.000Z","pushType":"push","commitsCount":18,"pusher":{"login":"ohwi","name":null,"path":"/ohwi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22569365?s=80&v=4"},"commit":{"message":"Merge branch 'main' into ohwi/pp-use-message-queue","shortMessageHtmlLink":"Merge branch 'main' into ohwi/pp-use-message-queue"}},{"before":"531b8ea2eb0ee14e8422262a903f967b80bfc828","after":"8a1e5ffcaa6e8aa6891dbc5d1d246de32cf07c75","ref":"refs/heads/ohwi/pp-use-message-queue","pushedAt":"2023-07-02T05:46:00.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"ohwi","name":null,"path":"/ohwi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22569365?s=80&v=4"},"commit":{"message":"run pre-commit","shortMessageHtmlLink":"run pre-commit"}},{"before":"d345607702387ebaa7a16a4c7c962304d360101c","after":"516582d1d23a1bfae63294973947f420d11b31f7","ref":"refs/heads/auto_model_test","pushedAt":"2023-06-29T16:47:42.000Z","pushType":"push","commitsCount":6,"pusher":{"login":"koliaok","name":"hyungrak kim","path":"/koliaok","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/13493100?s=80&v=4"},"commit":{"message":"merge from main","shortMessageHtmlLink":"merge from main"}},{"before":null,"after":"61c89f80f42263823e67dbf1aa9c0464a948f2a8","ref":"refs/heads/deparallel/optimizer","pushedAt":"2023-06-22T11:34:09.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"hyeinhyun","name":"hihyun","path":"/hyeinhyun","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/41287040?s=80&v=4"},"commit":{"message":"deparallel optimizer","shortMessageHtmlLink":"deparallel optimizer"}},{"before":"e61234a71040cbcf4ef2d3cef0e220be16c85f92","after":null,"ref":"refs/heads/186-todo-zero-optimizer-deparallel","pushedAt":"2023-06-22T11:31:31.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"hyeinhyun","name":"hihyun","path":"/hyeinhyun","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/41287040?s=80&v=4"}},{"before":"d15cccdb0a05a3689fd3557b73ef5c357cb4d9a9","after":"d345607702387ebaa7a16a4c7c962304d360101c","ref":"refs/heads/auto_model_test","pushedAt":"2023-06-17T15:36:16.865Z","pushType":"push","commitsCount":3,"pusher":{"login":"koliaok","name":"hyungrak kim","path":"/koliaok","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/13493100?s=80&v=4"},"commit":{"message":"Change training code","shortMessageHtmlLink":"Change training code"}},{"before":"c1cc666c7a7b0640346d3b47a0bb6bdeed852bfc","after":"7c69e70ced6ffa75e5a24f0bfb3c045793b6f965","ref":"refs/heads/main","pushedAt":"2023-06-15T13:21:45.443Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"hyunwoongko","name":"Kevin Ko","path":"/hyunwoongko","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/38183241?s=80&v=4"},"commit":{"message":"BART PreTraining code (#200)\n\n## Title\r\n\r\n- BART Pretraining code \r\n\r\n## Description\r\n\r\n- BART Pretraining using wiki and cnn dataset","shortMessageHtmlLink":"BART PreTraining code (#200)"}},{"before":"98778556f1bbd3d651f22d91c5f293d9662530f4","after":"c1cc666c7a7b0640346d3b47a0bb6bdeed852bfc","ref":"refs/heads/main","pushedAt":"2023-06-15T13:19:55.721Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"hyunwoongko","name":"Kevin Ko","path":"/hyunwoongko","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/38183241?s=80&v=4"},"commit":{"message":"Add requirement for lightseq2 (#202)\n\n## Title\r\n\r\n- import error if scipy is not installed\r\n\r\n## Description\r\n\r\n-\r\n\r\n## Linked Issues\r\n\r\n- resolved #00","shortMessageHtmlLink":"Add requirement for lightseq2 (#202)"}},{"before":null,"after":"8dba840e0e2626f8fcff30cc3a1f91ae6e5f0ef4","ref":"refs/heads/lightseq2/patch-1","pushedAt":"2023-06-15T10:26:36.435Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"jinwonkim93","name":"김진원","path":"/jinwonkim93","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/26476095?s=80&v=4"},"commit":{"message":"Add requirement for lightseq2","shortMessageHtmlLink":"Add requirement for lightseq2"}},{"before":null,"after":"bf3e50fbde103d25271633018fe96239b4f60235","ref":"refs/heads/zero_interface/patch-1","pushedAt":"2023-06-15T09:53:46.975Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"jinwonkim93","name":"김진원","path":"/jinwonkim93","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/26476095?s=80&v=4"},"commit":{"message":"[Feature] new interface for zero","shortMessageHtmlLink":"[Feature] new interface for zero"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"Y3Vyc29yOnYyOpK7MjAyMy0wOS0wOVQwODowNjo1Ny4wMDAwMDBazwAAAAN8ycLc","startCursor":"Y3Vyc29yOnYyOpK7MjAyMy0wOS0wOVQwODowNjo1Ny4wMDAwMDBazwAAAAN8ycLc","endCursor":"Y3Vyc29yOnYyOpK7MjAyMy0wNi0xNVQwOTo1Mzo0Ni45NzU0OTFazwAAAANCEEYw"}},"title":"Activity · EleutherAI/oslo"}