Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Missing OLMo checkpoints #726

Open
mirandrom opened this issue Oct 3, 2024 · 1 comment
Open

Missing OLMo checkpoints #726

mirandrom opened this issue Oct 3, 2024 · 1 comment

Comments

@mirandrom
Copy link

mirandrom commented Oct 3, 2024

Hi, thanks for making these available; really helpful for doing research on learning dynamics in LLMs.

I noticed there are gaps in the 7B (and to a lesser extent 1B) URLs.

Do these missing checkpoints exist and can they be made available? Thank you!

Originally posted by @mirandrom in #500 (comment)

@mirandrom
Copy link
Author

Would it also be possible to make model/optimizer checkpoints for the OLMo tiny suite of models down the line for research on scaling and learning dynamics?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant