You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I was wondering if you could provide more details on how to train OSM with FSDP.
I set args.fsdp to True and get the following error:
AttributeError: 'OmniScientModel' object has no attribute 'wrap_fsdp'
Are there more configurations to be set?
Thanks in advance!
The text was updated successfully, but these errors were encountered:
This code-base is built upon open-flamingo and I believe FSDP may not be fully tested in current code-base, you may refer to their implementations for more details regarding training with FSDP.
Hi, thanks for sharing the amazing work.
I was wondering if you could provide more details on how to train OSM with FSDP.
I set args.fsdp to True and get the following error:
AttributeError: 'OmniScientModel' object has no attribute 'wrap_fsdp'
Are there more configurations to be set?
Thanks in advance!
The text was updated successfully, but these errors were encountered: