You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This is needed to be able to use SDPA for NLLB (#478), which should hopefully be released in the next minor version of transformers.
There may be others, but at least one breaking change that we will need to take care of is the refactoring of the NllbTokenizer, specifically in regards to the language code special tokens. This change came in 4.38, and I believe the main changes came in this PR.
The text was updated successfully, but these errors were encountered:
This is needed to be able to use SDPA for NLLB (#478), which should hopefully be released in the next minor version of transformers.
There may be others, but at least one breaking change that we will need to take care of is the refactoring of the
NllbTokenizer
, specifically in regards to the language code special tokens. This change came in 4.38, and I believe the main changes came in this PR.The text was updated successfully, but these errors were encountered: