Upgrade transformers to the latest version #521
Labels
Comments
|
The changes should be coming in transformers 4.46 |
|
It is also worth noting that in this pr for version 4.42.0; they removed the features that were deprecated in version 4.38. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
This is needed to be able to use SDPA for NLLB (#478), which should hopefully be released in the next minor version of transformers.
There may be others, but at least one breaking change that we will need to take care of is the refactoring of the
NllbTokenizer, specifically in regards to the language code special tokens. This change came in 4.38, and I believe the main changes came in this PR.The text was updated successfully, but these errors were encountered: