-
Notifications
You must be signed in to change notification settings - Fork 26.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[NllbTokenizer
] refactor with added tokens decoder
#27717
Merged
Merged
Commits on Nov 27, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 76dd325 - Browse repository at this point
Copy the full SHA 76dd325View commit details -
Configuration menu - View commit details
-
Copy full SHA for 862d6d1 - Browse repository at this point
Copy the full SHA 862d6d1View commit details -
Configuration menu - View commit details
-
Copy full SHA for 0ae401f - Browse repository at this point
Copy the full SHA 0ae401fView commit details -
Configuration menu - View commit details
-
Copy full SHA for b230b6b - Browse repository at this point
Copy the full SHA b230b6bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 329569f - Browse repository at this point
Copy the full SHA 329569fView commit details -
Configuration menu - View commit details
-
Copy full SHA for ee08b8d - Browse repository at this point
Copy the full SHA ee08b8dView commit details
Commits on Dec 21, 2023
-
Configuration menu - View commit details
-
Copy full SHA for d5b3195 - Browse repository at this point
Copy the full SHA d5b3195View commit details -
Configuration menu - View commit details
-
Copy full SHA for 086000a - Browse repository at this point
Copy the full SHA 086000aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 23aa840 - Browse repository at this point
Copy the full SHA 23aa840View commit details -
Configuration menu - View commit details
-
Copy full SHA for dbd80f6 - Browse repository at this point
Copy the full SHA dbd80f6View commit details
Commits on Jan 16, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 5ec00d2 - Browse repository at this point
Copy the full SHA 5ec00d2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8a14c0b - Browse repository at this point
Copy the full SHA 8a14c0bView commit details
Commits on Jan 17, 2024
-
Configuration menu - View commit details
-
Copy full SHA for a77609f - Browse repository at this point
Copy the full SHA a77609fView commit details -
Configuration menu - View commit details
-
Copy full SHA for f79abb7 - Browse repository at this point
Copy the full SHA f79abb7View commit details -
Configuration menu - View commit details
-
Copy full SHA for f74b89c - Browse repository at this point
Copy the full SHA f74b89cView commit details
Commits on Jan 18, 2024
-
Update src/transformers/models/nllb/tokenization_nllb_fast.py
Co-authored-by: amyeroberts <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 337f068 - Browse repository at this point
Copy the full SHA 337f068View commit details -
Configuration menu - View commit details
-
Copy full SHA for c79212e - Browse repository at this point
Copy the full SHA c79212eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 0094394 - Browse repository at this point
Copy the full SHA 0094394View commit details -
Configuration menu - View commit details
-
Copy full SHA for ea9a78e - Browse repository at this point
Copy the full SHA ea9a78eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 424c8e4 - Browse repository at this point
Copy the full SHA 424c8e4View commit details -
Configuration menu - View commit details
-
Copy full SHA for eac3947 - Browse repository at this point
Copy the full SHA eac3947View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6bf2631 - Browse repository at this point
Copy the full SHA 6bf2631View commit details -
Configuration menu - View commit details
-
Copy full SHA for fa8ab61 - Browse repository at this point
Copy the full SHA fa8ab61View commit details -
Configuration menu - View commit details
-
Copy full SHA for db35a5d - Browse repository at this point
Copy the full SHA db35a5dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 0d19d4c - Browse repository at this point
Copy the full SHA 0d19d4cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3e01ea7 - Browse repository at this point
Copy the full SHA 3e01ea7View commit details -
Configuration menu - View commit details
-
Copy full SHA for ea6906c - Browse repository at this point
Copy the full SHA ea6906cView commit details
Commits on Jan 19, 2024
-
Configuration menu - View commit details
-
Copy full SHA for dc56b4a - Browse repository at this point
Copy the full SHA dc56b4aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 4f21f5e - Browse repository at this point
Copy the full SHA 4f21f5eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 0f44c39 - Browse repository at this point
Copy the full SHA 0f44c39View commit details
Commits on Feb 12, 2024
-
Configuration menu - View commit details
-
Copy full SHA for a038369 - Browse repository at this point
Copy the full SHA a038369View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7172ad7 - Browse repository at this point
Copy the full SHA 7172ad7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 93c02de - Browse repository at this point
Copy the full SHA 93c02deView commit details
Commits on Feb 13, 2024
-
Configuration menu - View commit details
-
Copy full SHA for f2ba78f - Browse repository at this point
Copy the full SHA f2ba78fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5b08ee0 - Browse repository at this point
Copy the full SHA 5b08ee0View commit details -
Configuration menu - View commit details
-
Copy full SHA for ed86fa6 - Browse repository at this point
Copy the full SHA ed86fa6View commit details
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.