Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[
NllbTokenizer
] refactor with added tokens decoder #27717[
NllbTokenizer
] refactor with added tokens decoder #27717Changes from 16 commits
76dd325
862d6d1
0ae401f
b230b6b
329569f
ee08b8d
d5b3195
086000a
23aa840
dbd80f6
5ec00d2
8a14c0b
a77609f
f79abb7
f74b89c
337f068
c79212e
0094394
ea9a78e
424c8e4
eac3947
6bf2631
fa8ab61
db35a5d
0d19d4c
3e01ea7
ea6906c
dc56b4a
4f21f5e
0f44c39
a038369
7172ad7
93c02de
f2ba78f
5b08ee0
ed86fa6
File filter
Filter by extension
Conversations
Jump to
There are no files selected for viewing