huggingface / tokenizers Public
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Add normalization option to Chinese characters (using OpenCC) and separate symbols from merging
#473
opened Oct 19, 2020 by
ecchochan
ProTip!
Add no:assignee to see everything that’s not assigned.