Skip to content

Pull requests: meta-pytorch/tokenizers

New pull request New
7 Open 182 Closed
7 Open 182 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

ByteLevel: honor use_regex=false (match HuggingFace tokenization) CLA Signed This label is managed by the Meta Open Source bot. meta-exported
#198 opened Jun 15, 2026 by joshuuuasu Contributor Loading…
1
Make ReplaceNormalizer::normalize O(N) (single forward pass) CLA Signed This label is managed by the Meta Open Source bot.
#196 opened Jun 12, 2026 by digantdesai Loading…
Make HFWord::merge_all O(n log n) CLA Signed This label is managed by the Meta Open Source bot.
#195 opened Jun 12, 2026 by digantdesai Loading…
1
Add a targeted HFTokenizer encode-latency benchmark CLA Signed This label is managed by the Meta Open Source bot.
#194 opened Jun 12, 2026 by digantdesai Loading…
Add lint CI workflow CLA Signed This label is managed by the Meta Open Source bot.
#192 opened May 26, 2026 by Copilot AI • Draft
1
@kirklandsign
1
Bump black from 24.4.2 to 26.3.1 CLA Signed This label is managed by the Meta Open Source bot. dependencies Pull requests that update a dependency file python Pull requests that update python code
#177 opened Mar 12, 2026 by dependabot Bot Loading…
1
Add AArch64 unit test workflow CLA Signed This label is managed by the Meta Open Source bot.
#125 opened Sep 4, 2025 by chizkiyahu Loading…
7
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.