NLPOptimize/flash-tokenizer

EFFICIENT AND OPTIMIZED TOKENIZER ENGINE FOR LLM INFERENCE SERVING

⭐ 458 ⑂ 10 C++ · 2026-02-02推送

https://github.com/NLPOptimize/flash-tokenizer

bert cpp cpp17 deep-learning flash huggingface nlp python tokenizer berttokenizer pybind11 trie wordpiece wordpiece-tokenization

458

Watchers

0

贡献者

0

Commits

0

Releases

7

Open Issues

2026-02-02

最近推送

原文中文

暂无 README