ml-rust/splintr
A high-performance tokenizer (BPE, WordPiece, SentencePiece) built with Rust with Python bindings, focused on speed, safety, and resource optimization.
⭐ 60
⑂ 6
Rust
MIT
· 22 小时前推送
60
Watchers
0
贡献者
0
Commits
0
Releases
0
Open Issues
22 小时前
最近推送
原文
中文
暂无 README