jshuadvd/LongRoPE

Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper

⭐ 154 ⑂ 13 Python · 2024-07-20推送

https://arxiv.org/pdf/2402.13753.pdf

ai artificial-intelligence deep-learning gpt language-model llm machine-learning natural natural-language-inference natural-language-processing natural-language-understanding nlp tokenization transformers attention-is-all-you-need attention-mechanisms transformer-architecture natural-language-procressing tokenizers

154

Watchers

0

贡献者

0

Commits

0

Releases

3

Open Issues

2024-07-20

最近推送

原文中文

暂无 README