kyegomez/LongNet

Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"

⭐ 726 ⑂ 59 Python Apache-2.0 · 2024-01-07推送

https://discord.gg/qUtxnK2NMf

artificial-intelligence attention chatgpt gpt3 gpt4 machine-learning transformer attention-is-all-you-need attention-mechanisms context-length

726

Watchers

0

贡献者

0

Commits

0

Releases

5

Open Issues

2024-01-07

最近推送

原文中文

暂无 README