kyegomez/LongNet

Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"

Chat apps & assistantsPython Apache-2.0 59created 2023-07-06

Stars

728

1-day growth

—

7-day growth

—

30-day growth

—

Star history

Tracked since 2026-11-13

The chart appears after at least 2 days of data.

#artificial-intelligence#attention#attention-is-all-you-need#attention-mechanisms#chatgpt#context-length#gpt3#gpt4#machine-learning#transformer

Top contributors

Not collected yet (contributors job).