Haiyang-W/TokenFormer

[ICLR2025 Spotlight🔥] Official Implementation of TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters

LLM & foundation modelsPython Apache-2.0 42created 2024-10-29

Stars

597

1-day growth

7-day growth

—

30-day growth

—

Star history

Tracked since 2026-11-13

#architecture#attention-mechanism#foundation-models#llm#scaling-methods#transformer

Top contributors

Not collected yet (contributors job).

Haiyang-W/TokenFormer · AI Repo Stats