lucidrains/PaLM-pytorch

Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways

Training & fine-tuningPython MIT 80created 2022-04-04

Stars

823

1-day growth

7-day growth

—

30-day growth

—

Star history

Tracked since 2026-11-13

#artificial-general-intelligence#attention-mechanism#deep-learning#transformers

Top contributors

Not collected yet (contributors job).

lucidrains/PaLM-pytorch · AI Repo Stats