cxcscmu/Craw4LLM

Official repository for "Craw4LLM: Efficient Web Crawling for LLM Pretraining"

LLM & foundation modelsPython MIT 60created 2025-02-17

Stars

667

1-day growth

7-day growth

—

30-day growth

—

Star history

Tracked since 2026-11-13

#crawler#crawling#large-language-models#llm#pre-training#pretraining#web-crawler#web-crawling

Top contributors

Not collected yet (contributors job).

cxcscmu/Craw4LLM · AI Repo Stats