therealoliver/Deepdive-llama3-from-scratch · AI Repo StatsTHtherealoliver/Deepdive-llama3-from-scratch
Achieve the llama3 inference step-by-step, grasp the core concepts, master the process derivation, implement the code.
Inference & local LLMJupyter Notebook MIT 52created 2025-02-19 #attention#attention-mechanism#gpt#inference#kv-cache#language-model#llama#llm-configuration#llms#mask#multi-head-attention#positional-encoding#residuals#rms#rms-norm#rope#rotary-position-encoding#swiglu#tokenizer#transformer