A 37-chapter public course explaining how large language models work internally, from tokenization and embeddings through attention, training loops, quantization, distributed training, LoRA, DPO, GRPO, distillation, RAG, tool use, AI agents, and safety. Includes a small runnable decoder-only Transformer in PyTorch with tests, plus guides for building datasets from Hugging Face, Kaggle, and Common Crawl. Explicitly framed as educational material, not a production LLM framework.

Fund this project


Mon, 17 Aug 2026 10:22:49 UTC

There was a problem with this listing's funding.json manifest. If it is not fixed, the listing will be removed from the portal.

Crawl error

error: https://github.com/AarambhDevHub/llm-from-scratch/blob/main/.well-known/funding-manifest-urls?raw=true returned 429

Unverified URL

The funding manifest has not provided proof via wellKnown that this link is associated with it. Learn more.

Continue