#transformers

Build a Small LLM From Scratch: A Tested GPT in PyTorch

Build a compact GPT-style transformer in PyTorch, train it on Tiny Shakespeare, test the critical pieces, and see exactly how an 813K-parameter language model learns.