Post

Open-source implementation of Karpathy's LLM Wiki

Your LLM compiles and maintains a structured wiki from raw sources.

This wiki tracks research on transformer architectures and their scaling properties. It synthesizes findings from 12 sources across 47 pages.

The relationship between model size and performance follows predictable scaling laws — loss decreases as a power law of compute, dataset size, and parameter count.

You rarely ever write the wiki yourself — the wiki is the domain of the LLM.

Articles, papers, notes, transcripts. Your immutable source of truth. The LLM reads from them but never modifies them.