Karpathy's LLM Wiki — A Better Pattern Than RAG? 🧠
· 10 min read
Andrej Karpathy — the same person who coined vibe coding — recently published a gist describing a pattern he calls the "LLM Wiki". The core tension it addresses is simple: RAG re-derives knowledge from scratch on every question. What if the LLM built something persistent instead — a structured, interlinked wiki that compounds over time? It's a deceptively simple idea with some genuinely interesting implications.