Why Implement GPT-2 in Pure C Language? Karpathy Responds to Online Criticism
Machine Heart ReportEditor: Xiao Zhou Karpathy: for fun. A few days ago, Andrej Karpathy, former head of Tesla Autopilot and OpenAI scientist, released a project called “llm.c” that implements GPT-2 training in just 1000 lines of code on CPU/fp32. llm.c aims to simplify large model (LM) training — using pure C language / CUDA, without … Read more