MuZero: Single-File Implementation

Learn to reimplement MuZero from scratch in a single file. This talk demonstrates core reinforcement learning concepts and shows how to build complex algorithms step-by-step.

Overview

I’m reimplementing reinforcement learning algorithms from scratch, most recently MuZero. I want to understand what comes after LLMs. Models learning purely from experience of interacting with the environment seem interesting, see for example David Silver’s recent start-up announcement. I want to show that it is possible to reimplement core parts of these algorithms in a single file.

Tech stack