Reinforcement Learning: Theory and Algorithms

Alekh Agarwal Kianté Brantley Nan Jiang Sham M. Kakade Wen Sun

PDF

We will be frequently updating the book this spring, 2026. Also see our current RL Theory course website.

Contact: Please email us at bookrltheory [at] gmail [dot] com with any typos or errors you find. We appreciate it!

Some notes:

Version 3 (1/31/2022) can be found here: PDF.