Markov decision process

Also called MDP, finite MDP.

Tuple of states, actions, transition probabilities, rewards and discount factor, the standard model of sequential decisions.

About this page

The build computes these levels from the evidence in the repository. Each row says what the next level needs. Read what the levels mean.

Ladder	Level	What the next level needs
Human proof	H0 no proof	add a proof in proofs/ (06.5)
Lean	L0 no Lean part	name a Lean module in the lean field (07)
Visual	V0 none	add viz/scene.ts or a figure (10)
Writing	W0 stub	one source with a locator