Algorithm Search⌘K

Theoremcore

Policy gradient theorem

Also called log-derivative trick.

Gradient of expected return as an expectation of grad log pi times Q, enabling gradient ascent on policies.

Gradient of expected return as an expectation of grad log pi times Q, enabling gradient ascent on policies.

About this page

The build computes these levels from the evidence in the repository. Each row says what the next level needs. Read what the levels mean.

LadderLevelWhat the next level needs
Human proofH0 no proof
  • add a proof in proofs/ (06.5)
LeanL0 no Lean part
  • name a Lean module in the lean field (07)
VisualV0 none
  • add viz/scene.ts or a figure (10)
WritingW0 stub
  • Statement
  • one source with a locator