Policy Gradient

Combines value estimation (critic) with policy learning (actor).

Learning from data generated by a different policy.

Learning only from current policy’s data.

Balancing learning new behaviors vs exploiting known rewards.

Strategy mapping states to actions.

Expected cumulative reward from a state or state-action pair.

Expected return of taking action in a state.

Fundamental recursive relationship defining optimal value functions.