Actor-Critic

Learning from data generated by a different policy.

Learning only from current policy’s data.

Balancing learning new behaviors vs exploiting known rewards.

Continuous cycle of observation, reasoning, action, and feedback.

Expected cumulative reward from a state or state-action pair.

Expected return of taking action in a state.

Fundamental recursive relationship defining optimal value functions.

Optimizing policies directly via gradient ascent on expected reward.