On-Policy Value Function

reinforcement-learning

Definition

On-Policy Value Function

The on-policy value function $V^{\pi }(s)$ gives the expected return if you start in state $s$ and always act according to policy $\pi$:

$$V^{\pi }(s)={\mathbb{E}}_{\tau \sim \pi }[R(\tau )\mid s_0=s]$$