Professional Documents
Culture Documents
X
V π (s) = E {rt | s0 = s}
t=1
" #
X X
= π(s, a) R(s, a) + γ P (s, s0 , a)V π (s0 )
a s0
T
1X
ρπ = lim rt (does not depend on s0 )
T →∞ T
t=1
X X
= dπ (s) π(s, a)R(s, a)
s a