Sheldon M Ross Stochastic Process 2nd Edition Solution ⚡

P X0 = 0 = P^2 (0,2) = 0.5(0.2) + 0.3(0.2) + 0.2(0.5) = 0.1 + 0.06 + 0.1 = 0.26

P = | 0.5 0.3 0.2 | | 0.2 0.6 0.2 | | 0.1 0.4 0.5 | Sheldon M Ross Stochastic Process 2nd Edition Solution

Var(X) = E[X^2] - (E[X])^2 = ∫[0,1] x^2(2x) dx - (2/3)^2 = ∫[0,1] 2x^3 dx - 4/9 = (1/2)x^4 | [0,1] - 4/9 = 1/2 - 4/9 = 1/18 P X0 = 0 = P^2 (0,2) = 0

Autocov(t, s) = E[(X(t) - E[X(t)]) (X(s) - E[X(s)])] = E[X(t)X(s)] = E[(A cos(t) + B sin(t))(A cos(s) + B sin(s))] = E[A^2] cos(t) cos(s) + E[B^2] sin(t) sin(s) = cos(t) cos(s) + sin(t) sin(s) = cos(t-s) and transition probability matrix: Solution:

4.3. Consider a Markov chain with states 0, 1, and 2, and transition probability matrix:

Solution: