-1. Finite states markov chain

Irreducible.

You should know the difference between recurrent and transient.

-2. M/M/2/n

2 : servers. n : Waiting space.

-3. \(M/M/\infty\)

Birth and death process. Define the correct states.

-4. Notice the difference between simple random walk and gambler ruin problem.

The probability of a before b. The expected number of games either reach 0 or N.