Row Stochastic Matrix A probability matrix is called row stochastic, if each of it’s rows sum upto one.