We can consider any physical system, including the entire universe, as a Markov chain.
It is established that in order to understand the behavior of markov chains, it is frequently required to run monte carlo simulations of the behavior of such mathematical objects.
http://perso-math.univ-mlv.fr/users/vandekerkhove.pierre/pdf/Entropy04_ss.pdf
For a cellular automata, consisting of an infinite one dimensional series of cells which are either on or off, we can
define the probability matrix for the transition of a specific cell to the next state as a function of probabilities with a stochastic matrix.
Here i, j represent the set of available states S = ${0,1,2,\cdots$}
P_{i j} >= 0, \Sigma_{j S} P_{i j} = 1
The above is latex, but I can't figure out how to get it to be displayed that way. I see "Link" "Image" "code" "HTML" "PHP" "Quote" all of which do various useful setting aside but are not mathematical symbols.
In any event, it is not possible to define the entire transition matrix for an infinite object with a finite representation- however, it is possible to define the transition matrix for an individual cell with specific neighbors.
As to whether an infinite transition matrix makes any sense or not- I am reserving judgement for the moment.
http://www.reti.dist.unige.it/reti/Documenti/MarkovChains.pdf