Systematic study of Markov chains and some of the simpler Markov processes including renewal theory, limit theorems for Markov chains, branching processes, queuing theory, birth and death processes, and Brownian motion. Applications to physical and biological sciences. Prereqs., MATH 4001, MATH 4510 or APPM 3570, or APPM 4560, or instructor consent. Same as MATH 6550.