Stochastic Processes

Important examples of stochastic processes, and how these processes can be analysed, will be the focus of this module.

As an introduction to stochastic processes, students will look at the random walk process. Historically this is an important process, and was initially motivated as a model for how the wealth of a gambler varies over time (initial analyses focused on whether there are betting strategies for a gambler that would ensure they won).

The focus will then be on the most important class of stochastic processes, Markov processes (of which the random walk is a simple example). Students will discover how to analyse Markov processes, and how they are used to model queues and populations.