Finite Markov Chains and Algorithmic Applications - Haggstrom, Olle (Chalmers University of Technology, Gothenberg)

This 2002 book is ideal for advanced undergraduate or beginning graduate students. The author first develops the necessary background in probability theory and Markov chains before applying it to study a range of randomised algorithms with important applications in optimisation and other problems in computing.