Computing Heat kernel of a Continuous-time Markov chain

We are talking about computing the heat kernel of a continuous-time Markov chain, where