Some remarks about the thermodynamics of discrete finite Markov chains