The replacement problem can be modeled as a finite, irreducible, homogeneous Markov Chain. In our proposal we modeled the problem using a Markov decision process and then, the instance is optimized using linear programming. Our ...