1Solving (1) for and substituting this expression in the place of in the Bellman equation, and then substituting for .