Pré-publication, Document de travail: This article presents an algorithm that extends Ljungqvist and Sargent's (2012) dynamic Stackelberg game to the case of dynamic stochastic general equilibrium models including forcing variables. Its first step is the solution of the discounted augmented linear quadratic regulator as in Hansen and Sargent (2007). It then computes the optimal initial anchor of "jump" variables such as inflation. We demonstrate that it is of no use to compute non-observable Lagrange multipliers for all periods in order to obtain impulse response functions and welfare. The algorithm presented, however, enables the computation of a history-dependent representation of a Ramsey policy rule that can be implemented by policy makers and estimated within a vector auto-regressive model. The policy instruments depend on the lagged values of the policy instruments and of the private sector's predetermined and "jump" variables. The algorithm is applied on the new-Keynesian Phillips curve as a monetary policy transmission mechanism.