In this paper, the implementation of a digital signal processor (DSP) based H.264 decoder for a multi-format set-top box is described. Baseline and Main profiles are supported. Using several software optimization techniques, the decoder has been fitted into a low-cost DSP. The decoder alone has been tested in simulation, achieving real-time performance with a 600 MHz system clock. Finally, it has been integrated in a multi-format IP set-top box using a commercial development board based on the DSP @ 600 MHz. Tests in a real environment have been performed using this board with good results.