FluidSynth is a free software synthesizer supporting SoundFont files. It can be used as a shared library in other applications (such as Swami). The API also allows for synthesizing other formats (although with a SoundFont centric synthesis model).
FluidSynth web site