Several small integrated amplifiers exist with a USB input line. The ones I have seen so far ship with Windows and OS X drivers.
Does Linux support audio output via USB out-of-the-box?
Update
It is a Teac A-H01 I have in mind, if that makes a difference.