Ant pointed me to SpeedFan in this stackoverflow question.
I downloaded SpeedFan and it reports that my CPU temperature peaks at about 73C which seems to be normal according to this chart (although the little flame icons in SpeedFan worry me).
However, is a CPU fan speed of 3590 RPM normal? The CPU fan reaches this speed after I e.g. open thunderbird, tweetdeck and a youtube video in firefox. At this speed the fan spins so vigorously that I can feel a light vibration in the table above the computer, and it makes a high pitch drone/whine like an airplane taking off. Is my fan broken or is this speed much too high for a CPU fan?
Here's a picture of the fan: