Here's the problem. I accidentally switched the theme to Classic (don't ask), and when I switched back, all windows have bold titles.
In the image, the top one is how it should be and the bottom is how it looks here. (I got the top image online)
Any proposals on how to fix this? Does this happen frequently?