I have all options for popup blocking enabled. Still, even without interacting with the page (tab is not even active, I'm reading reviews for the hotel in another tab) Kayak opens 2 to 4 windows in the background.
How do they do that?
Do you have any add-ons installed? You could try Ad-block Plus Pop-up Blocker.