I searched Google and SU for my problem, but everybody seems to want to add diacritics, while I don't want them.
I'm using Windows 7 and have a US keyboard installed, not the international version. Despite that some keys, like ", ^ and ~ are used for diacritics, which means that I have to type "SPACE to get a double quote. How do I get rid of this? My other PC, with the same settings, doesn't show this behavior.
edit re Stefan's answer
I don't see the icon Stefan refers to in my taskbar, probably because I have Classic Shell installed. But this is a screenshot of the Input Languages dialog, there are no other keyboards installed: