You're accidentally changing it to French Canadian and having to change it back to the US or Canadian English keyboard/language settings.
First thing I always do is go in and remove all the shortcut keys to change the language settings as I'll just manually change them with the menu/control panel if/when I want to change them. You can also try removing any languages or keyboards that you won't use.
You can change/edit the settings by right clicking on the settings if you have the language bar near your taskbar. The other way to get to the language and keyboard settings is to go to the Control Panel from the start menu.
Personally as a bilingual French Canadian, I keep my keyboard setup to US international and Language setting to Canadian English.