Even after I overclocked it? Seems really odd it stays on the range of 45-48 Celsius.
I'm scared that the number is not correct and my card is frying.. why could this be?
From the pictures you uploaded your card is operating as expected. You'll generally not see much change in temperature unless there is a serious issue such as the fan malfunctioning or the heatsink getting too dirty to properly dissipate heat.
Due to its design if there is a problem with overheating, your GPU will shut down regardless of the temperature being reported in windows.