Windows 8.1, just like its predecessors, doesn’t show size of folders
in Windows Explorer (File Explorer) by default. That is, when you open
up a folder containing several files and folders, Windows Explorer
shows only the size of files and not folders in Details view.
In order to view the size of a folder in Windows Explorer, one needs
to either hover mouse cursor on the folder, or select the folder,
right-click on it, and then click Properties (one can quickly open
properties by using Alt + Enter hotkey).
You can sort by folder size in OSX, but unfortunately there's no built in way to do so in Windows.
So back to your question, I don't think there is any way to display folder size without a third party app. I guess the way without a 3rd party tool would be to right-click>Properties.
Related superuser question.
- Folder Size
See here for more.