There is this button-like thing appearing when I click on a device:

Yet it's missing a tooltip. It could mean “safely remove this device” but it could also mean “uninstall this device driver” and in that case I wouldn't want to try and click it (why is it even there for things like my hard drive?).
So what exactly does this thing do?

