I have used the exact method your describing in the question for more than 15 years , and have never had a single problem. But there are thing for my specific items that i had to be VERY aware of.
Both computer systems (3 before) have always had those power switch boxes that sit under the computer monitor. on those power switch boxes are:
Audio amps , and various powered speakers
Camera plugins (power for external camera items)
Powered input items (joystick mouse things)
Internet modem switches routers and all.
External Drive boxes
and thing like that. These switches are used regularly to fire-up and power down any of those items at will all day long, and when walking away from the computer.
With only 5-6 switch items, many things are bundled together in a grouping on the switch using 3X extention plugs and even power strips to handle all the possible powered devices via the 5-6 switches.
The base computers are NOT on those switch items, or are not switched off using that method Ever.
What items presented "Issues" when using this method?
Printers - InkJet printers Park thier cartriges/heads in a more sealed area to prevent dryout, Almost every inkjet must be powered off manually before pulling the plug on it.
USB HUB items, in monitors , or loose ones or wherever, any USB items that would want the "safe removal" BS a person wouldn't want to just cut off thier power, unless they are totally sure that they and the (relentless) system are not playing with those items. For any normal computer usage the safe removal must be used first.
Any Raid boxes, NAS boxes , external drive items , external SCSI or E-Sata would also fall along the same lines of slamming them out when they might be doing something (even if not initiated by you)