I will answer even thought never used Power Shell.
Per the manual,
Delete the specified items.
Thus, at this point your question narrows down to:
Can I recover deleted file?
You can, but it is not something that you do from right click context menu.
File is not physically disappearing from the partition upon deletion. It's content remains there but being marked as free space. If this data is not overwritten by other data, than you can recover the files. There are various products which can help to do it.
One of them is free open source System Rescue CD.
Here is an analogy of reverting
rm command in real word with real objects:
Imagine following: You dropped a bottle of milk and it cracked - milk is all over the floor.
You know how to get milk out of the floor and put it back to different bottle. (For this example let's assume the milk is not intended for drinking - it is just content of the bottle).
But now you are asking me "How to cancel the drop action"? You can not cancel the drop action. Bottle was dropped and you can not "undrop" it. Milk is on the floor.
Your only solution - get milk off the floor back to different bottle before your dog will take care of it.