Probably, the presense of this partition and it's contents prevent my computer from booting Linux, resided in another partition.
This is incorrect. Most Linux distributions boot fine in EFI/UEFI mode, using an EFI boot loader stored on an EFI System Partition (ESP). You haven't provided much in the way of detail about your Linux boot problem, so I can't comment on it in detail, but the mere presence of an ESP is NOT the source of that problem. You may have installed in the wrong mode (BIOS/CSM/legacy rather than EFI/UEFI), a bug or user error may have caused the boot loader to not be properly installed, there might be a hardware incompatibility (especially if you've got a very new computer), etc. Deleting the ESP will just create new problems, so DON'T DO IT!
I recommend you post a new question that provides details about your problem with Linux. Include the name and version number of the Linux distribution you're trying to install and describe the symptoms you're seeing (for instance, is the installation medium not booting, is the installation failing with an error message, does the installation seem to complete but then boot straight into Windows, etc.).