You can do potentially do this via Group Policy:
Unfortunately, no simple Group Policy switch exists to do the trick, and the entire procedure is a bit longwinded. First, you have to manually set Internet Explorer as the default on a reference machine. Click Start and then Settings > System > Default apps. Under Web browser, you can configure Internet Explorer as the default.
Next, you have to export this setting to an XML file with the DISM tool that is shipped with Windows 10:
Dism /Online /Export-DefaultAppAssociations:\\server\share\defaultassociations.xml
This commands exports all file associations on your reference computer to an XML file on a network share. Thus, you have to make sure that you didn’t modify other app associations that you don’t want to deploy in your network. By the way, you can also use the method described here to set Chrome or Firefox as the default browser.
Finally, you can deploy this XML file with the Group Policy Set a default associations configuration file, which is located in Computer Configuration > Administrative Templates > Windows Components > File Explorer.
(Source: Set Internet Explorer as the default browser in Windows 10 with Group Policy)