Ever wondered where those pinned shortcuts are stored in Win7/8/8.1/10? This way you can edit, delete or create new shortcuts. Sometimes they get duplicated but they don't appear as pinned so this is the only way to delete them.
Just need to access this location from explorer:
%APPDATA%\Microsoft\Internet Explorer\Quick Launch\User Pinned\TaskBar