Go in to device manager with the device plugged in and double click on it.
Click the drivers tab and click on "Driver Details"
Jot down the location of all the drivers and take a backup before deleting as some may be shared and required by other devices... so be VERY careful with generic sounding names
Next, click Uninstall and once finished, pull it out quick before plug and play picks it up!
That being said, you may need to uninstall before deleting the files - truthfully, I know this should work as this will delete the driver files, but I have never tried it so I am not sure on the order needed to do this. You may not even need to unplug as if you can delete the drive files, if plug and play find it, it will probably ask you to reinstall the drivers anyway.
Also, if you do the update driver buttons, it may allow you to install the drivers you want without having to resort to the above method (if you have a .inf file... or can extract it from the cab or msi file e.t.c.)
If you do the method of manually deleting files, you may want to go to command prompt and type
SFC /VERIFYONLY
Just to verify that no system files have been deleted, I think there is a way to just manually type the file names you deleted in order to see if they were part of Windows, but I can not remember off by heart.