I use Spectrum as my ISP and in Filezilla, WinSCP, Putty, MobaXTerm I timeout after about 3-4 minutes and have to reconnect. I have discussed it with my ISP and they swear it is something to do with my computer (or program) but I do not timeout while on other internet lines, Only my main home internet. I have a Motorola router, 300mbps Connection (Usually 230-320) and Spectrum 300 plan.
I have fixed this issue by doing the following:
Site>Edit>Advanced>Enable Keepalives (I did every 30 seconds)
Settings>Configuration>SSH>Check "Keepalives" box
Edit>Settings>Connection>FTP>Enable FTP Keepalives
Thanks to Appleoddity for pointing me in the right direction.