I am looking for instructions or a script to copy my fish config files to a new computer via scp. Or at least build a tar file with all of them.
All your fish config files are in ~/.config/fish or a subdirectory of that directory. So all you need to do is
scp -pr ~/.config/fish remote_host:. Or
tar cf fish_cfg.tar .config/fish.