I want to replicate my current Xfce configuration complete with all settings on another Debian installation.
What file(s) do I need to copy and keep track of?
Well, according to What to save before re-installing?, duplicating your
~/.config/xfce4
folder should do the trick.
In any case, all your user configuration is in your home folder.