Our cluster is a linux cluster with Torque and Maui. I am reading tutorials online and find that the compilation is only on the head node, and after submitting the job by qsub, the other nodes are running the executable compiled on the head node. So that is why my questions arise.
Is it correct that a cluster has a head node and many compute nodes. user login and submit jobs at head node via scheduler, the jobs are running on compute nodes not on the head node?
can a program be compiled on the head node and run on the other compute nodes? If yes, does it mean that all compute nodes and head node must have same configuration and OS, so a program compiled on the head node can be run on the other nodes without recompiling on each other node?