I am working on numerical simulations, and I run them with parameters so that they finish in a couple minutes. I'd like to let them run longer, maybe days.
Currently, I have the parameters compiled into the C programs, but I guess I should make all the parameters command line arguments, so that I can change them on startup.
However, I am not sure how to distribute “tasks” onto several Linux computers. They have multiple cores each, but I may not be able to install extra software, since they are university computers that allow SSH, but no root access.
screen might be able to get me somewhere, but I'd like to drop in a list with commands, like
run="100-200" mkdir "$run" && cd "$run" && ./main 100 200 && ./plot run="100-300" mkdir "$run" && cd "$run" && ./main 100 300 && ./plot
It would be great if I could just supply
./main 100 200 && ./plot and it would run it into a new working directory.
Is there some scheduling software for that? I need something for Linux that is free. Bonus points if I can install it into my home directory.
So far, I have found TORQUE, and some people at my university apprently run a cluster with HTCondor.