up vote 1 down vote favorite
1
share [g+] share [fb]

We have about 10 heterogeneous machines we would like to run various jobs on. The current situation is that people log in on a machine with ssh, see if other people are running stuff on it, then use screen to run the job.

I'd like to automate this process, but I don't have enough time to install a full-fledged cluster solution. So what's the simplest thing I can do?

link|improve this question
94% accept rate
feedback

4 Answers

up vote 1 down vote accepted

How about GNU Queue? it's fairly easy to set up.

link|improve this answer
1  
Quote: "At this moment there are no versions available for download". And "Development Status: 2 - Pre-Alpha". – harrymc Jan 21 '10 at 14:03
Also, the website appears to be dead. It did seem like a good candidate, though. – Peltier Jan 21 '10 at 14:10
1  
@Harry, if you actually read the website it says A completely new code base is under development. Previous versions are still available: ftp.gnu.org/gnu/gnu-queue – John T Jan 21 '10 at 14:24
feedback
up vote 1 down vote

If you need to run same jobs in parallel on many machines, check this excellent article (not really Debian-specific). You can then set up a cronjob on some 'master' machine that would perform it on others or just do it manually.

link|improve this answer
That's nice, but at least some load balancing and queue management would be nice. – Peltier Jan 21 '10 at 13:46
feedback
up vote 1 down vote

If it's just a few users and you want a quick solution, what about a centralized schedule/calendar? Just have people schedule time as they would a lab/conference room. it would take all of 25 min to setup and guaranties resources as long as everyone plays nice.

link|improve this answer
That's basically what we're doing at the moment :) I want something a bit more automated, so we don't have to talk about it and can concentrate on more important stuff. – Peltier Jan 21 '10 at 14:24
1  
I have not used it, but the guy sitting across from me said to look into torque. clusterresources.com/products/torque-resource-manager.php – Will Jan 21 '10 at 14:33
feedback
up vote 0 down vote

I thing that SGE is pretty easy and straight forward. I even run it on all my machines at home.

link|improve this answer
feedback

Your Answer

 
or
required, but never shown
discard

Not the answer you're looking for? Browse other questions tagged or ask your own question.