Running multiple commands (or even computers) in parallel for more efficiency.

learn more… | top users | synonyms (1)

0
votes
2answers
36 views

bash for loop in parallel with n cores

I have a bash loop that looks like: for i in $(seq 0 $max); do my_command $i done and I would like to run this in parallel on n cores. I know that I could do while [[ "$j" -le "$max" ]]; do ...
1
vote
1answer
224 views

Is it normal to overworking of just one CPU when using openMP

When I use OpenMP in FORTRAN to parallelize a program on linux, ' top' command show me just one processor working ~%800 instead of ~%100 x 8 processors. Is it a expected situation ?
0
votes
1answer
328 views

Is Virtual Machine capable of running as normal PC would?

Let's imagine that you have a super-powerful-server at home of size of desktop (just visualisation). 2048 physical cores each 3GHz, 64TB RAM, GTX 780 Ti Black Edition (SLIx4, (four graphics card ...
0
votes
1answer
39 views

losetup Find in Parallel / Concurrency

I'm writing a makefile that at some point builds image files. I'm using losetup -f in the file to find a free loop device when building out each image. Since the images are independent of each other,...
0
votes
1answer
358 views

Kerrighed cluster does not use all nodes when running OpenMP

I've been given access to a recently built cluster that uses Kerrighed. I'm the first user of this cluster, so setup and configuration problems may be a possibility. I'm also totally new to ...
14
votes
0answers
905 views

Jenkins realtime console output for parallel threaded fabric command

We have a Python fabric command that runs in parallel across several hosts, something like this: $ fab --hosts=prod1.server,prod2.server,prod3.server --parallel copy_cache This will copy cache to ...
1
vote
0answers
48 views

why is my master node idle when running gnu parallel remotely?

I'm using gnu-parallel to run a number of python scripts in parallel across a number of computers in my gigabit network. The files being processed are located on a tmpfs (RAM) folder on my master ...
1
vote
0answers
150 views

Linux command-line utils with built-in support of multithreading

I would like to be able to compare performance of multicore computers from a point of view of a user who performs typical day-to-day tasks in Linux. My current goal is to collect a list of compute ...
1
vote
0answers
77 views

Can I set up PVM in such way that master doesn't start own tasks?

We have a Perceus cluster (Warewulf) consisting of 4-core master and a number of 4-core nodes. I can start PVM on the master and then add all nodes - it works fine. However, there are other guys who ...
0
votes
0answers
19 views

Running Matlab with clusrun

I'm pretty much a Microsoft HPC rookie, but here goes: I have a small cluster of 3 computers running Windows Server 2012 R2. I have the Microsoft PC Pack, which includes a clusrun command (https://...
0
votes
0answers
15 views

Transparently execute processes on another machine

Situation: At work, we have an in-house tool for data crunching. When a job is triggered, it starts multiple copies of itself in separate processes and communicates with them in order to crunch in ...
0
votes
0answers
36 views

Do threads/processes that create/delete files/directories under a shared parent dir interfere?

I was wondering: If I have a directory /a/b/c/ and under c X threads create subdirectories and files and delete them (they are temporary directories and files as intermediate steps of processing) do ...
0
votes
0answers
28 views

Is parallelism in computer science always directly tied to the number of processor cores?

Specific to the Java programming language, would it be accurate to say that two threads can be concurrent, but can only truly be run in parallel if there are two or more cores?
0
votes
0answers
53 views

How does niceness relate to CPU allocation on Solaris?

The wikipedia article for nice describes the relationship as follows: As a simple example, when two otherwise identical CPU-bound processes are running simultaneously on a single-CPU Linux system, ...
0
votes
0answers
61 views

How to setup grid/clutster computers?

We have 3 labs and each lab have 30 computers having different OS's on them windows, Ubuntu mostly, so i was thinking if i can connect them using grid computing, so we can use them for our research ...