Questions tagged [cluster]
A cluster consists of a set of connected computers that work together so that they can be viewed as a single system.
188
questions
2
votes
1
answer
725
views
How can I list all IPs when Consul Cluster DNS is queried?
I have a 5 node Consul Cluster. When I run the DNS command below, it lists only three IPs at a time randomly. How can I have all 5 IPs listed at the same time (randomly) as opposed to three at a time?
...
- 143
0
votes
0
answers
127
views
How can I list all head node host names on a network?
We have multiple clusters available at work. I don't know the names of all of them. How can I get a list of all head nodes available?
- 113
1
vote
1
answer
55
views
Virtual SAN not recognizing any disks
I'm trying to set up a virtual san but can't seem to add any disks. I made a cluster and added the hosts.
Here's what I get when I go to disk management in the cluster:
https://i.stack.imgur.com/...
- 223
0
votes
2
answers
1k
views
File sharing between a cluster of linux machines
I have a cluster of 6 machines. The other day we had a power cut and the fully functioning cluster turned off. Now we have turned it back on its no longer functioning and the person who was knew what ...
- 3,106
1
vote
1
answer
590
views
SSH Bash script for repeated commands on a network cluster
I have a network cluster of about 100 machines, a piece of software and a large list of different parameters for the software.
I want to use the cluster to speed up the calculation, so each machine ...
- 11
1
vote
0
answers
129
views
union-mount file system that actually deletes from all layers
Here's my use-case: I have roughly a dozen machines loosely clustered together, each with a few hundred GB partition that's currently not used. I would like to make a scratch partition so that users ...
- 563
3
votes
1
answer
780
views
Setting up cluster with vagrant
I want to create a cluster of 4 CentOS VMs using Vagrant. I installed Vagrant and VirtualBox on my Widnows machine, downloaded the CentOS 64 box and created the cluster. Steps:
Execute 'vagrant box ...
- 151
0
votes
1
answer
4k
views
ssh connection error "Permission denied (publickey)"
So I have been trying to build ssh connections between google cluster container containing 1 master node and 2 worker nodes. I have used ssh-keygen to generate key pairs for all three nodes, send the ...
- 11
1
vote
1
answer
79
views
Does LSF io index report NFS io?
We use SONAS for our filesystem on our cluster and I have noticed that the load on SONAS does not necessarily correlate with the value of io on the cluster nodes when I run lsload -l. Is it possible ...
- 1,496
0
votes
0
answers
113
views
copy files and folders from cluster to desktop using PuTTY [duplicate]
I would like to copy files and subfolders from a cluster that runs pacman to a Windows desktop computer using PuTTY.
First I would like to copy one specific file or subfolder as a test, for example ...
- 407
1
vote
0
answers
51
views
Is there a way to figure out the exact sector numbers of clusters “chkdsk” reports as bad?
Recently I run chkdsk after it finished it showed 4 clusters in size 4kb are bad, is there any way to know the sector numbers of them?
- 31
0
votes
1
answer
31
views
Windows 2003 cluster not able to initiate
I am having trouble getting a service started in windows 2003.
This is the cluster log, not able to deduce what is wrong either.
Any help would be appreciated, tks.
As it is with any log, it is ...
- 101
0
votes
1
answer
118
views
When overwriting a file, how does this effect the filesystem NTFS?
Say a I have a secondary hard drive that has been defragged and optimized so that the data is a nice neat continuous block with no missing spaces/clusters. Like a solid brick wall.
If I copy a file ...
- 1
3
votes
1
answer
1k
views
Apache Spark cluster through a proxy?
This is more a speculative question to those with more networking / Apache Spark experience than me.
My current setup: two 32GB, 4GHz Core i7 machines I'd love to tie into a Spark cluster. However, ...
- 177
1
vote
1
answer
823
views
After installing slurm 14.11,there is not any script in /etc//init.d/
After installing the slurm 14.11,there should be a a slurm script in /etc/init.d/,but I did not find it in the directory,what's the reason?
- 11
10
votes
3
answers
2k
views
Attach to the same tmux session from different nodes of a cluster
I'm working on a computing cluster which has several hundreds of nodes. A load-balancing scheme picks an idle node to login to when ssh-ing into the cluster. As a result, it is very unlikely to re-...
- 301
0
votes
1
answer
45
views
generic remote process accelerator
is there a solution to accelerate a local process using remote PC CPUs (and/or GPU)?
My ideal solution should:
work without the need to rewrite the app to use a specific library;
work on ...
- 1,256
1
vote
0
answers
90
views
How to set up a productive and flexible Linux cluster?
I have 7 old computers that are a few years old. I want to cluster them together to create a linux cluster that will run general purpose software(not cluster specific). Is there any software that can ...
- 189
0
votes
2
answers
3k
views
How to mount 7 desktop pc's into a 7u rack? [closed]
I am clustering 7 desktop computers and would like to put them in a rack. I have an 8U rack and 1U will be taken up by the ethernet switch. I will take out the optical drives. I plan on putting each ...
- 189
1
vote
0
answers
176
views
Create a decentralized file server out of multiple desktops with Windows 7 OS
I have a bunch of desktops with Windows 7 OS and some unused hard disk space on each one that I would like to connect together and use as a big file server that can be seen by all the desktops. I want ...
- 71
2
votes
0
answers
2k
views
recover deleted files in linux cluster
I just deleted some files that were very critical to my project on a linux cluster .I was wondering if there is a specific way to recover them. This is very critical and I would appreciate a detailed ...
- 21
0
votes
1
answer
212
views
OS partition has 512 bytes clusters, should I convert to 4k?
I made a mistake and formatted the OS partition with 512 bytes cluster size, thinking that this will save a lot of space when storing small files (That was a long time ago, I didn't know that it will ...
- 397
1
vote
1
answer
944
views
How do I display directories in colour on remote systems over ssh via Terminal?
When I do ls in Terminal.app, I see that directories on my local system are in colour. However, when I connect to a remote cluster via ssh, ls output is no longer coloured. Is there a way to have ls ...
- 11
0
votes
2
answers
1k
views
CNAME to shared IP on a cluster
I'm trying to set a CNAME record (www) at ISP-A to forward to a subdomain at ISP-B.
the domain/website at ISP-A works flawlessly at ISP-A, the website at the subdomain at ISP-B works also good.
but ...
- 131
0
votes
1
answer
1k
views
virtual machine replication between two separated Hyper-v clusters
I have two identical hyper-v cluster configurations.
Here is the configuration: 2 hyper-v servers in cluster with shared via fiber channel storage.
There is a 10 Gbit ethernet between these clusers....
- 1
0
votes
2
answers
162
views
Is there a way to build cluster machine that behaves like a single PC? [closed]
Is there some way to build a cluster from several desktops in such a way, that it can run an unprepared application and be seen as just a multicore CPU?
I understand it will be a lot slower than ...
- 365
2
votes
4
answers
544
views
Manage a few Linux servers at once
I have a small cluster that consists of a few Linux nodes. There's a shared NFS, and I have the same user account with shared SSH keys on all nodes, but other than that each node has it's-own file ...
0
votes
0
answers
281
views
ZSH and Passwordless access with SSH in a shared home environment
I have a small cluster with some nodes which share their home folder through NFS. I allow passwordless SSH access to the users with this script:
if [[ -e $homeDirs/$username/.ssh/id_rsa.pub ]]; then
...
- 101
2
votes
0
answers
387
views
Setting up an Ubuntu Linux scalable web video cluster
I'm in the process of setting up what I hope will be a robust and scalable video processing cluster for a website I'm creating.
Currently, I am processing video uploads with FFMPEG on the same web ...
- 121
0
votes
0
answers
709
views
Cannot copy over 7MB file to Samba cluster on Centos 6.5
I have followed these instructions (with lots of updates since it's old) to get working two nodes Samba cluster in my VirtualBox lab. It's almost done, but I experience strange issue and does not know ...
0
votes
2
answers
1k
views
Supercomputer via LAN [closed]
If I decide to parallel two computers via direct LAN connection would LAN (100 Mbits/s) bus bandwidth be enough for CPUs to communicate without performance loss? Or do I have to use some other bus (...
- 459
2
votes
1
answer
344
views
How to save job info (qstat) in SGE when submitting to qsub?
When submitting a job, I am able to provide qsub with the path for the standard output and the standard error.
On the other side, while my job 12345 is running, I can access to extra info related to ...
- 121
-1
votes
2
answers
5k
views
Difference between Compute Node and Compute Cluster [closed]
I have to give a presentation on Super Computing and I came across this pdf
http://yuva.cdac.in/YuvaII/YUVA_2%20leaflet.pdf. As mentioned in page 2 what is the difference between Computer Node and ...
- 101
2
votes
2
answers
1k
views
Beowulf cluster possible?
I don't really know where to find people who have experience in building computer clusters, so I thought maybe someone from here might answer my question.
Basically I have two machines at my disposal:...
- 161
-1
votes
1
answer
206
views
How can I use computers with RJ-11 ports in an Ethernet network?
In my school are many really old computers with Pentium 3 processors and Windows 95. I'd like to make a cluster of them.
Those computers have RJ-11 ports, not RJ-45 and I don't know if I can use an ...
1
vote
1
answer
451
views
So I found and marked some bad clusters—now what?
I don't know exactly why, but hard drive failure happens to me quite often. This time around, three out of my eight drives failed almost at the same time (two HDDs and one SSD).
I still don't know ...
user270749
1
vote
0
answers
606
views
Can I build a cluster with Mac and Linux computers?
I do video editing on a Mac and I'd like to setup a cluster for distributed rendering. I don't really have the money to buy several Macs and make a cluster from those (besides, Xgrid is dead). How can ...
- 1,639
5
votes
3
answers
21k
views
Sharing RAM resources between 2 or more computers
I know there was a somewhat similar question before: How to share CPU or RAM?
But, let me just specify it a little more...
When Microsoft Windows requires more RAM capacity than available it uses a ...
- 153
1
vote
2
answers
294
views
Can i use multiple computers to run different programs with the same desktop environment?
Is it possible to connect a laptop to a desktop computer in a way that i can run programs on the laptop and see them with barely any lag on my desktop computer? I'm not looking for a separate remote ...
- 11
1
vote
1
answer
183
views
Send files with scp while being logged on cluster interface
I have to do some work on a Torque cluster where I log on a User interface via ssh. I transfer files to my directory of the cluster and get files from the directory by using scp in my normal terminal (...
- 207
1
vote
1
answer
85
views
How to know the PBS batch job submit time inside the script being excuted?
I'm using the PBS qsub to run a script on a cluster that must output a report file named with the batch job submit time.
The batch job submit time is the time it joins the PBS batch job que.
I ...
- 141
0
votes
1
answer
710
views
How do you make multiple computers work on the same task? (hash cracking)
This is a question that's been plaguing me since I saw the following YouTube video:
http://www.youtube.com/watch?v=TBXBB5sy5sA
This man installed 20 video cards across 5 different rigs, all running ...
- 157
1
vote
1
answer
2k
views
Hadoop installation on ubuntu
I installed Hadoop on ubuntu from the .deb package when I run start-all.sh I get this error
I configured the core-site.xml for hdfs:localhost:9001 but i gives me the error. I think the problem in the ...
0
votes
1
answer
320
views
Scheduler for sequential jobs on Linux
I am running some programs over a cluster and I would like to run them in a sequence, i.e when the first program terminates the second one starts and so on.
This is so that my cluster does not exceed ...
- 1
15
votes
2
answers
4k
views
How to determine the physical location of data on a disc?
Does anybody know of a way to find out where, physically on a CD or DVD a given piece of data would be located?
I am trying to watch a DVD at the moment, and am about half-way through, but it keeps ...
- 68.8k
1
vote
1
answer
109
views
Shelves for super computing cluster [closed]
So I am currently running a small project with a few friends and we require a 2 Teraflop super computing cluster we have gathered all the money for this project mainly from donations and we need to ...
2
votes
1
answer
1k
views
PBS batch jobs - the qalter command
I've got a giant computation running on a Scientific Linux cluster. At present I have over 600 jobs parked in the queue, waiting for processor time, while a few are running.
I'm trying to use the ...
- 156
3
votes
2
answers
5k
views
ntpdate with crontab or ntpd?
(1)autostart one ntpd service in all cluster nodes and point the reference serve to one LAN server.
(2)use crontab to ntpdate every certain minutes.
In cluster environment, which will be a better ...
- 131
0
votes
1
answer
475
views
Kerrighed cluster does not use all nodes when running OpenMP
I've been given access to a recently built cluster that uses Kerrighed. I'm the first user of this cluster, so setup and configuration problems may be a possibility. I'm also totally new to ...
- 101
1
vote
4
answers
120
views
Distributed website server redundancy [closed]
Assume a website infrastructure is very complicated and is fully distributed (probably like most large web companies).
Am I right in thinking that although there are all these extra web servers to ...
- 11