Questions tagged [rsync]

Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.

Filter by
Sorted by
Tagged with
56 votes
5 answers
54k views

Rsync files via intermediate host

I am currently away from my LAN and I need to do a backup of my laptop. I have a somewhat recent copy of my laptop on my server and I usually back the laptop up using rsync. Now I wish to do that, but ...
GLaDER's user avatar
  • 811
1 vote
1 answer
69 views

Unexpected results from rsync on iMac

I've asked this question on other forums, hoping for some guidance. I have an iMac running 10.11.6 and have updated rsync to 3.1.2 (using homebrew). I am trying to use rsync to back up from my iMac ...
UncaMikey's user avatar
  • 111
2 votes
2 answers
2k views

Why does rsync update NTFS directories when the source has not changed?

I'm taking classes with lots of phonetic and grammatical analysis. They've given me an account on a Windows 10 network. Since I am much more comfortable with Mac and Linux (and since the Windows ...
WGroleau's user avatar
  • 784
1 vote
1 answer
661 views

Syncing immutable folders on linux (rsync/unison/some thing else?)

Consider the following directory layout: /foo /ABZE1 a1.txt a2.txt ... a59682.txt /BBSDF b1.txt b2.txt .... b42333.txt ... foo is the parent folder, ...
stav's user avatar
  • 113
3 votes
2 answers
10k views

How to rsync files older than x min on linux

Here is what I have now: rsync --remove-source-files -vr user@server:/foo/bar/in/ /some/local/path Is there a way I can instruct rsync to only fetch files that are older than x min/hours from the ...
Sean256's user avatar
  • 809
3 votes
0 answers
539 views

Rsync strangely gets auto killed and then binary is broken

I got a strange situation with Rsync on my remote Ubuntu 14.04.3 LTS (Trusty Tahir) instance. Whenever I execute it, it runs for a while (not completed) then seems get auto killed. After that it's ...
Arcobaleno's user avatar
1 vote
2 answers
2k views

How do I copy a file from one server to another without downloading first?

Is it possible to copy a file from one server to another without downloading first? I have a backup file that is 10gb that I'm wanting to copy from my production server to my staging server. ...
Corey's user avatar
  • 273
0 votes
1 answer
155 views

Could RSync be used to backup Parallels vm to KVM?

So I am currently using Parallels on my macbook pro but I am wanting to also use them on my desktop, which uses KVM. Since I don't believe KVM can read the parallels file format, would it be possible ...
XDroidie626's user avatar
2 votes
1 answer
3k views

How to interpret extended attributes on MacOS X?

I have a problem with rsync (version 2.6.9 which is outdated, but this is another problem) not correctly synchronizing files from MacOS X to MacOS X (versions Mountain Lion, Mavericks, Yosemite and ...
dan's user avatar
  • 374
15 votes
2 answers
16k views

Why does rsync over SSH give me 10x the throughput of SCP?

scp user@aws-ec2:~/file file rsync --partial --progress -Pav -e ssh user@aws-ec2:~/file file scp only gives me 200K/s, but rsync gives me 1.9M/s I tested several times, all same results. rsync ...
Sato's user avatar
  • 395
2 votes
2 answers
10k views

Rsync only certain directories and only certain sub-directories within them

In /opt I have many different directories, some of which contain _pkg_linux_deb_ or _pkg_android_apk_ in the middle of their name. Those directories also contain many sub-directories, one of which is ...
BananaBlender's user avatar
2 votes
3 answers
3k views

File synchronization on Linux over network: scp or rsync?

I have two Linux (Debian) machines "A" and "B" connected to each other wireless over the router. On the machine "A" I run a script that generates every 5 seconds a new 1MB file in the specific ...
Maximilian Wiens's user avatar
3 votes
0 answers
2k views

rsync SSD migration: lsetxattr failed: Operation not supported (95) -- consequences?

I just got an SSD and have been trying to migrate to it, poring through tons of how-to's I finally decided on this command (I have multiple partitions that needed migrating): time rsync -avHAXx /...
insaner's user avatar
  • 325
2 votes
5 answers
13k views

How can I check whether rsync transfered files or not?

I use rsync (cygwin) to transfer files between server and my PC. Rsync runs every 2 minutes, and sometimes there are some files to transfer, sometimes not. I need to execute some actions, but only ...
temur_p's user avatar
  • 41
1 vote
1 answer
536 views

rsync creates wrong backup directory names with a middle dot (·)

Under Windows, I use rsync to periodically clone some directory to ${LATEST_BACKUP_DIR}. I also use the --backup-dir="${OLD_BACKUP_DIR}" option to keep backups of files' old versions that have changed ...
Abdull's user avatar
  • 2,194
0 votes
1 answer
365 views

Inplace modification of incron monitored files

I have samba share where users create video files, i need to stripe audio tracks from that video files and rsync new files to remote folder. I monitor the samba share with CLOSE_WRITE option, to strip ...
Edik Mkoyan's user avatar
0 votes
2 answers
40 views

Can rsync be used to update restoration hdd?

I have two identical hard disks (say HDD1 and HDD2) with 4TB capacities. I want to create install CentOS, update it, install services and create users on one of the hard disk, say HDD1, meant only ...
Quiescent's user avatar
  • 163
0 votes
1 answer
969 views

rsync isn't understanding what is the relative part in --files-from=FILE

I've a file that looks like this: /cygdrive/d/path/to/my/file1.png /cygdrive/d/path/to/my/file2.png /cygdrive/d/path/to/my/file3.png /cygdrive/d/path/to/my/file4.png I'm calling rsync with: rsync --...
Caius Jard's user avatar
13 votes
1 answer
21k views

warning message "kex protocol error: type 7" during scp, rsync or shell work

Lately, I get lots of these errors on my home server. Their occurrence seems proportional to the traffic, so if I am working in a shell on the server I may seem 1-2 a day. But If I start some rsync, ...
Perlator's user avatar
  • 261
1 vote
1 answer
2k views

Diagnose why rsync is or is not copying certain files

I have a script that uses rsync to fetch files from a remote server, then process them. These local copies are not deleted between runs, so rsync should only have to fetch new files. However, it seems ...
macdjord's user avatar
  • 131
0 votes
2 answers
1k views

Patch a very big binary file over a slow connection

for backup purposes, I have transfered a very big binary file over a comparably upstream-wise slow connection (transfer took 2 weeks), by rsyncing it on a mounted cifs-share (so I could and can access ...
mcandril's user avatar
  • 123
1 vote
1 answer
445 views

Performance with multiple instances of rsync across different direct-attached storage devices?

Would running multiple instances of rsync with all the sources and destinations on different direct-attached storage devices cause any performance hits, or would the speed limits for each individual ...
user260467's user avatar
13 votes
5 answers
5k views

How to get rsync to not print directories

I use rsync to create backups on an external hard drive. I usually run a dry-run first just to sanity check. Specifically, I will use rsync -auvn path/to/source path/to/dest However this prints all ...
Andrew Schwartz's user avatar
1 vote
1 answer
143 views

Why would rsync be limiting syncs to ~252Kilobytes?

Here's a head scratcher for you... or at least it is for me. I am transferring a Wordpress site away from WP Engine to an Amazon instance. I am trying to upload the original Wordpress files from my ...
darkAsPitch's user avatar
  • 1,056
1 vote
1 answer
721 views

How to find the user who is running rsync?

In Linux, if rsync is already running, how can we identify which user is running it? And what if it is running as cron job, will the cron job user be different?
user600242's user avatar
6 votes
2 answers
11k views

rsync error - Unexpected remote arg: [email protected]:/*

I'm trying to migrate centos server to a new box with rsync and I run this command in the destination server: rsync -auHxv –numeric-ids –exclude=/etc/fstab –exclude=/etc/sysconfig/network-scripts/* ...
KeyJey's user avatar
  • 61
0 votes
1 answer
278 views

Chain several ssh tunnels

I'm new on this forum. I have the following configuration: my_computer gateway1 gateway2 host_to_reach. I can access gateway1 only with an ssh tunnel which has been created by a server where I have ...
Laurent Mortier's user avatar
2 votes
0 answers
2k views

How to force rsync to stop if destination disk is full?

I am using rsync (version 3.1.0 on a centos) to do some backup task. I develop a software that monitor my rsync processes to fit the backup configuration to my buisness logic. My software launch some ...
Adrien BARRAL's user avatar
0 votes
0 answers
391 views

rsync, symbols not resolved but libraries found

In an embedded system I can't run rsync: $ rsync /usr/bin/rsync: symbol 'poptHelpOptions': can't resolve symbol /usr/bin/rsync: symbol '_poptBitsN': can't resolve symbol /usr/bin/rsync: symbol '...
Mark's user avatar
  • 438
0 votes
1 answer
4k views

Linux rsync without recursive folders

I have a hierarchy of folders and want to rsync the file contents of one to another. So a simple rsync dirA to dirB However without the recursive element it does not include the files in the folder. ...
wcndave's user avatar
  • 103
0 votes
0 answers
168 views

rsync is copying all files

I have 3 servers, two of which share a drive with nfs, and other server and nfs driver share data with rsync. changes made on 3rd server transfered to nfs drive via rsync. earlier it was working fine,...
amit singh's user avatar
1 vote
0 answers
4k views

Problems with rsync and ssh-key

I created a ssh-key to log into my CentOS VPS, altered the default port to 2020 and disabled password connection, so I can only log in this VPS using the key (that need a password to be unlocked). My ...
André Carvalho's user avatar
1 vote
1 answer
1k views

Can rsync use a remote environment variable?

Say I want to use rsync to copy a remote folder to my local desktop: rsync -av remote:$REMOTEDATA $LOCALDATA But I want to access the $REMOTEDATA environment variable on the remote server, not the ...
nsheff's user avatar
  • 205
-1 votes
1 answer
292 views

Linux - Copy a folder including the subfolders, BUT don't copy any file that is over 5MB

I'm managing 2 linux servers and looking to copy the data from one to the other. I'm looking to just copy these files on one server first then zip it and then scp it over. I need to copy a 100GB ...
Patoshi パトシ's user avatar
1 vote
1 answer
61 views

How to make unique dump results?

I am trying to check if my read-only partitions in FreeBSD remains unchanged. I do this using dump: dump -R -h 0 -0Laf /dumps/boot.dump /dev/ufs/boot and then I compute its SHA256. I used -R to be ...
Neyman's user avatar
  • 48
0 votes
1 answer
71 views

cloning hard drive as backup strategy - ensure bootable

I've found a number of similar scenarios on this site and serverfault but still unclear about one thing. Basically I want to rsync from one 2TB drive to another 2TB drive and run this nightly. In ...
Andrew Grothe's user avatar
-1 votes
1 answer
74 views

Ramdisk that persists old files

I've got a program that writes a file to disk, then another processes it. Usually this happens within a second or so, so the file is nearly temporary. To avoid disk IO, I write to /dev/shm. However, ...
MichaelGG's user avatar
  • 119
-1 votes
1 answer
2k views

Rsync --checksum does not catch changed files

I am transferring files from a Linux computer to a Mac. The connection sometimes drops and I restart. This is usually fine, but I check everything for a possible data corruption using md5sum. With ...
jakethedog's user avatar
0 votes
1 answer
2k views

Can I check for multiple file extensions in one rsync filter rules file per line?

I have a working rsync script, which recursively traverses our directory structure and loads one .publish file per directory. Each file contains a list of files to be publish. Publish means to copy ...
Paebbels's user avatar
  • 179
4 votes
2 answers
7k views

Upload only modified part of file using rsync

I am studying rsync to synchronize remote and local folders in windows(using cwrsync). I have a doubt that, is it possible to upload only part of changes ? For example, I have a 100 MB file initially ...
IT researcher's user avatar
0 votes
1 answer
330 views

External drive throwing ATA errors. What's the issue?

I have an SSD in my system and an external hard drive (attached via eSATA) as a backup medium. I use "rsync" to synchronize the internal drive to the external drive. My backup drive was once a Seagate ...
no.human.being's user avatar
1 vote
1 answer
1k views

synology: rsync via ssh requires full path

I found the following behaviour on a Synology RS814+ > ssh backup01 rsync Permission denied, please try again. > ssh backup01 'which rsync' /usr/bin/rsync > ssh backup01 'echo $PATH' /usr/...
jan's user avatar
  • 208
6 votes
1 answer
4k views

How do you get rsync to load a list of (full rules, not limited like --include-from) filter rules from a file?

rsync has various options for reading various config from files so that you don't have to chain a bunch of individual --include or --exclude options together. All of these options (as far as I cantell)...
Tyler Rick's user avatar
1 vote
0 answers
126 views

Rsync check available

Hi i have the following mesh from raspberry pi which is with protocol 802.11s. In a pi5 with an ip 10.0.0.15 i have video capture who makes files in /home/pi/Desktop, And i need to make an arhive in ...
Veselin Marchev's user avatar
0 votes
2 answers
3k views

Starting rsync command on every hour

im new in linux just want to asking you : How to add this command to start every hour on the computer : rsync -a --ignore-existing 130.68.124.219:/home/pi/Desktop/* /home/pi/test/ Thanks
Veselin Marchev's user avatar
1 vote
0 answers
563 views

rsync/scp without root password and without allowing root ssh login

This is the scenario. We have a multitude of servers, currently we simply ssh in as root using our keyfile and then when we need to rsync we use the root user. All very easy. What we would like to ...
DeveloperChris's user avatar
1 vote
2 answers
2k views

Time Machine size explodes when copied to new drive

I'm trying to replace a 640GB USB2 drive which I use as my Time Machine backup device with a 1TB FireWire 400 drive without losing the current backup history. Given that the 640GB drive is nearly ...
rpspringuel's user avatar
0 votes
1 answer
204 views

Is running rdiff-backup or rsnapshot save while source directory is written?

I'm wondering if it's safe to use rdiff-backup or rsnapshot on a source directory which is written to while backup is running. Will they backup a snapshot of source or will they eventually backup ...
jelhan's user avatar
  • 77
1 vote
1 answer
2k views

Why does rsync not create a hard link in my Backup Set?

I am trying to set up an rsync Backup from my Windows pc to my raspi. On the raspi I have an NTFS formatted usb stick. When I sync files to the target everything works fine, except that rsync will not ...
Stefan371's user avatar
11 votes
2 answers
5k views

Unable to rsync to another volume with Git Bash

I use git bash on a windows machine: version 2.7.2 (32-bit version) of Git for Windows built on 2016-02-23 available from https://git-scm.com. Within bash I can copy a directory from /c/ to /e/ (a USB ...
geneorama's user avatar
  • 1,400

1
11 12
13
14 15
28