Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.

learn more… | top users | synonyms

2
votes
1answer
16 views

Understanding rsync's include / exclude patterns

I want to transfer N files from a remote system, using a pattern: ssh remote ls target/ 2013-08-01.mjson.gz 2014-07-04.mjson.gz 2014-07-09.mjson.gz 2014-08-12.mjson.gz ... I only want the 2014-07* ...
0
votes
0answers
15 views

Is there a tool for syncing changes to individual nodes within HDF5 files?

I'm looking for a tool for efficiently syncing large scientific datasets in HDF5 format: Each file is ~20-30GB in size and contains many large floating point arrays, which are usually chunked and ...
0
votes
1answer
20 views

rsync and symbolic links

I want to backup my home directory to an external drive nightly using a cron job to execute rsync. I am unsure of the exact behavior of rsync's symbolic link flags. rsync's -a flag includes the -l ...
0
votes
0answers
23 views

Backup certain folders to NAS with exFat

Hello everybody who has the same problem, trying to help or just reading! Recently I've bought one of IcyBox IB-NAS5520 NAS with 2 x 1TB drives in raid1. I've tryed to follow this idea: How to set ...
0
votes
1answer
16 views

automatic file encryption on NFS or RSYNC for remote incremental backup?

What solutions should I be looking at to allow an incremental backup via rsync over nfs4 to allow files to be encrypted on the backup host? I have zero control over the backup host's software so the ...
0
votes
0answers
9 views

Check if file is being read by remote rsync

I'm working on a script to copy files from one location to another (both are raspberry pis running raspbian). I have it set so that files are rsynced from one to the other (overnight, transferring ...
2
votes
2answers
69 views

Command line cp or rsync to crawl drive seeking only specific file types and put them somewhere?

Is it possible only using the command line to use something like the cp or rsync command to crawl a hard-drive seeking only image/video files? And maybe in the process of copying them over to another ...
0
votes
1answer
23 views

move files from a list of files

So, I have a list of files in a text file. I believe it's about 100,000 files. The files in said list are spread across many directories, have different sizes, filenames, extensions, ages, etc. I am ...
0
votes
2answers
38 views

CygWin rSync can't access file folder on Windows 7 with Vagrant

Facts- Machine is connected to domain User is a domain user Windows 7 running Cygwin with SSH / Rsync set up multiple times Running the rsync command from Cygwin finds the directory "c:\code" just ...
0
votes
0answers
7 views

Different low uplink machines hold the same data, how to speed up rsync to machine with faster connection?

Two different machines hold the same data (10G+), both with relatively slow upload. I want to transfer the data to a machine that can receive with a much faster speed. Now to speed up transfer of ...
0
votes
0answers
10 views

rsync over ssh tunnel: What does this repeated message mean? debug2: channel 2: window 1966080 sent adjust 131072

I'm rsyncing through an SSH tunnel (with ssh -vv). It's not very fast and I'm getting this message about every second: debug2: channel 2: window 1966080 sent adjust 131072 Once in a while I also ...
0
votes
1answer
26 views

Source host doesn't have access to Internet, but can SSH to host that has; how can I rsync to a third, Internet host?

This is the command I used to run from my SOURCE machine rsync -Rrlt --progress --delay-updates ./my_folder root@machine-on-same-network:/home/me/. Now I need to copy over this same folder to a ...
0
votes
0answers
27 views

Rsync and find filter

I'm trying to use rsync in combination with find to restrict the number of files to copy. My code looks like this: for NODE in $NODES; do echo Processing $NODE ........ for LOGDIR in ...
1
vote
0answers
24 views

Rsync doesn't allow me copy files into mounted filesystems

I configured rsyncd.conf for public access in my rpi: log file = /var/log/rsyncd.log timeout = 600 max connections = 20 uid = nobody gid = nogroup read only = yes list = yes [public] path = ...
0
votes
0answers
24 views

Syncing a static website via WebDAV?

I am running a static website at office and the sysadmins only allow updates through WebDAV(s) (Secure WebDAV) protocol. So, I have a local copy of the files' website on my machine and I upload the ...
0
votes
0answers
19 views

Trying to rsync and use sudo on other end

Scenario: Mac OS X Machine - old computer - user: john.doe Mac OS X Machine - new computer - user: john.doe Goal: Copy /Users/john.doe/Desktop and /Users/john.doe/Documents via rsync Problem: ...
0
votes
2answers
25 views

Syncing directory between Kubuntu and Windows 7

I recently came across an issue on my work computer. I'm running Kubuntu 14.04 as my main development OS and Windows 7 for compatibility with some company software and network stuff. My problem is ...
0
votes
0answers
14 views

Secure copy one folder to multiple destinations in OS X

Sorry for asking what looks like a question that's been asked a few times. I'm very far from being a super user, which makes it very difficult for me to be able to expand on a relatively complex ...
0
votes
1answer
31 views

Do GUI and Terminal execution (of Back In Time/Grsync/other Linux apps) produce the same results?

I've opened Back In Time GUI and copied the whole rsync ... line from the last log into Terminal and executed it in Terminal. Question #1 is: if I were to do it the normal way (click 'Take snapshot' ...
0
votes
0answers
14 views

Terminal 2 way ftp sync

I am looking for a way to sync a directory/path on my computer with an ftp server so that all the files that are newer will be copied and will replace the old files. The files that have been created ...
3
votes
1answer
35 views

Using pv(1) to limit rsync speed

I'm trying to use pv rather than rsync's builtin --bwlimit to limit the bandwidth of an rsync transfer because --bwlimit is implemented in an eventually-consistent way, and my transfers are so short ...
0
votes
0answers
40 views

Synology NAS resume rsync backup after connection loss

I am trying to do a backup from a synology NAS to an offsite NAS. I am using rsync through DSM5 as of now, but it doesn't give me the possibility to resume the backup if a connection loss occurs. This ...
1
vote
2answers
34 views

How can I rsync a set of subdirectories?

I have a source directory that looks like the following (with numerous subdirectories inside of the src and bin dirs): top_dir proj1 src/ bin/ scripts/ somefile.txt proj2 src/ bin/ target bin/ ...
1
vote
1answer
30 views

Rsync transfers everything instead of changed

I have tried many many different combinations of rsync commands, but whatever platform I use it on, from whatever source to whatever destination. It always transfers everything no matter if it's ...
0
votes
1answer
22 views

rsync --backup-dir not getting changed data - instead it is going to the original backup location

I'm not sure why this is not working as expected. I have a full rsync backup of /scripts/source in /scripts/full and want to put differential backup into /scripts/diff However, when a file is added ...
1
vote
1answer
35 views

Find files with different inodes in same directory structure

We have a slight problem with our backups. Our setup is as follows: We create a backup using the rsync command. The backup uses the option --link-dest option, to create incremental backups with ...
0
votes
1answer
84 views

File synchronization between two Linux servers

We have a two web servers running CentOS. We need to sync images that users uploaded. No servers should be needed to synchronize those, because we need to handle failover. Also, we need to do a ...
0
votes
1answer
22 views

Transfer to a remote machine, trouble with hostname

I'm connected to a remote host via SSH, I've read the rsync page and I understood that to transfer a file from my local machine to the remote host I have to do rsync myHostname:path/to/file ...
0
votes
0answers
103 views

How to always let rsync continue when (permission denied) error occurs

The following error happened with a rsync task. rsync: send_files failed to open "/home/user/scripts/@eaDir/script.js@SynoEAStream": Permission denied (13) rsync error: some files/attrs were not ...
0
votes
0answers
29 views

Rsync for backup

I think I'm using rsync wrong as it appears to be backing up unchanged files I ran it yesterday and it's backup up again when I run today instead of skipping them. Why? EDIT Trying to back up to a ...
1
vote
2answers
185 views

Properly escaping forward slash in bash script for usage with sed

I'm trying to determine the size of the files that would be newly copied when syncing two folders by running rsync in dry mode and then summing up the sizes of the files listed in the output of rsync. ...
0
votes
0answers
393 views

Can't git push to Bitbucket.org — with ssh keys

I'm running doku-wiki on may (Ubuntu) laptop for some note taking. So, to keep backup, I was using Bitbucket and periodically pushed my wiki files there and everything worked smoothly. (a) Some time ...
0
votes
1answer
22 views

rsync per-site configuration file?

I know how to configure a per-site entry for ssh, but is there any kind of a client configuration for rsync that allows per-site configuration options and aliases or similar shortcuts like the ...
1
vote
1answer
23 views

Will an rsync copy operation “fix” issues with invalid file block counts, or does it preserve everything exactly as the source?

Here are the events surrounding my question, which may make things more relevant: I had a hard drive fail recently, to the point where neither Disk Utility or asr could fix the structure to a ...
0
votes
0answers
16 views

rsync stops at client version

I try to get rsync working between a freeSSHd Windows Server and Windows, Mac and Linux Clients. Current if I execute on Linux: rsync --progress -vvvvzrlt -e ssh myusername@10.254.0.108:/c/mypath ...
1
vote
1answer
98 views

rsync to windows (cygwin)

We have a windows file storage (don't ask) and now I want to rsync with the machine from Windows, Mac and Linux. So I installed freeSSHd (login shell is set to C:/cygwin64/bin/sh.exe), set up ...
0
votes
0answers
35 views

rsync seems to overwrite already existing file on ExFat

I have a curious behavior from rsync between two hard drives containing the exact same four partitions. However on one partition rsync seems to always copy again the files, I don't understand why. ...
0
votes
2answers
40 views

Could server's support of RSync speed up backup process?

I have Synology 210j NAS, which supports rsync. Currently this feature is disabled and I use the following code to backup data there from my Mac: mkdir /Volumes/BackupTemp mount -t smbfs ...
0
votes
3answers
53 views

How to write files in specific order?

Okay, here's a weird problem -- My wife just bought a 2014 Nissan Altima. So, I took her iTunes library and converted the .m4a files to .mp3, since the car audio system only supports .mp3 and .wma. ...
0
votes
0answers
83 views

File transfer tools for linux with support of zero-copy transfer

Are there small and simple file transfer tools for Linux, which can use "zero-copy" style of transferring files from HDD (SSD) to tcp socket, and back? I want to often send huge amount of ...
1
vote
1answer
50 views

Setting up Debian server for remote backups

I am running a Debian Wheezy server at home, and am offering an organization to let them do rsync backups to their own folder on my system. I created the unique user for them, and got a strong ...
1
vote
1answer
153 views

How to speed up data transfer between Portable HD and NAS (QNAP)?

I am trying to transfer data from a Western Digital USB2 Drive to a QNAP TS-212E. I am transfering the data between the portable HD and the NAS using rsync (see following command). rsync -v -r -h ...
0
votes
1answer
90 views

ntfs disk dying or..? rsync and mkdir failing, strange behavior

System root@host:~# uname -a Linux host 3.2.0-4-686-pae #1 SMP Debian 3.2.57-3+deb7u1 i686 GNU/Linux Mounts root@host:~# mount | tail -2 /dev/sda1 on /mnt/sda1 type ntfs ...
0
votes
0answers
38 views

Win7 -> Linux cannot seem to copy large file without errors

I have a 70 GB file I am trying to copy from a Windows 7 machine to a Linux Mint 16 machine over a network, and I don't seem to be able to get the MD5 sums to match afterwards. I've so far tried two ...
0
votes
1answer
13 views

rsync exclude config.js but include lib/project/config.js

I have a folder like this / config.js /lib /project config.js In the root directory I execute rsync rsync -azvr --exclude config.js --include lib/project/config.js . dest The ...
3
votes
1answer
71 views

How to control permissions on external USB hard disk

I'm using RHEL 6.5, andhave an auto-mounted external USB drive. Any and all files created in the mounted filesystem are given permission 700 for dirs and 777 for files. The chmod command does not ...
0
votes
1answer
83 views

Make rsync update existing files first, create new ones later?

I have a source directory which I'm periodically syncing to a target using rsync: rsync --bwlimit=1600 --recursive --times --omit-dir-times --copy-links --modify-window=30 --inplace ...
1
vote
0answers
208 views

rsync failed: No Such file or directory

I'm using rsync in Windows ( through cygwin64 ) to backup some data to an samba share. I've made this bat file that would take care of everything: net use S: \\10.1.1.23\marc password /user:marc ...
0
votes
0answers
11 views

Using an SD card for regular backups? [duplicate]

I recently updated to a 128 GB solid state drive, and I've gotta say, I love the boot times and app load times, however I'm not keen on the increased possibility of spontaneous failure. I figure I've ...
0
votes
1answer
63 views

How to make rsync completely ignore permission from source

I'm trying to use rsync to copy from an Android source where the sdcard mount has rather nonsensical permissions (---rwxr-x) and rsync fails because it creates the destination directories with the ...