Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.

learn more… | top users | synonyms

9
votes
2answers
8k views

rsync and symbolic links

I want to backup my home directory to an external drive nightly using a cron job to execute rsync. I am unsure of the exact behavior of rsync's symbolic link flags. rsync's -a flag includes the -l ...
18
votes
4answers
19k views

rsync file permissions on windows

I have an rsync service that syncs files from remote machine to a machine that drops them on a network drive. I need the copied files to take on the native permissions of the destination folder. ...
1
vote
1answer
248 views

Rsync incredibly slow in Cygwin - am I doing something wrong?

I am trying to back up my C: and D: drives (each 1 TB, C: has around 210 GB of data on it, D: has around 345 GB on it) onto a 3 TB external HDD using Cygwin in Windows 8. I am doing this with ...
0
votes
2answers
79 views

two-way sync between mac and unix

I would like to work on a directory on two different macs and have access to a unix server that I ssh into. I would like to just start a script at the end of the day that let's me upload all my ...
0
votes
0answers
26 views

Raising a processes' memory limit on FreeNAS

I am using BackupPC, which is a Free Software backup tool based on rsync for transfers, to back up a FreeNAS box. Recently, with more files being added to the NAS, this has stopped working. I get ...
4
votes
2answers
186 views

Rsync copying current directory with name

I want to copy current directory to my backup directory: I tried this command rsync -a . ~/backup/ but it just copies the current directory contents instead of creating new directory at the ...
0
votes
0answers
14 views

How to manage complexe rsync safely when some files have moved and when the source is not complete?

My use case is the following: one working system unused for a while (say a partialy broken system) a second system with partial copy of system #1 content (say a partial copy because system #2 is ...
0
votes
0answers
178 views

How can I copy my Apple Photos Library and Aperture Library to a new drive preserving the hard links?

Due to low disk space on my internal drive I had to carry out the migration of my 300GB Aperture Library to the new Photos app on an external drive. The libraries currently reside in the following ...
0
votes
0answers
41 views

normal user to rsync between two systems as root

How can I change the user permissions so that the user will be able to rsync between two systems as a root. I added the user in visudo. paru ALL = NOPASSWD: /usr/bin/rsync then I typed the ...
0
votes
1answer
72 views

Rsync delete only remove older source files

Ok, I could probably spend a lot of time writing a complex set of bash scripts that would accomplish this, but I'm hoping this functionality already exists somewhere. I have a device in my car which ...
0
votes
1answer
43 views

Merge .AppleDouble forks with original files

I used to place my iTunes’s media folder on a NAS accessed through AFP and, as you may know, the OS also placed several .AppleDouble files on it. Now, my NAS isn’t working as expected and the only ...
1
vote
1answer
35 views

Rsync ask for password even though I can SSH in without a password using a key

This is the command I'm using: sudo rsync -rvz -e 'ssh -p 1111' ******@111.111.111.111:/home/sql/ /media/disk1/bd92a143-c4d7-4b70-bb6a-6576678fa96b/user/Backups/sql/4-6-2015 Any advice?
0
votes
1answer
23 views

How to rsync a folder and subfolders using filenames only?

I would like to synchronize files from the folder /media/alex/Disk1/Movies to the folder named /media/alex/Disk2/Movies. I want to copy each file from /media/alex/Disk1/Movies or a subdirectory to the ...
0
votes
0answers
23 views

rsync created directory permissions (Windows to Linux)

I am trying to rsync a directory from Windows (cygwin) to a Linux server. After googling a bit, I found out how to properly set the file permission of the remote files. However, the directory that is ...
0
votes
0answers
15 views

rsync --exclude option with wildcards and slashes

I have an rsync command that looks like this: /usr/bin/rsync -e ssh -prLtvz --ignore-errors --progress --exclude "/*/*/*" --stats --chmod=u+rwx,g+rwx,o+rx /foo/bar/baz targetloc:/root_path/dest ...
2
votes
2answers
746 views

How to rsync via gateway ssh?

I want to rsync my local files with a backup which I have on a server which allows access from where I am right now only via a gateway. So I came up with the following rsync -avz -r --stats ...
1
vote
2answers
2k views

Is there an rsync alternative, that stores compressed and encrypted?

I'm looking for a suitable off-site backup / file synchronization solution. Both local client and remote server run linux. Storage space on the server is limited, bandwidth between client and server ...
7
votes
3answers
6k views

RSYNC Does Not Delete Source Directories

I'm using rsync to essential fetch files off a server, then delete the files from the server once I have them locally. The full command I'm running is below. This does successfully delete the files ...
0
votes
0answers
23 views

rsyncd daemon - how to minimize logged information?

I backup my synology NAS to a linux Debian server that runs rsyncd daemon. A typical backup session will write hundreds of thousands useless messages (sample below) to the daemon log file. Q: How can ...
0
votes
0answers
71 views

Rsync with extended attributes

I'm using command rsync -aAX --delete /src/ /dest/ on linux to backup data from samba share to external disk. When rsync backup symlinks for the first time everything goes smoothly, but when I run the ...
0
votes
0answers
79 views

How to do a nightly Rsync from Windows Client to Ubuntu Server with Cygwin and Task Scheduler?

I do this with the OS X machines in the office but I wish to do this with the Windows PC too. On OS X, I created SSH keys and cron jobs to rsync certain folders to specific user folders on our Ubuntu ...
0
votes
1answer
161 views

How to output file sizes in human-readable format in an rsync logfile

I know that the -h option outputs file sizes in human-readable format when, for example, displaying the transfer progress with --progress. But is it possible to get this same file size formatting in ...
0
votes
0answers
28 views

running rsync from vmware player vm using NAT to new server

I have been searching for days. I am trying to run rsync to a new server from a guest VMware Player VM using Ubuntu 14.04 NAT on the host Win7 pro server. I cannot setup a shell connections to the new ...
1
vote
2answers
632 views

How to back up server with rsync, preserving ownership/permissions without root login

I am setting up a backup server on which I want to run rsync over ssh to backup content on other servers every night. I would like to set up ssh keys to make it password-less, but I want to preserve ...
1
vote
4answers
3k views

Rsync root files between systems without specifying password

This seems very tricky to me. I've set up my two systems so that I can rsync files between them as me, without specifying password. Now the the problem is to rsync files that belong to root. On both ...
0
votes
1answer
35 views

How to estimate the time needed for transferring files between internal and external drives?

My laptop usb port is usb 2.0. my external hard drive is usb 3.0. Wikipedia says Due to bus access constraints, the effective throughput of the High Speed signaling rate is limited to 35 MB/s or ...
1
vote
1answer
352 views

File inconsistency… doesn't appear in 'ls -a' but it exists?

I’ve run rsync (3.0.6) on Mac OS X 10.6 (Snow Leopard )to backup a folder form an external hard drive (FAT32) to another external hard disk (FAT32). Somehow certain files (and at times they change!) ...
11
votes
2answers
12k views

rsync --remove-source-files deletes source files one by one or after rsync completes?

I have a rsync command in an application that copies the contents of a folder to another machine. I have the option --remove-source-files because I'm only interested in having the files on the ...
15
votes
4answers
11k views

How to do rsync-like encrypted backup?

I want to save a backup of my data on a remote server, but never want the backup server to see the data unencrypted. Editing a single file and backing up should not result in everything being ...
1
vote
2answers
4k views

rsync permissioning?

I have run the command sudo rsync --chmod=a+rwx testfile testfile2 This creates a file testfile2 but the permissions on it are 755 (-rwxr-xr-x) Can someone explain how to make it so the ...
3
votes
2answers
175 views

Differential copy from Windows to Linux

Is there any way to do differential copies of a directory from Windows to Linux over ssh, sftp, scp, or similar? Preferably not rsync since they are all cygwin based and force you to use the ...
0
votes
0answers
22 views

scp/rsync through a SSH gateway using authorized_keys

My Network layout is similar to the diagram in this post (SCP through SSH gateway connection). With respect to the answer by Ash Vince in that post, I am would like to know if it is possible to ...
1
vote
1answer
117 views

rsync from Solaris to Windows (character encoding on filenames)

I'm trying to use RSYNC to sync files from a Solaris 9 (SunOS 5.9) System to a Windows Server 2008 R2 (via cygwin) There are many Files containing characters like "ä", "ö", "ü" or "ß". Which are only ...
5
votes
1answer
2k views

Unicode Characters in Ubuntu Server

I recently migrated from Ubuntu Desktop 13.04 to Ubuntu Server 13.10 and now my filesystem doesn't seem to support unicode characters. I use rsync to backup/sync files and it shows the proper ...
1
vote
1answer
36 views

How can I quickly compare two directories skipping hard linked files that exist in both directories in linux

I have two directories that I would like to compare. The first directory contains an rsync backup of many thousands of folders and files. The second directory contains hard links to all of the files ...
1
vote
2answers
16k views

rsync cron job with a password?

I want to set up an rsync command as a cron job, so I need to find a way to supply my server password automatically to rsync. Currently I have a shell script that looks like this: #!/bin/sh rsync ...
1
vote
1answer
126 views

How to disable rate limit on SSH connections in UFW?

I've got a dev server to which I constantly sync my code using rsync. To secure the dev server a bit more I now activated UFW, which seems to work fine. The problem is that it works a bit too well, ...
0
votes
0answers
13 views

Bash/Cygwin synchronize two directories

I have small problem with synchronization of two git repositories. In first directory for example localRepo is only two subdirectories: localRepo/ dirA/ dirA1/ ...
0
votes
0answers
91 views

cwrsync on Windows 7 and setting PATH variable

The rsync command rsync.exe -av -riz -e "ssh -p 2222 -i d:/vagrants/rails-dev-box/.vagrant/machines/default/virtualbox/private_key" --delete --delete-excluded --exclude ".git" --exclude "cwrsync.*" ...
0
votes
0answers
85 views

Why is there no difference in file transfer speeds using 802.11ac adapter?

My 2012 MacBook Pro is connected to my Netgear R7000 802.11ac router via 2.4 GHz Wi-Fi connection. I can transfer a large file from my Wi-Fi connected to my iMac using rsync at about 90MB/s. Then I ...
1
vote
1answer
348 views

How can I make hourly backups from my Synology NAS to my LaCie NAS?

I have a Synology DiskStation DS215j and a LaCie Network Space 2. The LaCie has firmware >2.2.3, which allows it to function as an rsync server. Of course, normal network shares are also available. ...
0
votes
0answers
40 views

Rsync over intermediate computer with autossh tunnel

I have two laptops with dynamic IP and I am trying to copy directly from one to the other. Lets call them, worklaptop, homelaptop, workserver Worklaptop has a perminant tunnel to workserver by way of ...
1
vote
1answer
174 views

can we use unix hardlinks on a mounted windows share?

ln command can create hard links on the mounted windows share, but cp -al fails. Is this expected behaviour? I'm trying to save disk space by creating copy on write style backups using cowdancer, ...
0
votes
0answers
8 views

Rsync doesn't respect --exclude-from; --exclude works

Any idea as to what the problem might be? --exclude works just fine, but when I stick the same line in a file and use --exclude-from=that_file, the exclude pattern no longer registers. (==the files do ...
0
votes
1answer
52 views

Use shell provided by non-root user

What is a good way for a non-root user to use an executable that is not in the system's list of shells as if it were the user's actual shell? I'm trying to do this with two different versions of ...
0
votes
1answer
151 views

cannot rsync via ssh from crontab

I'm having issues transferring files with rsync via ssh. If I just run rsync -avz devel@10.10.10.83:/home/devel/ $/home/user/rsync/servidor it works as expected since the public key is stored in ...
1
vote
3answers
4k views

Rsync as another user (www-data)

I usually use a graphical SSH client to sync a local and remote directory. And I have to set the ownership of all the files from root to www-data. Can I do the same with Rsync, only that I do it as ...
0
votes
1answer
29 views

Delete old backups alike Apple Time Machine does

Time Machine saves hourly backups for the past 24 hours, daily backups for the past month, and weekly backups for everything older than a month until the volume runs out of space. At that point, Time ...
1
vote
1answer
20 views

rsync ignoring partition directory

I use rsync to clone my internal hdd to an external disk. My system is Arch Linux. I have two partitions: / /data I am using the following rsync command: rsync -avzxt --progress --delete ...
0
votes
2answers
2k views

Get rsync to skip files with same size

I'm using the following command to copy a large number of big video files to external drives. rsync -Ph --inplace /Volumes/Production/Prefix* Prefix We had a power failure and the copying was ...