Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.

learn more… | top users | synonyms

0
votes
1answer
204 views

File sync solution with pattern matching

I have a directory I want to sync over the cloud using a service like Dropbox. But, within that folder, I only want to sync directories that match a particular pattern. For instance, sync all folders ...
3
votes
2answers
174 views

Differential copy from Windows to Linux

Is there any way to do differential copies of a directory from Windows to Linux over ssh, sftp, scp, or similar? Preferably not rsync since they are all cygwin based and force you to use the ...
0
votes
1answer
47 views

rsync not skipping untouched files

I transferred about 300GB of files with scp from one server to another. Sadly I forgot the -r option, so part of the files that were in subdirectories were not copied. I verified that the files that ...
0
votes
1answer
40 views

Rsync only files from specific user

Is there a way to rsync only files from a certain user? I have a folder which contains files from multiple users but would only like to backup files from a particular user. I've looked at the man ...
1
vote
1answer
81 views

rsync expanding remote directory with local username?

I am new to rsync but attempting to setup a backup server. User names follow this basic idea: remote user: computer local user: computer-bkup. When I run $ rsync -avz -e ssh ...
0
votes
0answers
54 views

Rsync delete issue

I implemented rsync to backup the data from the server to my local machine,and done it regularly by cron. It works fine but yesterday it deletes the files from the folders on my local machine but on ...
1
vote
1answer
147 views

My Backups are all flocked up

I have cron job that runs an rsync command that does a remote backup every two hours. In the event that the previous remote backup is still running, I've encapsulated this rysnc command inside of a ...
0
votes
1answer
227 views

Using excludes with rsync

I am trying to use rsync to automatically backup my personal files in /home/usr to an external drive. Of course, my /home/usr directory contains a number of hidden files (for config, etc.), such as ...
5
votes
1answer
2k views

Unicode Characters in Ubuntu Server

I recently migrated from Ubuntu Desktop 13.04 to Ubuntu Server 13.10 and now my filesystem doesn't seem to support unicode characters. I use rsync to backup/sync files and it shows the proper ...
0
votes
2answers
105 views

Rsync fails to sync flags

I am trying to sync two folders along their extended attributes, however some files are always synced every single time without any apparent reason. Debugging rsync I found out that the remote file ...
1
vote
1answer
511 views

Multiple rsync versions conflict

RSYNC only fails when I try to sync extended attributes (Mac OS X) with the following error. rsync error: protocol incompatibility (code 2) at io.c(599) [sender=3.1.0] rsync: [receiver] write error: ...
0
votes
1answer
64 views

Linux shell command to compare two directories and remove dupes

As a part of an app I'm developing, I need to remove any files in directory A that are already into directory B. I thought of rsync but I can't stop it from copying the files missing from source to ...
0
votes
1answer
1k views

Specifying an alternate shell with rsync

I'm using rsync to sync up files between two computers. On one machine, my default shell is set to fish, which breaks rsync ("protocol version mismatch -- is your shell clean?"). Is there a way to ...
1
vote
2answers
1k views

Linux: What is the best way to copy from a damaged HD, only the files that can be completely read?

I am copying from a damaged HDD (not SDD) where about 15% files would cause I/O error. I only want the rest of the 85% complete files, and get a list of damanged files. How to do that? cp stops on ...
7
votes
3answers
6k views

RSYNC Does Not Delete Source Directories

I'm using rsync to essential fetch files off a server, then delete the files from the server once I have them locally. The full command I'm running is below. This does successfully delete the files ...
3
votes
1answer
15k views

How to interpret and fix a Input/output error in Linux?

I am running a daily backup with rsync. Starting some days ago, one of the files has been throwing this error during the backup: rsync: read errors mapping "/home/folder/file.ext": Input/output error ...
4
votes
4answers
5k views

How to arbitrarily map user/group ownerships in rsync

I need to rsync a directory to a remote server so that all files belonging to user X and group Y on the source (local) machine are mapped to user W and group Z on the destination (remote) machine. If ...
0
votes
1answer
308 views

Error while executing bash command stored in string

Wrote a bash shell script that uses rsync to deploy files to live web server. Right before executing, the script outputs the full command that the my shell script generates: rsync --chmod="ug=rwx" ...
0
votes
1answer
387 views

Scripting with rsync, pulling more than the return status

I have a script to backup my images and alert me to the status of the script which gets run every 5 minutes. However, I want to figure out how to identify when rsync was successful, but didn't do ...
3
votes
1answer
115 views

How can I rename files and subdirectories in a copied directory based on changes in the original?

I have a directory structure with many hundreds of files and folders underneath it for organising files (in this case photos). I create backups of that directory structure by rsyncing it to identical ...
3
votes
0answers
578 views

Rsync fails for files that start with underscore when destination is zfs

I'm using rsync3.1.0pre1 on Mac OS X 10.8.5, and am trying to rsync one folder to another. The destination is a ZFS volume mounted via SMB. The problem I'm having is that files that start with ...
0
votes
1answer
474 views

rsync filter: not finding the filter file

Wrote a shell script to aid me in deployment of website. Everything finally comes together as supposed, but the rsync command refuses to work. rsync --chmod="ug+rwx" -e="ssh" --filter="merge ...
0
votes
1answer
134 views

Rsync --backup-dir seems to be ignored

I want to use rsync to backup a directory from a local location to a remote location, and store changed files in another remote location. I did use: rsync -rcvhL --progress --backup ...
2
votes
1answer
935 views

How can I direct rsync output / log to the remote server?

I am able to output rsync logs on the client machine using --log-file=FILE but I want the output to be sent to the server instead. The client is a W7 machine (cygwin) and the server a Linux NAS. This ...
2
votes
0answers
218 views

External drive has strange files “_*” appearing - culprit is maybe rsync or SMB access?

I'm using rsync to back up folders from my iMac to a WD MyBook and the process seems to leave files such as these: _0O1MN~H.MP4 _2C0X2~3.AVI _ALLYW~B.SRT _VUC69~7 The last one is the most ...
1
vote
2answers
5k views

Permission problems with rsync

I wanna do daily ssh synchronization of some of my local machines files with my server. I want to do this via rsync, since it sounds the most promising tool for this task to me. Sadly I get the ...
0
votes
1answer
215 views

Rsync from godaddy to OS X

I would like to use rsync to backup my website to my local computer (OS X). I started of with this guide and got pretty far. I use the following rsync-line: rsync -PzrlptgD --del --delete-excluded ...
3
votes
1answer
554 views

Fastest way to delete a non empty directory in Linux

I use the command rm -rf directory but i came across the following article : Article That suggests that rsynch to an empty folder is the fastest way? rsync -a –delete empty/ a Why is this the case ? ...
1
vote
3answers
2k views

Are periodic full backups really necessary on an incremental backup setup?

I intend to use an old computer I have as a remote backup server for myself and a few other people. We are all geographically separated, and the plan is to do incremental daily backups using rsync and ...
1
vote
1answer
594 views

rsync include all directories and certain subdirectories and *.java of the last sub

I am trying to rsync include all directories but only one of each of those subdirectories which contain certain files. For example, rsync -auvz --include '*' --include '*/certain_sub/' --include ...
1
vote
2answers
336 views

Why does my rsync server on windows always set the read-only flag when I write to it?

I'm using cwrsync on windows. This is my daemon config file use chroot = false strict modes = false hosts allow = * log file = rsyncd.log pid file = rsyncd.pid port = 11011 # Module definitions # ...
1
vote
1answer
316 views

Backup files from Linux client to Windows Server

I'm trying to backup my files from my Linux box to my Windows Server 2008 as a push, and when I delete them from my Linux box, they remain on my Windows Server. I've found lots of sources that are ...
0
votes
2answers
75 views

Sycronizing/deploying scripts across several systems

I have a few time consuming tasks that I like to spread across several computers. These tasks require running an identical ruby or python script (or series of scripts that call each other) on each ...
0
votes
2answers
79 views

two-way sync between mac and unix

I would like to work on a directory on two different macs and have access to a unix server that I ssh into. I would like to just start a script at the end of the day that let's me upload all my ...
1
vote
1answer
306 views

rsync backup messes up permissions on files

I use rsync backup on my Android device to backup some files from my device to my *nix server. It sort of works, except the target directory and all files under it have their file mode flags set to ...
0
votes
1answer
267 views

Can't get rsync to sync two external harddrives

I'm trying to use rsync to copy files from one external HDD to another external HDD. I use the following commands rsync -rv --exclude=.DS_Store ~/Volumes/Backed /Volumes/Hero where Backed is the ...
1
vote
2answers
293 views

Is there an rsync equivlent of .gitignore?

I have a file that should never be synced in a directory that will be rsynced often. Rather than relying on --exclude (and my ability to remember to use it), can I tell rsync to ignore the file in a ...
0
votes
1answer
73 views

Does a successful exit of rsync -acvvv s d guarantee identical directory trees?

I have two volumes, one xfs, and another ntfs - ntfs was empty, and xfs had 10 subitems. I needed to sync them. I initially copied a few of the subitems by dragging them over in a gui fm. Several of ...
0
votes
1answer
418 views

Will the option NOATIME in /etc/fstab ruin my Unison synchronizations?

I read here in ArchWiki that the option noatime can improve hard disk performance and durability: The use of noatime, nodiratime or relatime can improve drive performance. Linux by default uses ...
4
votes
2answers
566 views

How can completely back up my linux computer so that it can be fully restored easily?

I want to be able to blindly back up my entire hard disk, so that I can blindly and automatically restore in case there is any problem. I am not interested in merely backing up data, but specifically ...
0
votes
1answer
542 views

Caveats with gzip --rsyncable - no speedup

I am using (trying) gzip to compress an SQL file in an rsyncable way in order to transfer the backup with minimal delay. However it appears that this is not working, since the speedup is always 1.00. ...
1
vote
2answers
5k views

What is more efficient / faster, rsync compression or ssh compression?

I currently rsync files: (i) locally and (ii) remotely over WAN (connection c. 8mbps down / 1.5mbps up). I am considering adding to rsync: -z to compress files. Or alternatively adding to ...
1
vote
0answers
61 views

Running a symlink locally

I am running the same program multiple times over a linux platform. It is compiled at another server, and frequently updated, and it's uploaded over through rsync to all "hosting" servers, which do ...
3
votes
2answers
304 views

restrict rsync (or bash script) to a directory

After a bad accident with rsync deleting wrong files due to wrong destination parameter, I want to restrict rsync (or the bash script running it) to be able to delete/modify files only under a certain ...
1
vote
3answers
758 views

Moving files over SSH and delete on source after successful final copy

I have a folder of ~200 000 files with a total size around 300 GB that I need to transfer over an SSH connection to a remote host. I'm looking for a way to have the local files deleted after it's been ...
1
vote
1answer
641 views

Bash script fails from Windows 7 task scheduler

In order to use rsync I created a Bash script. It runs fine from the Cygwin 32-bit shell in Win 7 but fails when run from the Win 7 Task Scheduler. My Task Scheduler script is a simple: ...
0
votes
1answer
87 views

Copying Thousands of Files on the same HD

I found myself in a situation I am copying an entire filesystem across two different HD partitions (different sizes and filesystem types). The problem so far is taht both cp and rsync will read a ...
2
votes
1answer
156 views

rsync via gateway ssh while defining .pem key

I need to sync my local files through a gateway to an Amazon EC2 instance that requires specifying my .pem key. I can do this as a three step like so (assuming no typos): rsync -avzh -e ssh ...
2
votes
1answer
4k views

Permission denied using Rsync as root

All topics that I've come across involved rsync over ssh or rsync using a user with restricted access. I'm getting permission denied (13) errors as root. Here are my config files: /etc/rsyncd.conf: ...
16
votes
3answers
1k views

Moving 2TB (10 mil files + dirs), what's my bottleneck?

Background I ran out of space on /home/data and need to transfer /home/data/repo to /home/data2. /home/data/repo contains 1M dirs, each of which contain 11 dirs and 10 files. It totals 2TB. ...