Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.

learn more… | top users | synonyms

0
votes
0answers
29 views

Easy, reliable, set-up-and-forget external drive mirror from windows to debian

I bought three external drives, one will be on a windows machine as the file server, and two will be backups, each probably running on a dedicated Raspberry Pi. After reading up on rsync and ...
0
votes
1answer
44 views

Using excludes with rsync

I am trying to use rsync to automatically backup my personal files in /home/usr to an external drive. Of course, my /home/usr directory contains a number of hidden files (for config, etc.), such as ...
0
votes
1answer
230 views

Unicode Characters in Ubuntu Server

I recently migrated from Ubuntu Desktop 13.04 to Ubuntu Server 13.10 and now my filesystem doesn't seem to support unicode characters. I use rsync to backup/sync files and it shows the proper ...
0
votes
0answers
5 views

Rule to combine hide and protect?

I am syncing two drives with rsync --delete-excluded but I would like to ignore-and-not-delete some folders. Now my filter file looks like this: hide ./journal protect ./journal Normally I would do ...
0
votes
0answers
6 views

What are the problems in concurrently syncing files with same name from multiple sources to a directory in rsync?

I am trying to sync the files from multiple sources to a particular directory in my machine. What happens if a file has same name in 2 different sources concurrently? Is there any guarantee that at ...
0
votes
2answers
36 views

Rsync fails to sync flags

I am trying to sync two folders along their extended attributes, however some files are always synced every single time without any apparent reason. Debugging rsync I found out that the remote file ...
1
vote
1answer
162 views

Multiple rsync versions conflict

RSYNC only fails when I try to sync extended attributes (Mac OS X) with the following error. rsync error: protocol incompatibility (code 2) at io.c(599) [sender=3.1.0] rsync: [receiver] write error: ...
9
votes
10answers
4k views

Something like Dropbox for local use with a NAS as storage server

I am looking for a solution to sync folder pairs between a NAS and multiple local macs. Each of the macs could edit files and the other macs should then get synced automatically. Basically my own ...
0
votes
1answer
50 views

Linux shell command to compare two directories and remove dupes

As a part of an app I'm developing, I need to remove any files in directory A that are already into directory B. I thought of rsync but I can't stop it from copying the files missing from source to ...
0
votes
1answer
148 views

Specifying an alternate shell with rsync

I'm using rsync to sync up files between two computers. On one machine, my default shell is set to fish, which breaks rsync ("protocol version mismatch -- is your shell clean?"). Is there a way to ...
5
votes
2answers
1k views

What if files change while rsync is running?

I am using rsync to copy ~10GB of small files. What happens if the files in the source directory are modified while rsync is running?
1
vote
2answers
387 views

Linux: What is the best way to copy from a damaged HD, only the files that can be completely read?

I am copying from a damaged HDD (not SDD) where about 15% files would cause I/O error. I only want the rest of the 85% complete files, and get a list of damanged files. How to do that? cp stops on ...
24
votes
15answers
26k views

Best way to copy millions of files between 2 servers

I have roughly around 5 million small (5-30k) files in a single directory that I would like to copy to another machine on the same gigabit network. I tried using rsync, but it would slow down to a ...
16
votes
3answers
6k views

Resume rsync over SSH after broken connection?

I have to transfer large amounts of data (>80 GB) over ssh using rsync. Everything is working fine, but the DSL connection where the backup data is sent from will drop once every 24h for up to 3 ...
4
votes
2answers
9k views

rsync: failed to set times on “<dir path>”

I am trying to rsync files from one server to another but getting this error rsync: failed to set times on "/dept/intranet/dept/atest/.": Operation not permitted (1) Can someone help me why so ...
2
votes
2answers
1k views

RSYNC Does Not Delete Source Directories

I'm using rsync to essential fetch files off a server, then delete the files from the server once I have them locally. The full command I'm running is below. This does successfully delete the files ...
5
votes
1answer
3k views

Rsync to-check grows during backup

I am currently transferring about 40 Gigs of files from an external disk to my hard drive, and the rsync progress output always shows something like ... to-check=1100/24094) ... to-check=1099/24094) ...
1
vote
1answer
2k views

How to interpret and fix a Input/output error in Linux?

I am running a daily backup with rsync. Starting some days ago, one of the files has been throwing this error during the backup: rsync: read errors mapping "/home/folder/file.ext": Input/output error ...
0
votes
0answers
35 views

Live rsync directory monitor

While developing websites locally on my Mac I would like it to sync with my remote server on changes to the files inside the x directory. I have looked around and found lsyncd which almost does what ...
1
vote
4answers
3k views

Does rsync --inplace write to the entire file, or just to the parts that need to be updated? (for btrfs+rsync backups)

I was reading several guides how combine btrfs snapshots with rsync to make an efficient backup solution with history. However it all depends on if rsync --inplace modifies only those portions of ...
3
votes
2answers
7k views

How to Setup Rsync without password with SSH on UNIX / Linux?

How can I set up a rsync between two hosts without providing any password?
2
votes
2answers
866 views

Bash script: dealing with spaces when running indirectly commands

I have been struggling for a while with the folllowing problems I have written scripts in which any command run is first put into a string, and then executed. That way, the command is written only ...
2
votes
2answers
892 views

Can I use Acronis to create and sync a mirror of my main drive?

Having had a complete disk failure the other day, and spending two days getting everything back to normal (read: i had backups of data, but re-installing apps and a million little configs were the ...
0
votes
1answer
56 views

Scripting with rsync, pulling more than the return status

I have a script to backup my images and alert me to the status of the script which gets run every 5 minutes. However, I want to figure out how to identify when rsync was successful, but didn't do ...
0
votes
0answers
67 views

rsync around a VPN connection on CentOS 6.4

I'm trying to rsync outside of a VPN connection. I have a CentOS 6.4 machine that has an open VPN connection, that capable of roughly 10Mbps, whereas the WAN connection is 40Mbps. I'm trying to rsync ...
1
vote
1answer
127 views

How can I direct rsync output / log to the remote server?

I am able to output rsync logs on the client machine using --log-file=FILE but I want the output to be sent to the server instead. The client is a W7 machine (cygwin) and the server a Linux NAS. This ...
3
votes
1answer
61 views

How can I rename files and subdirectories in a copied directory based on changes in the original?

I have a directory structure with many hundreds of files and folders underneath it for organising files (in this case photos). I create backups of that directory structure by rsyncing it to identical ...
0
votes
1answer
142 views

Error while executing bash command stored in string

Wrote a bash shell script that uses rsync to deploy files to live web server. Right before executing, the script outputs the full command that the my shell script generates: rsync --chmod="ug=rwx" ...
0
votes
1answer
128 views

rsync filter: not finding the filter file

Wrote a shell script to aid me in deployment of website. Everything finally comes together as supposed, but the rsync command refuses to work. rsync --chmod="ug+rwx" -e="ssh" --filter="merge ...
2
votes
0answers
155 views

Rsync fails for files that start with underscore when destination is zfs

I'm using rsync3.1.0pre1 on Mac OS X 10.8.5, and am trying to rsync one folder to another. The destination is a ZFS volume mounted via SMB. The problem I'm having is that files that start with ...
15
votes
6answers
10k views

Parallelizing rsync

I just moved and discovered after some trial and error that somewhere between my home and my remote server, there is some throttling going on...but the throttling is not very intelligent. It only ...
0
votes
1answer
34 views

Does a successful exit of rsync -acvvv s d guarantee identical directory trees?

I have two volumes, one xfs, and another ntfs - ntfs was empty, and xfs had 10 subitems. I needed to sync them. I initially copied a few of the subitems by dragging them over in a gui fm. Several of ...
0
votes
1answer
126 views

Backup files from Linux client to Windows Server

I'm trying to backup my files from my Linux box to my Windows Server 2008 as a push, and when I delete them from my Linux box, they remain on my Windows Server. I've found lots of sources that are ...
0
votes
1answer
47 views

Rsync --backup-dir seems to be ignored

I want to use rsync to backup a directory from a local location to a remote location, and store changed files in another remote location. I did use: rsync -rcvhL --progress --backup ...
13
votes
4answers
4k views

Rsync friendly gzip

I must not be the only one - I'm rsyncing .tar.gz files and notice that every time the full file gets rsynced rather than the differences. Reading into it it seems back in 1999 someone created an ...
0
votes
1answer
119 views

I wanna save some terminal commands in a file

I am using Opensuse 12.3 What I wanna do is, create a link on my desktop for some specific terminal commandos. The backround is, that I do some backup via rsync and don`t wanna type the commandos ...
2
votes
0answers
109 views

External drive has strange files “_*” appearing - culprit is maybe rsync or SMB access?

I'm using rsync to back up folders from my iMac to a WD MyBook and the process seems to leave files such as these: _0O1MN~H.MP4 _2C0X2~3.AVI _ALLYW~B.SRT _VUC69~7 The last one is the most ...
0
votes
1answer
65 views

rsync options to exclude deletes

I backup my files from my desktop to my FreeNAS box with rsync. Here is the command I use: rsync.exe -v -rlt -z --chmod=a=rw,Da+x --delete --exclude="Torrents/Downloads" --exclude="Torrents/Watch" ...
0
votes
1answer
973 views

Permission problems with rsync

I wanna do daily ssh synchronization of some of my local machines files with my server. I want to do this via rsync, since it sounds the most promising tool for this task to me. Sadly I get the ...
1
vote
1answer
254 views

rsync include all directories and certain subdirectories and *.java of the last sub

I am trying to rsync include all directories but only one of each of those subdirectories which contain certain files. For example, rsync -auvz --include '*' --include '*/certain_sub/' --include ...
0
votes
1answer
110 views

Rsync from godaddy to OS X

I would like to use rsync to backup my website to my local computer (OS X). I started of with this guide and got pretty far. I use the following rsync-line: rsync -PzrlptgD --del --delete-excluded ...
0
votes
3answers
727 views

Are periodic full backups really necessary on an incremental backup setup?

I intend to use an old computer I have as a remote backup server for myself and a few other people. We are all geographically separated, and the plan is to do incremental daily backups using rsync and ...
1
vote
1answer
281 views

Fastest way to delete a non empty directory in Linux

I use the command rm -rf directory but i came across the following article : Article That suggests that rsynch to an empty folder is the fastest way? rsync -a –delete empty/ a Why is this the case ? ...
0
votes
2answers
50 views

Sycronizing/deploying scripts across several systems

I have a few time consuming tasks that I like to spread across several computers. These tasks require running an identical ruby or python script (or series of scripts that call each other) on each ...
1
vote
1answer
77 views

rsync backup messes up permissions on files

I use rsync backup on my Android device to backup some files from my device to my *nix server. It sort of works, except the target directory and all files under it have their file mode flags set to ...
0
votes
1answer
1k views

How to remove/delete a vanished file?

[macek ~]$ rysnc -av /src /dest building file list ... file has vanished: "/src/file.ext" This will not generate error: [macek /src]$ rm file.ext Also strange: [macek /src]$ fi Tab The path will ...
3
votes
3answers
455 views

Enter password only once for a script that uses rsync and SSH

I am trying to write a script that pushes a website to my server, where the website files are on my local machine for testing. It works now, by using rsync to update the server, then ssh to get the ...
2
votes
4answers
5k views

How to print Linux command output to a file?

I am creating a script to sync my important documents between two system. I want my script to generate a log file for the last action. can you suggest me a way to achieve this. Question: If I execute ...
0
votes
1answer
126 views

Can't get rsync to sync two external harddrives

I'm trying to use rsync to copy files from one external HDD to another external HDD. I use the following commands rsync -rv --exclude=.DS_Store ~/Volumes/Backed /Volumes/Hero where Backed is the ...
2
votes
4answers
2k views

Sync desktop Mac environment to laptop

I spend the majority of my time working at my desktop Mac, which I have configured for my web development environment. My spouse has a MacBook for casual use, and I occasionally steal it back when I ...