Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.

learn more… | top users | synonyms

1
vote
2answers
20 views

Copy multiple sources to multiple destinations simultaneously

Suppose I need to copy files ~/path/to/file to user@remote:/path/to/file ~/path/to/another/file to user@remote:/path/to/another/file ~/path/alternative to user@remote:/path/alternative Is there is ...
26
votes
17answers
35k views

Best way to copy millions of files between 2 servers

I have roughly around 5 million small (5-30k) files in a single directory that I would like to copy to another machine on the same gigabit network. I tried using rsync, but it would slow down to a ...
1
vote
2answers
2k views

rsync fails after server restart

Usually I use the command rsync -av --delete someroot/somedir user@remote_server_ip:/someroot/. on my development server to synchronize somedir to a remote server. It worked fine. But after the ...
1
vote
1answer
2k views

Rsync and Windows 7

Can someone give me any tips on setting up some sort of Rsync server/client on Windows 7 to run rsync between both my web hosting server, and a backup server that I have running Ubuntu? I've tried ...
2
votes
3answers
3k views

Any faster scp or rsync?

How can I transfer a large file quickly, when I don't really require a secure connection? Often I would like to copy a large file from local machine to remote machine. The file does not already ...
1
vote
2answers
32 views

Copy ubuntu from one PC to another

I have a very weird scenerio here, I have installed some softwares on my Ubuntu machine, Now I want to move everything (including windows)to another Machine B, notice Machine has no access to Internet ...
0
votes
1answer
20 views

Google Compute Engine - SSH or RSYNC without a Password

I have several Google Compute Engine (GCE) instances up and running. I have a few scripts that pull information (log files, etc) from these instances, and a few others that push up files. I would like ...
0
votes
0answers
11 views

Mac backup / sync software [on hold]

I'm looking for a mac program that would allow me to work following way: Keep all my files on Windows/Samba Share (on Synology NAS device that can also act as rsync server). When I need to work on ...
3
votes
1answer
1k views

rsync between two local directories

I am trying to do rsync between two directories I have in two filesystems connected to the same computer. I want to do it without deleting the extra files in b. I though a simple rsync -a a/dir b/dir ...
0
votes
0answers
11 views

Resume SCP download when using .pem file with rsync

I have a large file to down form a ssh server, however the connection keeps cutting out. I know that rsync can be used to resume the download however I can not find how to do this when I am using a ...
0
votes
1answer
2k views

How to set/keep directory permissions?

I'm using CwRsync to connect from my Windows development machine to a linux webserver : rsync -avuz -e ./ssh --exclude=".svn" /cygdrive/c/xampp/htdocs/project123/ ...
5
votes
3answers
6k views

rsync - does it create a temp file during transfer?

As far as I can see rsync doesn't create the file in the target directory until it is complete. This must mean that it creates the file in a temp directory somewhere and copies the file into the ...
-1
votes
0answers
11 views

Automatically pauseing rsync if target is full

I need to transfer 80gb's of unsorted text documents from one computer to another and all I have is a 32gb USB. Is there an option to make rsync automatically pause when the USB is full without losing ...
0
votes
0answers
11 views

rsync a git project to clone it for the first time?

I want to use Git to version our existing magento shop. I initiated git on the production server (which has the most up-to-date code), added all files except for several directories like cache, and ...
1
vote
0answers
24 views

rsync from Solaris to Windows (character encoding on filenames)

I'm trying to use RSYNC to sync files from a Solaris 9 (SunOS 5.9) System to a Windows Server 2008 R2 (via cygwin) There are many Files containing characters like "ä", "ö", "ü" or "ß". Which are only ...
2
votes
2answers
1k views

Rsync to multiple directories with one command?

I want to rsync my working directory to two other directories. One would destination would be for backup, another for testing it. I tried this: rsync -av --exclude='.git' source dest1,dest2 But ...
43
votes
16answers
56k views

How to synchronize the home folder between multiple computers?

I have three computers at home, and would like to have the /home/ folder tree synchronized between the three. Any files/folders (except those hidden) that are modified/added/removed in one of the ...
1
vote
2answers
3k views

Permission problems with rsync

I wanna do daily ssh synchronization of some of my local machines files with my server. I want to do this via rsync, since it sounds the most promising tool for this task to me. Sadly I get the ...
0
votes
1answer
2k views

How to remove/delete a vanished file?

[macek ~]$ rysnc -av /src /dest building file list ... file has vanished: "/src/file.ext" This will not generate error: [macek /src]$ rm file.ext Also strange: [macek /src]$ fi Tab The path will ...
0
votes
0answers
7 views

Is cp -au / cp --archive --update contradictory?

I want to update a directory on a backup disk with new content added to the source, and of course rsync is too slow. cp -a does the trick but is a bulldozer; cp -u should leave existing files alone. ...
2
votes
1answer
2k views

Rsync to a WebDAV filesystem on OS X copies all files regardless of being changed or not

I am trying to sync from my (Mac) desktop to an iPad and an iPhone. MacOS X mounts WebDAV as a native file system, but syncing results in all files in my directory structure being copied again. This ...
0
votes
2answers
4k views

rsync option --log-file seems is not working

I am using the --log-file option in rsync to see the logs. But when I tried to run, it says: --log-file unrecognized option Here is my command: #/usr/bin/rsync -av -u ...
8
votes
3answers
5k views

Why cwRsync doesn't work on Windows?

I'm trying to run rsync on Windows with the cwrsync port. I'm issuing the following command (note that this is just a dry run): rsync -nPaAz foouser@webxx.example.com:/home/foobar/webapps/barbaz/ ...
2
votes
1answer
25 views

What are the rsync equivalent command/s to mv /a/b /c/d?

What are the rsync equivalent command/s to mv /a/b/ /c/d/, i.e, to move a directory tree from one location to another, possibly on another file system? That is, not just copy, but delete the files ...
2
votes
2answers
4k views

How do I replicate the directory structure to a remote Linux server?

I want to replicate a complex directory structure from one Linux server to another remote server start at a certain sub-directory. I don't want the contents of the files, I just want to preserve the ...
9
votes
10answers
5k views

Something like Dropbox for local use with a NAS as storage server

I am looking for a solution to sync folder pairs between a NAS and multiple local macs. Each of the macs could edit files and the other macs should then get synced automatically. Basically my own ...
1
vote
0answers
14 views

rsnapshot or similar tool for no added size differential backup

I've currently got a backup that backs up all my files to an external hard drive, but currently I am traveling and I want to backup file changes, but without having to duplicate all the files, or ...
0
votes
1answer
55 views

Prevent rsync out of memory

I am trying to rsync 55000 jpg files in 10000 folders (from an Android phone to a Linux box). Usually, I did this: rsync -rOi --size-only --delete --timeout=60 --progress --no-perms ...
0
votes
2answers
285 views

How to intelligently sync two directories under OSX

This may seem like a simple request at first glance, but I believe it is not due to some critical subtleties I wish to keep track of. Here is the scenario: I have a directory on my home workstation, ...
0
votes
0answers
6 views

Improve accuracy of rsync's speed reporting

I am doing an rsync from a local SSD (super-fast) to a samba NAS (super-slow). When I sync (e.g.) ~400MB files, it seems to read the first entirely into memory before it does any writing, and thus I ...
0
votes
2answers
32 views

How to migrate a root filesystem to another partition from within running system?

I try to migrate a root filesystem from ext4 to another partition type (zfs) and started with a simple rsync -a --exclude=/boot --exclude=/mnt --exclude=/media --exclude=/tmp --exclude=[all zfs ...
0
votes
0answers
15 views

How to tell if a directory is completely synced by rsync?

I'm rsync'ing some directories from one machine to another, in a cronjob. Each directory is complete set of data files. On the destination machine, is there a sane way to tell if a directory is ...
0
votes
0answers
11 views

Periodic backup of changes on another disk from full backup

I am looking for a backup solution that will enable me to backup only changes to an internal disk after a full backup to an external disk. Also, this should run snapshot backups every day until the ...
0
votes
1answer
47 views

Merging two directory trees with same structure, but different contents in Unix

I have two directories with the following structure: A |_0 |_1 |_2 B |_0 |_1 |_2 each 0,1,2 directory contains unique contents. I want all of the contents to simply exist as: A |_0 |_1 |_2 Is ...
7
votes
5answers
22k views

What similar rsync tool for Windows? [closed]

What can you recommend of an application that looks the same on rsync for windows? I will be doing migration where I need to transfer data from Windows to Linux. I like the rsync on linux where you ...
2
votes
0answers
164 views

External drive has strange files “_*” appearing - culprit is maybe rsync or SMB access?

I'm using rsync to back up folders from my iMac to a WD MyBook and the process seems to leave files such as these: _0O1MN~H.MP4 _2C0X2~3.AVI _ALLYW~B.SRT _VUC69~7 The last one is the most ...
3
votes
2answers
85 views

How to use rsync to make a copy of a huge source split into two destinations?

I have 3 drives. For this purpose, we will call them A, B and C respectively. A is 2 TB B is 1 TB C is 500 GB I have already run rsync -avz -progress A B Now B is full and I want to move/copy ...
0
votes
2answers
201 views

rsync on Windows not transferring large files

I'm noticing a strange issue where rsync isn't transferring large (approx >3GB) files. I'm running MSYS rsync and I'm transferring on my LAN from my Windows box to my Linux based NAS over ssh. Most of ...
3
votes
4answers
27k views

How to configure and use rsyncd?

I have a server configured to run rsync as demon /etc/rsyncd.conf file: log file = /var/log/rsyncd.log pid file = /var/run/rsyncd.pid lock file = /var/run/rsync.lock [documents] path = ...
-1
votes
2answers
22 views

How can I set a count down timer in perl for doing a function repeatedly?

I am copying a file from one file to another. I want to check whether the source file is available or not repeatedly in every 10 secs. How can I check it in between copying?
0
votes
1answer
32 views

Rsync unhides files when syncing

When I tell rsync to sync 2 folders with -a /source/path/ /destination/path, hidden files become suddenly visible. Is there a way to tell rsync not to unhide those files, but simply copy the folder as ...
7
votes
2answers
10k views

Rsync only changed files

Is it possible to have rsync transfer all files in a directory that have changed or have been created? I don't need something as sophisticated as a CRC diff check; files with different timestamps ...
0
votes
0answers
18 views

How to match the source and destination files using perl

I tried to copy a file from server to local using rsync. How can I check wether the source and destination files are same using a perl script?
1
vote
2answers
20 views

How to wait for 3 mints if the n/w got disconnected while copying in Rsync without failing using perl script?

I have to transfer 2-3 GB using Rsync.Everything is working fine, but my network got disconnected sometimes, and the entire process got failed. I want to retry it for the network for every 3 mints, ...
5
votes
5answers
4k views

Only show changed files while syncing from ext4 to NTFS

I would like rsync to print modified and deleted files. The verbose option (-v) does print modified files but also the list of subdirectories, maybe because touched directories are considered ...
0
votes
1answer
31 views

Is there any advantage of using rsync over plain cp when copying from a samba share?

I am currently configuring Dirvish on a Linux computer for backing up the contents of a share on a Windows computer. Dirvish creates a new directory every time it is called. It internally uses rsync ...
0
votes
1answer
38 views

Does Killing A Bash Process Affect Children Processes [duplicate]

The Scenario I'm automating backups via a bash script. The script is executed via cron. The script archives directories recursively using tar, and then rsync's them to the remote host. Here is a ...
6
votes
1answer
3k views

Does rsync delete files, folders at destination by default?

Files Suppose that /foo/src contains only A.c and that /foo/dest contains both A.c and B.c. And suppose I run the following command: rsync /foo/src/ /foo/dest Will rsync erase B.c? Folders Now ...
2
votes
1answer
3k views

Rsync difference between two directories to a 3rd directory

How would I go about rsyncing the difference between two directories to a 3rd directory. For example, if I have the command rsync -av --progress --stats /hdd1/ /hdd2/ I would like to copy the ...
0
votes
0answers
91 views

Run cygwin command from windows command line

I am trying to make PhpStorm run vagrant rsync when files are changed, because built-in rsync-auto fails with my deep directory structure. I am able to setup watcher in PhpStorm settings, but I don't ...