Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.

learn more… | top users | synonyms

3
votes
5answers
14k views

What similar rsync tool for Windows?

What can you recommend of an application that looks the same on rsync for windows? I will be doing migration where I need to transfer data from Windows to Linux. I like the rsync on linux where you ...
0
votes
2answers
3k views

rsync option --log-file seems is not working

I am using the --log-file option in rsync to see the logs. But when I tried to run, it says: --log-file unrecognized option Here is my command: #/usr/bin/rsync -av -u ...
1
vote
2answers
1k views

rsync fails after server restart

Usually I use the command rsync -av --delete someroot/somedir user@remote_server_ip:/someroot/. on my development server to synchronize somedir to a remote server. It worked fine. But after the ...
0
votes
2answers
29 views

Rsync folders automatization

I've got a folder on the remote server, to which I'm connecting via SSH. When I need to synchronise folders I'm using manually access via scp. (I'm synchronising my folder with the folder on the ...
0
votes
1answer
15 views

Merging two directory trees with same structure, but different contents in Unix

I have two directories with the following structure: A |_0 |_1 |_2 B |_0 |_1 |_2 each 0,1,2 directory contains unique contents. I want all of the contents to simply exist as: A |_0 |_1 |_2 Is ...
1
vote
1answer
15 views

What does the output of rsync look like when it completes successfully?

I used rsync to back up my main drive to an external drive last night. At some point in the night the external drive was unplugged. This is the tail of the output of rsync -avRP ... ...
1
vote
1answer
2k views

Rsync and Windows 7

Can someone give me any tips on setting up some sort of Rsync server/client on Windows 7 to run rsync between both my web hosting server, and a backup server that I have running Ubuntu? I've tried ...
0
votes
0answers
8 views

rsync to machine A via machine B over ssh

rsync to a remote machine A over ssh is simple. rsync -v -e 'ssh user@A' local-file ... connecting to a remote machine A via another remote machine B is also simple ssh -t user@B ssh user@A How ...
2
votes
2answers
838 views

Is there a way to use plink with rsync on Windows?

I use rsync to sync files between a local directory and a remote host. I also use plink to automate my SSH passphase entry. What I can't figure out is how to use rsync with plink. This is what I ...
0
votes
1answer
45 views

two-way sync between mac and unix

I would like to work on a directory on two different macs and have access to a unix server that I ssh into. I would like to just start a script at the end of the day that let's me upload all my ...
1
vote
1answer
31 views

How to keep two directories on two unconnected machines in sync via emailing of delta-archives

My situation is that I have two directories on two different computers (one Windows machine, OSX machine) and I need to keep the two directories on the two machines in sync (= mirrored), so that they ...
0
votes
2answers
2k views

What is more efficient / faster, rsync compression or ssh compression?

I currently rsync files: (i) locally and (ii) remotely over WAN (connection c. 8mbps down / 1.5mbps up). I am considering adding to rsync: -z to compress files. Or alternatively adding to ...
2
votes
1answer
140 views

Rsync very slow

I have just setup a Debian server for backup of Windows PCs. I am currently testing various methods including: rsync (using Deltacopy on Windows), SMB via Samba and scp. Currently rsync (without SSH ...
0
votes
1answer
44 views

Exact copy of files from NTFS to another NTFS using Linux

I try to copy all files from an NTFS to an external drive and want to preserve all permissions and attributes. The external drive has already an NTFS and contains other files. I've considered using ...
15
votes
3answers
598 views

Moving 2TB (10 mil files + dirs), what's my bottleneck?

Background I ran out of space on /home/data and need to transfer /home/data/repo to /home/data2. /home/data/repo contains 1M dirs, each of which contain 11 dirs and 10 files. It totals 2TB. ...
0
votes
1answer
2k views

rsync - how to set/keep directory permissions?

I'm using CwRsync to connect from my Windows development machine to a linux webserver : rsync -avuz -e ./ssh --exclude=".svn" /cygdrive/c/xampp/htdocs/project123/ ...
0
votes
0answers
10 views

How to output file sizes in human-readable format in an rsync logfile

I know that the -h option outputs filesizes in human-readable format when, ex, displaying the transfer progress with --progress, but is it possible to get this same file size formatting in the log ...
0
votes
1answer
19 views

Fast splitting of list of files in chunks of the same size (memory)

See title. Assume I have the following list of files and relatives sizes: cat list_of_files.txt: 1243 001.txt 124 002.txt 4132 003.txt 3000 004.txt I want to be able to split into multiple chunks ...
0
votes
1answer
21 views

How to Find the Bottleneck when Transferring Files over WAN

This question may be a little too broad, but I'm looking for some methodology to identify a transfer speed bottleneck. I'm using rsync to transfer files between 2 NAS devices (DNS-323 to be specific) ...
2
votes
1answer
2k views

Rsync to a WebDAV filesystem on OS X copies all files regardless of being changed or not

I am trying to sync from my (Mac) desktop, to an iPad and an iPhone. OS X mounts WebDAV as a native filesystem, but syncing results in all files in my directory structure being copied again. This ...
0
votes
0answers
23 views

web interface for server-to-server file transfer

I'm looking for a way to transfer files between two servers. I currently ssh into one server and use rsync inside a screen session to initiate a transfer from the other host. This works, but I'm ...
0
votes
1answer
20 views

Transparent failover for NFS home directory (with LDAP users)

Background: In our work environment, we have LDAP users together with NFS homes. So you sign on LDAP server, autofs mounts the homes, etc. Pretty neat so far. However, from time to time, the NFS or ...
0
votes
1answer
21 views

rsync from two servers to a common location

I have two servers and I want to rsync files from both servers to a single location. Server 1 has files A and B Server 2 has files A and B After rsync server 3 has file A and B When a user ...
0
votes
0answers
15 views

How to rsync merge two paths into one; opposite of --inplace

I have a large remote directory: remote://server/pathA/zupertoll And a large local directory that is 95% the same as the remote directory: local:///home/pathB/zupertoll I want to copy zupertoll to ...
0
votes
0answers
9 views

rsync: Exclude files included from --files-from

I'm on Mac OS X. I have a source file list that contains files that sometimes don't exist. So I want to exclude them on those occasions, like this: /usr/bin/rsync -av --progress --delete ...
4
votes
4answers
2k views

Only show changed files while syncing from ext4 to NTFS

I would like rsync to print modified and deleted files. The verbose option (-v) does print modified files but also the list of subdirectories, maybe because touched directories are considered ...
0
votes
0answers
25 views

ssh proxycommand equivalent on server

Lets say we have three machines me, proxy, server I would like to have an ssh connection to server, so normally I would do me$ ssh proxy proxy$ ssh server server$ # and here we are ssh proxy ...
1
vote
1answer
33 views

Does rsync delete files, folders at destination by default?

Files Suppose that /foo/src contains only A.c and that /foo/dest contains both A.c and B.c. And suppose I run the following command: rsync /foo/src/ /foo/dest Will rsync erase B.c? Folders Now ...
1
vote
2answers
831 views

Can't rsync locally on synology NAS

I'm logged in to my Synology NAS and although I can rsync from my servers to the NAS and vice versa, I can't use rsync where the source and destination are both on the DiskStation. midnight my_user ...
1
vote
3answers
2k views

scp certain files only

I am trying to copy changed files to godaddy via ssh. Godaddy is terrible and so they of course do not allow rsync. I can use scp, but I really only want to copy changed files. I don't think this is ...
0
votes
0answers
15 views

mv backup but instead of creating tilde directories, create tilde files in subdirectories?

I have 2 deep directory structures that are (probably) identical and I want to end up with a single one, but not auto-resolve existing conflicts (I'm guessing rsync would clobber something). I just ...
2
votes
3answers
279 views

How can this backup strategy work?

I am trying to script a very simple backup strategy. Here is the general idea. Daily - Backup the entire filesystem using rsync, overwriting the previous day's backup. Weekly - Once a week copy the ...
0
votes
2answers
614 views

rsync slow copy from one disk to another

I got two drives of the same model which are connected using SATA. When benchmarking read speeds using hdparm -t /dev/sdX, speeds of about 160MB/s are returned. When benchmarking write-speed using dd ...
3
votes
2answers
137 views

restrict rsync (or bash script) to a directory

After a bad accident with rsync deleting wrong files due to wrong destination parameter, I want to restrict rsync (or the bash script running it) to be able to delete/modify files only under a certain ...
0
votes
2answers
49 views

rsync on Windows not transferring large files

I'm noticing a strange issue where rsync isn't transferring large (approx >3GB) files. I'm running MSYS rsync and I'm transferring on my LAN from my Windows box to my Linux based NAS over ssh. Most of ...
0
votes
0answers
33 views

Rsync incredibly slow in Cygwin - am I doing something wrong?

I am trying to back up my C: and D: drives (each 1 TB, C: has around 210 GB of data on it, D: has around 345 GB on it) onto a 3 TB external HDD using Cygwin in Windows 8. I am doing this with ...
7
votes
2answers
952 views

How to copy Time Machine volume to another disk using rsync while preserving ACLs?

Recently I had to change my Mac's filesystem from case-preserving to being fully case-sensitive. I did that by using CCC and copying data to another disk, then returning back to newly formatted main ...
3
votes
1answer
1k views

rsync --remove-source-files but only those that match a pattern

Is this possible with rsync? Transfer everything from src:path/to/dir to dest:/path/to/other/dir and delete some of the source files in src:path/to/dir that match a pattern (or size limit) but keep ...
0
votes
0answers
22 views

I have a very large rsync job that fails during 'receiving incremental file list"

I have a multi-TB backup that I'm trying to move. It's an rsnapshot-like collection of many dated directories that are 99% hardlinks to unchanged files and some new files. The job runs for many hours ...
0
votes
0answers
18 views

How to backup incremental with rsync with diffrent location for incremental changes?

I want to do incremental backup with rsync in centos. but I want to have a full backup in a specific folder and for incremental changes I use to another folder with time stamp. Is it possible and how? ...
0
votes
1answer
23 views

rsync don t work as expected

I have a script which download and compress a folder of a remote server (example: /home). I m trying to make the "restore" script, but I have a strange behavior. restore.sh: ($1 is IP adress, $2 is ...
0
votes
1answer
28 views

Error message using scp over ssh

I'm not sure what's going on but as of late I can't seem to get any files copied to local from my remote server. I tried rsync from local and get the following error message: mut@mylocalcomputer:~$ ...
0
votes
1answer
36 views

Watch a filesystem and rsync changes in a cross-platform way with minimal dependencies

I'd like to start a long-running Ruby or Python script, and have the script watch a local directory for changes to files and new files. Periodically, the script will trigger a one-way rsync to a ...
0
votes
0answers
27 views

Copy files to location, skipping duplicates (in source and dest. location)

I have an external hardrive I think is running down breaking (unable to delete some files from it). I copied a bunch of files over already but ran out of space. How do I dedup while copying/How to I ...
0
votes
1answer
21 views

rsync not skipping untouched files

I transferred about 300GB of files with scp from one server to another. Sadly I forgot the -r option, so part of the files that were in subdirectories were not copied. I verified that the files that ...
0
votes
0answers
39 views

Backup with rsync in an encrypted folder

I want to backup a folder from a remote server in a local folder encrypted with encfs. The files in the remote folder are owned by different users and I want to keep ownerships. The local folder is in ...
1
vote
1answer
153 views

How to copy directories into symbolic links using rsync?

I have directories and files locally and I want to copy them over to another box using rsync . The problem is that most of the data is already on the remove box, but not on the target disk. E.g., I ...
1
vote
1answer
14 views

Rsync to multiple directories with one command?

I want to rsync my working directory to two other directories. One would destination would be for backup, another for testing it. I tried this: rsync -av --exclude='.git' source dest1,dest2 But ...
0
votes
0answers
29 views

rsync won't recognize my /user folder?

On OSX, 10.9.1. I'm trying to use rsync to sync the contents of local folder: (/Users/username/00_WORK/FolderX) with (/Volumes/WORK_BACKUP/01_Current_Work/FolderX) Obviously the destination is ...
1
vote
1answer
342 views

What does Rsync's output tell here about to-chk?

I was using rsync using --progress option , So the file transfer completed and I got following output receiving incremental file list Makefile 9,935 100% 9.47MB/s 0:00:00 (xfr#1, ...