Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.

learn more… | top users | synonyms

4
votes
0answers
53 views

Does Cygwin support hard links in Windows 8?

I'm working on a backup script that behaves like TimeMachine and uses RSync with --link-dest to create hardlinks to unchanged files. If I run this on a *Nix-based system, of course it works as ...
3
votes
0answers
252 views

Rsync, how can I delete remote duplicates?

I'm trying to delete remote duplicate files without transferring the non-existing files, and without updating the existing files. If I specify both --existing and --ignore-existing (along with -av ...
3
votes
0answers
205 views

Live rsync/directory monitor for Windows?

Right now, we have a central Linux server and several satellite Windows servers dispersed around the region. Every 15 minutes, the Linux server rsyncs files from the others (which are running the ...
2
votes
0answers
413 views

Rsync fails for files that start with underscore when destination is zfs

I'm using rsync3.1.0pre1 on Mac OS X 10.8.5, and am trying to rsync one folder to another. The destination is a ZFS volume mounted via SMB. The problem I'm having is that files that start with ...
2
votes
0answers
164 views

External drive has strange files “_*” appearing - culprit is maybe rsync or SMB access?

I'm using rsync to back up folders from my iMac to a WD MyBook and the process seems to leave files such as these: _0O1MN~H.MP4 _2C0X2~3.AVI _ALLYW~B.SRT _VUC69~7 The last one is the most ...
2
votes
0answers
179 views

rsync: large exclusion list adding 10 hours to sync

I have had an rsync backup script running on a Centos 6 box that has been syncing ~410gb of data from a local (LAN) server over a gigabit connection. This script runs hourly, and if there are no new ...
2
votes
0answers
276 views

Keep local folder in sync with Samba share

I have a local folder on my Linux Mint desktop (my Dropbox folder, though that shouldn't matter), and I'd like to keep it synced with my school's "datastore" Samba share, which I can connect to from ...
1
vote
0answers
24 views

rsync from Solaris to Windows (character encoding on filenames)

I'm trying to use RSYNC to sync files from a Solaris 9 (SunOS 5.9) System to a Windows Server 2008 R2 (via cygwin) There are many Files containing characters like "ä", "ö", "ü" or "ß". Which are only ...
1
vote
0answers
14 views

rsnapshot or similar tool for no added size differential backup

I've currently got a backup that backs up all my files to an external hard drive, but currently I am traveling and I want to backup file changes, but without having to duplicate all the files, or ...
1
vote
0answers
51 views

Rsync doesn't allow me copy files into mounted filesystems

I configured rsyncd.conf for public access in my rpi: log file = /var/log/rsyncd.log timeout = 600 max connections = 20 uid = nobody gid = nogroup read only = yes list = yes [public] path = ...
1
vote
0answers
107 views

Synology NAS resume rsync backup after connection loss

I am trying to do a backup from a synology NAS to an offsite NAS. I am using rsync through DSM5 as of now, but it doesn't give me the possibility to resume the backup if a connection loss occurs. This ...
1
vote
0answers
171 views

File transfer tools for linux with support of zero-copy transfer

Are there small and simple file transfer tools for Linux, which can use "zero-copy" style of transferring files from HDD (SSD) to tcp socket, and back? I want to often send huge amount of ...
1
vote
0answers
416 views

rsync failed: No Such file or directory

I'm using rsync in Windows ( through cygwin64 ) to backup some data to an samba share. I've made this bat file that would take care of everything: net use S: \\10.1.1.23\marc password /user:marc ...
1
vote
0answers
91 views

ssh proxycommand equivalent on server

Lets say we have three machines me, proxy, server I would like to have an ssh connection to server, so normally I would do me$ ssh proxy proxy$ ssh server server$ # and here we are ssh proxy ...
1
vote
0answers
159 views

Rsync incredibly slow in Cygwin - am I doing something wrong?

I am trying to back up my C: and D: drives (each 1 TB, C: has around 210 GB of data on it, D: has around 345 GB on it) onto a 3 TB external HDD using Cygwin in Windows 8. I am doing this with ...
1
vote
0answers
392 views

rsync error: symlink has no referent

I am trying to configure rsnapshot (which uses rsync) to backup a Windows server but I am having trouble with rsync being unable to follow a symlink on the server to be backed up. Setup: Windows ...
1
vote
0answers
30 views

rsync ssh to ssh to local

Is it possible to perform a rsync to backup files from a server passing by an another server by ssh. And I have to use port 23 from local to server1. So : ssh ssh -p 23 server2 ...
1
vote
0answers
132 views

Rsync do not do anything if files not changed

#!/bin/sh date=`date "+%Y-%m-%dT%H:%M:%S"` rsync -aP --link-dest=/target/current '/source/folder' /target/back-$date rm -f /target/Backups/current ln -s back-$date /target/current This is a little ...
1
vote
0answers
58 views

Running a symlink locally

I am running the same program multiple times over a linux platform. It is compiled at another server, and frequently updated, and it's uploaded over through rsync to all "hosting" servers, which do ...
1
vote
0answers
70 views

Is there a way to verify the integrity of a rsnapshot backups?

I'm using rsnapshot to make daily backups to a second hdd. But how can I make sure, that no file in my backup is corrupted? If I use the checksum option from rsync, the whole backup will take much ...
1
vote
0answers
89 views

rsync - Exclude directories but include files within them

I have an rsync command which I'm using to synchronise two directories: rsync -CurvtOlon --delete /home/source/path/ /home/dest/path/ When I run the command, it recursively scans all of the source ...
1
vote
0answers
50 views

Include exclude patterns rsync relative

I'm trying to sync a large tree on Linux, but include and exclude certain files/directories. My question is regarding rsync's --relative option and how relative paths are handled. Directory structures ...
1
vote
0answers
427 views

Automatically transfer completed downloads from seedbox home

I'm pondering a move to ruTorrent/rTorrent and was wondering how people have gone about automating transferring content from their seedbox to a linux based home server. I'd like to: 1 - Download ...
1
vote
0answers
130 views

hash-based asyncronous directory comparison

I am trying to efficiently synchronize two large directories via VPN over a long distance. Unfortunately I cannot install advanced tools like git or rsync on the remote server due to company ...
1
vote
0answers
169 views

Which filesystems support hard links (rsync) to backup a Mac?

I want to make a rsync-style hard-link backup from Mac on an external hard drive, but I cannot decide for a file system. It should be (preferably natively) readable from other operating systems. ...
1
vote
0answers
73 views

Where did my rsync'd file go?

I just copied a very large file (> 10 gb) from one EC2 server to another using rsync: rsync -asv -P xtrabackup_2012_07_08_21h20m.tar.gz staging:/mnt/backups This took a couple of hours. Then, after ...
1
vote
0answers
156 views

Efficient mirroring of directories using hardlinks

I'm backing up my music collection on to a number of NTFS-formatted external hard-drives; however, as I store my main collection in FLAC and have my library on my laptop as MP3s to save space, I want ...
1
vote
0answers
274 views

Rsync equiv of “do not terminate”

Is there anyway to not terminate, but instead when this type of error is encountered? sent 605.85M bytes received 19.89G bytes 483.43K bytes/sec total size is 248.71G speedup is 12.13 rsync ...
1
vote
0answers
234 views

rsync cygwin also hangs without ssh

I've been using rsync installed via cygwin on two Windows 7 PCs to sync my music and picture collection, but eventually it always stops transferring after some time. I've googled and it seems that ...
1
vote
0answers
293 views

Rsync from Linux to Windows producing problems with back slash

I know if I was having an issue with rsync with characters I'd use --iconv= - but this issue is some file names have black slashes in them, and I don't have the ability to rename the original files. ...
1
vote
0answers
1k views

How to achieve NAS to NAS rsync for offsite backup?

I'm interested in a home NAS solution that would look like this: local NAS box for home backups remote NAS box (at my parents) as an offsite copy periodic rsync over the internet from "local" to ...
1
vote
0answers
163 views

How does rsync behave with --append and --link-dest together?

The question refers to the case where a file exists both in the origin and the link-dest folder, but it's larger in the origin. Will it hard-link it and append inplace (thus modifying the file in ...
1
vote
0answers
2k views

Backup to Synology NAS using rsync or NFS and hardlinks

I want to backup data from a Windows (Vista) computer to a Synology NAS (210j). The NAS supports FTP, SMB, NFS and also allows a rsync daemon to be set up. I want to backup different folders to the ...
0
votes
0answers
11 views

Resume SCP download when using .pem file with rsync

I have a large file to down form a ssh server, however the connection keeps cutting out. I know that rsync can be used to resume the download however I can not find how to do this when I am using a ...
0
votes
0answers
11 views

rsync a git project to clone it for the first time?

I want to use Git to version our existing magento shop. I initiated git on the production server (which has the most up-to-date code), added all files except for several directories like cache, and ...
0
votes
0answers
7 views

Is cp -au / cp --archive --update contradictory?

I want to update a directory on a backup disk with new content added to the source, and of course rsync is too slow. cp -a does the trick but is a bulldozer; cp -u should leave existing files alone. ...
0
votes
0answers
6 views

Improve accuracy of rsync's speed reporting

I am doing an rsync from a local SSD (super-fast) to a samba NAS (super-slow). When I sync (e.g.) ~400MB files, it seems to read the first entirely into memory before it does any writing, and thus I ...
0
votes
0answers
15 views

How to tell if a directory is completely synced by rsync?

I'm rsync'ing some directories from one machine to another, in a cronjob. Each directory is complete set of data files. On the destination machine, is there a sane way to tell if a directory is ...
0
votes
0answers
11 views

Periodic backup of changes on another disk from full backup

I am looking for a backup solution that will enable me to backup only changes to an internal disk after a full backup to an external disk. Also, this should run snapshot backups every day until the ...
0
votes
0answers
19 views

How to match the source and destination files using perl

I tried to copy a file from server to local using rsync. How can I check wether the source and destination files are same using a perl script?
0
votes
0answers
53 views

Rsync takes longer time “receiving incremental file list”

I am using rysnc to copy files from remote host to local machine using a cron job. Every time I need the rsync to copy new files only from remote host. But its getting struck at this line "receiving ...
0
votes
0answers
91 views

Run cygwin command from windows command line

I am trying to make PhpStorm run vagrant rsync when files are changed, because built-in rsync-auto fails with my deep directory structure. I am able to setup watcher in PhpStorm settings, but I don't ...
0
votes
0answers
18 views

Is there a simple way to automatically send through scp any file modified in a folder to a remote folder?

Put it simply: I have a folder full of files and subfolders with more files. I would like to have a mirror of that folder in a remote server so anytime a file is modified on my machine it gets ...
0
votes
0answers
32 views

Is there a tool for syncing changes to individual nodes within HDF5 files?

I'm looking for a tool for efficiently syncing large scientific datasets in HDF5 format: Each file is ~20-30GB in size and contains many large floating point arrays, which are usually chunked and ...
0
votes
0answers
48 views

Backup certain folders to NAS with exFat

Hello everybody who has the same problem, trying to help or just reading! Recently I've bought one of IcyBox IB-NAS5520 NAS with 2 x 1TB drives in raid1. I've tryed to follow this idea: How to set ...
0
votes
0answers
15 views

Check if file is being read by remote rsync

I'm working on a script to copy files from one location to another (both are raspberry pis running raspbian). I have it set so that files are rsynced from one to the other (overnight, transferring ...
0
votes
0answers
8 views

Different low uplink machines hold the same data, how to speed up rsync to machine with faster connection?

Two different machines hold the same data (10G+), both with relatively slow upload. I want to transfer the data to a machine that can receive with a much faster speed. Now to speed up transfer of ...
0
votes
0answers
34 views

rsync over ssh tunnel: What does this repeated message mean? debug2: channel 2: window 1966080 sent adjust 131072

I'm rsyncing through an SSH tunnel (with ssh -vv). It's not very fast and I'm getting this message about every second: debug2: channel 2: window 1966080 sent adjust 131072 Once in a while I also ...
0
votes
0answers
52 views

Rsync and find filter

I'm trying to use rsync in combination with find to restrict the number of files to copy. My code looks like this: for NODE in $NODES; do echo Processing $NODE ........ for LOGDIR in ...
0
votes
0answers
38 views

Syncing a static website via WebDAV?

I am running a static website at office and the sysadmins only allow updates through WebDAV(s) (Secure WebDAV) protocol. So, I have a local copy of the files' website on my machine and I upload the ...