Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.

learn more… | top users | synonyms

4
votes
0answers
619 views

Rsync fails for files that start with underscore when destination is zfs

I'm using rsync3.1.0pre1 on Mac OS X 10.8.5, and am trying to rsync one folder to another. The destination is a ZFS volume mounted via SMB. The problem I'm having is that files that start with ...
4
votes
0answers
2k views

How to tell rsync to skip files on a damaged hard drive block, instead of being stuck trying to read it

I am trying to recover files from a disk that has hardware errors. The disk was repaired by disk utility, but it told me that the disk is damaged, so I need to backup everything before a failure will ...
4
votes
0answers
297 views

Live rsync/directory monitor for Windows?

Right now, we have a central Linux server and several satellite Windows servers dispersed around the region. Every 15 minutes, the Linux server rsyncs files from the others (which are running the ...
3
votes
0answers
277 views

Rsync, how can I delete remote duplicates?

I'm trying to delete remote duplicate files without transferring the non-existing files, and without updating the existing files. If I specify both --existing and --ignore-existing (along with -av ...
2
votes
0answers
47 views

USB 3.0 Trouble

I am using a WD Elements Portable 1TB USB 3.0 2.5" disk bought in May 2014 to backup data of my desktop machine. rsync runs smoothly without any error messages. However upon restoring data from the ...
2
votes
0answers
692 views

rsync error: symlink has no referent

I am trying to configure rsnapshot (which uses rsync) to backup a Windows server but I am having trouble with rsync being unable to follow a symlink on the server to be backed up. Setup: Windows ...
2
votes
0answers
233 views

External drive has strange files “_*” appearing - culprit is maybe rsync or SMB access?

I'm using rsync to back up folders from my iMac to a WD MyBook and the process seems to leave files such as these: _0O1MN~H.MP4 _2C0X2~3.AVI _ALLYW~B.SRT _VUC69~7 The last one is the most ...
2
votes
0answers
225 views

rsync: large exclusion list adding 10 hours to sync

I have had an rsync backup script running on a Centos 6 box that has been syncing ~410gb of data from a local (LAN) server over a gigabit connection. This script runs hourly, and if there are no new ...
2
votes
0answers
332 views

Keep local folder in sync with Samba share

I have a local folder on my Linux Mint desktop (my Dropbox folder, though that shouldn't matter), and I'd like to keep it synced with my school's "datastore" Samba share, which I can connect to from ...
1
vote
0answers
42 views

How to rsync root files over non-root ssh?

I have two machines, both providing no root login, but provide sudo root access. Now I like to initate a rsync transfer of root files over ssh. Is there an easy way make the the root access given by ...
1
vote
0answers
42 views

rsync glitches with -X (extended attributes) flag

When I rsync files from ext4 file system to btrfs with the following set of flags: rsync --update -DHAXErlptgo the first copy of the backaped directory is done OK, but when this same command is ...
1
vote
0answers
22 views

How to set permissions and ownership when using rsync?

I'm using capistrano-wpcli (link), a program that uses 'rsync' to synchronize folders between development and testing servers. I've set the uploads folder's permission on the remote server to 777 ...
1
vote
0answers
64 views

Is cp -au / cp --archive --update contradictory?

I want to update a directory on a backup disk with new content added to the source, and of course rsync is too slow. cp -a does the trick but is a bulldozer; cp -u should leave existing files alone. ...
1
vote
0answers
277 views

Run cygwin command from windows command line

I am trying to make PhpStorm run vagrant rsync when files are changed, because built-in rsync-auto fails with my deep directory structure. I am able to setup watcher in PhpStorm settings, but I don't ...
1
vote
0answers
95 views

rsync over ssh tunnel: What does this repeated message mean? debug2: channel 2: window 1966080 sent adjust 131072

I'm rsyncing through an SSH tunnel (with ssh -vv). It's not very fast and I'm getting this message about every second: debug2: channel 2: window 1966080 sent adjust 131072 Once in a while I also ...
1
vote
0answers
102 views

Rsync doesn't allow me copy files into mounted filesystems

I configured rsyncd.conf for public access in my rpi: log file = /var/log/rsyncd.log timeout = 600 max connections = 20 uid = nobody gid = nogroup read only = yes list = yes [public] path = ...
1
vote
0answers
213 views

Synology NAS resume rsync backup after connection loss

I am trying to do a backup from a synology NAS to an offsite NAS. I am using rsync through DSM5 as of now, but it doesn't give me the possibility to resume the backup if a connection loss occurs. This ...
1
vote
0answers
200 views

rsync seems to overwrite already existing file on ExFat

I have a curious behavior from rsync between two hard drives containing the exact same four partitions. However on one partition rsync seems to always copy again the files, I don't understand why. ...
1
vote
0answers
315 views

File transfer tools for linux with support of zero-copy transfer

Are there small and simple file transfer tools for Linux, which can use "zero-copy" style of transferring files from HDD (SSD) to tcp socket, and back? I want to often send huge amount of ...
1
vote
0answers
544 views

rsync failed: No Such file or directory

I'm using rsync in Windows ( through cygwin64 ) to backup some data to an samba share. I've made this bat file that would take care of everything: net use S: \\10.1.1.23\marc password /user:marc ...
1
vote
0answers
135 views

ssh proxycommand equivalent on server

Lets say we have three machines me, proxy, server I would like to have an ssh connection to server, so normally I would do me$ ssh proxy proxy$ ssh server server$ # and here we are ssh proxy ...
1
vote
0answers
35 views

rsync ssh to ssh to local

Is it possible to perform a rsync to backup files from a server passing by an another server by ssh. And I have to use port 23 from local to server1. So : ssh ssh -p 23 server2 ...
1
vote
0answers
169 views

Rsync do not do anything if files not changed

#!/bin/sh date=`date "+%Y-%m-%dT%H:%M:%S"` rsync -aP --link-dest=/target/current '/source/folder' /target/back-$date rm -f /target/Backups/current ln -s back-$date /target/current This is a little ...
1
vote
0answers
62 views

Running a symlink locally

I am running the same program multiple times over a linux platform. It is compiled at another server, and frequently updated, and it's uploaded over through rsync to all "hosting" servers, which do ...
1
vote
0answers
131 views

Is there a way to verify the integrity of a rsnapshot backups?

I'm using rsnapshot to make daily backups to a second hdd. But how can I make sure, that no file in my backup is corrupted? If I use the checksum option from rsync, the whole backup will take much ...
1
vote
0answers
114 views

rsync - Exclude directories but include files within them

I have an rsync command which I'm using to synchronise two directories: rsync -CurvtOlon --delete /home/source/path/ /home/dest/path/ When I run the command, it recursively scans all of the source ...
1
vote
0answers
58 views

Include exclude patterns rsync relative

I'm trying to sync a large tree on Linux, but include and exclude certain files/directories. My question is regarding rsync's --relative option and how relative paths are handled. Directory structures ...
1
vote
0answers
567 views

Automatically transfer completed downloads from seedbox home

I'm pondering a move to ruTorrent/rTorrent and was wondering how people have gone about automating transferring content from their seedbox to a linux based home server. I'd like to: 1 - Download ...
1
vote
0answers
135 views

hash-based asyncronous directory comparison

I am trying to efficiently synchronize two large directories via VPN over a long distance. Unfortunately I cannot install advanced tools like git or rsync on the remote server due to company ...
1
vote
0answers
188 views

Which filesystems support hard links (rsync) to backup a Mac?

I want to make a rsync-style hard-link backup from Mac on an external hard drive, but I cannot decide for a file system. It should be (preferably natively) readable from other operating systems. ...
1
vote
0answers
465 views

Synchronising a medium sized sqlite database over several computers

I have an SQLite database that is about 10MiB in size. Every few minutes a new record is inserted. Now I'd like to synchronise this file over several computers, with a remote server in between. But ...
1
vote
0answers
93 views

Where did my rsync'd file go?

I just copied a very large file (> 10 gb) from one EC2 server to another using rsync: rsync -asv -P xtrabackup_2012_07_08_21h20m.tar.gz staging:/mnt/backups This took a couple of hours. Then, after ...
1
vote
0answers
170 views

Efficient mirroring of directories using hardlinks

I'm backing up my music collection on to a number of NTFS-formatted external hard-drives; however, as I store my main collection in FLAC and have my library on my laptop as MP3s to save space, I want ...
1
vote
0answers
300 views

Rsync equiv of “do not terminate”

Is there anyway to not terminate, but instead when this type of error is encountered? sent 605.85M bytes received 19.89G bytes 483.43K bytes/sec total size is 248.71G speedup is 12.13 rsync ...
1
vote
0answers
273 views

rsync cygwin also hangs without ssh

I've been using rsync installed via cygwin on two Windows 7 PCs to sync my music and picture collection, but eventually it always stops transferring after some time. I've googled and it seems that ...
1
vote
0answers
319 views

Rsync from Linux to Windows producing problems with back slash

I know if I was having an issue with rsync with characters I'd use --iconv= - but this issue is some file names have black slashes in them, and I don't have the ability to rename the original files. ...
1
vote
0answers
1k views

How to achieve NAS to NAS rsync for offsite backup?

I'm interested in a home NAS solution that would look like this: local NAS box for home backups remote NAS box (at my parents) as an offsite copy periodic rsync over the internet from "local" to ...
1
vote
0answers
172 views

How does rsync behave with --append and --link-dest together?

The question refers to the case where a file exists both in the origin and the link-dest folder, but it's larger in the origin. Will it hard-link it and append inplace (thus modifying the file in ...
1
vote
0answers
2k views

Backup to Synology NAS using rsync or NFS and hardlinks

I want to backup data from a Windows (Vista) computer to a Synology NAS (210j). The NAS supports FTP, SMB, NFS and also allows a rsync daemon to be set up. I want to backup different folders to the ...
0
votes
0answers
5 views

rsync directories with sudo permissions on the remote server

I have one server which has access to a remote server, let's call it as A. I'm trying to rsyncing a remote directory from the remote server and I want to put the synchronized directory in a mounted ...
0
votes
0answers
12 views

Why did rsync removed files from my source directories?

I generated a subset of files to copy and saved it into tocopy.txt. Then I ran: rsync --progress -v --checksum --itemize-changes -r -a -z --files-from=/tmp/tocopy.txt user@server:/destination ...
0
votes
0answers
16 views

Multiboot flash drive backup

I have a 16GB flash drive, formatted in FAT32 which contains multiple live linux distros, syslinux bootloader and personal data. I would like to make a backup of it and restore this backup on 64GDB ...
0
votes
0answers
17 views

IO errors from ESXi to OS X Server (NFS or rsync)

Ok, so here is the context. I have a OSX Server 10.8 inside a VM. This VM is attached to an iSCSI volume (from a thecus bay where it is a RAID5). This volume is shared via NFS and AFP. I have some ...
0
votes
0answers
24 views

Clean way to preserve permissions in backups from Linux stored on NTFS

With cygwin, rsync and SSH I have set up a backup mechanism that copies all of the vServers (running Debian) contents to my local NTFS hard drive (running Windows 10) and it works. Partially. I use ...
0
votes
0answers
24 views

rsync: connection unexpectedly closed - Migration from AWS to Digital Ocean

I'm trying to migrate my Django site from AWS to DigitalOcean. I'm following this tutorial My problem is that I can't rsyncmy files. Just as info, I'm able to connect via ssh to my Digital Ocean's ...
0
votes
0answers
16 views

How to kill or abort ssh and rsync reliably by parent process

I am calling rsync from my Qt application which in turn uses ssh to sync data from a remote server. The user of my application however could cancel or abort the sync process but the rsync.exe or ...
0
votes
0answers
15 views

How much upstream traffic should a transfer over TCP produce

When a file is downloaded via some TCP-based protocol, there is also data flowing in the other direction – acknowledgement packages etc. Now if I watch some network monitor, I wonder if all of the ...
0
votes
0answers
10 views

Unable to change owner on a mapped drive directory

I am using a script to copy files from amazon instances to a network drive using rsync. After the file copy I am trying to change the owner of these transferred files but am not able to. What is the ...
0
votes
0answers
30 views

Linux: sync/merge two (or more) directories, but keep older file versions?

got alotta help throughout the time just by simply scrolling and crawling through the vast landscape of qualified answers here from you, now's the time to ask my first question and it looks rather ...
0
votes
0answers
22 views

Making mbuffer faster

I'm trying to transfer files as fast as possible across a 10 gig network connection. Up until now, I've been using rsync to move large files across the network, but I'm trying mbuffer now because I've ...