Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.

learn more… | top users | synonyms

12
votes
1answer
5k views

How to exclude rsync excludes from delete?

I'm using rsync to sync files across multiple machines, using the following: rsync -az -e "ssh -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no" \ --delete --delete-excluded --force ...
2
votes
3answers
3k views

RSync to WebDAV mounted volume very slow

I have a mounted WebDAV store, which I am playing around with to try and put together my own pseudo-DropBox set up. However, it seems very slow to upload larger files (my bandwidth graph goes ok for a ...
14
votes
1answer
10k views

Resume transfer of a single file by rsync

In Ubuntu, I want to copy a big file from my harddrive to a removable drive by rsync. For some reason or other, the operation cannot complete in a single run. So I am trying to figure out how to use ...
2
votes
1answer
12k views

How to interpret and fix a Input/output error in Linux?

I am running a daily backup with rsync. Starting some days ago, one of the files has been throwing this error during the backup: rsync: read errors mapping "/home/folder/file.ext": Input/output error ...
0
votes
0answers
777 views

How to always let rsync continue when (permission denied) error occurs

The following error happened with a rsync task. rsync: send_files failed to open "/home/user/scripts/@eaDir/script.js@SynoEAStream": Permission denied (13) rsync error: some files/attrs were not ...
21
votes
6answers
22k views

Why is rsync -avz faster than scp -r?

I'm a bit puzzled by this? Why is rsync faster than scp? Doesn't rsync use scp beneath or does it do something more efficient? Is there some way to speed up scp?
0
votes
0answers
51 views

Syncing a static website via WebDAV?

I am running a static website at office and the sysadmins only allow updates through WebDAV(s) (Secure WebDAV) protocol. So, I have a local copy of the files' website on my machine and I upload the ...
0
votes
1answer
78 views

Ununtu 12.0.4 LTS Boots to some unknown mount point

I installed Ubuntu 12.0.4 LTS to a 2TB Sata with a swap partition and a data partition. I installed mdadm and setup an incomplete raid. I later unmounted that raid (to which it erred as non-existent) ...
0
votes
0answers
33 views

Trying to rsync and use sudo on other end

Scenario: Mac OS X Machine - old computer - user: john.doe Mac OS X Machine - new computer - user: john.doe Goal: Copy /Users/john.doe/Desktop and /Users/john.doe/Documents via rsync Problem: ...
8
votes
3answers
5k views

How to best clone a running system to a new harddisk using rsync?

I have a system running as a server that has a failing harddrive. While all important data is on a RAID and backed up and all that, I don't have an image of the system itself. There is no specific ...
0
votes
2answers
45 views

Syncing directory between Kubuntu and Windows 7

I recently came across an issue on my work computer. I'm running Kubuntu 14.04 as my main development OS and Windows 7 for compatibility with some company software and network stuff. My problem is ...
5
votes
2answers
18k views

How to Setup Rsync without password with SSH on UNIX / Linux?

How can I set up a rsync between two hosts without providing any password?
0
votes
1answer
111 views

Do GUI and Terminal execution (of Back In Time/Grsync/other Linux apps) produce the same results?

I've opened Back In Time GUI and copied the whole rsync ... line from the last log into Terminal and executed it in Terminal. Question #1 is: if I were to do it the normal way (click 'Take snapshot' ...
0
votes
0answers
48 views

Secure copy one folder to multiple destinations in OS X

Sorry for asking what looks like a question that's been asked a few times. I'm very far from being a super user, which makes it very difficult for me to be able to expand on a relatively complex ...
0
votes
1answer
53 views

Fast splitting of list of files in chunks of the same size (memory)

See title. Assume I have the following list of files and relatives sizes: cat list_of_files.txt: 1243 001.txt 124 002.txt 4132 003.txt 3000 004.txt I want to be able to split into multiple chunks ...
-1
votes
2answers
5k views

How to copy files from remote machine (ubuntu) to local machine (windows)?

I would like to know about two ways: scp and rsync and how exactly they are used to copy files. I tried doing scp ubuntu@ip-10-124-83-21:/home/* /home/ubuntu/crockonjs-2-hd.mov but it didn't work. ...
0
votes
0answers
28 views

Terminal 2 way ftp sync

I am looking for a way to sync a directory/path on my computer with an ftp server so that all the files that are newer will be copied and will replace the old files. The files that have been created ...
3
votes
1answer
96 views

Using pv(1) to limit rsync speed

I'm trying to use pv rather than rsync's builtin --bwlimit to limit the bandwidth of an rsync transfer because --bwlimit is implemented in an eventually-consistent way, and my transfers are so short ...
0
votes
3answers
122 views

How to write files in specific order?

Okay, here's a weird problem -- My wife just bought a 2014 Nissan Altima. So, I took her iTunes library and converted the .m4a files to .mp3, since the car audio system only supports .mp3 and .wma. ...
1
vote
0answers
165 views

Synology NAS resume rsync backup after connection loss

I am trying to do a backup from a synology NAS to an offsite NAS. I am using rsync through DSM5 as of now, but it doesn't give me the possibility to resume the backup if a connection loss occurs. This ...
1
vote
2answers
71 views

How can I rsync a set of subdirectories?

I have a source directory that looks like the following (with numerous subdirectories inside of the src and bin dirs): top_dir proj1 src/ bin/ scripts/ somefile.txt proj2 src/ bin/ target bin/ ...
0
votes
1answer
148 views

rsync --backup-dir not getting changed data - instead it is going to the original backup location

I'm not sure why this is not working as expected. I have a full rsync backup of /scripts/source in /scripts/full and want to put differential backup into /scripts/diff However, when a file is added ...
1
vote
1answer
55 views

Rsync transfers everything instead of changed

I have tried many many different combinations of rsync commands, but whatever platform I use it on, from whatever source to whatever destination. It always transfers everything no matter if it's ...
1
vote
1answer
74 views

Find files with different inodes in same directory structure

We have a slight problem with our backups. Our setup is as follows: We create a backup using the rsync command. The backup uses the option --link-dest option, to create incremental backups with ...
2
votes
1answer
428 views

rsync permissions from Windows (cygwin) to Linux server

I'm trying to sync files from development machine running Windows (using cygwin) to staging server running Linux. I tried rsync -avz --no-p --no-g so synced directories/files would receive default ...
0
votes
1answer
494 views

File synchronization between two Linux servers

We have a two web servers running CentOS. We need to sync images that users uploaded. No servers should be needed to synchronize those, because we need to handle failover. Also, we need to do a ...
4
votes
5answers
993 views

Why every OS still can't resume file transferring? [closed]

I mean, Windows 7, Ubuntu 9.10 and Snow Leopard... All newest and top of line desktop operating system still use regular copy to transfer files, as it seems to me from experience. Instead of using ...
0
votes
1answer
830 views

How to copy only certain files and subdirectories

Hi let's say I have a directory like this: / my_work /dir1 keepdir1.ddd keepdir2.ddd file.cfg (lots ...
0
votes
1answer
41 views

Transfer to a remote machine, trouble with hostname

I'm connected to a remote host via SSH, I've read the rsync page and I understood that to transfer a file from my local machine to the remote host I have to do rsync myHostname:path/to/file ...
2
votes
1answer
2k views

rsync switch to only compare timestamps

Is there a way to let rsync only compare timestamps of files, and ignore their contents? That includes ignoring the file size. Just the timestamp. Nothing but the timestamp.
0
votes
0answers
36 views

Rsync for backup

I think I'm using rsync wrong as it appears to be backing up unchanged files I ran it yesterday and it's backup up again when I run today instead of skipping them. Why? EDIT Trying to back up to a ...
2
votes
2answers
3k views

Properly escaping forward slash in bash script for usage with sed

I'm trying to determine the size of the files that would be newly copied when syncing two folders by running rsync in dry mode and then summing up the sizes of the files listed in the output of rsync. ...
0
votes
0answers
1k views

Can't git push to Bitbucket.org — with ssh keys

I'm running doku-wiki on may (Ubuntu) laptop for some note taking. So, to keep backup, I was using Bitbucket and periodically pushed my wiki files there and everything worked smoothly. (a) Some time ...
0
votes
1answer
45 views

rsync per-site configuration file?

I know how to configure a per-site entry for ssh, but is there any kind of a client configuration for rsync that allows per-site configuration options and aliases or similar shortcuts like the ...
2
votes
1answer
508 views

rsync to windows (cygwin)

We have a windows file storage (don't ask) and now I want to rsync with the machine from Windows, Mac and Linux. So I installed freeSSHd (login shell is set to C:/cygwin64/bin/sh.exe), set up ...
0
votes
0answers
49 views

rsync stops at client version

I try to get rsync working between a freeSSHd Windows Server and Windows, Mac and Linux Clients. Current if I execute on Linux: rsync --progress -vvvvzrlt -e ssh myusername@10.254.0.108:/c/mypath ...
1
vote
2answers
141 views

Could server's support of RSync speed up backup process?

I have Synology 210j NAS, which supports rsync. Currently this feature is disabled and I use the following code to backup data there from my Mac: mkdir /Volumes/BackupTemp mount -t smbfs ...
2
votes
1answer
428 views

Why does rsync copy files after copying files manually?

I copied many files in many folders (~54GB) from an ext4 location to another with cp ~/1 ~/2 -d -r -v -i in bash. I then wanted to check that all files were copied correctly, so I ran rsync --delete ...
1
vote
0answers
215 views

File transfer tools for linux with support of zero-copy transfer

Are there small and simple file transfer tools for Linux, which can use "zero-copy" style of transferring files from HDD (SSD) to tcp socket, and back? I want to often send huge amount of ...
1
vote
1answer
78 views

Setting up Debian server for remote backups

I am running a Debian Wheezy server at home, and am offering an organization to let them do rsync backups to their own folder on my system. I created the unique user for them, and got a strong ...
2
votes
1answer
805 views

Rsync out of memory

I'm using a VPS (running Debian) with 512mb RAM. I'm trying to copy some file locally on the server with rsync, but it fails fast with this message: rsync: writefd_unbuffered failed to write 5 bytes ...
16
votes
4answers
6k views

Rsync friendly gzip

I must not be the only one - I'm rsyncing .tar.gz files and notice that every time the full file gets rsynced rather than the differences. Reading into it it seems back in 1999 someone created an ...
4
votes
4answers
7k views

Does rsync --inplace write to the entire file, or just to the parts that need to be updated? (for btrfs+rsync backups)

I was reading several guides how combine btrfs snapshots with rsync to make an efficient backup solution with history. However it all depends on if rsync --inplace modifies only those portions of ...
1
vote
1answer
660 views

How to speed up data transfer between Portable HD and NAS (QNAP)?

I am trying to transfer data from a Western Digital USB2 Drive to a QNAP TS-212E. I am transfering the data between the portable HD and the NAS using rsync (see following command). rsync -v -r -h ...
0
votes
1answer
322 views

ntfs disk dying or..? rsync and mkdir failing, strange behavior

System root@host:~# uname -a Linux host 3.2.0-4-686-pae #1 SMP Debian 3.2.57-3+deb7u1 i686 GNU/Linux Mounts root@host:~# mount | tail -2 /dev/sda1 on /mnt/sda1 type ntfs ...
0
votes
0answers
84 views

Win7 -> Linux cannot seem to copy large file without errors

I have a 70 GB file I am trying to copy from a Windows 7 machine to a Linux Mint 16 machine over a network, and I don't seem to be able to get the MD5 sums to match afterwards. I've so far tried two ...
0
votes
1answer
24 views

rsync exclude config.js but include lib/project/config.js

I have a folder like this / config.js /lib /project config.js In the root directory I execute rsync rsync -azvr --exclude config.js --include lib/project/config.js . dest The ...
1
vote
0answers
473 views

rsync failed: No Such file or directory

I'm using rsync in Windows ( through cygwin64 ) to backup some data to an samba share. I've made this bat file that would take care of everything: net use S: \\10.1.1.23\marc password /user:marc ...
0
votes
1answer
211 views

Make rsync update existing files first, create new ones later?

I have a source directory which I'm periodically syncing to a target using rsync: rsync --bwlimit=1600 --recursive --times --omit-dir-times --copy-links --modify-window=30 --inplace ...
3
votes
1answer
146 views

How to control permissions on external USB hard disk

I'm using RHEL 6.5, andhave an auto-mounted external USB drive. Any and all files created in the mounted filesystem are given permission 700 for dirs and 777 for files. The chmod command does not ...