Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.

learn more… | top users | synonyms

3
votes
1answer
596 views

Preserve icon with rsync

I was under the impression from here among other research, that rsync was the command used to sync directories and any contents they have. I have tried the following commands: rsync -avzr ...
2
votes
1answer
111 views

Understanding rsync's include / exclude patterns

I want to transfer N files from a remote system, using a pattern: ssh remote ls target/ 2013-08-01.mjson.gz 2014-07-04.mjson.gz 2014-07-09.mjson.gz 2014-08-12.mjson.gz ... I only want the 2014-07* ...
1
vote
0answers
135 views

hash-based asyncronous directory comparison

I am trying to efficiently synchronize two large directories via VPN over a long distance. Unfortunately I cannot install advanced tools like git or rsync on the remote server due to company ...
0
votes
0answers
105 views

Backup certain folders to NAS with exFat

Hello everybody who has the same problem, trying to help or just reading! Recently I've bought one of IcyBox IB-NAS5520 NAS with 2 x 1TB drives in raid1. I've tryed to follow this idea: How to set ...
0
votes
1answer
271 views

automatic file encryption on NFS or RSYNC for remote incremental backup?

What solutions should I be looking at to allow an incremental backup via rsync over nfs4 to allow files to be encrypted on the backup host? I have zero control over the backup host's software so the ...
7
votes
4answers
3k views

File copying utility like rsync with error handling like ddrescue, for data recovery from a hard drive with bad sectors or hardware failure [closed]

I have a hard drive with either bad blocks or sectors that are failing to read due to potential mechanical issues, such as a bad disk head, bad motor, or some other issue that is causing the hard ...
0
votes
0answers
20 views

Check if file is being read by remote rsync

I'm working on a script to copy files from one location to another (both are raspberry pis running raspbian). I have it set so that files are rsynced from one to the other (overnight, transferring ...
1
vote
0answers
186 views

rsync seems to overwrite already existing file on ExFat

I have a curious behavior from rsync between two hard drives containing the exact same four partitions. However on one partition rsync seems to always copy again the files, I don't understand why. ...
2
votes
2answers
142 views

Command line cp or rsync to crawl drive seeking only specific file types and put them somewhere?

Is it possible only using the command line to use something like the cp or rsync command to crawl a hard-drive seeking only image/video files? And maybe in the process of copying them over to another ...
0
votes
1answer
35 views

move files from a list of files

So, I have a list of files in a text file. I believe it's about 100,000 files. The files in said list are spread across many directories, have different sizes, filenames, extensions, ages, etc. I am ...
0
votes
2answers
263 views

rsync 3 TB of data to 2x 2TB big external drives

Is it possible to rsync my 3TB big hard drive to two external 2TB hard drives? If so what would the command look like? If not, can you think of another solution to sync 3TB of data to 2x 2TB drives? ...
1
vote
1answer
50 views

Will an rsync copy operation “fix” issues with invalid file block counts, or does it preserve everything exactly as the source?

Here are the events surrounding my question, which may make things more relevant: I had a hard drive fail recently, to the point where neither Disk Utility or asr could fix the structure to a ...
0
votes
0answers
10 views

Different low uplink machines hold the same data, how to speed up rsync to machine with faster connection?

Two different machines hold the same data (10G+), both with relatively slow upload. I want to transfer the data to a machine that can receive with a much faster speed. Now to speed up transfer of ...
1
vote
0answers
86 views

rsync over ssh tunnel: What does this repeated message mean? debug2: channel 2: window 1966080 sent adjust 131072

I'm rsyncing through an SSH tunnel (with ssh -vv). It's not very fast and I'm getting this message about every second: debug2: channel 2: window 1966080 sent adjust 131072 Once in a while I also ...
0
votes
1answer
44 views

Source host doesn't have access to Internet, but can SSH to host that has; how can I rsync to a third, Internet host?

This is the command I used to run from my SOURCE machine rsync -Rrlt --progress --delay-updates ./my_folder root@machine-on-same-network:/home/me/. Now I need to copy over this same folder to a ...
0
votes
0answers
82 views

Rsync and find filter

I'm trying to use rsync in combination with find to restrict the number of files to copy. My code looks like this: for NODE in $NODES; do echo Processing $NODE ........ for LOGDIR in ...
0
votes
1answer
542 views

Sync only files after a specific time with rsync

I have a server from which I want to copy files and directories to a local destination. The local destination does not have any of the files or directories on it. Instead of copying all files on the ...
1
vote
0answers
94 views

Rsync doesn't allow me copy files into mounted filesystems

I configured rsyncd.conf for public access in my rpi: log file = /var/log/rsyncd.log timeout = 600 max connections = 20 uid = nobody gid = nogroup read only = yes list = yes [public] path = ...
12
votes
1answer
6k views

How to exclude rsync excludes from delete?

I'm using rsync to sync files across multiple machines, using the following: rsync -az -e "ssh -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no" \ --delete --delete-excluded --force ...
3
votes
3answers
4k views

RSync to WebDAV mounted volume very slow

I have a mounted WebDAV store, which I am playing around with to try and put together my own pseudo-DropBox set up. However, it seems very slow to upload larger files (my bandwidth graph goes ok for a ...
15
votes
1answer
10k views

Resume transfer of a single file by rsync

In Ubuntu, I want to copy a big file from my harddrive to a removable drive by rsync. For some reason or other, the operation cannot complete in a single run. So I am trying to figure out how to use ...
3
votes
1answer
16k views

How to interpret and fix a Input/output error in Linux?

I am running a daily backup with rsync. Starting some days ago, one of the files has been throwing this error during the backup: rsync: read errors mapping "/home/folder/file.ext": Input/output error ...
0
votes
0answers
1k views

How to always let rsync continue when (permission denied) error occurs

The following error happened with a rsync task. rsync: send_files failed to open "/home/user/scripts/@eaDir/script.js@SynoEAStream": Permission denied (13) rsync error: some files/attrs were not ...
25
votes
6answers
24k views

Why is rsync -avz faster than scp -r?

I'm a bit puzzled by this? Why is rsync faster than scp? Doesn't rsync use scp beneath or does it do something more efficient? Is there some way to speed up scp?
0
votes
1answer
85 views

Ununtu 12.0.4 LTS Boots to some unknown mount point

I installed Ubuntu 12.0.4 LTS to a 2TB Sata with a swap partition and a data partition. I installed mdadm and setup an incomplete raid. I later unmounted that raid (to which it erred as non-existent) ...
8
votes
3answers
7k views

How to best clone a running system to a new harddisk using rsync?

I have a system running as a server that has a failing harddrive. While all important data is on a RAID and backed up and all that, I don't have an image of the system itself. There is no specific ...
0
votes
2answers
55 views

Syncing directory between Kubuntu and Windows 7

I recently came across an issue on my work computer. I'm running Kubuntu 14.04 as my main development OS and Windows 7 for compatibility with some company software and network stuff. My problem is ...
5
votes
2answers
22k views

How to Setup Rsync without password with SSH on UNIX / Linux?

How can I set up a rsync between two hosts without providing any password?
0
votes
1answer
148 views

Do GUI and Terminal execution (of Back In Time/Grsync/other Linux apps) produce the same results?

I've opened Back In Time GUI and copied the whole rsync ... line from the last log into Terminal and executed it in Terminal. Question #1 is: if I were to do it the normal way (click 'Take snapshot' ...
0
votes
1answer
62 views

Fast splitting of list of files in chunks of the same size (memory)

See title. Assume I have the following list of files and relatives sizes: cat list_of_files.txt: 1243 001.txt 124 002.txt 4132 003.txt 3000 004.txt I want to be able to split into multiple chunks ...
-1
votes
2answers
6k views

How to copy files from remote machine (ubuntu) to local machine (windows)?

I would like to know about two ways: scp and rsync and how exactly they are used to copy files. I tried doing scp ubuntu@ip-10-124-83-21:/home/* /home/ubuntu/crockonjs-2-hd.mov but it didn't work. ...
3
votes
1answer
115 views

Using pv(1) to limit rsync speed

I'm trying to use pv rather than rsync's builtin --bwlimit to limit the bandwidth of an rsync transfer because --bwlimit is implemented in an eventually-consistent way, and my transfers are so short ...
0
votes
3answers
165 views

How to write files in specific order?

Okay, here's a weird problem -- My wife just bought a 2014 Nissan Altima. So, I took her iTunes library and converted the .m4a files to .mp3, since the car audio system only supports .mp3 and .wma. ...
1
vote
0answers
204 views

Synology NAS resume rsync backup after connection loss

I am trying to do a backup from a synology NAS to an offsite NAS. I am using rsync through DSM5 as of now, but it doesn't give me the possibility to resume the backup if a connection loss occurs. This ...
1
vote
2answers
113 views

How can I rsync a set of subdirectories?

I have a source directory that looks like the following (with numerous subdirectories inside of the src and bin dirs): top_dir proj1 src/ bin/ scripts/ somefile.txt proj2 src/ bin/ target bin/ ...
0
votes
1answer
215 views

rsync --backup-dir not getting changed data - instead it is going to the original backup location

I'm not sure why this is not working as expected. I have a full rsync backup of /scripts/source in /scripts/full and want to put differential backup into /scripts/diff However, when a file is added ...
1
vote
1answer
63 views

Rsync transfers everything instead of changed

I have tried many many different combinations of rsync commands, but whatever platform I use it on, from whatever source to whatever destination. It always transfers everything no matter if it's ...
1
vote
1answer
83 views

Find files with different inodes in same directory structure

We have a slight problem with our backups. Our setup is as follows: We create a backup using the rsync command. The backup uses the option --link-dest option, to create incremental backups with ...
2
votes
1answer
508 views

rsync permissions from Windows (cygwin) to Linux server

I'm trying to sync files from development machine running Windows (using cygwin) to staging server running Linux. I tried rsync -avz --no-p --no-g so synced directories/files would receive default ...
0
votes
1answer
586 views

File synchronization between two Linux servers

We have a two web servers running CentOS. We need to sync images that users uploaded. No servers should be needed to synchronize those, because we need to handle failover. Also, we need to do a ...
4
votes
5answers
1k views

Why every OS still can't resume file transferring? [closed]

I mean, Windows 7, Ubuntu 9.10 and Snow Leopard... All newest and top of line desktop operating system still use regular copy to transfer files, as it seems to me from experience. Instead of using ...
0
votes
1answer
881 views

How to copy only certain files and subdirectories

Hi let's say I have a directory like this: / my_work /dir1 keepdir1.ddd keepdir2.ddd file.cfg (lots ...
0
votes
1answer
58 views

Transfer to a remote machine, trouble with hostname

I'm connected to a remote host via SSH, I've read the rsync page and I understood that to transfer a file from my local machine to the remote host I have to do rsync myHostname:path/to/file ...
2
votes
1answer
2k views

rsync switch to only compare timestamps

Is there a way to let rsync only compare timestamps of files, and ignore their contents? That includes ignoring the file size. Just the timestamp. Nothing but the timestamp.
6
votes
2answers
5k views

Properly escaping forward slash in bash script for usage with sed

I'm trying to determine the size of the files that would be newly copied when syncing two folders by running rsync in dry mode and then summing up the sizes of the files listed in the output of rsync. ...
0
votes
0answers
1k views

Can't git push to Bitbucket.org — with ssh keys

I'm running doku-wiki on may (Ubuntu) laptop for some note taking. So, to keep backup, I was using Bitbucket and periodically pushed my wiki files there and everything worked smoothly. (a) Some time ...
0
votes
1answer
54 views

rsync per-site configuration file?

I know how to configure a per-site entry for ssh, but is there any kind of a client configuration for rsync that allows per-site configuration options and aliases or similar shortcuts like the ...
2
votes
1answer
658 views

rsync to windows (cygwin)

We have a windows file storage (don't ask) and now I want to rsync with the machine from Windows, Mac and Linux. So I installed freeSSHd (login shell is set to C:/cygwin64/bin/sh.exe), set up ...
1
vote
2answers
182 views

Could server's support of RSync speed up backup process?

I have Synology 210j NAS, which supports rsync. Currently this feature is disabled and I use the following code to backup data there from my Mac: mkdir /Volumes/BackupTemp mount -t smbfs ...
3
votes
1answer
476 views

Why does rsync copy files after copying files manually?

I copied many files in many folders (~54GB) from an ext4 location to another with cp ~/1 ~/2 -d -r -v -i in bash. I then wanted to check that all files were copied correctly, so I ran rsync --delete ...