Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.

learn more… | top users | synonyms

5
votes
2answers
18k views

How to Setup Rsync without password with SSH on UNIX / Linux?

How can I set up a rsync between two hosts without providing any password?
0
votes
1answer
106 views

Do GUI and Terminal execution (of Back In Time/Grsync/other Linux apps) produce the same results?

I've opened Back In Time GUI and copied the whole rsync ... line from the last log into Terminal and executed it in Terminal. Question #1 is: if I were to do it the normal way (click 'Take snapshot' ...
0
votes
0answers
45 views

Secure copy one folder to multiple destinations in OS X

Sorry for asking what looks like a question that's been asked a few times. I'm very far from being a super user, which makes it very difficult for me to be able to expand on a relatively complex ...
0
votes
1answer
52 views

Fast splitting of list of files in chunks of the same size (memory)

See title. Assume I have the following list of files and relatives sizes: cat list_of_files.txt: 1243 001.txt 124 002.txt 4132 003.txt 3000 004.txt I want to be able to split into multiple chunks ...
-1
votes
2answers
4k views

How to copy files from remote machine (ubuntu) to local machine (windows)?

I would like to know about two ways: scp and rsync and how exactly they are used to copy files. I tried doing scp ubuntu@ip-10-124-83-21:/home/* /home/ubuntu/crockonjs-2-hd.mov but it didn't work. ...
0
votes
0answers
26 views

Terminal 2 way ftp sync

I am looking for a way to sync a directory/path on my computer with an ftp server so that all the files that are newer will be copied and will replace the old files. The files that have been created ...
3
votes
1answer
93 views

Using pv(1) to limit rsync speed

I'm trying to use pv rather than rsync's builtin --bwlimit to limit the bandwidth of an rsync transfer because --bwlimit is implemented in an eventually-consistent way, and my transfers are so short ...
0
votes
3answers
114 views

How to write files in specific order?

Okay, here's a weird problem -- My wife just bought a 2014 Nissan Altima. So, I took her iTunes library and converted the .m4a files to .mp3, since the car audio system only supports .mp3 and .wma. ...
1
vote
0answers
150 views

Synology NAS resume rsync backup after connection loss

I am trying to do a backup from a synology NAS to an offsite NAS. I am using rsync through DSM5 as of now, but it doesn't give me the possibility to resume the backup if a connection loss occurs. This ...
1
vote
2answers
68 views

How can I rsync a set of subdirectories?

I have a source directory that looks like the following (with numerous subdirectories inside of the src and bin dirs): top_dir proj1 src/ bin/ scripts/ somefile.txt proj2 src/ bin/ target bin/ ...
0
votes
1answer
138 views

rsync --backup-dir not getting changed data - instead it is going to the original backup location

I'm not sure why this is not working as expected. I have a full rsync backup of /scripts/source in /scripts/full and want to put differential backup into /scripts/diff However, when a file is added ...
1
vote
1answer
55 views

Rsync transfers everything instead of changed

I have tried many many different combinations of rsync commands, but whatever platform I use it on, from whatever source to whatever destination. It always transfers everything no matter if it's ...
1
vote
1answer
69 views

Find files with different inodes in same directory structure

We have a slight problem with our backups. Our setup is as follows: We create a backup using the rsync command. The backup uses the option --link-dest option, to create incremental backups with ...
2
votes
1answer
408 views

rsync permissions from Windows (cygwin) to Linux server

I'm trying to sync files from development machine running Windows (using cygwin) to staging server running Linux. I tried rsync -avz --no-p --no-g so synced directories/files would receive default ...
0
votes
1answer
467 views

File synchronization between two Linux servers

We have a two web servers running CentOS. We need to sync images that users uploaded. No servers should be needed to synchronize those, because we need to handle failover. Also, we need to do a ...
4
votes
5answers
980 views

Why every OS still can't resume file transferring? [closed]

I mean, Windows 7, Ubuntu 9.10 and Snow Leopard... All newest and top of line desktop operating system still use regular copy to transfer files, as it seems to me from experience. Instead of using ...
0
votes
1answer
822 views

How to copy only certain files and subdirectories

Hi let's say I have a directory like this: / my_work /dir1 keepdir1.ddd keepdir2.ddd file.cfg (lots ...
0
votes
1answer
38 views

Transfer to a remote machine, trouble with hostname

I'm connected to a remote host via SSH, I've read the rsync page and I understood that to transfer a file from my local machine to the remote host I have to do rsync myHostname:path/to/file ...
2
votes
1answer
2k views

rsync switch to only compare timestamps

Is there a way to let rsync only compare timestamps of files, and ignore their contents? That includes ignoring the file size. Just the timestamp. Nothing but the timestamp.
0
votes
0answers
36 views

Rsync for backup

I think I'm using rsync wrong as it appears to be backing up unchanged files I ran it yesterday and it's backup up again when I run today instead of skipping them. Why? EDIT Trying to back up to a ...
2
votes
2answers
2k views

Properly escaping forward slash in bash script for usage with sed

I'm trying to determine the size of the files that would be newly copied when syncing two folders by running rsync in dry mode and then summing up the sizes of the files listed in the output of rsync. ...
0
votes
0answers
1k views

Can't git push to Bitbucket.org — with ssh keys

I'm running doku-wiki on may (Ubuntu) laptop for some note taking. So, to keep backup, I was using Bitbucket and periodically pushed my wiki files there and everything worked smoothly. (a) Some time ...
0
votes
1answer
45 views

rsync per-site configuration file?

I know how to configure a per-site entry for ssh, but is there any kind of a client configuration for rsync that allows per-site configuration options and aliases or similar shortcuts like the ...
2
votes
1answer
470 views

rsync to windows (cygwin)

We have a windows file storage (don't ask) and now I want to rsync with the machine from Windows, Mac and Linux. So I installed freeSSHd (login shell is set to C:/cygwin64/bin/sh.exe), set up ...
0
votes
0answers
47 views

rsync stops at client version

I try to get rsync working between a freeSSHd Windows Server and Windows, Mac and Linux Clients. Current if I execute on Linux: rsync --progress -vvvvzrlt -e ssh myusername@10.254.0.108:/c/mypath ...
1
vote
2answers
135 views

Could server's support of RSync speed up backup process?

I have Synology 210j NAS, which supports rsync. Currently this feature is disabled and I use the following code to backup data there from my Mac: mkdir /Volumes/BackupTemp mount -t smbfs ...
2
votes
1answer
421 views

Why does rsync copy files after copying files manually?

I copied many files in many folders (~54GB) from an ext4 location to another with cp ~/1 ~/2 -d -r -v -i in bash. I then wanted to check that all files were copied correctly, so I ran rsync --delete ...
1
vote
0answers
204 views

File transfer tools for linux with support of zero-copy transfer

Are there small and simple file transfer tools for Linux, which can use "zero-copy" style of transferring files from HDD (SSD) to tcp socket, and back? I want to often send huge amount of ...
1
vote
1answer
77 views

Setting up Debian server for remote backups

I am running a Debian Wheezy server at home, and am offering an organization to let them do rsync backups to their own folder on my system. I created the unique user for them, and got a strong ...
2
votes
1answer
784 views

Rsync out of memory

I'm using a VPS (running Debian) with 512mb RAM. I'm trying to copy some file locally on the server with rsync, but it fails fast with this message: rsync: writefd_unbuffered failed to write 5 bytes ...
16
votes
4answers
6k views

Rsync friendly gzip

I must not be the only one - I'm rsyncing .tar.gz files and notice that every time the full file gets rsynced rather than the differences. Reading into it it seems back in 1999 someone created an ...
4
votes
4answers
7k views

Does rsync --inplace write to the entire file, or just to the parts that need to be updated? (for btrfs+rsync backups)

I was reading several guides how combine btrfs snapshots with rsync to make an efficient backup solution with history. However it all depends on if rsync --inplace modifies only those portions of ...
1
vote
1answer
616 views

How to speed up data transfer between Portable HD and NAS (QNAP)?

I am trying to transfer data from a Western Digital USB2 Drive to a QNAP TS-212E. I am transfering the data between the portable HD and the NAS using rsync (see following command). rsync -v -r -h ...
0
votes
1answer
308 views

ntfs disk dying or..? rsync and mkdir failing, strange behavior

System root@host:~# uname -a Linux host 3.2.0-4-686-pae #1 SMP Debian 3.2.57-3+deb7u1 i686 GNU/Linux Mounts root@host:~# mount | tail -2 /dev/sda1 on /mnt/sda1 type ntfs ...
0
votes
0answers
79 views

Win7 -> Linux cannot seem to copy large file without errors

I have a 70 GB file I am trying to copy from a Windows 7 machine to a Linux Mint 16 machine over a network, and I don't seem to be able to get the MD5 sums to match afterwards. I've so far tried two ...
0
votes
1answer
24 views

rsync exclude config.js but include lib/project/config.js

I have a folder like this / config.js /lib /project config.js In the root directory I execute rsync rsync -azvr --exclude config.js --include lib/project/config.js . dest The ...
1
vote
0answers
461 views

rsync failed: No Such file or directory

I'm using rsync in Windows ( through cygwin64 ) to backup some data to an samba share. I've made this bat file that would take care of everything: net use S: \\10.1.1.23\marc password /user:marc ...
0
votes
1answer
204 views

Make rsync update existing files first, create new ones later?

I have a source directory which I'm periodically syncing to a target using rsync: rsync --bwlimit=1600 --recursive --times --omit-dir-times --copy-links --modify-window=30 --inplace ...
3
votes
1answer
138 views

How to control permissions on external USB hard disk

I'm using RHEL 6.5, andhave an auto-mounted external USB drive. Any and all files created in the mounted filesystem are given permission 700 for dirs and 777 for files. The chmod command does not ...
0
votes
0answers
11 views

Using an SD card for regular backups? [duplicate]

I recently updated to a 128 GB solid state drive, and I've gotta say, I love the boot times and app load times, however I'm not keen on the increased possibility of spontaneous failure. I figure I've ...
0
votes
1answer
384 views

How to make rsync completely ignore permission from source

I'm trying to use rsync to copy from an Android source where the sdcard mount has rather nonsensical permissions (---rwxr-x) and rsync fails because it creates the destination directories with the ...
3
votes
3answers
1k views

Is there a way to use plink with rsync on Windows?

I use rsync to sync files between a local directory and a remote host. I also use plink to automate my SSH passphase entry. What I can't figure out is how to use rsync with plink. This is what I ...
3
votes
2answers
691 views

How do I compare two folders recursively and generate a list of files and folders that are different?

tl;dr and an example I'm looking for a way to compare two folders recursively and output the relative paths all files (and folders) that are different (by size or by timestamp, à la rsync). For ...
0
votes
1answer
27 views

Below what network speed should I be using compression for an rsync transfer?

I'm transferring some files from a remote server. The speeds for the transfer are abysmal (~1 MBps), and have got me thinking about optimizing the transfer for speed. At what network speed does it ...
0
votes
2answers
34 views

rsync from two servers to a common location

I have two servers and I want to rsync files from both servers to a single location. Server 1 has files A and B Server 2 has files A and B After rsync server 3 has file A and B When a user ...
0
votes
0answers
45 views

Rsync to Samba Mount fails to set time

I have a NAS box which I have mounted to my Ubuntu 10.04 box which I am rsyncing to as a nightly backup. I'm trying to use this command: rsync -itrvz The problem is that the -t option causes ...
0
votes
1answer
34 views

without ssh key setup, can have write a non-interactive script to rsync/scp/etc withut me having to input the password everytime?

Is there some switch/option for ssh or rsync (something like -u username -p passowrd) that would allow me to pass in the password?
0
votes
2answers
44 views

Rsync folders automatization

I've got a folder on the remote server, to which I'm connecting via SSH. When I need to synchronise folders I'm using manually access via scp. (I'm synchronising my folder with the folder on the ...
1
vote
1answer
60 views

What does the output of rsync look like when it completes successfully?

I used rsync to back up my main drive to an external drive last night. At some point in the night the external drive was unplugged. This is the tail of the output of rsync -avRP ... ...
0
votes
0answers
21 views

rsync to machine A via machine B over ssh

rsync to a remote machine A over ssh is simple. rsync -v -e 'ssh user@A' local-file ... connecting to a remote machine A via another remote machine B is also simple ssh -t user@B ssh user@A How ...