Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.

learn more… | top users | synonyms

19
votes
3answers
8k views

Do I need to have a passphrase for my SSH RSA key?

Before I started at my current job (at a small business), my office had no firewall on the network and literally nothing was ever being backed up. Now that I've signed on as a dedicated sysadmin / ...
5
votes
1answer
64 views

Why does rsync read .bashrc and not .profile?

rsync is a non-interactive program that logs into other machines. It shouldn't need the init file for an interactive shell session, and it should absolutely need the init file for a login shell. Or so ...
0
votes
0answers
10 views

rsync directories with sudo permissions on the remote server

I have one server which has access to a remote server, let's call it as A. I'm trying to rsyncing a remote directory from the remote server and I want to put the synchronized directory in a mounted ...
0
votes
3answers
35 views

Rsyncing directories through ssh tunnel

I have 3 computers/servers, let's call them as computer A, computer B and computer C. Computer A has access via ssh to computer B. Only computer B has access via ssh to computer C. Computer A ...
0
votes
1answer
3k views

How to set/keep directory permissions?

I'm using CwRsync to connect from my Windows development machine to a linux webserver : rsync -avuz -e ./ssh --exclude=".svn" /cygdrive/c/xampp/htdocs/project123/ ...
0
votes
3answers
432 views

Watch a filesystem and rsync changes in a cross-platform way with minimal dependencies

I'd like to start a long-running Ruby or Python script, and have the script watch a local directory for changes to files and new files. Periodically, the script will trigger a one-way rsync to a ...
4
votes
4answers
6k views

Rsync print only files that would have been changed

Is there a way to get rsync to print the full filepaths to all files that are different without actually transferring any files? Alternatively, I need a way to diff the files across two trees (over ...
1
vote
1answer
16 views

Spread rsync over several separate calls

I need to transfer a very large file with rsync (~1TB), but only transfer during a certain times (at night). The transfer takes longer than a single night, so I'd like to spread it across multiple ...
0
votes
0answers
12 views

Why did rsync removed files from my source directories?

I generated a subset of files to copy and saved it into tocopy.txt. Then I ran: rsync --progress -v --checksum --itemize-changes -r -a -z --files-from=/tmp/tocopy.txt user@server:/destination ...
0
votes
2answers
39 views

Rsync over SSH and passwordless key security

I need to send files from a group of servers to a remote server. My plan was to use rsync over SSH as it meets my requirement of a secure connection and the ability to delete from source upon ...
1
vote
2answers
6k views

Permission problems with rsync

I wanna do daily ssh synchronization of some of my local machines files with my server. I want to do this via rsync, since it sounds the most promising tool for this task to me. Sadly I get the ...
0
votes
0answers
16 views

Multiboot flash drive backup

I have a 16GB flash drive, formatted in FAT32 which contains multiple live linux distros, syslinux bootloader and personal data. I would like to make a backup of it and restore this backup on 64GDB ...
0
votes
0answers
17 views

IO errors from ESXi to OS X Server (NFS or rsync)

Ok, so here is the context. I have a OSX Server 10.8 inside a VM. This VM is attached to an iSCSI volume (from a thecus bay where it is a RAID5). This volume is shared via NFS and AFP. I have some ...
0
votes
3answers
4k views

rsync option --log-file seems not to be working

I am using the --log-file option in rsync to see the logs. But when I tried to run, it says: --log-file unrecognized option Here is my command: #/usr/bin/rsync -av -u ...
0
votes
0answers
26 views

Clean way to preserve permissions in backups from Linux stored on NTFS

With cygwin, rsync and SSH I have set up a backup mechanism that copies all of the vServers (running Debian) contents to my local NTFS hard drive (running Windows 10) and it works. Partially. I use ...
0
votes
0answers
25 views

rsync: connection unexpectedly closed - Migration from AWS to Digital Ocean

I'm trying to migrate my Django site from AWS to DigitalOcean. I'm following this tutorial My problem is that I can't rsyncmy files. Just as info, I'm able to connect via ssh to my Digital Ocean's ...
0
votes
0answers
17 views

How to kill or abort ssh and rsync reliably by parent process

I am calling rsync from my Qt application which in turn uses ssh to sync data from a remote server. The user of my application however could cancel or abort the sync process but the rsync.exe or ...
2
votes
1answer
43 views

Mac OS - running a bash script for rsync with different network credentials

I want to run rsync to copy files from local mac folders to a corporate network drive. To access the network drive I have to mount it using different credentials compared to my local user account. ...
2
votes
2answers
2k views

rsync fails after server restart

Usually I use the command rsync -av --delete someroot/somedir user@remote_server_ip:/someroot/. on my development server to synchronize somedir to a remote server. It worked fine. But after the ...
0
votes
0answers
15 views

How much upstream traffic should a transfer over TCP produce

When a file is downloaded via some TCP-based protocol, there is also data flowing in the other direction – acknowledgement packages etc. Now if I watch some network monitor, I wonder if all of the ...
1
vote
1answer
17 views

Why isn't ownership preserved with “rsync -a” on my Mac?

I am copying files from an internal disk to an external one attached by USB (both are formatted as Mac OS Extended (Journaled)): root# rsync -avi /Volumes/int_hd/ /Volumes/ext_hd/ All directories ...
3
votes
2answers
681 views

Fastest way to delete a non empty directory in Linux

I use the command rm -rf directory but i came across the following article : Article That suggests that rsynch to an empty folder is the fastest way? rsync -a –delete empty/ a Why is this the case ? ...
9
votes
2answers
14k views

Rsync only changed files

Is it possible to have rsync transfer all files in a directory that have changed or have been created? I don't need something as sophisticated as a CRC diff check; files with different timestamps ...
0
votes
0answers
10 views

Unable to change owner on a mapped drive directory

I am using a script to copy files from amazon instances to a network drive using rsync. After the file copy I am trying to change the owner of these transferred files but am not able to. What is the ...
0
votes
1answer
34 views

How do I make Unison behave like rsync?

I have two roots, /sync and ssh://bob@remotehost//sync. These roots contain three subfolders: paul, bob and sam. I currently sync them using the following script: rsync -a --delete --delete-excluded ...
0
votes
1answer
268 views

Alternative to diff with progress for massive directory compare?

I just rsync-ed 2,000,000 files (3TB) from one RAID to another. I want to make sure my data is intact. rsync -c takes a really long time. diff doesn't show me what it's doing. Is there an ...
13
votes
3answers
11k views

linux merge folders: rsync?

I have two copies of a folder src/ dest/ I want to merge them, doing the following: If a file is only in src, I want it to be moved to dest If a file is only in dest, I want it ignored IE left ...
1
vote
1answer
22 views

Limit rsync to available space on destination

I have a directory, /data/snapshots, which I'd like to archive to an external drive mounted at /mnt. The external is 2tb, /data/snapshots is much more. If I: rysnc -av /data/snapshot /mnt Then ...
4
votes
4answers
3k views

rsync synchronizing files only without creating folders on destination

Is it possible with rsync to not create directories on destination? Imagine I have that source : a/ a/x.txt b/ b/y.txt And that I have this destination : a/ a/z.txt The wanted result of rsync ...
0
votes
0answers
30 views

Linux: sync/merge two (or more) directories, but keep older file versions?

got alotta help throughout the time just by simply scrolling and crawling through the vast landscape of qualified answers here from you, now's the time to ask my first question and it looks rather ...
0
votes
0answers
22 views

Making mbuffer faster

I'm trying to transfer files as fast as possible across a 10 gig network connection. Up until now, I've been using rsync to move large files across the network, but I'm trying mbuffer now because I've ...
4
votes
5answers
10k views

Does rsync --inplace write to the entire file, or just to the parts that need to be updated? (for btrfs+rsync backups)

I was reading several guides how combine btrfs snapshots with rsync to make an efficient backup solution with history. However it all depends on if rsync --inplace modifies only those portions of ...
18
votes
5answers
20k views

rsync file permissions on windows

I have an rsync service that syncs files from remote machine to a machine that drops them on a network drive. I need the copied files to take on the native permissions of the destination folder. ...
0
votes
0answers
39 views

Accessing rsync folder after windows re-install

I am using cygwin to backup my Debian VPS to my Windows PC. All is fine, but if I re-install Windows I can't access the backup folder until I change the owner of the folder and all its children. ...
0
votes
0answers
42 views

How to roll back rsync backup, and having trouble targeting a particular partition for backup

I'm using Linux Mint 17.1. I tried to set up a backup with rsync using the following command: sudo rsync -aAXv --exclude={"/dev/*","/proc/*","/media/*"} /* /media/hex/ I just installed an m.2 SSD ...
1
vote
1answer
25 views

How to maintain a remote cloned directory with rsync?

I have SSH access (using a SSH key pair) to a remote machine. I want to keep a directory on the remote machine exactly equal to a given local directory (one way sync). The check for file equality ...
0
votes
0answers
24 views

rsync tree but ignore folders where a .git directory exists?

All I found were questions how to ignore the .git directory when using rsync - my question is a little different: I want to ignore the whole tree from the point where the .git directory exists. ./ ...
0
votes
1answer
21 views

How to properly migrate a constantly changing set of files from one NAS to another?

I am moving 4.4TB of files from one NAS to another, both running Ubuntu. However there is one thing that made me a bit worried whether rsync would work or not: there is a folder whose contents that is ...
2
votes
1answer
2k views

Rsync to a WebDAV filesystem on OS X copies all files regardless of being changed or not

I am trying to sync from my (Mac) desktop to an iPad and an iPhone. MacOS X mounts WebDAV as a native file system, but syncing results in all files in my directory structure being copied again. This ...
0
votes
1answer
44 views

Fastest way to duplicate encrypted hard drives?

I used hard drive duplicator to do the sector-by-sector duplication of hard drives. I think it took about 5 hours. Pros: easy unattended, computer-free operation Cons: hard drive size ...
1
vote
1answer
20 views

Rsync behaviour/differences & newbie

From my understanding, rsync over SMB tries to build a file list each time on source/destination to check any changes have been modified before a copy takes please. I’m trying to understand the ...
0
votes
1answer
55 views

How to safely synchronize two folders without duplicates?

I have an account on mega and I want to synchronize it with a folder on my computer. The problem is, that this account is public to some extent so I can't just use rsync with --delete in case someone ...
0
votes
0answers
11 views

Use rsync on bare device

Is it feasible to use rsync on bare device files, like rsync /dev/sdb user@remote:/dev/sdb or even rsync /dev/sdb user@remote:images/sdb.img to sync two drives or a drive image?
1
vote
0answers
43 views

How to rsync root files over non-root ssh?

I have two machines, both providing no root login, but provide sudo root access. Now I like to initate a rsync transfer of root files over ssh. Is there an easy way make the the root access given by ...
55
votes
3answers
41k views

What are the differences between the rsync delete options?

I see on the rsync man page that there are a number of delete options, but don't really understand the differences between them. What are the differences between these options? --del ...
0
votes
1answer
119 views

Rsync-like automatic delta backup of a removable hard drive on windows

Well a lot of questions have been asked on the SE network about using rsync on Windows. But nothing seems to really do the trick so I'd like to expose the specific mechanism I need to setup. Lets say ...
1
vote
1answer
62 views

Cannot delete file on Linux

After backuping with 'rsync --archive --update' my home directory from ext4 to btrfs, rsync reports errors like this: rsync: ...
0
votes
2answers
116 views

OS X file copy fills up the system drive

I have a Mac Mini with a 40GB system drive and the time has come to move all the user data to an external drive, as I only have 750MB left. So I plugged in a 1TB firewire drive and used Finder to ...
0
votes
0answers
62 views

Synchronize two folders over sftp?

I have a cloned git repository in a directory and a sftp server, I want the server to be in sync with my repository. I've been trying multiple Atom/Sublime Text plugins with no luck, they only upload ...
1
vote
2answers
654 views

How to avoid rsync -b to backing up backup files

I always do a mutual sync by issuing always "rsync -avuzb src dest" and then "rsync -avuzb dest src". If I use "rsync -avuzb ", already existing files are renamed to ~ on the destination, due to the ...