Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.

learn more… | top users | synonyms

0
votes
0answers
37 views

running rsnapshot with hardlinks only?

We are running rsnapshot as a backup mechansim for long time but we manage also very huge systems which already take enough care about hardware failiure but don't have a convenient snapshot mechanism. ...
2
votes
2answers
3k views

rsync fails after server restart

Usually I use the command rsync -av --delete someroot/somedir user@remote_server_ip:/someroot/. on my development server to synchronize somedir to a remote server. It worked fine. But after the ...
0
votes
0answers
73 views

rsync --append-verify with a very unstable source

I'm trying to salvage files from a hard disk that is about to die (or it's the USB-SATA dock that's about to die, I can't be sure). The disk is GPT partitioned and has one HFS+ volume. I'm pretty much ...
10
votes
2answers
15k views

Use rsync to copy all files except for certain filenames with a certain extension

I have two same-size flash cards, and I want to copy contents of one to the other based on the following rules: I want all directories and subdirectories in place I want to exclude files of type ....
6
votes
2answers
4k views

Behavior of rsync with file that's still being written?

If Apache is in the middle of writing a large file and an rsync cron job runs on that file, does rsync attempt to copy the file? Example Apache-1: Has file large being written to /var/www. Apache-2:...
0
votes
1answer
36 views

Why do I sometimes have to double escape spaces in rsync paths?

When referring to paths with spaces, e.g. Steve Jobs, I can either backslash escape, or surround with quotes, when the path is the local directory: rsync Steve\ Jobs user@remote:/ or rsync "Steve ...
0
votes
2answers
169 views

Rsync with SSH prompting for remote password

I have followed the following guide to setup Rsync with SSH between my local machine and a remote server: I performed the below as root: rsync -avz -e ssh /home/user/dir root@192.168.200.10::Backup/...
1
vote
0answers
35 views

Make rsync honor directory setuid

I have a destination dir with id bit set, i.e. -rwxrws--- If I mkdir within this dir, it creates new dirs with the dir bit set. But when I rsync into it, rsync creates new dirs without the dir bit set....
0
votes
0answers
30 views

Restrict rsync operations to a subset of files

I have 2 directories that timestamped files are written to. At the end of the day, I would like to synchronize the directories so that they look exactly the same. I have something like this: dir1/ &...
0
votes
0answers
124 views

How to capture packets of rysnc using tcpdump

I am trying to do rysnc a 4G file to another directory and want to capture rsync packets using tcpdump. I tried listning to port 873 which is used for rsync but did not find anything captured. I ...
0
votes
0answers
39 views

Syncronizing with some variables

We have three product image folders on our server and their locations on server are also different. For making it clear i'll call them A,B,C here. The "A" folder have sub folders of different ...
0
votes
2answers
75 views

Rsync only files from specific user

Is there a way to rsync only files from a certain user? I have a folder which contains files from multiple users but would only like to backup files from a particular user. I've looked at the man ...
0
votes
2answers
76 views

Using multiple rsync processes with --remove-source-files

Let’s say that I have data on the order of terabytes, in files on the order of megabytes, to move away from a server that’s over 500 ms away. Due to the nature of TCP, the command below works but ...
0
votes
1answer
65 views

Why is Rsync is only sending an incremental file list via SSH?

I’m trying to copy clean Arch Linux installation and send it to other VPS trought SSH. It doesn’t do anything else than send out an incremental file list. rsync -axH --delete -e ssh --stats -P build/ ...
11
votes
4answers
11k views

Rsync print only files that would have been changed

Is there a way to get rsync to print the full filepaths to all files that are different without actually transferring any files? Alternatively, I need a way to diff the files across two trees (over ...
0
votes
0answers
19 views

How to copy/sync pictures with certain xmp tags only

I want to copy jpg pictures to a matching folder structure (one way syncing) only when they include a certain XMP tag. For example: I have ALL my pictures in a folder structure on drive A. Within the ...
0
votes
1answer
42 views

How to tell if Rsync transfer has finished from the remote computer?

If I am transferring a file or a directory form Computer A to Computer B, is there a way for me to tell (when SSH'd in to computer B) that the transfer is A. Complete or B. Finished with an error ...
0
votes
1answer
41 views

Linux script to move files from muilple directories

I am trying to create a script to move files once they are placed in a directory into sub directory Example Files placed in /home/userA/directory1 get moved into /home/userA/directory1/directory2 I ...
76
votes
16answers
95k views

How to synchronize the home folder between multiple computers?

I have three computers at home, and would like to have the /home/ folder tree synchronized between the three. Any files/folders (except those hidden) that are modified/added/removed in one of the ...
4
votes
4answers
10k views

How to arbitrarily map user/group ownerships in rsync

I need to rsync a directory to a remote server so that all files belonging to user X and group Y on the source (local) machine are mapped to user W and group Z on the destination (remote) machine. If ...
2
votes
1answer
71 views

Set up MySQL slave to slave replication

I have two machines with MySQL servers instances A and B. I want to add another MySQL server C which should replicate from B rather than from A. I may stop B but not A. These are the steps I tried: ...
0
votes
3answers
106 views

Syncing Large, Rarely Changing Files

I have a home server containing a fair amount of (legally-obtained) media files. When additions are made to this set when I am away, I would like to be able to sync these files to the remote copy on ...
6
votes
1answer
4k views

How to tell rsync to skip files on a damaged hard drive block, instead of being stuck trying to read it

I am trying to recover files from a disk that has hardware errors. The disk was repaired by disk utility, but it told me that the disk is damaged, so I need to backup everything before a failure will ...
1
vote
1answer
425 views

Run cygwin command from windows command line

I am trying to make PhpStorm run vagrant rsync when files are changed, because built-in rsync-auto fails with my deep directory structure. I am able to setup watcher in PhpStorm settings, but I don't ...
0
votes
0answers
11 views

ftp or rsync equivalent on windows 7 to acquire entire directory [duplicate]

I am not a Windows User, I am much more comfortable in Linux. My institution blocks ftp and rsync from my local Apple machine, and forces me to log on to a Windows 7 Virtual Machine. I want to ...
0
votes
2answers
30 views

Copy drive A to drive B on mount

I need some help with the problem of an automatic copy from drive A --> drive B. I want to detect a drive on mount as A - 1st mounted drive is A, as source drive. Detect the 2nd mounted drive as B - ...
3
votes
1answer
483 views

Rsync backups on btrfs very slow

My environment is Ubuntu 15.04 with kernel 3.19.0-28-generic and Btrfs v3.17. I have two identical external USB hard disks that I use with my backup script. One of them is formatted with btrfs and ...
0
votes
1answer
245 views

rsync directories that need sudo permissions on the remote server

I have one local server, let's call it as A, which has access to a remote server. I want to synchronize with rsync a directory from the remote server to the local one, and I want to put the ...
0
votes
1answer
56 views

Bash Script for mounting share and starting rsync

There is a need to migrate data from one server to another as we begin decommissioning the first server; the first server is an OS X 10.9.5 machine. I would like to devise a script that, when launched,...
0
votes
3answers
65 views

Rsyncing directories through ssh tunnel

I have 3 computers/servers, let's call them as computer A, computer B and computer C. Computer A has access via ssh to computer B. Only computer B has access via ssh to computer C. Computer A ...
1
vote
1answer
247 views

Proper rsync flags for backuping from ext4 to ZFS

I have a home server running Ubuntu 14.04.3 LTS with an ext4 file system, to which I regularly backup data from various devices. Now I have set-up an external USB HDD with ZFS file system and would ...
23
votes
3answers
15k views

Do I need to have a passphrase for my SSH RSA key?

Before I started at my current job (at a small business), my office had no firewall on the network and literally nothing was ever being backed up. Now that I've signed on as a dedicated sysadmin / one-...
6
votes
1answer
190 views

Why does rsync read .bashrc and not .profile?

rsync is a non-interactive program that logs into other machines. It shouldn't need the init file for an interactive shell session, and it should absolutely need the init file for a login shell. Or so ...
0
votes
3answers
861 views

Watch a filesystem and rsync changes in a cross-platform way with minimal dependencies

I'd like to start a long-running Ruby or Python script, and have the script watch a local directory for changes to files and new files. Periodically, the script will trigger a one-way rsync to a ...
1
vote
1answer
18 views

Spread rsync over several separate calls

I need to transfer a very large file with rsync (~1TB), but only transfer during a certain times (at night). The transfer takes longer than a single night, so I'd like to spread it across multiple ...
0
votes
0answers
15 views

Why did rsync removed files from my source directories?

I generated a subset of files to copy and saved it into tocopy.txt. Then I ran: rsync --progress -v --checksum --itemize-changes -r -a -z --files-from=/tmp/tocopy.txt user@server:/destination ...
0
votes
2answers
199 views

Rsync over SSH and passwordless key security

I need to send files from a group of servers to a remote server. My plan was to use rsync over SSH as it meets my requirement of a secure connection and the ability to delete from source upon ...
0
votes
0answers
22 views

Multiboot flash drive backup

I have a 16GB flash drive, formatted in FAT32 which contains multiple live linux distros, syslinux bootloader and personal data. I would like to make a backup of it and restore this backup on 64GDB ...
0
votes
0answers
69 views

IO errors from ESXi to OS X Server (NFS or rsync)

Ok, so here is the context. I have a OSX Server 10.8 inside a VM. This VM is attached to an iSCSI volume (from a thecus bay where it is a RAID5). This volume is shared via NFS and AFP. I have some ...
0
votes
0answers
189 views

Clean way to preserve permissions in backups from Linux stored on NTFS

With cygwin, rsync and SSH I have set up a backup mechanism that copies all of the vServers (running Debian) contents to my local NTFS hard drive (running Windows 10) and it works. Partially. I use ...
0
votes
0answers
110 views

How to kill or abort ssh and rsync reliably by parent process

I am calling rsync from my Qt application which in turn uses ssh to sync data from a remote server. The user of my application however could cancel or abort the sync process but the rsync.exe or ssh....
2
votes
1answer
293 views

Mac OS - running a bash script for rsync with different network credentials

I want to run rsync to copy files from local mac folders to a corporate network drive. To access the network drive I have to mount it using different credentials compared to my local user account. ...
0
votes
0answers
25 views

How much upstream traffic should a transfer over TCP produce

When a file is downloaded via some TCP-based protocol, there is also data flowing in the other direction – acknowledgement packages etc. Now if I watch some network monitor, I wonder if all of the ...
2
votes
1answer
59 views

Why isn't ownership preserved with “rsync -a” on my Mac?

I am copying files from an internal disk to an external one attached by USB (both are formatted as Mac OS Extended (Journaled)): root# rsync -avi /Volumes/int_hd/ /Volumes/ext_hd/ All directories ...
3
votes
2answers
1k views

Fastest way to delete a non empty directory in Linux

I use the command rm -rf directory but i came across the following article : Article That suggests that rsynch to an empty folder is the fastest way? rsync -a –delete empty/ a Why is this the case ? ...
10
votes
2answers
18k views

Rsync only changed files

Is it possible to have rsync transfer all files in a directory that have changed or have been created? I don't need something as sophisticated as a CRC diff check; files with different timestamps and/...
0
votes
0answers
37 views

Unable to change owner on a mapped drive directory

I am using a script to copy files from amazon instances to a network drive using rsync. After the file copy I am trying to change the owner of these transferred files but am not able to. What is the ...
0
votes
1answer
98 views

How do I make Unison behave like rsync?

I have two roots, /sync and ssh://bob@remotehost//sync. These roots contain three subfolders: paul, bob and sam. I currently sync them using the following script: rsync -a --delete --delete-excluded -...
1
vote
1answer
419 views

Alternative to diff with progress for massive directory compare?

I just rsync-ed 2,000,000 files (3TB) from one RAID to another. I want to make sure my data is intact. rsync -c takes a really long time. diff doesn't show me what it's doing. Is there an ...
13
votes
3answers
11k views

linux merge folders: rsync?

I have two copies of a folder src/ dest/ I want to merge them, doing the following: If a file is only in src, I want it to be moved to dest If a file is only in dest, I want it ignored IE left ...