Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.

learn more… | top users | synonyms

79
votes
16answers
97k views

How to synchronize the home folder between multiple computers?

I have three computers at home, and would like to have the /home/ folder tree synchronized between the three. Any files/folders (except those hidden) that are modified/added/removed in one of the ...
4
votes
2answers
2k views

rsync over SSH with cron in osx-environment

I want to automatically download files and folders from a Linux server to which I have an SSH (and FTP) account. The files shall be downloaded on a regular basis (I suppose a cron is the right tool to ...
4
votes
2answers
4k views

rsync as a background process?

I've been using rsync to sync a bunch of files between my two servers. I set a cron job that would run rsync every minute. However, I'd prefer if I could have it run always, so that files are synced ...
6
votes
1answer
4k views

How to tell rsync to skip files on a damaged hard drive block, instead of being stuck trying to read it

I am trying to recover files from a disk that has hardware errors. The disk was repaired by disk utility, but it told me that the disk is damaged, so I need to backup everything before a failure will ...
21
votes
4answers
16k views

How to do rsync-like encrypted backup?

I want to save a backup of my data on a remote server, but never want the backup server to see the data unencrypted. Editing a single file and backing up should not result in everything being ...
12
votes
1answer
11k views

How can I set environment variables for a remote rsync process?

When I use rsync to copy files from one computer to another, an rsync process is started on both ends. However, on the remote end, shell initialization files are apparently not read, so I cannot set ...
7
votes
5answers
44k views

What similar rsync tool for Windows? [closed]

What can you recommend of an application that looks the same on rsync for windows? I will be doing migration where I need to transfer data from Windows to Linux. I like the rsync on linux where you ...
2
votes
4answers
4k views

Make rsync case insensitive

I'm rsync'ing a bunch of files between a Windows and a Linux system. Since not all Windows care about case, some of the files on the Windows system no longer have the same casing as they had on the ...
1
vote
2answers
4k views

rsync slow copy from one disk to another

I got two drives of the same model which are connected using SATA. When benchmarking read speeds using hdparm -t /dev/sdX, speeds of about 160MB/s are returned. When benchmarking write-speed using dd ...
3
votes
2answers
4k views

How do I compare two folders recursively and generate a list of files and folders that are different?

tl;dr and an example I'm looking for a way to compare two folders recursively and output the relative paths all files (and folders) that are different (by size or by timestamp, à la rsync). For ...
1
vote
2answers
877 views

sync local and remote directories using rsync?

I have two linux box that i would like to keep in sync. I see option -avz syncs the remote with local but new local files are not pushed. How do i do this?
20
votes
4answers
24k views

Run rsync with root permission on remote machine

I want to sync a folder from my machine with a folder on a remote machine. The remote folder can only be manipulated by root. I have an account on the remote machine which can use sudo. How can I run ...
23
votes
3answers
16k views

Do I need to have a passphrase for my SSH RSA key?

Before I started at my current job (at a small business), my office had no firewall on the network and literally nothing was ever being backed up. Now that I've signed on as a dedicated sysadmin / one-...
19
votes
5answers
26k views

rsync file permissions on windows

I have an rsync service that syncs files from remote machine to a machine that drops them on a network drive. I need the copied files to take on the native permissions of the destination folder. ...
29
votes
3answers
18k views

Resume rsync over SSH after broken connection?

I have to transfer large amounts of data (>80 GB) over ssh using rsync. Everything is working fine, but the DSL connection where the backup data is sent from will drop once every 24h for up to 3 ...
13
votes
3answers
11k views

linux merge folders: rsync?

I have two copies of a folder src/ dest/ I want to merge them, doing the following: If a file is only in src, I want it to be moved to dest If a file is only in dest, I want it ignored IE left ...
23
votes
2answers
30k views

rsync and symbolic links

I want to backup my home directory to an external drive nightly using a cron job to execute rsync. I am unsure of the exact behavior of rsync's symbolic link flags. rsync's -a flag includes the -l ...
5
votes
3answers
4k views

Stop a Mac from sleeping while a bash script is running, then allow it to sleep as normal once complete

I've got my Mac to wake up during the night and run an rsync to back it up. This is configured through Energy Saver > Schedule. However it seems that it's going back to sleep before it can get ...
13
votes
3answers
24k views

rsync: failed to set times on “<dir path>”

I am trying to rsync files from one server to another but getting this error rsync: failed to set times on "/dept/intranet/dept/atest/.": Operation not permitted (1) Can someone help me why so ?...
13
votes
5answers
37k views

How to use rsync from Windows PC to remote Linux server?

How do I use the rsync command from a local Windows 7 machine to a remote Linux server? What software is needed on the Windows 7 machine to use rsync? The remote Linux server is using Amazon's Linux ...
13
votes
2answers
17k views

rsync --remove-source-files deletes source files one by one or after rsync completes?

I have a rsync command in an application that copies the contents of a folder to another machine. I have the option --remove-source-files because I'm only interested in having the files on the ...
9
votes
4answers
5k views

File copying utility like rsync with error handling like ddrescue, for data recovery from a hard drive with bad sectors or hardware failure [closed]

I have a hard drive with either bad blocks or sectors that are failing to read due to potential mechanical issues, such as a bad disk head, bad motor, or some other issue that is causing the hard ...
4
votes
5answers
1k views

Why every OS still can't resume file transferring? [closed]

I mean, Windows 7, Ubuntu 9.10 and Snow Leopard... All newest and top of line desktop operating system still use regular copy to transfer files, as it seems to me from experience. Instead of using ...
14
votes
2answers
13k views

rsync files newer than 1 week

I want to run rsync on server A to copy all files from Server B when they are newer than 7 days.(find . -mtime -7) I don't want to delete the files on Server B. Thanks for you help.
7
votes
1answer
3k views

Unicode Characters in Ubuntu Server

I recently migrated from Ubuntu Desktop 13.04 to Ubuntu Server 13.10 and now my filesystem doesn't seem to support unicode characters. I use rsync to backup/sync files and it shows the proper ...
6
votes
2answers
8k views

Rsync, two-way sync, and syncing file-deletion operations

I use rsync in the following manner: rsync -Pvaz me@192.168.*.***:Documents/ /Users/me/Documents/ rsync -Pvaz /Users/me/Documents/ me@192.168.*.***:Documents/ The problem: if I delete a file on my ...
4
votes
2answers
3k views

rsync N newest files in a directory

What would be the easiest way to go about rsyncing the n newest files in a directory to a remote server?
11
votes
2answers
13k views

How to rsync a large file, with as little CPU and bandwidth expense as possible?

I have a 500 GB file that I plan on backing up remotely. The file changes often. I'll be rsyncing it from a desktop to a server. Both can run rsync client or server. What is the proper command for ...
9
votes
3answers
8k views

Why cwRsync doesn't work on Windows?

I'm trying to run rsync on Windows with the cwrsync port. I'm issuing the following command (note that this is just a dry run): rsync -nPaAz foouser@webxx.example.com:/home/foobar/webapps/barbaz/ C:\...
8
votes
3answers
30k views

rsync Permission denied backing up a remote directory to my local machine

I'm getting the error mentioned in the title. I found this similar question: Run rsync with root permission on remote machine. That doesn't answer my question. I'm the admin on the remote server ...
7
votes
5answers
15k views

rsync using regex to include only some files

I am trying to run rsync to copy some files recursively down a path based on their file name pattern, case insensitive. This is what I have done to run rsync: $ rsync -avvz --include ='*/' --include='...
6
votes
5answers
5k views

Copy a large file over an unreliable link

This isn't really a question about programming, but it is a question about working as a programmer. I hope this is an appropriate forum for this question. I work from home. My Windows XP based ...
4
votes
4answers
10k views

How to arbitrarily map user/group ownerships in rsync

I need to rsync a directory to a remote server so that all files belonging to user X and group Y on the source (local) machine are mapped to user W and group Z on the destination (remote) machine. If ...
3
votes
2answers
82 views

How do I efficiently move a large, empty disk image to another system

I'm currently trying to move a fairly empty, fresh qcow2 image from one system to another that's far away. I've basically got a fresh install of ubuntu LTS (real size 6gb, apparent size 200gb). Most ...
3
votes
2answers
1k views

Redirect all SSH traffic through a “middleman” server

this is my setup right now: A. My NAS with static IP, reachable via SSH from the Internet (OS X) B. a VPS (Ubuntu Server) C. a dedicated server (Gentoo) My question: Due to bad peering i want to ...
2
votes
1answer
3k views

Rsync difference between two directories to a 3rd directory

How would I go about rsyncing the difference between two directories to a 3rd directory. For example, if I have the command rsync -av --progress --stats /hdd1/ /hdd2/ I would like to copy the ...
1
vote
1answer
262 views

Identify files that would be deleted when removing an rsync --link-dest directory?

I have a Time Machine-style backup system set up on my NAS (running BusyBox v1.16.1), using rsync --link-dest as described here: http://blog.interlinked.org/tutorials/rsync_time_machine.html Is there ...
1
vote
4answers
4k views

Rsync root files between systems without specifying password

This seems very tricky to me. I've set up my two systems so that I can rsync files between them as me, without specifying password. Now the the problem is to rsync files that belong to root. On both ...
1
vote
1answer
498 views

How can I limit the disk I/O priority for a process in Windows XP?

I have a setup where a Windows XP machine gets backed up to a server on the LAN, using rsync. Because of operational requirements, the backup needs to happen while the machine is in use. While this is ...
1
vote
1answer
6k views

How to set up rsync to backup from win7 to NAS?

I'd like to use cwRsync to back up some files from my Win7 notebook to my Synology DS211j NAS at home. (Why cwRsync? That should be another question, but basically because I tried quite a number of ...
1
vote
1answer
472 views

Divide out local files in different servers with limited space with rsync

I have 80 GB of files in a local directory that I want to back up, dividing them out onto different servers with a limited space quota, using rsync, like so: LOCAL 80 Gb ====> server1: first 30 Gb ...
0
votes
2answers
497 views

Rsync-like automatic delta backup of a removable hard drive on windows

Well a lot of questions have been asked on the SE network about using rsync on Windows. But nothing seems to really do the trick so I'd like to expose the specific mechanism I need to setup. Lets say ...
12
votes
2answers
5k views

Does anyone know why rsync would keep sending the files over and over again?

I'm trying to using rsync to backup some files, about half a TB. It's now it a state where it keeps sending the same files everytime it runs. for example: rsync -av /data/source/* user@host:/data/...
3
votes
1answer
6k views

Leave ACL handling to Windows with Cygwin rsync

I'm running an rsync command, copying my files from a server to my Windows machine like: rsync -rt --partial-dir=".rsync" --del rsync://server/a/ a/ Whenever this command creates a directory, it ...
2
votes
3answers
802 views

How can this backup strategy work?

I am trying to script a very simple backup strategy. Here is the general idea. Daily - Backup the entire filesystem using rsync, overwriting the previous day's backup. Weekly - Once a week copy the ...
1
vote
2answers
1k views

Script/Batch command to initiate file transfer between Windows and Ubuntu

So I've setup a backup system for my notebook. Using Rsync, I am able to backup specific folders to my Ubuntu Home Server by executing a batch file. My question is about the possibility of automating ...
1
vote
5answers
1k views

What is the best way to perform daily/weekly/monthly backups?

I am currently running a script in leopard every few days to make sure I have backed up my data on a remote server using: #!/bin/bash rsync -avvz ~/Documents ~/Workspace -e ssh admin@myhost.com:~/...
0
votes
3answers
254 views

Does rsync require 2 computers?

I am wanting to use something like rsync (i think). I am using Windows 7, I would like to be able to sync files/folder to other Disks on 1 computer, sometimes, just keep 2 folders or more in sync on ...
-1
votes
1answer
628 views

What is Git Bash for Windows anyway?

I have happily been using git and git bash from https://git-scm.com/. There is a page with more information here: https://git-for-windows.github.io/. Yesterday I ran into a problem with rsync and ...