Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.

learn more… | top users | synonyms

6
votes
5answers
8k views

rsync using regex to include only some files

I am trying to run rsync to copy some files recursively down a path based on their file name pattern, case insensitive. This is what I have done to run rsync: $ rsync -avvz --include ='*/' ...
0
votes
0answers
3 views

Rsync file has vanished error on OS X

I'm trying to rsync between two shared drives. For the most part this works fine, however any file with international characters reports the following error: file has vanished: ...
1
vote
2answers
2k views

rsync fails after server restart

Usually I use the command rsync -av --delete someroot/somedir user@remote_server_ip:/someroot/. on my development server to synchronize somedir to a remote server. It worked fine. But after the ...
1
vote
1answer
14 views

restoring files after doing rsync with compression

I understand that you can rsync with arg -z and -a for compress and archive. Can someone tell me with these options, does it affect the files being backed up in any way if ever they need to be ...
0
votes
2answers
655 views

Using rsync to recursively copy a directory while excluding a sub-directory but including a file in a sub-directory of the excluded sub-directory

I have a file tree that looks as such: in ├── file1 ├── dir1 └── dir2 ├── dir3 │   ├──── file2 │ └──── junk1 ├── junk2 └── junk3 I want to create a sibling of in which looks ...
1
vote
1answer
21 views

How to rsync the / folder properly?

I have a btrfs snapshot of / and I want to rsync it with my current / folder. As form of "rollback" if you want. My question is what folder should I avoid for instance I should use -x option to ...
0
votes
1answer
29 views

“No space left on device” when writing to NTFS on Ubuntu

I'm on Ubuntu 12.04 and want to backup data to my external hard drive which is NTFS. When running cp -rp or rsync, I get no space left errors like this: `rsync: mkstemp "/media/Expansion ...
0
votes
2answers
228 views

Watch a filesystem and rsync changes in a cross-platform way with minimal dependencies

I'd like to start a long-running Ruby or Python script, and have the script watch a local directory for changes to files and new files. Periodically, the script will trigger a one-way rsync to a ...
0
votes
2answers
29 views

cwRsync permissions on external drive

I'm having problem using cwrsync to backup my data to an external drive as no data can't be opened on other computers because of permissions cwrsync sets. This is my backup batch script: @ECHO OFF ...
0
votes
1answer
2k views

How to set/keep directory permissions?

I'm using CwRsync to connect from my Windows development machine to a linux webserver : rsync -avuz -e ./ssh --exclude=".svn" /cygdrive/c/xampp/htdocs/project123/ ...
0
votes
1answer
21 views

rsync - exlude specific files from directories that are included

I have this script: #!bin/bash AMB="specific_dir*/***" SRC="/path/to/dir/" DST_1="user@host1:~/path/to/dest/" DST_2="virkantas@host2:~/path/to/dest/" DST_3="nodbaltic@host3:~/path/to/dest/" for DEST ...
0
votes
0answers
15 views

Mac won't boot from a mirrored drive

I'm cloning the two internal volumes SSD and HD to one external volume by telling rsync to resolve symlinks and copy the actual files / directories: sudo rsync --acls \ --archive \ ...
0
votes
1answer
85 views

cwrsync and long file names issue

I am trying to use cwrsync on my windows server to backup to my linux server, but am running into an issue where the file names become too long. So a user on one of the systems will have a mapped ...
10
votes
2answers
11k views

rsync --remove-source-files deletes source files one by one or after rsync completes?

I have an rsync command in an application that copies the contents of a folder to another machine. I have the option --remove-source-files because I'm only interested in having the files on the ...
1
vote
2answers
1k views

Allowing multiple simultaneous rsyncs to play nice together

Each day I need to copy N files from a source location to a mirror at a specific time (where N is very large). Let's say I tell multiple CPUs to each run an rsync simultaneously on a subset of the ...
1
vote
1answer
33 views

offline incremental backup via thumbdrive? [closed]

I need to mirror one computer's 3 TB directory tree on another computer. The computers share no network [edit: they cannot communicate at all, "air barrier"], but I can transport a 32 GB thumbdrive ...
0
votes
3answers
200 views

CygWin rSync can't access file folder on Windows 7 with Vagrant

Facts- Machine is connected to domain User is a domain user Windows 7 running Cygwin with SSH / Rsync set up multiple times Running the rsync command from Cygwin finds the directory "c:\code" just ...
0
votes
2answers
25 views

Rsync Only Different Files with a Checksum?

Does anyone know if it's possible to run rsync to transfer all changed/new files in a directory (and its sub-directories) from my local OSX 10.9 machine up to a network share? The wrench in the plan ...
1
vote
2answers
4k views

Permission problems with rsync

I wanna do daily ssh synchronization of some of my local machines files with my server. I want to do this via rsync, since it sounds the most promising tool for this task to me. Sadly I get the ...
0
votes
2answers
4k views

rsync option --log-file seems is not working

I am using the --log-file option in rsync to see the logs. But when I tried to run, it says: --log-file unrecognized option Here is my command: #/usr/bin/rsync -av -u ...
0
votes
1answer
30 views

rsnapshot or similar tool for no added size differential backup

I've currently got a backup that backs up all my files to an external hard drive, but currently I am traveling and I want to backup file changes, but without having to duplicate all the files, or ...
1
vote
1answer
372 views

How do I setup rsync and any other scripts to mimic a minimal viable replica of DropBox?

The tools I use to mimic the service are not as important as creating a reliable replacement in case something happens to the DropBox company (price flux, acquisition, etc) My original question was ...
0
votes
0answers
27 views

ssh indirectly to root

Is there a way to ssh to root on another machine even if PermitRootLogin is set to no, but ssh to a user is allowed and this user can just sudo -i to become root. For simple commands, I think there ...
0
votes
3answers
29 views

ssh config with sudo

I'm backing up my local machine to a remote server. Because I want to backup the whole local machine, even files that my local user doesn't normally have access to, I'm doing it using sudo, so the ...
0
votes
0answers
17 views

WordPress uploads rsync file ownership issues

I'm running a LEMP stack. Nginx is running as www-data user. It's running a WordPress installation. Every time I upload something the uploaded files belong to www-data as expected. I'm trying to ...
2
votes
1answer
2k views

Rsync to a WebDAV filesystem on OS X copies all files regardless of being changed or not

I am trying to sync from my (Mac) desktop to an iPad and an iPhone. MacOS X mounts WebDAV as a native file system, but syncing results in all files in my directory structure being copied again. This ...
0
votes
0answers
83 views

Reading SMART results for failing disk

I recently started having trouble with my Dell laptop and would appreciate any recommendations on the next steps for my issue. I have portions of the dmesg log below to show the errors I'm getting. ...
0
votes
2answers
40 views

how does data integrity affect offline backups with rsync?

I am trying to understand the implications of bitrot and data corruption on my data on disks. Currently for my family photos (JPEG and MOVs), aside from storing them on my main pc, I have them on a ...
1
vote
1answer
43 views

Issue with rsync/cwrsync on windows

I'm having this batch script which i'm trying to make to backup stuff to my external drive. For some reason, it works just fine when I run it as administrator but not when i run it as a regular user. ...
0
votes
1answer
79 views

Google Compute Engine - SSH or RSYNC without a Password

I have several Google Compute Engine (GCE) instances up and running. I have a few scripts that pull information (log files, etc) from these instances, and a few others that push up files. I would like ...
0
votes
0answers
29 views

can we use unix hardlinks on a mounted windows share?

ln command can create hard links on the mounted windows share, but cp -al fails. Is this expected behaviour? I'm trying to save disk space by creating copy on write style backups using cowdancer, ...
0
votes
0answers
23 views

SecGenericPasswordCreate failed when trying to rsync

Hi I'm trying to rsync my Mac OSX 10.6 to a folder on a server in which I have an account. I have followed the instructions reported on www.rsync.net. I have created the public key (where as ...
0
votes
0answers
11 views

Rsync over NFS I/O error

We have two servers running CentOS 6.4. Both are NFS servers and each have shares mounted from each other. Regardless of which direction the transfer goes (upload or download) it fails after a few ...
0
votes
0answers
17 views

Troubles backing up some files from Linux system to FreeNAS using rsync

I'm using rsync to backup whole system over LAN to freeNAS server with this command: rsync -aAX --delete /* /mnt/backup ...
6
votes
3answers
13k views

rsync: failed to set times on “<dir path>”

I am trying to rsync files from one server to another but getting this error rsync: failed to set times on "/dept/intranet/dept/atest/.": Operation not permitted (1) Can someone help me why so ...
5
votes
1answer
88 views

Does Cygwin support hard links in Windows 8?

I'm working on a backup script that behaves like TimeMachine and uses RSync with --link-dest to create hardlinks to unchanged files. If I run this on a *Nix-based system, of course it works as ...
1
vote
1answer
30 views

Copying files without losing metadata in Linux

How on Linux can I copy things like music files with “Artist” and “Title” tags without losing the tags? Will rsync work? Will cp? Does either one need any specific switch?
4
votes
2answers
123 views

Behavior of rsync with file that's still being written?

If Apache is in the middle of writing a large file and an rsync cron job runs on that file, does rsync attempt to copy the file? Example Apache-1: Has file large being written to /var/www. ...
0
votes
2answers
36 views

What is the correct way to move a Ubuntu server from one machine to another?

Attempted this three times now and not bee successful, so was hoping someone here could point me in the right direction? I am trying to move my Ubuntu 14.04 Server from one physical machine, to ...
2
votes
2answers
852 views

Copying folder from one Unix server to another, updating owners IDs

I'm using the method described here to copy a directory from one Unix server to another (both Ubuntu 14.04): rsync -aruv localfolder/ user@server:destination/ I need to keep the same owners and ...
4
votes
4answers
3k views

How to arbitrarily map user/group ownerships in rsync

I need to rsync a directory to a remote server so that all files belonging to user X and group Y on the source (local) machine are mapped to user W and group Z on the destination (remote) machine. If ...
0
votes
1answer
25 views

How to wait for 3 mints if the n/w got disconnected while copying in Rsync without failing using perl script?

I have to transfer 2-3 GB using Rsync.Everything is working fine, but my network got disconnected sometimes, and the entire process got failed. I want to retry it for the network for every 3 mints, ...
0
votes
1answer
23 views

Resume SCP download when using .pem file with rsync

I have a large file to down form a ssh server, however the connection keeps cutting out. I know that rsync can be used to resume the download however I can not find how to do this when I am using a ...
2
votes
2answers
106 views

Copy multiple sources to multiple destinations simultaneously

Suppose I need to copy files ~/path/to/file to user@remote:/path/to/file ~/path/to/another/file to user@remote:/path/to/another/file ~/path/alternative to user@remote:/path/alternative Is there is ...
28
votes
17answers
36k views

Best way to copy millions of files between 2 servers

I have roughly around 5 million small (5-30k) files in a single directory that I would like to copy to another machine on the same gigabit network. I tried using rsync, but it would slow down to a ...
1
vote
1answer
2k views

Rsync and Windows 7

Can someone give me any tips on setting up some sort of Rsync server/client on Windows 7 to run rsync between both my web hosting server, and a backup server that I have running Ubuntu? I've tried ...
2
votes
3answers
3k views

Any faster scp or rsync?

How can I transfer a large file quickly, when I don't really require a secure connection? Often I would like to copy a large file from local machine to remote machine. The file does not already ...
1
vote
2answers
70 views

Copy ubuntu from one PC to another

I have a very weird scenerio here, I have installed some softwares on my Ubuntu machine, Now I want to move everything (including windows)to another Machine B, notice Machine has no access to Internet ...
4
votes
1answer
1k views

rsync between two local directories

I am trying to do rsync between two directories I have in two filesystems connected to the same computer. I want to do it without deleting the extra files in b. I though a simple rsync -a a/dir b/dir ...
5
votes
3answers
7k views

rsync - does it create a temp file during transfer?

As far as I can see rsync doesn't create the file in the target directory until it is complete. This must mean that it creates the file in a temp directory somewhere and copies the file into the ...