Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.

learn more… | top users | synonyms

0
votes
0answers
81 views

Rsync over intermediate computer with autossh tunnel

I have two laptops with dynamic IP and I am trying to copy directly from one to the other. Lets call them, worklaptop, homelaptop, workserver Worklaptop has a perminant tunnel to workserver by way of ...
1
vote
1answer
636 views

can we use unix hardlinks on a mounted windows share?

ln command can create hard links on the mounted windows share, but cp -al fails. Is this expected behaviour? I'm trying to save disk space by creating copy on write style backups using cowdancer, ...
0
votes
0answers
13 views

Rsync doesn't respect --exclude-from; --exclude works

Any idea as to what the problem might be? --exclude works just fine, but when I stick the same line in a file and use --exclude-from=that_file, the exclude pattern no longer registers. (==the files do ...
0
votes
1answer
61 views

Use shell provided by non-root user

What is a good way for a non-root user to use an executable that is not in the system's list of shells as if it were the user's actual shell? I'm trying to do this with two different versions of ...
0
votes
1answer
408 views

cannot rsync via ssh from crontab

I'm having issues transferring files with rsync via ssh. If I just run rsync -avz devel@10.10.10.83:/home/devel/ $/home/user/rsync/servidor it works as expected since the public key is stored in ...
3
votes
3answers
6k views

Rsync as another user (www-data)

I usually use a graphical SSH client to sync a local and remote directory. And I have to set the ownership of all the files from root to www-data. Can I do the same with Rsync, only that I do it as ...
0
votes
1answer
60 views

Delete old backups alike Apple Time Machine does

Time Machine saves hourly backups for the past 24 hours, daily backups for the past month, and weekly backups for everything older than a month until the volume runs out of space. At that point, Time ...
1
vote
1answer
60 views

rsync ignoring partition directory

I use rsync to clone my internal hdd to an external disk. My system is Arch Linux. I have two partitions: / /data I am using the following rsync command: rsync -avzxt --progress --delete ...
0
votes
2answers
3k views

Get rsync to skip files with same size

I'm using the following command to copy a large number of big video files to external drives. rsync -Ph --inplace /Volumes/Production/Prefix* Prefix We had a power failure and the copying was ...
6
votes
5answers
13k views

rsync using regex to include only some files

I am trying to run rsync to copy some files recursively down a path based on their file name pattern, case insensitive. This is what I have done to run rsync: $ rsync -avvz --include ='*/' ...
1
vote
1answer
205 views

restoring files after doing rsync with compression

I understand that you can rsync with arg -z and -a for compress and archive. Can someone tell me with these options, does it affect the files being backed up in any way if ever they need to be ...
0
votes
2answers
833 views

Using rsync to recursively copy a directory while excluding a sub-directory but including a file in a sub-directory of the excluded sub-directory

I have a file tree that looks as such: in ├── file1 ├── dir1 └── dir2 ├── dir3 │   ├──── file2 │ └──── junk1 ├── junk2 └── junk3 I want to create a sibling of in which looks ...
1
vote
1answer
52 views

How to rsync the / folder properly?

I have a btrfs snapshot of / and I want to rsync it with my current / folder. As form of "rollback" if you want. My question is what folder should I avoid for instance I should use -x option to ...
1
vote
1answer
595 views

“No space left on device” when writing to NTFS on Ubuntu

I'm on Ubuntu 12.04 and want to backup data to my external hard drive which is NTFS. When running cp -rp or rsync, I get no space left errors like this: `rsync: mkstemp "/media/Expansion ...
0
votes
2answers
255 views

cwRsync permissions on external drive

I'm having problem using cwrsync to backup my data to an external drive as no data can't be opened on other computers because of permissions cwrsync sets. This is my backup batch script: @ECHO OFF ...
0
votes
1answer
103 views

rsync - exlude specific files from directories that are included

I have this script: #!bin/bash AMB="specific_dir*/***" SRC="/path/to/dir/" DST_1="user@host1:~/path/to/dest/" DST_2="virkantas@host2:~/path/to/dest/" DST_3="nodbaltic@host3:~/path/to/dest/" for DEST ...
0
votes
1answer
152 views

cwrsync and long file names issue

I am trying to use cwrsync on my windows server to backup to my linux server, but am running into an issue where the file names become too long. So a user on one of the systems will have a mapped ...
1
vote
2answers
2k views

Allowing multiple simultaneous rsyncs to play nice together

Each day I need to copy N files from a source location to a mirror at a specific time (where N is very large). Let's say I tell multiple CPUs to each run an rsync simultaneously on a subset of the ...
2
votes
1answer
282 views

offline incremental backup via thumbdrive? [closed]

I need to mirror one computer's 3 TB directory tree on another computer. The computers share no network [edit: they cannot communicate at all, "air barrier"], but I can transport a 32 GB thumbdrive ...
0
votes
3answers
451 views

CygWin rSync can't access file folder on Windows 7 with Vagrant

Facts- Machine is connected to domain User is a domain user Windows 7 running Cygwin with SSH / Rsync set up multiple times Running the rsync command from Cygwin finds the directory "c:\code" just ...
0
votes
2answers
375 views

Rsync Only Different Files with a Checksum?

Does anyone know if it's possible to run rsync to transfer all changed/new files in a directory (and its sub-directories) from my local OSX 10.9 machine up to a network share? The wrench in the plan ...
0
votes
1answer
105 views

rsnapshot or similar tool for no added size differential backup

I've currently got a backup that backs up all my files to an external hard drive, but currently I am traveling and I want to backup file changes, but without having to duplicate all the files, or ...
1
vote
1answer
394 views

How do I setup rsync and any other scripts to mimic a minimal viable replica of DropBox?

The tools I use to mimic the service are not as important as creating a reliable replacement in case something happens to the DropBox company (price flux, acquisition, etc) My original question was ...
0
votes
0answers
41 views

ssh indirectly to root

Is there a way to ssh to root on another machine even if PermitRootLogin is set to no, but ssh to a user is allowed and this user can just sudo -i to become root. For simple commands, I think there ...
0
votes
3answers
469 views

ssh config with sudo

I'm backing up my local machine to a remote server. Because I want to backup the whole local machine, even files that my local user doesn't normally have access to, I'm doing it using sudo, so the ...
0
votes
0answers
71 views

WordPress uploads rsync file ownership issues

I'm running a LEMP stack. Nginx is running as www-data user. It's running a WordPress installation. Every time I upload something the uploaded files belong to www-data as expected. I'm trying to ...
0
votes
0answers
425 views

Reading SMART results for failing disk

I recently started having trouble with my Dell laptop and would appreciate any recommendations on the next steps for my issue. I have portions of the dmesg log below to show the errors I'm getting. ...
0
votes
2answers
148 views

how does data integrity affect offline backups with rsync?

I am trying to understand the implications of bitrot and data corruption on my data on disks. Currently for my family photos (JPEG and MOVs), aside from storing them on my main pc, I have them on a ...
1
vote
1answer
252 views

Issue with rsync/cwrsync on windows

I'm having this batch script which i'm trying to make to backup stuff to my external drive. For some reason, it works just fine when I run it as administrator but not when i run it as a regular user. ...
-1
votes
1answer
634 views

Google Compute Engine - SSH or RSYNC without a Password

I have several Google Compute Engine (GCE) instances up and running. I have a few scripts that pull information (log files, etc) from these instances, and a few others that push up files. I would like ...
12
votes
3answers
20k views

rsync: failed to set times on “<dir path>”

I am trying to rsync files from one server to another but getting this error rsync: failed to set times on "/dept/intranet/dept/atest/.": Operation not permitted (1) Can someone help me why so ...
5
votes
1answer
366 views

Does Cygwin support hard links in Windows 8?

I'm working on a backup script that behaves like TimeMachine and uses RSync with --link-dest to create hardlinks to unchanged files. If I run this on a *Nix-based system, of course it works as ...
1
vote
1answer
333 views

Copying files without losing metadata in Linux

How on Linux can I copy things like music files with “Artist” and “Title” tags without losing the tags? Will rsync work? Will cp? Does either one need any specific switch?
0
votes
2answers
299 views

What is the correct way to move a Ubuntu server from one machine to another?

Attempted this three times now and not bee successful, so was hoping someone here could point me in the right direction? I am trying to move my Ubuntu 14.04 Server from one physical machine, to ...
2
votes
2answers
1k views

Copying folder from one Unix server to another, updating owners IDs

I'm using the method described here to copy a directory from one Unix server to another (both Ubuntu 14.04): rsync -aruv localfolder/ user@server:destination/ I need to keep the same owners and ...
0
votes
1answer
42 views

How to wait for 3 mints if the n/w got disconnected while copying in Rsync without failing using perl script?

I have to transfer 2-3 GB using Rsync.Everything is working fine, but my network got disconnected sometimes, and the entire process got failed. I want to retry it for the network for every 3 mints, ...
0
votes
1answer
82 views

Resume SCP download when using .pem file with rsync

I have a large file to down form a ssh server, however the connection keeps cutting out. I know that rsync can be used to resume the download however I can not find how to do this when I am using a ...
2
votes
2answers
1k views

Copy multiple sources to multiple destinations simultaneously

Suppose I need to copy files ~/path/to/file to user@remote:/path/to/file ~/path/to/another/file to user@remote:/path/to/another/file ~/path/alternative to user@remote:/path/alternative Is there is ...
33
votes
17answers
51k views

Best way to copy millions of files between 2 servers

I have roughly around 5 million small (5-30k) files in a single directory that I would like to copy to another machine on the same gigabit network. I tried using rsync, but it would slow down to a ...
1
vote
1answer
2k views

Rsync and Windows 7

Can someone give me any tips on setting up some sort of Rsync server/client on Windows 7 to run rsync between both my web hosting server, and a backup server that I have running Ubuntu? I've tried ...
3
votes
3answers
3k views

Any faster scp or rsync?

How can I transfer a large file quickly, when I don't really require a secure connection? Often I would like to copy a large file from local machine to remote machine. The file does not already ...
1
vote
2answers
656 views

Copy ubuntu from one PC to another

I have a very weird scenerio here, I have installed some softwares on my Ubuntu machine, Now I want to move everything (including windows)to another Machine B, notice Machine has no access to Internet ...
6
votes
1answer
4k views

rsync between two local directories

I am trying to do rsync between two directories I have in two filesystems connected to the same computer. I want to do it without deleting the extra files in b. I though a simple rsync -a a/dir b/dir ...
12
votes
3answers
13k views

rsync - does it create a temp file during transfer?

As far as I can see rsync doesn't create the file in the target directory until it is complete. This must mean that it creates the file in a temp directory somewhere and copies the file into the ...
3
votes
2answers
4k views

Rsync to multiple directories with one command?

I want to rsync my working directory to two other directories. One would destination would be for backup, another for testing it. I tried this: rsync -av --exclude='.git' source dest1,dest2 But ...
0
votes
1answer
2k views

How to remove/delete a vanished file?

[macek ~]$ rysnc -av /src /dest building file list ... file has vanished: "/src/file.ext" This will not generate error: [macek /src]$ rm file.ext Also strange: [macek /src]$ fi Tab The path will ...
1
vote
0answers
116 views

Is cp -au / cp --archive --update contradictory?

I want to update a directory on a backup disk with new content added to the source, and of course rsync is too slow. cp -a does the trick but is a bulldozer; cp -u should leave existing files alone. ...
8
votes
3answers
7k views

Why cwRsync doesn't work on Windows?

I'm trying to run rsync on Windows with the cwrsync port. I'm issuing the following command (note that this is just a dry run): rsync -nPaAz foouser@webxx.example.com:/home/foobar/webapps/barbaz/ ...
2
votes
1answer
161 views

What are the rsync equivalent command/s to mv /a/b /c/d?

What are the rsync equivalent command/s to mv /a/b/ /c/d/, i.e, to move a directory tree from one location to another, possibly on another file system? That is, not just copy, but delete the files ...
2
votes
2answers
4k views

How do I replicate the directory structure to a remote Linux server?

I want to replicate a complex directory structure from one Linux server to another remote server start at a certain sub-directory. I don't want the contents of the files, I just want to preserve the ...