Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.

learn more… | top users | synonyms

0
votes
0answers
24 views

Rsync over intermediate computer with autossh tunnel

I have two laptops with dynamic IP and I am trying to copy directly from one to the other. Lets call them, worklaptop, homelaptop, workserver Worklaptop has a perminant tunnel to workserver by way of ...
0
votes
1answer
105 views

can we use unix hardlinks on a mounted windows share?

ln command can create hard links on the mounted windows share, but cp -al fails. Is this expected behaviour? I'm trying to save disk space by creating copy on write style backups using cowdancer, ...
0
votes
0answers
8 views

Rsync doesn't respect --exclude-from; --exclude works

Any idea as to what the problem might be? --exclude works just fine, but when I stick the same line in a file and use --exclude-from=that_file, the exclude pattern no longer registers. (==the files do ...
0
votes
1answer
47 views

Use shell provided by non-root user

What is a good way for a non-root user to use an executable that is not in the system's list of shells as if it were the user's actual shell? I'm trying to do this with two different versions of ...
0
votes
1answer
87 views

cannot rsync via ssh from crontab

I'm having issues transferring files with rsync via ssh. If I just run rsync -avz devel@10.10.10.83:/home/devel/ $/home/user/rsync/servidor it works as expected since the public key is stored in ...
1
vote
3answers
3k views

Rsync as another user (www-data)

I usually use a graphical SSH client to sync a local and remote directory. And I have to set the ownership of all the files from root to www-data. Can I do the same with Rsync, only that I do it as ...
0
votes
1answer
22 views

Delete old backups alike Apple Time Machine does

Time Machine saves hourly backups for the past 24 hours, daily backups for the past month, and weekly backups for everything older than a month until the volume runs out of space. At that point, Time ...
1
vote
1answer
18 views

rsync ignoring partition directory

I use rsync to clone my internal hdd to an external disk. My system is Arch Linux. I have two partitions: / /data I am using the following rsync command: rsync -avzxt --progress --delete ...
0
votes
2answers
2k views

Get rsync to skip files with same size

I'm using the following command to copy a large number of big video files to external drives. rsync -Ph --inplace /Volumes/Production/Prefix* Prefix We had a power failure and the copying was ...
6
votes
5answers
9k views

rsync using regex to include only some files

I am trying to run rsync to copy some files recursively down a path based on their file name pattern, case insensitive. This is what I have done to run rsync: $ rsync -avvz --include ='*/' ...
0
votes
0answers
44 views

Rsync file has vanished error on OS X

I'm trying to rsync between two shared drives. For the most part this works fine, however any file with international characters reports the following error: file has vanished: ...
1
vote
1answer
53 views

restoring files after doing rsync with compression

I understand that you can rsync with arg -z and -a for compress and archive. Can someone tell me with these options, does it affect the files being backed up in any way if ever they need to be ...
0
votes
2answers
688 views

Using rsync to recursively copy a directory while excluding a sub-directory but including a file in a sub-directory of the excluded sub-directory

I have a file tree that looks as such: in ├── file1 ├── dir1 └── dir2 ├── dir3 │   ├──── file2 │ └──── junk1 ├── junk2 └── junk3 I want to create a sibling of in which looks ...
1
vote
1answer
33 views

How to rsync the / folder properly?

I have a btrfs snapshot of / and I want to rsync it with my current / folder. As form of "rollback" if you want. My question is what folder should I avoid for instance I should use -x option to ...
0
votes
1answer
271 views

“No space left on device” when writing to NTFS on Ubuntu

I'm on Ubuntu 12.04 and want to backup data to my external hard drive which is NTFS. When running cp -rp or rsync, I get no space left errors like this: `rsync: mkstemp "/media/Expansion ...
0
votes
2answers
319 views

Watch a filesystem and rsync changes in a cross-platform way with minimal dependencies

I'd like to start a long-running Ruby or Python script, and have the script watch a local directory for changes to files and new files. Periodically, the script will trigger a one-way rsync to a ...
0
votes
2answers
86 views

cwRsync permissions on external drive

I'm having problem using cwrsync to backup my data to an external drive as no data can't be opened on other computers because of permissions cwrsync sets. This is my backup batch script: @ECHO OFF ...
0
votes
1answer
41 views

rsync - exlude specific files from directories that are included

I have this script: #!bin/bash AMB="specific_dir*/***" SRC="/path/to/dir/" DST_1="user@host1:~/path/to/dest/" DST_2="virkantas@host2:~/path/to/dest/" DST_3="nodbaltic@host3:~/path/to/dest/" for DEST ...
0
votes
0answers
22 views

Mac won't boot from a mirrored drive

I'm cloning the two internal volumes SSD and HD to one external volume by telling rsync to resolve symlinks and copy the actual files / directories: sudo rsync --acls \ --archive \ ...
0
votes
1answer
104 views

cwrsync and long file names issue

I am trying to use cwrsync on my windows server to backup to my linux server, but am running into an issue where the file names become too long. So a user on one of the systems will have a mapped ...
1
vote
2answers
1k views

Allowing multiple simultaneous rsyncs to play nice together

Each day I need to copy N files from a source location to a mirror at a specific time (where N is very large). Let's say I tell multiple CPUs to each run an rsync simultaneously on a subset of the ...
1
vote
1answer
66 views

offline incremental backup via thumbdrive? [closed]

I need to mirror one computer's 3 TB directory tree on another computer. The computers share no network [edit: they cannot communicate at all, "air barrier"], but I can transport a 32 GB thumbdrive ...
0
votes
3answers
255 views

CygWin rSync can't access file folder on Windows 7 with Vagrant

Facts- Machine is connected to domain User is a domain user Windows 7 running Cygwin with SSH / Rsync set up multiple times Running the rsync command from Cygwin finds the directory "c:\code" just ...
0
votes
2answers
48 views

Rsync Only Different Files with a Checksum?

Does anyone know if it's possible to run rsync to transfer all changed/new files in a directory (and its sub-directories) from my local OSX 10.9 machine up to a network share? The wrench in the plan ...
0
votes
1answer
62 views

rsnapshot or similar tool for no added size differential backup

I've currently got a backup that backs up all my files to an external hard drive, but currently I am traveling and I want to backup file changes, but without having to duplicate all the files, or ...
1
vote
1answer
380 views

How do I setup rsync and any other scripts to mimic a minimal viable replica of DropBox?

The tools I use to mimic the service are not as important as creating a reliable replacement in case something happens to the DropBox company (price flux, acquisition, etc) My original question was ...
0
votes
0answers
32 views

ssh indirectly to root

Is there a way to ssh to root on another machine even if PermitRootLogin is set to no, but ssh to a user is allowed and this user can just sudo -i to become root. For simple commands, I think there ...
0
votes
3answers
75 views

ssh config with sudo

I'm backing up my local machine to a remote server. Because I want to backup the whole local machine, even files that my local user doesn't normally have access to, I'm doing it using sudo, so the ...
0
votes
0answers
33 views

WordPress uploads rsync file ownership issues

I'm running a LEMP stack. Nginx is running as www-data user. It's running a WordPress installation. Every time I upload something the uploaded files belong to www-data as expected. I'm trying to ...
0
votes
0answers
197 views

Reading SMART results for failing disk

I recently started having trouble with my Dell laptop and would appreciate any recommendations on the next steps for my issue. I have portions of the dmesg log below to show the errors I'm getting. ...
0
votes
2answers
77 views

how does data integrity affect offline backups with rsync?

I am trying to understand the implications of bitrot and data corruption on my data on disks. Currently for my family photos (JPEG and MOVs), aside from storing them on my main pc, I have them on a ...
1
vote
1answer
86 views

Issue with rsync/cwrsync on windows

I'm having this batch script which i'm trying to make to backup stuff to my external drive. For some reason, it works just fine when I run it as administrator but not when i run it as a regular user. ...
-1
votes
1answer
219 views

Google Compute Engine - SSH or RSYNC without a Password

I have several Google Compute Engine (GCE) instances up and running. I have a few scripts that pull information (log files, etc) from these instances, and a few others that push up files. I would like ...
0
votes
0answers
81 views

SecGenericPasswordCreate failed when trying to rsync

Hi I'm trying to rsync my Mac OSX 10.6 to a folder on a server in which I have an account. I have followed the instructions reported on www.rsync.net. I have created the public key (where as ...
0
votes
0answers
31 views

Rsync over NFS I/O error

We have two servers running CentOS 6.4. Both are NFS servers and each have shares mounted from each other. Regardless of which direction the transfer goes (upload or download) it fails after a few ...
0
votes
0answers
41 views

Troubles backing up some files from Linux system to FreeNAS using rsync

I'm using rsync to backup whole system over LAN to freeNAS server with this command: rsync -aAX --delete /* /mnt/backup ...
7
votes
3answers
15k views

rsync: failed to set times on “<dir path>”

I am trying to rsync files from one server to another but getting this error rsync: failed to set times on "/dept/intranet/dept/atest/.": Operation not permitted (1) Can someone help me why so ...
5
votes
1answer
144 views

Does Cygwin support hard links in Windows 8?

I'm working on a backup script that behaves like TimeMachine and uses RSync with --link-dest to create hardlinks to unchanged files. If I run this on a *Nix-based system, of course it works as ...
1
vote
1answer
79 views

Copying files without losing metadata in Linux

How on Linux can I copy things like music files with “Artist” and “Title” tags without losing the tags? Will rsync work? Will cp? Does either one need any specific switch?
4
votes
2answers
371 views

Behavior of rsync with file that's still being written?

If Apache is in the middle of writing a large file and an rsync cron job runs on that file, does rsync attempt to copy the file? Example Apache-1: Has file large being written to /var/www. ...
0
votes
2answers
77 views

What is the correct way to move a Ubuntu server from one machine to another?

Attempted this three times now and not bee successful, so was hoping someone here could point me in the right direction? I am trying to move my Ubuntu 14.04 Server from one physical machine, to ...
2
votes
2answers
1k views

Copying folder from one Unix server to another, updating owners IDs

I'm using the method described here to copy a directory from one Unix server to another (both Ubuntu 14.04): rsync -aruv localfolder/ user@server:destination/ I need to keep the same owners and ...
4
votes
4answers
4k views

How to arbitrarily map user/group ownerships in rsync

I need to rsync a directory to a remote server so that all files belonging to user X and group Y on the source (local) machine are mapped to user W and group Z on the destination (remote) machine. If ...
0
votes
1answer
32 views

How to wait for 3 mints if the n/w got disconnected while copying in Rsync without failing using perl script?

I have to transfer 2-3 GB using Rsync.Everything is working fine, but my network got disconnected sometimes, and the entire process got failed. I want to retry it for the network for every 3 mints, ...
0
votes
1answer
41 views

Resume SCP download when using .pem file with rsync

I have a large file to down form a ssh server, however the connection keeps cutting out. I know that rsync can be used to resume the download however I can not find how to do this when I am using a ...
2
votes
2answers
411 views

Copy multiple sources to multiple destinations simultaneously

Suppose I need to copy files ~/path/to/file to user@remote:/path/to/file ~/path/to/another/file to user@remote:/path/to/another/file ~/path/alternative to user@remote:/path/alternative Is there is ...
31
votes
17answers
40k views

Best way to copy millions of files between 2 servers

I have roughly around 5 million small (5-30k) files in a single directory that I would like to copy to another machine on the same gigabit network. I tried using rsync, but it would slow down to a ...
1
vote
1answer
2k views

Rsync and Windows 7

Can someone give me any tips on setting up some sort of Rsync server/client on Windows 7 to run rsync between both my web hosting server, and a backup server that I have running Ubuntu? I've tried ...
2
votes
3answers
3k views

Any faster scp or rsync?

How can I transfer a large file quickly, when I don't really require a secure connection? Often I would like to copy a large file from local machine to remote machine. The file does not already ...
1
vote
2answers
290 views

Copy ubuntu from one PC to another

I have a very weird scenerio here, I have installed some softwares on my Ubuntu machine, Now I want to move everything (including windows)to another Machine B, notice Machine has no access to Internet ...