Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.

learn more… | top users | synonyms

1
vote
1answer
968 views

can we use unix hardlinks on a mounted windows share?

ln command can create hard links on the mounted windows share, but cp -al fails. Is this expected behaviour? I'm trying to save disk space by creating copy on write style backups using cowdancer, ...
1
vote
1answer
445 views

Copying files without losing metadata in Linux

How on Linux can I copy things like music files with “Artist” and “Title” tags without losing the tags? Will rsync work? Will cp? Does either one need any specific switch?
0
votes
2answers
430 views

What is the correct way to move a Ubuntu server from one machine to another?

Attempted this three times now and not bee successful, so was hoping someone here could point me in the right direction? I am trying to move my Ubuntu 14.04 Server from one physical machine, to ...
5
votes
2answers
3k views

Behavior of rsync with file that's still being written?

If Apache is in the middle of writing a large file and an rsync cron job runs on that file, does rsync attempt to copy the file? Example Apache-1: Has file large being written to /var/www. ...
2
votes
2answers
2k views

Copy multiple sources to multiple destinations simultaneously

Suppose I need to copy files ~/path/to/file to user@remote:/path/to/file ~/path/to/another/file to user@remote:/path/to/another/file ~/path/alternative to user@remote:/path/alternative Is there is ...
0
votes
1answer
89 views

Resume SCP download when using .pem file with rsync

I have a large file to down form a ssh server, however the connection keeps cutting out. I know that rsync can be used to resume the download however I can not find how to do this when I am using a ...
-1
votes
1answer
764 views

Google Compute Engine - SSH or RSYNC without a Password

I have several Google Compute Engine (GCE) instances up and running. I have a few scripts that pull information (log files, etc) from these instances, and a few others that push up files. I would like ...
1
vote
2answers
827 views

Copy ubuntu from one PC to another

I have a very weird scenerio here, I have installed some softwares on my Ubuntu machine, Now I want to move everything (including windows)to another Machine B, notice Machine has no access to Internet ...
1
vote
1answer
249 views

rsync from Solaris to Windows (character encoding on filenames)

I'm trying to use RSYNC to sync files from a Solaris 9 (SunOS 5.9) System to a Windows Server 2008 R2 (via cygwin) There are many Files containing characters like "ä", "ö", "ü" or "ß". Which are only ...
1
vote
0answers
135 views

Is cp -au / cp --archive --update contradictory?

I want to update a directory on a backup disk with new content added to the source, and of course rsync is too slow. cp -a does the trick but is a bulldozer; cp -u should leave existing files alone. ...
2
votes
1answer
204 views

What are the rsync equivalent command/s to mv /a/b /c/d?

What are the rsync equivalent command/s to mv /a/b/ /c/d/, i.e, to move a directory tree from one location to another, possibly on another file system? That is, not just copy, but delete the files ...
0
votes
1answer
122 views

rsnapshot or similar tool for no added size differential backup

I've currently got a backup that backs up all my files to an external hard drive, but currently I am traveling and I want to backup file changes, but without having to duplicate all the files, or ...
0
votes
2answers
140 views

How to migrate a root filesystem to another partition from within running system?

I try to migrate a root filesystem from ext4 to another partition type (zfs) and started with a simple rsync -a --exclude=/boot --exclude=/mnt --exclude=/media --exclude=/tmp --exclude=[all zfs ...
0
votes
1answer
45 views

How to wait for 3 mints if the n/w got disconnected while copying in Rsync without failing using perl script?

I have to transfer 2-3 GB using Rsync.Everything is working fine, but my network got disconnected sometimes, and the entire process got failed. I want to retry it for the network for every 3 mints, ...
0
votes
1answer
174 views

Is there any advantage of using rsync over plain cp when copying from a samba share?

I am currently configuring Dirvish on a Linux computer for backing up the contents of a share on a Windows computer. Dirvish creates a new directory every time it is called. It internally uses rsync ...
0
votes
1answer
109 views

Does Killing A Bash Process Affect Children Processes [duplicate]

The Scenario I'm automating backups via a bash script. The script is executed via cron. The script archives directories recursively using tar, and then rsync's them to the remote host. Here is a ...
0
votes
1answer
159 views

Prevent rsync out of memory

I am trying to rsync 55000 jpg files in 10000 folders (from an Android phone to a Linux box). Usually, I did this: rsync -rOi --size-only --delete --timeout=60 --progress --no-perms ...
0
votes
1answer
64 views

Rsync unhides files when syncing

When I tell rsync to sync 2 folders with -a /source/path/ /destination/path, hidden files become suddenly visible. Is there a way to tell rsync not to unhide those files, but simply copy the folder as ...
1
vote
1answer
410 views

Run cygwin command from windows command line

I am trying to make PhpStorm run vagrant rsync when files are changed, because built-in rsync-auto fails with my deep directory structure. I am able to setup watcher in PhpStorm settings, but I don't ...
0
votes
0answers
54 views

Is there a simple way to automatically send through scp any file modified in a folder to a remote folder?

Put it simply: I have a folder full of files and subfolders with more files. I would like to have a mirror of that folder in a remote server so anytime a file is modified on my machine it gets ...
0
votes
1answer
66 views

Rsync: Mirror only certain directories based on presence of dotfile

I have a large amount of files on a server and I have a partial mirror of these files on my Mac (i.e. only some folders exist in the mirror). I would like to have a sync from the Mac to server using ...
1
vote
1answer
436 views

Special characters on Synology NAS

I've been backing up my photos and mp3s from my MacBook Pro to a Synology NAS. Many files have names containing special characters like é and ö. I've been copying them with Rsync, as follows: rsync ...
1
vote
1answer
370 views

SSH connection with key, not working with rsync

After creating a key with no password, I can login with SSH to my remote host: $ ssh root@machine.local Welcome to Ubuntu 14.04.1... However when I try to use SSH to rsync to the same remote host: ...
5
votes
1answer
475 views

Does Cygwin support hard links in Windows 8?

I'm working on a backup script that behaves like TimeMachine and uses RSync with --link-dest to create hardlinks to unchanged files. If I run this on a *Nix-based system, of course it works as ...
0
votes
2answers
141 views

“2 way” NAS 'time-machine' backup [closed]

For off-site backup purposes I am looking at putting a NAS in 2 places (my own and another) and having them sync. This can be done with rsync obviously, but I'm looking for a bit more security ...
3
votes
1answer
2k views

Understanding rsync's include / exclude patterns

I want to transfer N files from a remote system, using a pattern: ssh remote ls target/ 2013-08-01.mjson.gz 2014-07-04.mjson.gz 2014-07-09.mjson.gz 2014-08-12.mjson.gz ... I only want the 2014-07* ...
2
votes
2answers
1k views

Copying folder from one Unix server to another, updating owners IDs

I'm using the method described here to copy a directory from one Unix server to another (both Ubuntu 14.04): rsync -aruv localfolder/ user@server:destination/ I need to keep the same owners and ...
21
votes
2answers
26k views

rsync and symbolic links

I want to backup my home directory to an external drive nightly using a cron job to execute rsync. I am unsure of the exact behavior of rsync's symbolic link flags. rsync's -a flag includes the -l ...
0
votes
0answers
173 views

Backup certain folders to NAS with exFat

Hello everybody who has the same problem, trying to help or just reading! Recently I've bought one of IcyBox IB-NAS5520 NAS with 2 x 1TB drives in raid1. I've tryed to follow this idea: How to set ...
0
votes
1answer
442 views

automatic file encryption on NFS or RSYNC for remote incremental backup?

What solutions should I be looking at to allow an incremental backup via rsync over nfs4 to allow files to be encrypted on the backup host? I have zero control over the backup host's software so the ...
2
votes
2answers
169 views

Command line cp or rsync to crawl drive seeking only specific file types and put them somewhere?

Is it possible only using the command line to use something like the cp or rsync command to crawl a hard-drive seeking only image/video files? And maybe in the process of copying them over to another ...
0
votes
1answer
41 views

move files from a list of files

So, I have a list of files in a text file. I believe it's about 100,000 files. The files in said list are spread across many directories, have different sizes, filenames, extensions, ages, etc. I am ...
0
votes
3answers
523 views

CygWin rSync can't access file folder on Windows 7 with Vagrant

Facts- Machine is connected to domain User is a domain user Windows 7 running Cygwin with SSH / Rsync set up multiple times Running the rsync command from Cygwin finds the directory "c:\code" just ...
2
votes
0answers
135 views

rsync over ssh tunnel: What does this repeated message mean? debug2: channel 2: window 1966080 sent adjust 131072

I'm rsyncing through an SSH tunnel (with ssh -vv). It's not very fast and I'm getting this message about every second: debug2: channel 2: window 1966080 sent adjust 131072 Once in a while I also ...
0
votes
1answer
59 views

Source host doesn't have access to Internet, but can SSH to host that has; how can I rsync to a third, Internet host?

This is the command I used to run from my SOURCE machine rsync -Rrlt --progress --delay-updates ./my_folder root@machine-on-same-network:/home/me/. Now I need to copy over this same folder to a ...
1
vote
0answers
172 views

Rsync doesn't allow me copy files into mounted filesystems

I configured rsyncd.conf for public access in my rpi: log file = /var/log/rsyncd.log timeout = 600 max connections = 20 uid = nobody gid = nogroup read only = yes list = yes [public] path = ...
0
votes
2answers
66 views

Syncing directory between Kubuntu and Windows 7

I recently came across an issue on my work computer. I'm running Kubuntu 14.04 as my main development OS and Windows 7 for compatibility with some company software and network stuff. My problem is ...
0
votes
1answer
290 views

Do GUI and Terminal execution (of Back In Time/Grsync/other Linux apps) produce the same results?

I've opened Back In Time GUI and copied the whole rsync ... line from the last log into Terminal and executed it in Terminal. Question #1 is: if I were to do it the normal way (click 'Take snapshot' ...
3
votes
1answer
209 views

Using pv(1) to limit rsync speed

I'm trying to use pv rather than rsync's builtin --bwlimit to limit the bandwidth of an rsync transfer because --bwlimit is implemented in an eventually-consistent way, and my transfers are so short ...
1
vote
0answers
294 views

Synology NAS resume rsync backup after connection loss

I am trying to do a backup from a synology NAS to an offsite NAS. I am using rsync through DSM5 as of now, but it doesn't give me the possibility to resume the backup if a connection loss occurs. This ...
1
vote
2answers
839 views

How can I rsync a set of subdirectories?

I have a source directory that looks like the following (with numerous subdirectories inside of the src and bin dirs): top_dir proj1 src/ bin/ scripts/ somefile.txt proj2 src/ bin/ target bin/ ...
1
vote
1answer
88 views

Rsync transfers everything instead of changed

I have tried many many different combinations of rsync commands, but whatever platform I use it on, from whatever source to whatever destination. It always transfers everything no matter if it's ...
0
votes
1answer
424 views

rsync --backup-dir not getting changed data - instead it is going to the original backup location

I'm not sure why this is not working as expected. I have a full rsync backup of /scripts/source in /scripts/full and want to put differential backup into /scripts/diff However, when a file is added ...
1
vote
1answer
121 views

Find files with different inodes in same directory structure

We have a slight problem with our backups. Our setup is as follows: We create a backup using the rsync command. The backup uses the option --link-dest option, to create incremental backups with ...
0
votes
1answer
835 views

File synchronization between two Linux servers

We have a two web servers running CentOS. We need to sync images that users uploaded. No servers should be needed to synchronize those, because we need to handle failover. Also, we need to do a ...
0
votes
1answer
117 views

Transfer to a remote machine, trouble with hostname

I'm connected to a remote host via SSH, I've read the rsync page and I understood that to transfer a file from my local machine to the remote host I have to do rsync myHostname:path/to/file ...
0
votes
0answers
2k views

How to always let rsync continue when (permission denied) error occurs

The following error happened with a rsync task. rsync: send_files failed to open "/home/user/scripts/@eaDir/script.js@SynoEAStream": Permission denied (13) rsync error: some files/attrs were not ...
8
votes
2answers
8k views

Properly escaping forward slash in bash script for usage with sed

I'm trying to determine the size of the files that would be newly copied when syncing two folders by running rsync in dry mode and then summing up the sizes of the files listed in the output of rsync. ...
0
votes
0answers
2k views

Can't git push to Bitbucket.org — with ssh keys

I'm running doku-wiki on may (Ubuntu) laptop for some note taking. So, to keep backup, I was using Bitbucket and periodically pushed my wiki files there and everything worked smoothly. (a) Some time ...
0
votes
1answer
77 views

rsync per-site configuration file?

I know how to configure a per-site entry for ssh, but is there any kind of a client configuration for rsync that allows per-site configuration options and aliases or similar shortcuts like the ...