Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.

learn more… | top users | synonyms

2
votes
1answer
3k views

Permission denied using Rsync as root

All topics that I've come across involved rsync over ssh or rsync using a user with restricted access. I'm getting permission denied (13) errors as root. Here are my config files: /etc/rsyncd.conf: ...
15
votes
3answers
1k views

Moving 2TB (10 mil files + dirs), what's my bottleneck?

Background I ran out of space on /home/data and need to transfer /home/data/repo to /home/data2. /home/data/repo contains 1M dirs, each of which contain 11 dirs and 10 files. It totals 2TB. ...
3
votes
2answers
3k views

make linux server allow rsync/scp/sftp but not a terminal login

I'd like to configure a linux box (probably an Ubuntu server) so that I can setup users, so that it is possible to upload/download files via rsync/scp/sftp, but it should not be possible to ssh to the ...
2
votes
1answer
46 views

rsync - How to sync specifc files and delete the rest on destination

I want to sync specific files and delete anything else that exists on the destination server. Source = /dir1/A - Z How do I sync A - D and delete E - Z if they exist?
0
votes
1answer
88 views

How to copy directory from remote server

I came across following instruction to copy a directory to my local machine. copy the gems from styx server from "‪location/to/the/directory" to your local directory I know rsync and scp can do the ...
0
votes
3answers
202 views

What are good compression algorithms for delta synchronization?

When syncing large files over a slow link, it is often useful to use delta compression in order to reduce the bandwidth used. It is also useful to compress files as they take up much less space. ...
0
votes
1answer
1k views

Rsync Remote To Local Issue

I was wondering if I could get some help with this rsync command. I am trying to copy files from a remote system by running rsync on the local system. Here is my command: /usr/bin/rsync -avz ...
1
vote
1answer
181 views

How can I reallocate an ext4 file system in an extended partition without lose data?

I resize the disk using the Windows default program. I don't know why, the extended partition of Linux now result unallocated. I'm sure I don't "touch" the extended partition, and I don't know why ...
0
votes
0answers
82 views

Reducing OpenSSH session key size

I am running into severe performance issues using SSH/Rsync on a Synology NAS (model DS413j if anybody knows anything about it). Both the sshd and the rsync processes are taking 100% CPU on the NAS, ...
2
votes
0answers
189 views

rsync: large exclusion list adding 10 hours to sync

I have had an rsync backup script running on a Centos 6 box that has been syncing ~410gb of data from a local (LAN) server over a gigabit connection. This script runs hourly, and if there are no new ...
2
votes
0answers
291 views

Keep local folder in sync with Samba share

I have a local folder on my Linux Mint desktop (my Dropbox folder, though that shouldn't matter), and I'd like to keep it synced with my school's "datastore" Samba share, which I can connect to from ...
0
votes
0answers
157 views

How do I keep the same UID among many servers?

I have many servers with LDAP which mantain the users UID the same among the servers, but how can I change and keep the same UID for local users ? For example, the user tomcat, when someone create an ...
3
votes
1answer
457 views

scp: How to copy only the last 10% of a file?

I have a relatively large log file (46M) on a vServer, of which I'm only interested in the most recent part. How can I download only the last 10% of the file? The server is running Debian and I'm ...
0
votes
0answers
421 views

Problems copying to VFAT formatted SD-card

I was going to copy my (mp3-encoded) music files (organized in one directory) to a (vfat-formatted) (micro-)sd-card to use it in my digital audio player (DAP) (on Linux). I used to use the same ...
1
vote
0answers
82 views

Is there a way to verify the integrity of a rsnapshot backups?

I'm using rsnapshot to make daily backups to a second hdd. But how can I make sure, that no file in my backup is corrupted? If I use the checksum option from rsync, the whole backup will take much ...
1
vote
2answers
100 views

Unix copy multiple folders based on a specified CSV list using rsync

I have done some research and it appears that rsync is the only method that can possibly help me achieve this. I want to specify a list of folders in a CSV which can tell rsync to copy them to ...
1
vote
1answer
240 views

Backup LaCie 5big Pro to Amazon Glacier

Does anyone know of an easy way that I could back-up my LaCie 5big Pro NAS to Amazon Glacier? The automatic backup feature of the LaCie only supports rsync compatible servers, which Amazon Glacier is ...
1
vote
2answers
191 views

Backing up multiple vmware VMs from a mac

I use vmware fusion to prototype and model enterprise infrastructure. This question is intended to solicit an optimal method for backing up (preferably incrementally) VMs. My VM directory is now ...
1
vote
0answers
94 views

rsync - Exclude directories but include files within them

I have an rsync command which I'm using to synchronise two directories: rsync -CurvtOlon --delete /home/source/path/ /home/dest/path/ When I run the command, it recursively scans all of the source ...
2
votes
1answer
177 views

How to mimic Echo sync mode using rsync commandline?

The MS tool SyncToy, has 3 intuitive sync modes (N.B. sync NOT backup), to sync two folders. One of them is: Echo which looks for changes (file modifications, new files, renames, deletes) in the ...
0
votes
1answer
285 views

Files hidden after copying from NAS to NAS using rsync

I have 2 Western Digital NAS: a blue light and a 2TB MyBook latest edition. I enabled ssh on the MyBook and I can use rsync from a terminal to sync files between the 2 NAS. Instead of copying using a ...
0
votes
1answer
146 views

rsync transfer chunk size

I‘m transferring 1.1 Mb files over very poor GSM EDGE connection. My rsync command is: rsync --partial --remove-source-files --timeout=120 --append --progress --rsh=ssh -z LOCAL_FILE ...
0
votes
1answer
211 views

rsync - resume broken transfer (idea of rsync)

I have remote stations that collect data from sensors (ARM Debian) and transfers sets of data (about 1.1 MB) every 15 minutes (server is full Debian). On one station GSM reception is poor and standard ...
4
votes
1answer
676 views

rsync recursive on same mount only

Hopefully, this simple question has a simple answer. I want to run rsync recursively using the -r option, but without descending into a different mount point (file system). i.e. like the -mount ...
1
vote
1answer
213 views

Bash/Rsync: One-way synchronize files, leave files alone when only metadata has changed

I have some programs that allow exporting to different formats (e.g. html), but many of them share a problem: Exports are always done "all together", i.e. things like images or attachments are created ...
2
votes
1answer
2k views

Excluding a folder from the home directory with rsync exclude list

I am trying to set up rsync for OS X 10.8.4 using an exclude file. However, it does not recognize the paths I want to exclude. I want to copy the user ABC's home directory to a folder called ...
2
votes
3answers
465 views

How can this backup strategy work?

I am trying to script a very simple backup strategy. Here is the general idea. Daily - Backup the entire filesystem using rsync, overwriting the previous day's backup. Weekly - Once a week copy the ...
-1
votes
2answers
4k views

How to copy files from remote machine (ubuntu) to local machine (windows)?

I would like to know about two ways: scp and rsync and how exactly they are used to copy files. I tried doing scp ubuntu@ip-10-124-83-21:/home/* /home/ubuntu/crockonjs-2-hd.mov but it didn't work. ...
0
votes
1answer
369 views

Sync only files after a specific time with rsync

I have a server from which I want to copy files and directories to a local destination. The local destination does not have any of the files or directories on it. Instead of copying all files on the ...
2
votes
2answers
866 views

Delete duplicate files with rsync

Here is the thing , I have a folder on my server with 50 GB size and its' containing over 60000 file. I used rsync to transfer it to a mirror server and almost half of file has been transferred.Now i ...
2
votes
2answers
330 views

Can't copy specific files with rsync over SSH

I am trying to sync all PHP files to another computer over ssh via rsync. However, it never copies any files. I am on Mac OSX Mountain Lion (10.8.4) Here is what I have tried: rsync --rsh=ssh ...
1
vote
1answer
735 views

How to copy directories into symbolic links using rsync?

I have directories and files locally and I want to copy them over to another box using rsync . The problem is that most of the data is already on the remove box, but not on the target disk. E.g., I ...
1
vote
1answer
151 views

Failure modes for simultaneous rsyncing between two computers

How does rsync handle the possibility of interference with another rsync on the same machine? I have read all the documentation I can find but do not see any mention of this. I am going to run some ...
0
votes
2answers
298 views

How to intelligently sync two directories under OSX

This may seem like a simple request at first glance, but I believe it is not due to some critical subtleties I wish to keep track of. Here is the scenario: I have a directory on my home workstation, ...
1
vote
0answers
51 views

Include exclude patterns rsync relative

I'm trying to sync a large tree on Linux, but include and exclude certain files/directories. My question is regarding rsync's --relative option and how relative paths are handled. Directory structures ...
0
votes
1answer
90 views

Did killing rsync job corrupt my files

While my regular backup script was running (using rsync to move files from NFS to external harddrive) we had network problems and I was forced to kill the rsync job in the middle of moving files. ...
0
votes
1answer
695 views

How can I keep a folder on two computers in sync, without uploading to the cloud?

I want to keep certain folders in sync between various computers. They are a mix of Ubuntu 12.04 and Windows 7 machines. I already know about services such as SpiderOak and Dropbox, but I want to ...
0
votes
2answers
2k views

rsync slow copy from one disk to another

I got two drives of the same model which are connected using SATA. When benchmarking read speeds using hdparm -t /dev/sdX, speeds of about 160MB/s are returned. When benchmarking write-speed using dd ...
2
votes
1answer
2k views

Why doesn't rsync keep my user and groups even with the -o / -g option?

On the client side: rsync -x -r -t -v -o "nobody" -g "nogroup" --progress --delete -u --partial -s -e ssh /home/john/Calibre\ Library root@192.168.0.21:/media/Book On the server side: ...
0
votes
1answer
519 views

rsync not copying hard links

I have two computers (both MacBook Airs) for which I sync one directory tree in both, but not the entire hard drive or any other directories. Let's say on computer A the directory is ...
0
votes
2answers
869 views

Update a bootable OS X drive clone with rsync?

The question: is it possible to keep a boot-able backup drive clone of OS X updated with rsync? If rsync is not a viable option are there alternatives? The Setup: My situation is as shown above. ...
0
votes
1answer
49 views

Logistics of a large data transfer

This is the setup: I have a Ubuntu server that is doing the heavily lifting. Its pulls backups from an NFS and puts them on a Drobo device connected via USB using rsync. The Drobo has two seperate ...
4
votes
1answer
350 views

How to encrypt rsync communication? (rsyncd + stunnel, vs rsync over SSH, etc)

I don't know much about the specifics of rsync, SSH, stunnel, etc, but I'm looking for a way to make rsync backups, but the transfer of data over the network must be encrypted (the credentials, and ...
0
votes
1answer
697 views

How to have a complicated two way sync using rsync preserving deletions

I have gone thorough similar questions on stackoverflow but they dont cover the situation that I would like to ask here. I have all my music files on my remote machine. I would like to sync them to ...
1
vote
1answer
104 views

rsync in a bash script appears to work, but the files aren't updated on destination server

I've got a server where I do my web development and testing, and I have a bunch of frontend servers that sit behind a load balancer. I wrote a simple bash script to rsync a directory on my dev server ...
0
votes
1answer
116 views

rsync options to exclude deletes

I backup my files from my desktop to my FreeNAS box with rsync. Here is the command I use: rsync.exe -v -rlt -z --chmod=a=rw,Da+x --delete --exclude="Torrents/Downloads" --exclude="Torrents/Watch" ...
0
votes
3answers
3k views

Rsync root files between systems without specifying password

This seems very tricky to me. I've set up my two systems so that I can rsync files between them as me, without specifying password. Now the the problem is to rsync files that belong to root. On both ...
1
vote
1answer
113 views

Issue with rsync: tput warning

I am using rsync to copy files from one server to the other and I keep getting this warning: tput: No value for $TERM and no -T specified The command I run is this: rsync -aq ...
0
votes
1answer
168 views

How to copy file from PC to Mac, while preserving xattrs on the target file?

I've a file M on my Mac (OS X ML 10.8.4) and file P on my PC (Win7). File P was originally a copy of file M but is now slightly updated. File M has some extended attributes. How can I copy file P ...
0
votes
0answers
70 views

rsync fails to copy files from remote machine

#Bypassing the ssh spawn -noecho /usr/bin/ssh -o 'StrictHostKeyChecking=no' "$user\@$ip"; if { $argc == $total_arguments} { set REMOTEDIR "$remote_dir"; spawn -noecho /usr/bin/rsync -r ...