Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.

learn more… | top users | synonyms

2
votes
0answers
204 views

External drive has strange files “_*” appearing - culprit is maybe rsync or SMB access?

I'm using rsync to back up folders from my iMac to a WD MyBook and the process seems to leave files such as these: _0O1MN~H.MP4 _2C0X2~3.AVI _ALLYW~B.SRT _VUC69~7 The last one is the most ...
1
vote
2answers
5k views

Permission problems with rsync

I wanna do daily ssh synchronization of some of my local machines files with my server. I want to do this via rsync, since it sounds the most promising tool for this task to me. Sadly I get the ...
0
votes
1answer
208 views

Rsync from godaddy to OS X

I would like to use rsync to backup my website to my local computer (OS X). I started of with this guide and got pretty far. I use the following rsync-line: rsync -PzrlptgD --del --delete-excluded ...
3
votes
1answer
510 views

Fastest way to delete a non empty directory in Linux

I use the command rm -rf directory but i came across the following article : Article That suggests that rsynch to an empty folder is the fastest way? rsync -a –delete empty/ a Why is this the case ? ...
1
vote
3answers
2k views

Are periodic full backups really necessary on an incremental backup setup?

I intend to use an old computer I have as a remote backup server for myself and a few other people. We are all geographically separated, and the plan is to do incremental daily backups using rsync and ...
1
vote
1answer
566 views

rsync include all directories and certain subdirectories and *.java of the last sub

I am trying to rsync include all directories but only one of each of those subdirectories which contain certain files. For example, rsync -auvz --include '*' --include '*/certain_sub/' --include ...
1
vote
2answers
308 views

Why does my rsync server on windows always set the read-only flag when I write to it?

I'm using cwrsync on windows. This is my daemon config file use chroot = false strict modes = false hosts allow = * log file = rsyncd.log pid file = rsyncd.pid port = 11011 # Module definitions # ...
1
vote
1answer
278 views

Backup files from Linux client to Windows Server

I'm trying to backup my files from my Linux box to my Windows Server 2008 as a push, and when I delete them from my Linux box, they remain on my Windows Server. I've found lots of sources that are ...
0
votes
2answers
72 views

Sycronizing/deploying scripts across several systems

I have a few time consuming tasks that I like to spread across several computers. These tasks require running an identical ruby or python script (or series of scripts that call each other) on each ...
0
votes
2answers
72 views

two-way sync between mac and unix

I would like to work on a directory on two different macs and have access to a unix server that I ssh into. I would like to just start a script at the end of the day that let's me upload all my ...
1
vote
1answer
272 views

rsync backup messes up permissions on files

I use rsync backup on my Android device to backup some files from my device to my *nix server. It sort of works, except the target directory and all files under it have their file mode flags set to ...
0
votes
1answer
238 views

Can't get rsync to sync two external harddrives

I'm trying to use rsync to copy files from one external HDD to another external HDD. I use the following commands rsync -rv --exclude=.DS_Store ~/Volumes/Backed /Volumes/Hero where Backed is the ...
1
vote
2answers
272 views

Is there an rsync equivlent of .gitignore?

I have a file that should never be synced in a directory that will be rsynced often. Rather than relying on --exclude (and my ability to remember to use it), can I tell rsync to ignore the file in a ...
0
votes
1answer
68 views

Does a successful exit of rsync -acvvv s d guarantee identical directory trees?

I have two volumes, one xfs, and another ntfs - ntfs was empty, and xfs had 10 subitems. I needed to sync them. I initially copied a few of the subitems by dragging them over in a gui fm. Several of ...
0
votes
1answer
390 views

Will the option NOATIME in /etc/fstab ruin my Unison synchronizations?

I read here in ArchWiki that the option noatime can improve hard disk performance and durability: The use of noatime, nodiratime or relatime can improve drive performance. Linux by default uses ...
4
votes
2answers
507 views

How can completely back up my linux computer so that it can be fully restored easily?

I want to be able to blindly back up my entire hard disk, so that I can blindly and automatically restore in case there is any problem. I am not interested in merely backing up data, but specifically ...
0
votes
0answers
467 views

Caveats with gzip --rsyncable - no speedup

I am using (trying) gzip to compress an SQL file in an rsyncable way in order to transfer the backup with minimal delay. However it appears that this is not working, since the speedup is always 1.00. ...
1
vote
2answers
5k views

What is more efficient / faster, rsync compression or ssh compression?

I currently rsync files: (i) locally and (ii) remotely over WAN (connection c. 8mbps down / 1.5mbps up). I am considering adding to rsync: -z to compress files. Or alternatively adding to ...
1
vote
0answers
60 views

Running a symlink locally

I am running the same program multiple times over a linux platform. It is compiled at another server, and frequently updated, and it's uploaded over through rsync to all "hosting" servers, which do ...
3
votes
2answers
289 views

restrict rsync (or bash script) to a directory

After a bad accident with rsync deleting wrong files due to wrong destination parameter, I want to restrict rsync (or the bash script running it) to be able to delete/modify files only under a certain ...
1
vote
3answers
688 views

Moving files over SSH and delete on source after successful final copy

I have a folder of ~200 000 files with a total size around 300 GB that I need to transfer over an SSH connection to a remote host. I'm looking for a way to have the local files deleted after it's been ...
1
vote
1answer
611 views

Bash script fails from Windows 7 task scheduler

In order to use rsync I created a Bash script. It runs fine from the Cygwin 32-bit shell in Win 7 but fails when run from the Win 7 Task Scheduler. My Task Scheduler script is a simple: ...
0
votes
1answer
85 views

Copying Thousands of Files on the same HD

I found myself in a situation I am copying an entire filesystem across two different HD partitions (different sizes and filesystem types). The problem so far is taht both cp and rsync will read a ...
2
votes
1answer
146 views

rsync via gateway ssh while defining .pem key

I need to sync my local files through a gateway to an Amazon EC2 instance that requires specifying my .pem key. I can do this as a three step like so (assuming no typos): rsync -avzh -e ssh ...
2
votes
1answer
3k views

Permission denied using Rsync as root

All topics that I've come across involved rsync over ssh or rsync using a user with restricted access. I'm getting permission denied (13) errors as root. Here are my config files: /etc/rsyncd.conf: ...
16
votes
3answers
1k views

Moving 2TB (10 mil files + dirs), what's my bottleneck?

Background I ran out of space on /home/data and need to transfer /home/data/repo to /home/data2. /home/data/repo contains 1M dirs, each of which contain 11 dirs and 10 files. It totals 2TB. ...
3
votes
2answers
3k views

make linux server allow rsync/scp/sftp but not a terminal login

I'd like to configure a linux box (probably an Ubuntu server) so that I can setup users, so that it is possible to upload/download files via rsync/scp/sftp, but it should not be possible to ssh to the ...
2
votes
1answer
47 views

rsync - How to sync specifc files and delete the rest on destination

I want to sync specific files and delete anything else that exists on the destination server. Source = /dir1/A - Z How do I sync A - D and delete E - Z if they exist?
0
votes
1answer
90 views

How to copy directory from remote server

I came across following instruction to copy a directory to my local machine. copy the gems from styx server from "‪location/to/the/directory" to your local directory I know rsync and scp can do the ...
0
votes
3answers
226 views

What are good compression algorithms for delta synchronization?

When syncing large files over a slow link, it is often useful to use delta compression in order to reduce the bandwidth used. It is also useful to compress files as they take up much less space. ...
0
votes
1answer
1k views

Rsync Remote To Local Issue

I was wondering if I could get some help with this rsync command. I am trying to copy files from a remote system by running rsync on the local system. Here is my command: /usr/bin/rsync -avz ...
1
vote
1answer
191 views

How can I reallocate an ext4 file system in an extended partition without lose data?

I resize the disk using the Windows default program. I don't know why, the extended partition of Linux now result unallocated. I'm sure I don't "touch" the extended partition, and I don't know why ...
0
votes
0answers
85 views

Reducing OpenSSH session key size

I am running into severe performance issues using SSH/Rsync on a Synology NAS (model DS413j if anybody knows anything about it). Both the sshd and the rsync processes are taking 100% CPU on the NAS, ...
2
votes
0answers
204 views

rsync: large exclusion list adding 10 hours to sync

I have had an rsync backup script running on a Centos 6 box that has been syncing ~410gb of data from a local (LAN) server over a gigabit connection. This script runs hourly, and if there are no new ...
2
votes
0answers
310 views

Keep local folder in sync with Samba share

I have a local folder on my Linux Mint desktop (my Dropbox folder, though that shouldn't matter), and I'd like to keep it synced with my school's "datastore" Samba share, which I can connect to from ...
0
votes
0answers
169 views

How do I keep the same UID among many servers?

I have many servers with LDAP which mantain the users UID the same among the servers, but how can I change and keep the same UID for local users ? For example, the user tomcat, when someone create an ...
3
votes
1answer
544 views

scp: How to copy only the last 10% of a file?

I have a relatively large log file (46M) on a vServer, of which I'm only interested in the most recent part. How can I download only the last 10% of the file? The server is running Debian and I'm ...
0
votes
0answers
466 views

Problems copying to VFAT formatted SD-card

I was going to copy my (mp3-encoded) music files (organized in one directory) to a (vfat-formatted) (micro-)sd-card to use it in my digital audio player (DAP) (on Linux). I used to use the same ...
1
vote
0answers
98 views

Is there a way to verify the integrity of a rsnapshot backups?

I'm using rsnapshot to make daily backups to a second hdd. But how can I make sure, that no file in my backup is corrupted? If I use the checksum option from rsync, the whole backup will take much ...
1
vote
2answers
113 views

Unix copy multiple folders based on a specified CSV list using rsync

I have done some research and it appears that rsync is the only method that can possibly help me achieve this. I want to specify a list of folders in a CSV which can tell rsync to copy them to ...
1
vote
1answer
261 views

Backup LaCie 5big Pro to Amazon Glacier

Does anyone know of an easy way that I could back-up my LaCie 5big Pro NAS to Amazon Glacier? The automatic backup feature of the LaCie only supports rsync compatible servers, which Amazon Glacier is ...
1
vote
2answers
213 views

Backing up multiple vmware VMs from a mac

I use vmware fusion to prototype and model enterprise infrastructure. This question is intended to solicit an optimal method for backing up (preferably incrementally) VMs. My VM directory is now ...
1
vote
0answers
101 views

rsync - Exclude directories but include files within them

I have an rsync command which I'm using to synchronise two directories: rsync -CurvtOlon --delete /home/source/path/ /home/dest/path/ When I run the command, it recursively scans all of the source ...
2
votes
1answer
185 views

How to mimic Echo sync mode using rsync commandline?

The MS tool SyncToy, has 3 intuitive sync modes (N.B. sync NOT backup), to sync two folders. One of them is: Echo which looks for changes (file modifications, new files, renames, deletes) in the ...
0
votes
1answer
338 views

Files hidden after copying from NAS to NAS using rsync

I have 2 Western Digital NAS: a blue light and a 2TB MyBook latest edition. I enabled ssh on the MyBook and I can use rsync from a terminal to sync files between the 2 NAS. Instead of copying using a ...
0
votes
1answer
187 views

rsync transfer chunk size

I‘m transferring 1.1 Mb files over very poor GSM EDGE connection. My rsync command is: rsync --partial --remove-source-files --timeout=120 --append --progress --rsh=ssh -z LOCAL_FILE ...
0
votes
1answer
237 views

rsync - resume broken transfer (idea of rsync)

I have remote stations that collect data from sensors (ARM Debian) and transfers sets of data (about 1.1 MB) every 15 minutes (server is full Debian). On one station GSM reception is poor and standard ...
5
votes
1answer
890 views

rsync recursive on same mount only

Hopefully, this simple question has a simple answer. I want to run rsync recursively using the -r option, but without descending into a different mount point (file system). i.e. like the -mount ...
1
vote
1answer
242 views

Bash/Rsync: One-way synchronize files, leave files alone when only metadata has changed

I have some programs that allow exporting to different formats (e.g. html), but many of them share a problem: Exports are always done "all together", i.e. things like images or attachments are created ...
2
votes
1answer
3k views

Excluding a folder from the home directory with rsync exclude list

I am trying to set up rsync for OS X 10.8.4 using an exclude file. However, it does not recognize the paths I want to exclude. I want to copy the user ABC's home directory to a folder called ...