Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.

learn more… | top users | synonyms

1
vote
2answers
97 views

Is there an rsync equivlent of .gitignore?

I have a file that should never be synced in a directory that will be rsynced often. Rather than relying on --exclude (and my ability to remember to use it), can I tell rsync to ignore the file in a ...
3
votes
2answers
383 views

rsync over ssh - 50kbps

This sync is taking all day, literally. Syncing from a mac (with rsync 3.0.5, from http://www.bombich.com/mactips/rsync.html) to Ubuntu with everything current. Internet is fast, computers are fast ...
0
votes
1answer
170 views

Will the option NOATIME in /etc/fstab ruin my Unison synchronizations?

I read here in ArchWiki that the option noatime can improve hard disk performance and durability: The use of noatime, nodiratime or relatime can improve drive performance. Linux by default uses ...
3
votes
2answers
166 views

How can completely back up my linux computer so that it can be fully restored easily?

I want to be able to blindly back up my entire hard disk, so that I can blindly and automatically restore in case there is any problem. I am not interested in merely backing up data, but specifically ...
0
votes
0answers
82 views

Caveats with gzip --rsyncable - no speedup

I am using (trying) gzip to compress an SQL file in an rsyncable way in order to transfer the backup with minimal delay. However it appears that this is not working, since the speedup is always 1.00. ...
1
vote
0answers
55 views

Running a symlink locally

I am running the same program multiple times over a linux platform. It is compiled at another server, and frequently updated, and it's uploaded over through rsync to all "hosting" servers, which do ...
1
vote
1answer
254 views

Bash script fails from Windows 7 task scheduler

In order to use rsync I created a Bash script. It runs fine from the Cygwin 32-bit shell in Win 7 but fails when run from the Win 7 Task Scheduler. My Task Scheduler script is a simple: ...
1
vote
3answers
291 views

Moving files over SSH and delete on source after successful final copy

I have a folder of ~200 000 files with a total size around 300 GB that I need to transfer over an SSH connection to a remote host. I'm looking for a way to have the local files deleted after it's been ...
0
votes
0answers
163 views

Synchronize file from Linux to Windows using rsync

I want to sync files from linux to windows using rsync. I use cwrsync as rsync server on windows and i want to execute rsync from linux automatically using cron every night. Anyone know good tutorial ...
2
votes
1answer
79 views

rsync via gateway ssh while defining .pem key

I need to sync my local files through a gateway to an Amazon EC2 instance that requires specifying my .pem key. I can do this as a three step like so (assuming no typos): rsync -avzh -e ssh ...
0
votes
1answer
64 views

Copying Thousands of Files on the same HD

I found myself in a situation I am copying an entire filesystem across two different HD partitions (different sizes and filesystem types). The problem so far is taht both cp and rsync will read a ...
1
vote
1answer
378 views

rsync from one source to multiple different target directories according to pattern?

Assume e.g. you want to backup all files matching pattern a to directory A and all files matching pattern b to directory B. The natural way to do this are two separate rsync commands. rsync ...
1
vote
1answer
505 views

Permission denied using Rsync as root

All topics that I've come across involved rsync over ssh or rsync using a user with restricted access. I'm getting permission denied (13) errors as root. Here are my config files: /etc/rsyncd.conf: ...
0
votes
0answers
46 views

rsync with diff between unrelated files

I need a Linux program similar to an rsync -a foodir targethost:foodir2 copy, but for each file in foodir it should find similar files in foodir2, and transfer only the difference. rsync can't do ...
3
votes
2answers
951 views

make linux server allow rsync/scp/sftp but not a terminal login

I'd like to configure a linux box (probably an Ubuntu server) so that I can setup users, so that it is possible to upload/download files via rsync/scp/sftp, but it should not be possible to ssh to the ...
2
votes
1answer
40 views

rsync - How to sync specifc files and delete the rest on destination

I want to sync specific files and delete anything else that exists on the destination server. Source = /dir1/A - Z How do I sync A - D and delete E - Z if they exist?
1
vote
1answer
69 views

Issue with rsync: tput warning

I am using rsync to copy files from one server to the other and I keep getting this warning: tput: No value for $TERM and no -T specified The command I run is this: rsync -aq ...
10
votes
1answer
9k views

How to rsync a large file, with as little CPU and bandwidth expense as possible?

I have a 500 GB file that I plan on backing up remotely. The file changes often. I'll be rsyncing it from a desktop to a server. Both can run rsync client or server. What is the proper command for ...
0
votes
1answer
63 views

How to copy directory from remote server

I came across following instruction to copy a directory to my local machine. copy the gems from styx server from "‪location/to/the/directory" to your local directory I know rsync and scp can do the ...
1
vote
1answer
771 views

Rsync via network to slow server

I am transporting lots of data with rsync from a Linux client to a NAS, both machines are connected via fast (100 Mbit) Ethernet. The NAS is a Linux-based "slow-CPU" D-Link DNS-323 with telnet and ...
1
vote
2answers
403 views

How to avoid having to type password every time rsync is run in a Bash script?

In a bash script, I have several rsync statements. Every rsync will prompt for typing password, and defeats very much the automation of doing the job using a script. How to improve this? The ...
0
votes
0answers
28 views

Rsync - privacy of excluded files

My question: Will any information about excluded files (in the example below, the contents of the private directories) be transferred between the rsync client and daemon? I am using Rsync to sync work ...
0
votes
3answers
98 views

What are good compression algorithms for delta synchronization?

When syncing large files over a slow link, it is often useful to use delta compression in order to reduce the bandwidth used. It is also useful to compress files as they take up much less space. ...
3
votes
1answer
2k views

Rsync on windows: Permission Denied (13)

I have a Windows 7 box and an Ubuntu server that I need to sync files between. My plan was to use Rsync running in cygwin on the Windows machine with a script like this: cd E:/User/ rsync -avz ...
0
votes
1answer
296 views

Rsync Remote To Local Issue

I was wondering if I could get some help with this rsync command. I am trying to copy files from a remote system by running rsync on the local system. Here is my command: /usr/bin/rsync -avz ...
1
vote
1answer
124 views

How can I reallocate an ext4 file system in an extended partition without lose data?

I resize the disk using the Windows default program. I don't know why, the extended partition of Linux now result unallocated. I'm sure I don't "touch" the extended partition, and I don't know why ...
0
votes
0answers
59 views

Reducing OpenSSH session key size

I am running into severe performance issues using SSH/Rsync on a Synology NAS (model DS413j if anybody knows anything about it). Both the sshd and the rsync processes are taking 100% CPU on the NAS, ...
1
vote
3answers
239 views

rsync: Can it transfer files ignoring size (comparing only timestamp and name)?

Can rsync compare/copy based on mod date and filename alone, ignoring file size? Context: I'm trying to implement a two-stage backup using rsync. The first stage is onsite, and I have a bash rsync ...
2
votes
0answers
145 views

rsync: large exclusion list adding 10 hours to sync

I have had an rsync backup script running on a Centos 6 box that has been syncing ~410gb of data from a local (LAN) server over a gigabit connection. This script runs hourly, and if there are no new ...
2
votes
0answers
184 views

Keep local folder in sync with Samba share

I have a local folder on my Linux Mint desktop (my Dropbox folder, though that shouldn't matter), and I'd like to keep it synced with my school's "datastore" Samba share, which I can connect to from ...
0
votes
0answers
119 views

How do I keep the same UID among many servers?

I have many servers with LDAP which mantain the users UID the same among the servers, but how can I change and keep the same UID for local users ? For example, the user tomcat, when someone create an ...
3
votes
1answer
226 views

scp: How to copy only the last 10% of a file?

I have a relatively large log file (46M) on a vServer, of which I'm only interested in the most recent part. How can I download only the last 10% of the file? The server is running Debian and I'm ...
3
votes
4answers
2k views

Truecrypt Rsync Container

Is there a good way to incrementally sync truecrypt containers? I currently have large containers (200gb+), and I'd like to find a way to back them up without having to mount them. Rsync seems to not ...
0
votes
0answers
232 views

Problems copying to VFAT formatted SD-card

I was going to copy my (mp3-encoded) music files (organized in one directory) to a (vfat-formatted) (micro-)sd-card to use it in my digital audio player (DAP) (on Linux). I used to use the same ...
19
votes
7answers
16k views

Replacing Dropbox with: Amazon S3 + SSL + GPG/TrueCrypt + Mounting on OSX ?? [closed]

So, right now we're using Dropbox to share various data files around between approximately 10 Mac OS X systems. However, we already have an S3 account and everyone on the lowest Dropbox plan of ...
0
votes
0answers
42 views

rsync Not Reporting Changes in Log File

I'm seeing some strange behavior from rsync. Here's what I did: Copied a remote directory to a local backup Changed a file on the remote server Ran rsync again with the --dry-run option on to see if ...
1
vote
2answers
112 views

Backing up multiple vmware VMs from a mac

I use vmware fusion to prototype and model enterprise infrastructure. This question is intended to solicit an optimal method for backing up (preferably incrementally) VMs. My VM directory is now ...
14
votes
4answers
12k views

Run rsync with root permission on remote machine

I want to sync a folder from my machine with a folder on a remote machine. The remote folder can only be manipulated by root. I have an account on the remote machine which can use sudo. How can I run ...
1
vote
2answers
67 views

Unix copy multiple folders based on a specified CSV list using rsync

I have done some research and it appears that rsync is the only method that can possibly help me achieve this. I want to specify a list of folders in a CSV which can tell rsync to copy them to ...
0
votes
0answers
12 views

rsync from windows 2003 server to a remote linux server [duplicate]

Can I load and use rsync to send files from a windows server 2003 machine to a remote linux server. Also, I could pull the files to the linux server if that's easier.
1
vote
0answers
36 views

Is there a way to verify the integrity of a rsnapshot backups?

I'm using rsnapshot to make daily backups to a second hdd. But how can I make sure, that no file in my backup is corrupted? If I use the checksum option from rsync, the whole backup will take much ...
0
votes
1answer
151 views

Backup LaCie 5big Pro to Amazon Glacier

Does anyone know of an easy way that I could back-up my LaCie 5big Pro NAS to Amazon Glacier? The automatic backup feature of the LaCie only supports rsync compatible servers, which Amazon Glacier is ...
1
vote
0answers
72 views

rsync - Exclude directories but include files within them

I have an rsync command which I'm using to synchronise two directories: rsync -CurvtOlon --delete /home/source/path/ /home/dest/path/ When I run the command, it recursively scans all of the source ...
0
votes
1answer
107 views

rsync - resume broken transfer (idea of rsync)

I have remote stations that collect data from sensors (ARM Debian) and transfers sets of data (about 1.1 MB) every 15 minutes (server is full Debian). On one station GSM reception is poor and standard ...
34
votes
3answers
24k views

rsync delete options

I see on the rsync man page that there are a number of delete options. I don't really understand the differences and implications of each of these - could someone fill me in please? --del ...
1
vote
1answer
111 views

Bash/Rsync: One-way synchronize files, leave files alone when only metadata has changed

I have some programs that allow exporting to different formats (e.g. html), but many of them share a problem: Exports are always done "all together", i.e. things like images or attachments are created ...
0
votes
1answer
153 views

Files hidden after copying from NAS to NAS using rsync

I have 2 Western Digital NAS: a blue light and a 2TB MyBook latest edition. I enabled ssh on the MyBook and I can use rsync from a terminal to sync files between the 2 NAS. Instead of copying using a ...
0
votes
1answer
158 views

rsync bullies destination ACLs for fun

I have the following ACLs configured on a directory (.ssh) at the destination of my rsync: # file: .ssh # owner: jsmith # group: jsmith user::rwx user:backup:r-x group::--- group:backup:r-x mask::r-x ...
0
votes
1answer
72 views

rsync transfer chunk size

I‘m transferring 1.1 Mb files over very poor GSM EDGE connection. My rsync command is: rsync --partial --remove-source-files --timeout=120 --append --progress --rsh=ssh -z LOCAL_FILE ...
3
votes
1answer
178 views

rsync recursive on same mount only

Hopefully, this simple question has a simple answer. I want to run rsync recursively using the -r option, but without descending into a different mount point (file system). i.e. like the -mount ...