Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.

learn more… | top users | synonyms

0
votes
1answer
559 views

Exact copy of files from NTFS to another NTFS using Linux

I try to copy all files from an NTFS to an external drive and want to preserve all permissions and attributes. The external drive has already an NTFS and contains other files. I've considered using ...
0
votes
1answer
133 views

How to output file sizes in human-readable format in an rsync logfile

I know that the -h option outputs file sizes in human-readable format when, for example, displaying the transfer progress with --progress. But is it possible to get this same file size formatting in ...
0
votes
1answer
59 views

Fast splitting of list of files in chunks of the same size (memory)

See title. Assume I have the following list of files and relatives sizes: cat list_of_files.txt: 1243 001.txt 124 002.txt 4132 003.txt 3000 004.txt I want to be able to split into multiple chunks ...
1
vote
1answer
192 views

How to Find the Bottleneck when Transferring Files over WAN

This question may be a little too broad, but I'm looking for some methodology to identify a transfer speed bottleneck. I'm using rsync to transfer files between 2 NAS devices (DNS-323 to be specific) ...
0
votes
0answers
34 views

web interface for server-to-server file transfer [duplicate]

I'm looking for a way to transfer files between two servers. I currently ssh into one server and use rsync inside a screen session to initiate a transfer from the other host. This works, but I'm ...
0
votes
2answers
37 views

rsync from two servers to a common location

I have two servers and I want to rsync files from both servers to a single location. Server 1 has files A and B Server 2 has files A and B After rsync server 3 has file A and B When a user ...
0
votes
1answer
225 views

Transparent failover for NFS home directory (with LDAP users)

Background: In our work environment, we have LDAP users together with NFS homes. So you sign on LDAP server, autofs mounts the homes, etc. Pretty neat so far. However, from time to time, the NFS or ...
1
vote
0answers
114 views

ssh proxycommand equivalent on server

Lets say we have three machines me, proxy, server I would like to have an ssh connection to server, so normally I would do me$ ssh proxy proxy$ ssh server server$ # and here we are ssh proxy ...
10
votes
1answer
7k views

Does rsync delete files, folders at destination by default?

Files Suppose that /foo/src contains only A.c and that /foo/dest contains both A.c and B.c. And suppose I run the following command: rsync /foo/src/ /foo/dest Will rsync erase B.c? Folders Now ...
0
votes
2answers
350 views

rsync on Windows not transferring large files

I'm noticing a strange issue where rsync isn't transferring large (approx >3GB) files. I'm running MSYS rsync and I'm transferring on my LAN from my Windows box to my Linux based NAS over ssh. Most of ...
1
vote
1answer
222 views

Rsync incredibly slow in Cygwin - am I doing something wrong?

I am trying to back up my C: and D: drives (each 1 TB, C: has around 210 GB of data on it, D: has around 345 GB on it) onto a 3 TB external HDD using Cygwin in Windows 8. I am doing this with ...
0
votes
1answer
57 views

rsync don t work as expected

I have a script which download and compress a folder of a remote server (example: /home). I m trying to make the "restore" script, but I have a strange behavior. restore.sh: ($1 is IP adress, $2 is ...
0
votes
1answer
164 views

Error message using scp over ssh

I'm not sure what's going on but as of late I can't seem to get any files copied to local from my remote server. I tried rsync from local and get the following error message: mut@mylocalcomputer:~$ ...
3
votes
2answers
2k views

Rsync to multiple directories with one command?

I want to rsync my working directory to two other directories. One would destination would be for backup, another for testing it. I tried this: rsync -av --exclude='.git' source dest1,dest2 But ...
0
votes
0answers
87 views

rsync won't recognize my /user folder?

On OSX, 10.9.1. I'm trying to use rsync to sync the contents of local folder: (/Users/username/00_WORK/FolderX) with (/Volumes/WORK_BACKUP/01_Current_Work/FolderX) Obviously the destination is ...
0
votes
1answer
109 views

cwrsync and long file names issue

I am trying to use cwrsync on my windows server to backup to my linux server, but am running into an issue where the file names become too long. So a user on one of the systems will have a mapped ...
0
votes
1answer
80 views

rsync over ssh but block changes to authorized_keys file on remote computer

OK I finally got rsync over ssh setup with authorized keys. Since I don't want my users browsing the filesystem, I have modified the authorized_keys file to run an rsync script. That way they can't do ...
2
votes
1answer
728 views

rsync on NTFS - permissions

I'm backing up directories on a Fedora machine onto an NTFS drive (fuseblk according to df -T) and it seems to go just fine with this: ls -t | sed -e "1,"$n"d" | xargs -d '\n' rm -rf nice rsync -azv ...
1
vote
2answers
847 views

RSYNC over SSH requesting password

I looked at numerous question but don't seem to find quite what I'm looking for. I've created a script in which I'm trying to run rsync over ssh, this will eventually be put into a cron job. The ...
2
votes
0answers
579 views

rsync error: symlink has no referent

I am trying to configure rsnapshot (which uses rsync) to backup a Windows server but I am having trouble with rsync being unable to follow a symlink on the server to be backed up. Setup: Windows ...
0
votes
1answer
14 views

Why am I still able to write to a directory after I have changed permissions at the terminal?

I am running Mac Os 10.9 and connecting to a Mac OS server (10.8?) over our local network where I have an admin account. I regularly sync 3 directories from my machine to the fileserver using rsync. ...
8
votes
3answers
6k views

How to best clone a running system to a new harddisk using rsync?

I have a system running as a server that has a failing harddrive. While all important data is on a RAID and backed up and all that, I don't have an image of the system itself. There is no specific ...
0
votes
0answers
135 views

rsync with folder and file name pattern matching to copy files

Right now I'm successfully running: rsync -uvma --include="*/" --include="*.css" --exclude="*" $spec_dir $css_spec_dir In a shell script which copies all of the files in the source directory, that ...
0
votes
2answers
340 views

Watch a filesystem and rsync changes in a cross-platform way with minimal dependencies

I'd like to start a long-running Ruby or Python script, and have the script watch a local directory for changes to files and new files. Periodically, the script will trigger a one-way rsync to a ...
0
votes
0answers
225 views

Alternative to diff with progress for massive directory compare?

I just rsync-ed 2,000,000 files (3TB) from one RAID to another. I want to make sure my data is intact. rsync -c takes a really long time. diff doesn't show me what it's doing. Is there an ...
1
vote
2answers
359 views

SCP remember password

On debian, is there anyway for scp to remember the password I've typed in for the duration of my ssh logon, similar to how sudo does? i.e. PC ---ssh(putty)---> server 1 ---scp---> server 2 ...
1
vote
0answers
34 views

rsync ssh to ssh to local

Is it possible to perform a rsync to backup files from a server passing by an another server by ssh. And I have to use port 23 from local to server1. So : ssh ssh -p 23 server2 ...
0
votes
1answer
82 views

Ununtu 12.0.4 LTS Boots to some unknown mount point

I installed Ubuntu 12.0.4 LTS to a 2TB Sata with a swap partition and a data partition. I installed mdadm and setup an incomplete raid. I later unmounted that raid (to which it erred as non-existent) ...
2
votes
1answer
1k views

Rsync very slow

I have just setup a Debian server for backup of Windows PCs. I am currently testing various methods including: rsync (using Deltacopy on Windows), SMB via Samba and scp. Currently rsync (without SSH ...
2
votes
2answers
1k views

Is there really no way in Linux to get creation time for files on cifs/smb share?

I am embarrassingly far along in a bash backup script and have missed something major. I know that ext3 filesystems don't track creation date, but copying files within ext3 updates the changed time as ...
0
votes
0answers
42 views

Rsync Being Naughty

Rsync as you know is known for its ability to sync files incrementally - backing up only the changes. However, this is not the behavior I have noticed while testing my Rsync setup. It appears that ...
0
votes
2answers
107 views

rsync: gzip on source tolerant

I need to transfer a couple of log-files each hour to a logstorage which all users can reach, and I use rsync for do that, but the problem comes when the log-file is rotated and automatically zipped, ...
0
votes
1answer
491 views

How to rollback a single file backed up with rsync?

I just set up a linux NAS as an rsync server to backup our file server. I'm saving several versions of each file and know how to restore a snapshot of our server, but what we really need is to ...
1
vote
1answer
211 views

Automatically purge rotated backup without breaking rsync

How do I make sure locally deleted files have been rotated before deleting them on the server, whithout breaking incremental rsyncing? I usually rsync my files into /backup/active/ on my server, ...
1
vote
1answer
48 views

Automatic Media Server Mirror

I have a large (400GB) photo library and I've just built a media server (Win 2012) that I use for local redundant storage and to backup to a cloud (CrashPlan). Since work is primarily done on a PC ...
2
votes
1answer
106 views

Rsync won't save some files

I have a strange issue with rsync: some files are not saved on the remote host. On my Windows 2012 server i'm using: rsync --progress --no-compress --partial -avshW "/cygdrive/d/foto" ...
1
vote
0answers
153 views

Rsync do not do anything if files not changed

#!/bin/sh date=`date "+%Y-%m-%dT%H:%M:%S"` rsync -aP --link-dest=/target/current '/source/folder' /target/back-$date rm -f /target/Backups/current ln -s back-$date /target/current This is a little ...
0
votes
0answers
138 views

Rsync between two VM stalls after few files

I have two VM (let's say VM A and B) on the same host. I try to rsync between those VM, from VM B (with a rsync daemon running on A): B$ rsync -rvut user@A::src dest/ It works well during few ...
0
votes
1answer
199 views

File sync solution with pattern matching

I have a directory I want to sync over the cloud using a service like Dropbox. But, within that folder, I only want to sync directories that match a particular pattern. For instance, sync all folders ...
3
votes
2answers
165 views

Differential copy from Windows to Linux

Is there any way to do differential copies of a directory from Windows to Linux over ssh, sftp, scp, or similar? Preferably not rsync since they are all cygwin based and force you to use the ...
0
votes
1answer
41 views

rsync not skipping untouched files

I transferred about 300GB of files with scp from one server to another. Sadly I forgot the -r option, so part of the files that were in subdirectories were not copied. I verified that the files that ...
0
votes
1answer
36 views

Rsync only files from specific user

Is there a way to rsync only files from a certain user? I have a folder which contains files from multiple users but would only like to backup files from a particular user. I've looked at the man ...
1
vote
1answer
74 views

rsync expanding remote directory with local username?

I am new to rsync but attempting to setup a backup server. User names follow this basic idea: remote user: computer local user: computer-bkup. When I run $ rsync -avz -e ssh ...
0
votes
0answers
54 views

Rsync delete issue

I implemented rsync to backup the data from the server to my local machine,and done it regularly by cron. It works fine but yesterday it deletes the files from the folders on my local machine but on ...
1
vote
1answer
142 views

My Backups are all flocked up

I have cron job that runs an rsync command that does a remote backup every two hours. In the event that the previous remote backup is still running, I've encapsulated this rysnc command inside of a ...
0
votes
1answer
218 views

Using excludes with rsync

I am trying to use rsync to automatically backup my personal files in /home/usr to an external drive. Of course, my /home/usr directory contains a number of hidden files (for config, etc.), such as ...
5
votes
1answer
2k views

Unicode Characters in Ubuntu Server

I recently migrated from Ubuntu Desktop 13.04 to Ubuntu Server 13.10 and now my filesystem doesn't seem to support unicode characters. I use rsync to backup/sync files and it shows the proper ...
0
votes
2answers
100 views

Rsync fails to sync flags

I am trying to sync two folders along their extended attributes, however some files are always synced every single time without any apparent reason. Debugging rsync I found out that the remote file ...
1
vote
1answer
494 views

Multiple rsync versions conflict

RSYNC only fails when I try to sync extended attributes (Mac OS X) with the following error. rsync error: protocol incompatibility (code 2) at io.c(599) [sender=3.1.0] rsync: [receiver] write error: ...
0
votes
1answer
62 views

Linux shell command to compare two directories and remove dupes

As a part of an app I'm developing, I need to remove any files in directory A that are already into directory B. I thought of rsync but I can't stop it from copying the files missing from source to ...