Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.

learn more… | top users | synonyms

0
votes
2answers
29 views

Rsync folders automatization

I've got a folder on the remote server, to which I'm connecting via SSH. When I need to synchronise folders I'm using manually access via scp. (I'm synchronising my folder with the folder on the ...
0
votes
1answer
15 views

Merging two directory trees with same structure, but different contents in Unix

I have two directories with the following structure: A |_0 |_1 |_2 B |_0 |_1 |_2 each 0,1,2 directory contains unique contents. I want all of the contents to simply exist as: A |_0 |_1 |_2 Is ...
1
vote
1answer
15 views

What does the output of rsync look like when it completes successfully?

I used rsync to back up my main drive to an external drive last night. At some point in the night the external drive was unplugged. This is the tail of the output of rsync -avRP ... ...
0
votes
0answers
8 views

rsync to machine A via machine B over ssh

rsync to a remote machine A over ssh is simple. rsync -v -e 'ssh user@A' local-file ... connecting to a remote machine A via another remote machine B is also simple ssh -t user@B ssh user@A How ...
1
vote
1answer
31 views

How to keep two directories on two unconnected machines in sync via emailing of delta-archives

My situation is that I have two directories on two different computers (one Windows machine, OSX machine) and I need to keep the two directories on the two machines in sync (= mirrored), so that they ...
0
votes
1answer
44 views

Exact copy of files from NTFS to another NTFS using Linux

I try to copy all files from an NTFS to an external drive and want to preserve all permissions and attributes. The external drive has already an NTFS and contains other files. I've considered using ...
0
votes
0answers
10 views

How to output file sizes in human-readable format in an rsync logfile

I know that the -h option outputs filesizes in human-readable format when, ex, displaying the transfer progress with --progress, but is it possible to get this same file size formatting in the log ...
0
votes
1answer
19 views

Fast splitting of list of files in chunks of the same size (memory)

See title. Assume I have the following list of files and relatives sizes: cat list_of_files.txt: 1243 001.txt 124 002.txt 4132 003.txt 3000 004.txt I want to be able to split into multiple chunks ...
0
votes
1answer
21 views

How to Find the Bottleneck when Transferring Files over WAN

This question may be a little too broad, but I'm looking for some methodology to identify a transfer speed bottleneck. I'm using rsync to transfer files between 2 NAS devices (DNS-323 to be specific) ...
0
votes
0answers
23 views

web interface for server-to-server file transfer

I'm looking for a way to transfer files between two servers. I currently ssh into one server and use rsync inside a screen session to initiate a transfer from the other host. This works, but I'm ...
0
votes
1answer
21 views

rsync from two servers to a common location

I have two servers and I want to rsync files from both servers to a single location. Server 1 has files A and B Server 2 has files A and B After rsync server 3 has file A and B When a user ...
0
votes
0answers
15 views

How to rsync merge two paths into one; opposite of --inplace

I have a large remote directory: remote://server/pathA/zupertoll And a large local directory that is 95% the same as the remote directory: local:///home/pathB/zupertoll I want to copy zupertoll to ...
0
votes
0answers
9 views

rsync: Exclude files included from --files-from

I'm on Mac OS X. I have a source file list that contains files that sometimes don't exist. So I want to exclude them on those occasions, like this: /usr/bin/rsync -av --progress --delete ...
0
votes
1answer
20 views

Transparent failover for NFS home directory (with LDAP users)

Background: In our work environment, we have LDAP users together with NFS homes. So you sign on LDAP server, autofs mounts the homes, etc. Pretty neat so far. However, from time to time, the NFS or ...
0
votes
0answers
25 views

ssh proxycommand equivalent on server

Lets say we have three machines me, proxy, server I would like to have an ssh connection to server, so normally I would do me$ ssh proxy proxy$ ssh server server$ # and here we are ssh proxy ...
1
vote
1answer
33 views

Does rsync delete files, folders at destination by default?

Files Suppose that /foo/src contains only A.c and that /foo/dest contains both A.c and B.c. And suppose I run the following command: rsync /foo/src/ /foo/dest Will rsync erase B.c? Folders Now ...
0
votes
0answers
15 views

mv backup but instead of creating tilde directories, create tilde files in subdirectories?

I have 2 deep directory structures that are (probably) identical and I want to end up with a single one, but not auto-resolve existing conflicts (I'm guessing rsync would clobber something). I just ...
0
votes
2answers
49 views

rsync on Windows not transferring large files

I'm noticing a strange issue where rsync isn't transferring large (approx >3GB) files. I'm running MSYS rsync and I'm transferring on my LAN from my Windows box to my Linux based NAS over ssh. Most of ...
0
votes
0answers
33 views

Rsync incredibly slow in Cygwin - am I doing something wrong?

I am trying to back up my C: and D: drives (each 1 TB, C: has around 210 GB of data on it, D: has around 345 GB on it) onto a 3 TB external HDD using Cygwin in Windows 8. I am doing this with ...
0
votes
0answers
22 views

I have a very large rsync job that fails during 'receiving incremental file list"

I have a multi-TB backup that I'm trying to move. It's an rsnapshot-like collection of many dated directories that are 99% hardlinks to unchanged files and some new files. The job runs for many hours ...
0
votes
0answers
18 views

How to backup incremental with rsync with diffrent location for incremental changes?

I want to do incremental backup with rsync in centos. but I want to have a full backup in a specific folder and for incremental changes I use to another folder with time stamp. Is it possible and how? ...
0
votes
1answer
23 views

rsync don t work as expected

I have a script which download and compress a folder of a remote server (example: /home). I m trying to make the "restore" script, but I have a strange behavior. restore.sh: ($1 is IP adress, $2 is ...
0
votes
1answer
28 views

Error message using scp over ssh

I'm not sure what's going on but as of late I can't seem to get any files copied to local from my remote server. I tried rsync from local and get the following error message: mut@mylocalcomputer:~$ ...
0
votes
0answers
27 views

Copy files to location, skipping duplicates (in source and dest. location)

I have an external hardrive I think is running down breaking (unable to delete some files from it). I copied a bunch of files over already but ran out of space. How do I dedup while copying/How to I ...
0
votes
0answers
39 views

Backup with rsync in an encrypted folder

I want to backup a folder from a remote server in a local folder encrypted with encfs. The files in the remote folder are owned by different users and I want to keep ownerships. The local folder is in ...
1
vote
1answer
14 views

Rsync to multiple directories with one command?

I want to rsync my working directory to two other directories. One would destination would be for backup, another for testing it. I tried this: rsync -av --exclude='.git' source dest1,dest2 But ...
0
votes
0answers
29 views

rsync won't recognize my /user folder?

On OSX, 10.9.1. I'm trying to use rsync to sync the contents of local folder: (/Users/username/00_WORK/FolderX) with (/Volumes/WORK_BACKUP/01_Current_Work/FolderX) Obviously the destination is ...
0
votes
0answers
15 views

'rsync -vr --delete' Replaces existing files, not just extraneous files

I have this: rsync -vr --delete /Volumes/source_hdd/folder_to_sync /Volumes/destination_hdd My intention is to have the 'folder_to_sync' on the 'destination_hdd' to be synced with the folder using ...
0
votes
1answer
16 views

cwrsync and long file names issue

I am trying to use cwrsync on my windows server to backup to my linux server, but am running into an issue where the file names become too long. So a user on one of the systems will have a mapped ...
0
votes
1answer
37 views

rsync over ssh but block changes to authorized_keys file on remote computer

OK I finally got rsync over ssh setup with authorized keys. Since I don't want my users browsing the filesystem, I have modified the authorized_keys file to run an rsync script. That way they can't do ...
2
votes
1answer
61 views

rsync on NTFS - permissions

I'm backing up directories on a Fedora machine onto an NTFS drive (fuseblk according to df -T) and it seems to go just fine with this: ls -t | sed -e "1,"$n"d" | xargs -d '\n' rm -rf nice rsync -azv ...
0
votes
2answers
102 views

RSYNC over SSH requesting password

I looked at numerous question but don't seem to find quite what I'm looking for. I've created a script in which I'm trying to run rsync over ssh, this will eventually be put into a cron job. The ...
1
vote
0answers
108 views

rsync error: symlink has no referent

I am trying to configure rsnapshot (which uses rsync) to backup a Windows server but I am having trouble with rsync being unable to follow a symlink on the server to be backed up. Setup: Windows ...
0
votes
1answer
11 views

Why am I still able to write to a directory after I have changed permissions at the terminal?

I am running Mac Os 10.9 and connecting to a Mac OS server (10.8?) over our local network where I have an admin account. I regularly sync 3 directories from my machine to the fileserver using rsync. ...
2
votes
2answers
284 views

How to best clone a running system to a new harddisk using rsync?

I have a system running as a server that has a failing harddrive. While all important data is on a RAID and backed up and all that, I don't have an image of the system itself. There is no specific ...
0
votes
0answers
61 views

rsync with folder and file name pattern matching to copy files

Right now I'm successfully running: rsync -uvma --include="*/" --include="*.css" --exclude="*" $spec_dir $css_spec_dir In a shell script which copies all of the files in the source directory, that ...
0
votes
1answer
36 views

Watch a filesystem and rsync changes in a cross-platform way with minimal dependencies

I'd like to start a long-running Ruby or Python script, and have the script watch a local directory for changes to files and new files. Periodically, the script will trigger a one-way rsync to a ...
0
votes
0answers
43 views

Alternative to diff with progress for massive directory compare?

I just rsync-ed 2,000,000 files (3TB) from one RAID to another. I want to make sure my data is intact. rsync -c takes a really long time. diff doesn't show me what it's doing. Is there an ...
1
vote
0answers
25 views

rsync ssh to ssh to local

Is it possible to perform a rsync to backup files from a server passing by an another server by ssh. And I have to use port 23 from local to server1. So : ssh ssh -p 23 server2 ...
0
votes
0answers
15 views

How can I get rsync to exclude files with brackets in the name?

I have my exclude.txt with files and most work except directories with []'s. I get the list from doing an ls on the remote direction and writing that to the exclude.txt file so is there a way I should ...
0
votes
0answers
39 views

Ununtu 12.0.4 LTS Boots to some unknown mount point

I installed Ubuntu 12.0.4 LTS to a 2TB Sata with a swap partition and a data partition. I installed mdadm and setup an incomplete raid. I later unmounted that raid (to which it erred as non-existent) ...
2
votes
1answer
141 views

Rsync very slow

I have just setup a Debian server for backup of Windows PCs. I am currently testing various methods including: rsync (using Deltacopy on Windows), SMB via Samba and scp. Currently rsync (without SSH ...
0
votes
2answers
144 views

Is there really no way in Linux to get creation time for files on cifs/smb share?

I am embarrassingly far along in a bash backup script and have missed something major. I know that ext3 filesystems don't track creation date, but copying files within ext3 updates the changed time as ...
0
votes
0answers
27 views

Rsync Being Naughty

Rsync as you know is known for its ability to sync files incrementally - backing up only the changes. However, this is not the behavior I have noticed while testing my Rsync setup. It appears that ...
0
votes
2answers
47 views

rsync: gzip on source tolerant

I need to transfer a couple of log-files each hour to a logstorage which all users can reach, and I use rsync for do that, but the problem comes when the log-file is rotated and automatically zipped, ...
0
votes
1answer
59 views

How to rollback a single file backed up with rsync?

I just set up a linux NAS as an rsync server to backup our file server. I'm saving several versions of each file and know how to restore a snapshot of our server, but what we really need is to ...
1
vote
1answer
100 views

Automatically purge rotated backup without breaking rsync

How do I make sure locally deleted files have been rotated before deleting them on the server, whithout breaking incremental rsyncing? I usually rsync my files into /backup/active/ on my server, ...
1
vote
1answer
33 views

Automatic Media Server Mirror

I have a large (400GB) photo library and I've just built a media server (Win 2012) that I use for local redundant storage and to backup to a cloud (CrashPlan). Since work is primarily done on a PC ...
0
votes
0answers
22 views

backup / version control hybrid scheme

Any suggestions for how to implement something that's about halfway between version control and a backup system? Specifics: I've been playing around with git and mercurial, and discovering that ...
0
votes
0answers
55 views

Rsync not working with Box.com

I have a Linux VPS running CentOS 6.5 32 bit, using OpenVZ. My host has enabled FUSE. I have then mounted my box.com using davfs2. Using df -h shows that the folder (box.com) exists. I have then ...