Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.

learn more… | top users | synonyms

0
votes
3answers
168 views

How to write files in specific order?

Okay, here's a weird problem -- My wife just bought a 2014 Nissan Altima. So, I took her iTunes library and converted the .m4a files to .mp3, since the car audio system only supports .mp3 and .wma. ...
1
vote
0answers
292 views

File transfer tools for linux with support of zero-copy transfer

Are there small and simple file transfer tools for Linux, which can use "zero-copy" style of transferring files from HDD (SSD) to tcp socket, and back? I want to often send huge amount of ...
1
vote
1answer
85 views

Setting up Debian server for remote backups

I am running a Debian Wheezy server at home, and am offering an organization to let them do rsync backups to their own folder on my system. I created the unique user for them, and got a strong ...
1
vote
1answer
860 views

How to speed up data transfer between Portable HD and NAS (QNAP)?

I am trying to transfer data from a Western Digital USB2 Drive to a QNAP TS-212E. I am transfering the data between the portable HD and the NAS using rsync (see following command). rsync -v -r -h ...
0
votes
1answer
382 views

ntfs disk dying or..? rsync and mkdir failing, strange behavior

System root@host:~# uname -a Linux host 3.2.0-4-686-pae #1 SMP Debian 3.2.57-3+deb7u1 i686 GNU/Linux Mounts root@host:~# mount | tail -2 /dev/sda1 on /mnt/sda1 type ntfs ...
0
votes
1answer
27 views

rsync exclude config.js but include lib/project/config.js

I have a folder like this / config.js /lib /project config.js In the root directory I execute rsync rsync -azvr --exclude config.js --include lib/project/config.js . dest The ...
3
votes
1answer
178 views

How to control permissions on external USB hard disk

I'm using RHEL 6.5, andhave an auto-mounted external USB drive. Any and all files created in the mounted filesystem are given permission 700 for dirs and 777 for files. The chmod command does not ...
0
votes
1answer
266 views

Make rsync update existing files first, create new ones later?

I have a source directory which I'm periodically syncing to a target using rsync: rsync --bwlimit=1600 --recursive --times --omit-dir-times --copy-links --modify-window=30 --inplace ...
1
vote
0answers
530 views

rsync failed: No Such file or directory

I'm using rsync in Windows ( through cygwin64 ) to backup some data to an samba share. I've made this bat file that would take care of everything: net use S: \\10.1.1.23\marc password /user:marc ...
0
votes
0answers
12 views

Using an SD card for regular backups? [duplicate]

I recently updated to a 128 GB solid state drive, and I've gotta say, I love the boot times and app load times, however I'm not keen on the increased possibility of spontaneous failure. I figure I've ...
0
votes
1answer
634 views

How to make rsync completely ignore permission from source

I'm trying to use rsync to copy from an Android source where the sdcard mount has rather nonsensical permissions (---rwxr-x) and rsync fails because it creates the destination directories with the ...
3
votes
2answers
1k views

How do I compare two folders recursively and generate a list of files and folders that are different?

tl;dr and an example I'm looking for a way to compare two folders recursively and output the relative paths all files (and folders) that are different (by size or by timestamp, à la rsync). For ...
0
votes
1answer
32 views

Below what network speed should I be using compression for an rsync transfer?

I'm transferring some files from a remote server. The speeds for the transfer are abysmal (~1 MBps), and have got me thinking about optimizing the transfer for speed. At what network speed does it ...
0
votes
1answer
39 views

without ssh key setup, can have write a non-interactive script to rsync/scp/etc withut me having to input the password everytime?

Is there some switch/option for ssh or rsync (something like -u username -p passowrd) that would allow me to pass in the password?
0
votes
2answers
46 views

Rsync folders automatization

I've got a folder on the remote server, to which I'm connecting via SSH. When I need to synchronise folders I'm using manually access via scp. (I'm synchronising my folder with the folder on the ...
0
votes
1answer
115 views

Merging two directory trees with same structure, but different contents in Unix

I have two directories with the following structure: A |_0 |_1 |_2 B |_0 |_1 |_2 each 0,1,2 directory contains unique contents. I want all of the contents to simply exist as: A |_0 |_1 |_2 Is ...
1
vote
1answer
89 views

What does the output of rsync look like when it completes successfully?

I used rsync to back up my main drive to an external drive last night. At some point in the night the external drive was unplugged. This is the tail of the output of rsync -avRP ... ...
1
vote
1answer
66 views

How to keep two directories on two unconnected machines in sync via emailing of delta-archives

My situation is that I have two directories on two different computers (one Windows machine, OSX machine) and I need to keep the two directories on the two machines in sync (= mirrored), so that they ...
0
votes
1answer
638 views

Exact copy of files from NTFS to another NTFS using Linux

I try to copy all files from an NTFS to an external drive and want to preserve all permissions and attributes. The external drive has already an NTFS and contains other files. I've considered using ...
1
vote
1answer
176 views

How to output file sizes in human-readable format in an rsync logfile

I know that the -h option outputs file sizes in human-readable format when, for example, displaying the transfer progress with --progress. But is it possible to get this same file size formatting in ...
0
votes
1answer
62 views

Fast splitting of list of files in chunks of the same size (memory)

See title. Assume I have the following list of files and relatives sizes: cat list_of_files.txt: 1243 001.txt 124 002.txt 4132 003.txt 3000 004.txt I want to be able to split into multiple chunks ...
1
vote
1answer
214 views

How to Find the Bottleneck when Transferring Files over WAN

This question may be a little too broad, but I'm looking for some methodology to identify a transfer speed bottleneck. I'm using rsync to transfer files between 2 NAS devices (DNS-323 to be specific) ...
0
votes
0answers
34 views

web interface for server-to-server file transfer [duplicate]

I'm looking for a way to transfer files between two servers. I currently ssh into one server and use rsync inside a screen session to initiate a transfer from the other host. This works, but I'm ...
0
votes
2answers
38 views

rsync from two servers to a common location

I have two servers and I want to rsync files from both servers to a single location. Server 1 has files A and B Server 2 has files A and B After rsync server 3 has file A and B When a user ...
0
votes
1answer
264 views

Transparent failover for NFS home directory (with LDAP users)

Background: In our work environment, we have LDAP users together with NFS homes. So you sign on LDAP server, autofs mounts the homes, etc. Pretty neat so far. However, from time to time, the NFS or ...
1
vote
0answers
131 views

ssh proxycommand equivalent on server

Lets say we have three machines me, proxy, server I would like to have an ssh connection to server, so normally I would do me$ ssh proxy proxy$ ssh server server$ # and here we are ssh proxy ...
12
votes
1answer
8k views

Does rsync delete files, folders at destination by default?

Files Suppose that /foo/src contains only A.c and that /foo/dest contains both A.c and B.c. And suppose I run the following command: rsync /foo/src/ /foo/dest Will rsync erase B.c? Folders Now ...
0
votes
2answers
391 views

rsync on Windows not transferring large files

I'm noticing a strange issue where rsync isn't transferring large (approx >3GB) files. I'm running MSYS rsync and I'm transferring on my LAN from my Windows box to my Linux based NAS over ssh. Most of ...
1
vote
1answer
263 views

Rsync incredibly slow in Cygwin - am I doing something wrong?

I am trying to back up my C: and D: drives (each 1 TB, C: has around 210 GB of data on it, D: has around 345 GB on it) onto a 3 TB external HDD using Cygwin in Windows 8. I am doing this with ...
0
votes
1answer
64 views

rsync don t work as expected

I have a script which download and compress a folder of a remote server (example: /home). I m trying to make the "restore" script, but I have a strange behavior. restore.sh: ($1 is IP adress, $2 is ...
0
votes
1answer
183 views

Error message using scp over ssh

I'm not sure what's going on but as of late I can't seem to get any files copied to local from my remote server. I tried rsync from local and get the following error message: mut@mylocalcomputer:~$ ...
3
votes
2answers
3k views

Rsync to multiple directories with one command?

I want to rsync my working directory to two other directories. One would destination would be for backup, another for testing it. I tried this: rsync -av --exclude='.git' source dest1,dest2 But ...
0
votes
0answers
96 views

rsync won't recognize my /user folder?

On OSX, 10.9.1. I'm trying to use rsync to sync the contents of local folder: (/Users/username/00_WORK/FolderX) with (/Volumes/WORK_BACKUP/01_Current_Work/FolderX) Obviously the destination is ...
0
votes
1answer
117 views

cwrsync and long file names issue

I am trying to use cwrsync on my windows server to backup to my linux server, but am running into an issue where the file names become too long. So a user on one of the systems will have a mapped ...
0
votes
1answer
86 views

rsync over ssh but block changes to authorized_keys file on remote computer

OK I finally got rsync over ssh setup with authorized keys. Since I don't want my users browsing the filesystem, I have modified the authorized_keys file to run an rsync script. That way they can't do ...
2
votes
1answer
825 views

rsync on NTFS - permissions

I'm backing up directories on a Fedora machine onto an NTFS drive (fuseblk according to df -T) and it seems to go just fine with this: ls -t | sed -e "1,"$n"d" | xargs -d '\n' rm -rf nice rsync -azv ...
1
vote
2answers
947 views

RSYNC over SSH requesting password

I looked at numerous question but don't seem to find quite what I'm looking for. I've created a script in which I'm trying to run rsync over ssh, this will eventually be put into a cron job. The ...
2
votes
0answers
647 views

rsync error: symlink has no referent

I am trying to configure rsnapshot (which uses rsync) to backup a Windows server but I am having trouble with rsync being unable to follow a symlink on the server to be backed up. Setup: Windows ...
0
votes
1answer
14 views

Why am I still able to write to a directory after I have changed permissions at the terminal?

I am running Mac Os 10.9 and connecting to a Mac OS server (10.8?) over our local network where I have an admin account. I regularly sync 3 directories from my machine to the fileserver using rsync. ...
8
votes
3answers
7k views

How to best clone a running system to a new harddisk using rsync?

I have a system running as a server that has a failing harddrive. While all important data is on a RAID and backed up and all that, I don't have an image of the system itself. There is no specific ...
0
votes
0answers
150 views

rsync with folder and file name pattern matching to copy files

Right now I'm successfully running: rsync -uvma --include="*/" --include="*.css" --exclude="*" $spec_dir $css_spec_dir In a shell script which copies all of the files in the source directory, that ...
0
votes
2answers
391 views

Watch a filesystem and rsync changes in a cross-platform way with minimal dependencies

I'd like to start a long-running Ruby or Python script, and have the script watch a local directory for changes to files and new files. Periodically, the script will trigger a one-way rsync to a ...
0
votes
1answer
253 views

Alternative to diff with progress for massive directory compare?

I just rsync-ed 2,000,000 files (3TB) from one RAID to another. I want to make sure my data is intact. rsync -c takes a really long time. diff doesn't show me what it's doing. Is there an ...
1
vote
2answers
436 views

SCP remember password

On debian, is there anyway for scp to remember the password I've typed in for the duration of my ssh logon, similar to how sudo does? i.e. PC ---ssh(putty)---> server 1 ---scp---> server 2 ...
1
vote
0answers
35 views

rsync ssh to ssh to local

Is it possible to perform a rsync to backup files from a server passing by an another server by ssh. And I have to use port 23 from local to server1. So : ssh ssh -p 23 server2 ...
0
votes
1answer
85 views

Ununtu 12.0.4 LTS Boots to some unknown mount point

I installed Ubuntu 12.0.4 LTS to a 2TB Sata with a swap partition and a data partition. I installed mdadm and setup an incomplete raid. I later unmounted that raid (to which it erred as non-existent) ...
2
votes
1answer
1k views

Rsync very slow

I have just setup a Debian server for backup of Windows PCs. I am currently testing various methods including: rsync (using Deltacopy on Windows), SMB via Samba and scp. Currently rsync (without SSH ...
3
votes
2answers
2k views

Is there really no way in Linux to get creation time for files on cifs/smb share?

I am embarrassingly far along in a bash backup script and have missed something major. I know that ext3 filesystems don't track creation date, but copying files within ext3 updates the changed time as ...
0
votes
0answers
44 views

Rsync Being Naughty

Rsync as you know is known for its ability to sync files incrementally - backing up only the changes. However, this is not the behavior I have noticed while testing my Rsync setup. It appears that ...
0
votes
2answers
111 views

rsync: gzip on source tolerant

I need to transfer a couple of log-files each hour to a logstorage which all users can reach, and I use rsync for do that, but the problem comes when the log-file is rotated and automatically zipped, ...