Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.

learn more… | top users | synonyms

1
vote
1answer
59 views

How can I clone files from OS X to a FAT32 formatted USB pen drive?

I have my music library on my Synology NAS which is an ext4 file system. I copy those files to a V-FAT formatted USB thumb drive ($usbdir), and then use the thumb drive in my car. The problem is the ...
0
votes
0answers
30 views

Move files from Linux disk img to Windows to Linux server and keep permissions?

I have a backup disk image that I am trying to upload to my server. The problem is that the disk image is corrupted according to Linux. However, using DiskInternals Linux Reader on Windows I can open ...
1
vote
1answer
472 views

Divide out local files in different servers with limited space with rsync

I have 80 GB of files in a local directory that I want to back up, dividing them out onto different servers with a limited space quota, using rsync, like so: LOCAL 80 Gb ====> server1: first 30 Gb ...
0
votes
0answers
37 views

Ubuntu admin can't open a directory - permission denied

Ok, so I have family backing up to my Lubuntu desktop server (ubuntu). They do rsync over ssh and the backup works fine. I then run backintime to make daily backups to another server. I am the admin ...
0
votes
0answers
26 views

rsync via sudo user using ssh not working

I logged in as USER1 and I am trying the below one from shell script. rsync -v -p -t -e "sudo -u USER2 ssh" USER2@HOST2:${REMOTE_FILE_TO_MOVE} \ ${DESTINATION_PATH} It prompts password for USER1 ...
1
vote
1answer
58 views

rsnapshot: What's wrong with my crontab?

I am using Rsnapshot for backups (Linux CentOS 6). Here is my /etc/cron.d/rsnapshot: 30 11 * * * root /usr/bin/rsnapshot nowandthen > /backups/rsnapshot_cron.txt 2>&1 15 11 * * 4 root ...
0
votes
1answer
127 views

Rsync hanging on files from client to LAN NAS server via ssh

I'm using rsync to do a backup to a NAS on my local network over SSH. However when running rsync I'm finding that it's getting stuck on certain files. Rsync will completely freeze and refuse to ...
0
votes
1answer
74 views

Incremental Snapshot Style backups with rsync on NTFS

I've taken over development of an embedded Linux product which needs a reliable backup solution. Backups are to be performed without compression to an attached USB storage device formatted to NTFS. ...
0
votes
1answer
229 views

rsync vs cp on Synology NAS

After i was disappointed with the performance of an external USB drive with my Synology DS251j i did some transfer tests on the shell. Interestingly i found that copying a 1GB test file takes over ...
0
votes
0answers
123 views

rsnapshot exclude_file not working for local backup?

I've setup rsnapshot for 2 Ubuntu 14.04 servers. One is over SSH, the other is local. The configs are almost exactly the same, however the local backup seems to not honor the exclude_file. Global ...
0
votes
1answer
98 views

How do I set up rsync in my environment (windows client to apache server with Wordpress installation)

I read the word rsync for the first time today after looking here on sueperuser for a solution to only transfer files which have been changed. I am working on a website with this environment: ...
0
votes
1answer
37 views

Rsync over a Network

I can't exchange files between my pcs, when I give the command sudo rsync -av -delete --rsh=ssh localhost/directory remotehost/directory remotehost root password is required but when I type it the ...
1
vote
1answer
38 views

unable to remove symbolic links of rsync copy of /bin and /dev

I accidentally made a rsync copy of my root directory, "/" using the -a option, as follows: user@mycomputer:~$ rsync -a / /backup-dir user@mycomputer:~$ ls -l /backup-dir/ total 10102784 drwxrwxrwx 1 ...
3
votes
1answer
20 views

Rsync: Skip files that are not present locally?

+------+-----+------+ |Local | |Remote| +------+-----+------+ |file01| <- |file01| +------+-----+------+ |- | |file02| +------+-----+------+ |file03| <- |file03| +------+-----+-----...
1
vote
1answer
59 views

create an alias to rsync local directory with a remote server - is it bad practice?

disclaimer: I am no superuser. question: I find myself writing out this beast every time I want to sync up my server with my dev directories on my machine: rsync -chavzP --stats user@host:/remote/ ~...
3
votes
1answer
95 views

Killing rsync softly

Is there a way of tell rsync to stop whenever possible in a clean way? Two options: tell rsync to stop transfering the current file, clean any temp file and exit; or let rsync end the transfer of ...
0
votes
1answer
27 views

Bash expands array where it should just use one element

My simple bash script to fetch images of a Raspberry Pi that are older than one minute: #!/bin/bash time=`date +"%FT%H_%M_%S"` imagedir="/root/pilapse/images/" files=`ssh pi find /home/pi/weatherPi-...
0
votes
1answer
21 views

Cygwin and automated SSH Login - one user works, the other does not

Ok, so I have two windows computers and one linux computer. I setup cygwin and installed the ssh package. I then opened up the cygwin terminal on each computer and ran ssh-keygen -t -N '' I then ...
1
vote
1answer
32 views

Synchronize identical files' timestamps across directory trees?

In January of 2015, I transferred some files from a dd created backup image to a new hard disk. This transfer did not preserve timestamps, so basically every file shows a timestamp of January 20th. ...
4
votes
3answers
2k views

Exact copy of files from NTFS to another NTFS using Linux

I try to copy all files from an NTFS to an external drive and want to preserve all permissions and attributes. The external drive has already an NTFS and contains other files. I've considered using ...
1
vote
1answer
292 views

rsync: connection unexpectedly closed - Migration from AWS to Digital Ocean

I'm trying to migrate my Django site from AWS to DigitalOcean. I'm following this tutorial My problem is that I can't rsyncmy files. Just as info, I'm able to connect via ssh to my Digital Ocean's ...
0
votes
1answer
206 views

normal user to rsync between two systems as root

How can I change the user permissions so that the user will be able to rsync between two systems as a root. I added the user in visudo. paru ALL = NOPASSWD: /usr/bin/rsync then I typed the ...
1
vote
1answer
28 views

backing up Linux (CentOS) to rsync.net

I'm doing a full backup of a server using /usr/bin/rsync and it seemed to hang. The problem was that the /proc directory has a huge file -r-------- 1 root root 140737477877760 Jan 24 13:...
1
vote
2answers
348 views

Rsnapshot --exclude-from file not working for sub directories

I am doing a remote backup. This are my rsnapshot config. config_version 1.2 snapshot_root /data/sbackup/ cmd_cp /bin/cp cmd_rm /bin/rm cmd_rsync /usr/bin/rsync cmd_ssh /usr/bin/ssh ...
1
vote
2answers
45 views

Retrying failed command that is run with xargs

I have a script that rsync's files over in parallel using xargs and rsync daemon mode. I occasionally get errors with rsync due to writes happening on the source. I want to be able to retry the rsync ...
18
votes
3answers
2k views

Moving 2TB (10 mil files + dirs), what's my bottleneck?

Background I ran out of space on /home/data and need to transfer /home/data/repo to /home/data2. /home/data/repo contains 1M dirs, each of which contain 11 dirs and 10 files. It totals 2TB. /home/...
1
vote
0answers
94 views

ignoring No data available (61) errors with rsync

Is there a way to supress a warning where the prigin changes during the rsync? $ rsync --archive server::somemodule/ /dest/dir rsync: read errors mapping "/somefile" (in somemodule): No data ...
0
votes
0answers
14 views

No modules listed by rsync server

I have an rsync server running on a Windows 7 machine as part of a BackupPC install. I was able to install the server and run it, because I can telnet to the server/port and receive the proper ...
1
vote
1answer
63 views

How do I move hard links to new server properly?

I have a server with 4 drives in it and am getting pretty full. I run the drives in a raid 5 and they are all 3tb drives. I then run backintime and have it run my daily backup. My data set is about ...
-1
votes
1answer
23 views

How to use rsync to copy files changed in dirB compared against dirA to dirC? (Repost from Stackoverflow)

I posted the below question to stackoverflow, but people suggest I posted here instead: I have two directories, dirA and dirB. I want to move everything in dirB that are different from dirA (checksum ...
1
vote
2answers
198 views

Unix copy multiple folders based on a specified CSV list using rsync

I have done some research and it appears that rsync is the only method that can possibly help me achieve this. I want to specify a list of folders in a CSV which can tell rsync to copy them to ...
1
vote
1answer
271 views

rsync to/from tar archive

Is it possible to rsync a real filesystem (remote) with a tar archive (local)? If so, how? Problem is I need to correctly backup user/group/permission settings and, while I have root access on remote ...
0
votes
2answers
26 views

Moving data across environments

I have a very lame situation at the moment about moving data across environments at work. These data are database dumps, Solr indexes or simple images. Our process is: "tarball the data" + "rsync/...
8
votes
3answers
30k views

rsync Permission denied backing up a remote directory to my local machine

I'm getting the error mentioned in the title. I found this similar question: Run rsync with root permission on remote machine. That doesn't answer my question. I'm the admin on the remote server ...
11
votes
2answers
13k views

How to rsync a large file, with as little CPU and bandwidth expense as possible?

I have a 500 GB file that I plan on backing up remotely. The file changes often. I'll be rsyncing it from a desktop to a server. Both can run rsync client or server. What is the proper command for ...
0
votes
0answers
25 views

Script repeatedly runs when USB mounted on Ubuntu

First post so bear with me if I don't give enough info first time around. I have a script set to run when either of 2 USB drives are plugged into my Ubuntu server. I have FSTAB set correctly for the ...
1
vote
1answer
616 views

Copying large files using Rsync on Mac between a NAS and a local hard drive

I am running a regular backup using Rsync for one of my data servers. I am backing up the data which is on my Synology NAS Storage to an External Hard drive over the network and using a gigabit ...
0
votes
1answer
49 views

Which options to rsync from vfat to vfat

I rsync local mounted vfat partitions. If I use the -a option I get these messages: rsync: chown "/media/new64gb/bar" failed: Operation not permitted (1) rsync: mkstemp "/media/new64gb/Tryo/Grain de ...
0
votes
0answers
118 views

rsync unexplained error (code 255) at io.c(820)

Out of the blue, upon vagrant up, rsync started throwing the error below: There was an error when attempting to rsync a synced folder. Please inspect the error message below for more info. Host path:...
0
votes
0answers
44 views

rsync dry run not showing differences

I'm copying some directories between 2 remote servers (using FileZilla). To make sure everything had copied correctly, I wanted to use rsync to make sure there were no differences. FileZilla had ...
1
vote
2answers
489 views

How can rsync fail due to missing permissions if remote login occurs with root?

I can't think of any reason why the transfer of a simple file with rsync -e 'ssh -p 19' -vvv /path/to/file root@192.168.179.3: fails with opening connection using: ssh -p 19 -l root 192.168.179.3 ...
0
votes
1answer
49 views

Rsync between KVM VPS and VirtualBox

I need advice how to rsync via ssh (and what directories need to be synced) between a KVM VPS (Debian Jessie) and VirtualBox to effectively make the VirtualBox a clone of the VPS. I use the term "...
0
votes
0answers
66 views

rsync “file has vanished” for broken symlinks when --del is used

I'm using rsync on a Synology NAS to make daily hardlink-snapshots from all shares. To have a off-site backup, I'm copying the local backup away. Due to performance, only the newest backup is copied ...
0
votes
1answer
24 views

network old mac to use as rsync backup

The goal: Be able to run my rsync backup on my local machine "X" (Ubuntu 13.1) to a remote machine, a currently un-networked mac "Y" (OSX 10.2.8). What I've done so far: Flew to the old mac ...
0
votes
0answers
21 views

How to Synchronize Full Content of Mail Account and Local Directory via IMAP?

Is there tool which facilitates one-way synchronization of a mail account's content (accessible via IMAP) and a local directory? For example: An email with attachment is received - then that email is ...
4
votes
1answer
4k views

How to keep rsync over SSH conenction permanent - no broken pipe

I try to run a rsync on a shared server that I have no control over the ssh-config file to prevent the broken pipe error because the connection drop. Here's a snippet of the code I use to backup ...
0
votes
1answer
33 views

Best method to copy big partition contents with many hard links

We had a LVM of almost 16TB with ReiserFS. We now want to add more disks, but we cannot continue using ReiserFS, as it has a maximum capacity of 16TB. This volume is being used to make incremental ...
0
votes
1answer
49 views

User can't delete file owned by user with w permission

I've a backup system based on rsync. Get a problem when try delete one file srv106@storage10:~$ rm -vf /srv/storage/homes/srv106/daily/files/daily.32/root/.my.cnf rm: cannot remove `/srv/storage/...
4
votes
5answers
3k views

rsync synchronizing files only without creating folders on destination

Is it possible with rsync to not create directories on destination? Imagine I have that source : a/ a/x.txt b/ b/y.txt And that I have this destination : a/ a/z.txt The wanted result of rsync ...
0
votes
0answers
6 views

rsync does not ignore open tmp files

file~ // <--- example of file I do not want to copy And the command: rsync -r --exclude '*~' /from/my/dir/ root@server.com:/to/my/dir/ I am trying to exclude tmp files that I am currently ...