Questions tagged [rsync]

Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.

Filter by
Sorted by
Tagged with
11 votes
2 answers
25k views

rsync to/from tar archive

Is it possible to rsync a real filesystem (remote) with a tar archive (local)? If so, how? Problem is I need to correctly backup user/group/permission settings and, while I have root access on remote ...
ZioByte's user avatar
  • 541
10 votes
2 answers
4k views

Live rsync/directory monitor for Windows?

Right now, we have a central Linux server and several satellite Windows servers dispersed around the region. Every 15 minutes, the Linux server rsyncs files from the others (which are running the ...
Andrew's user avatar
  • 589
10 votes
1 answer
7k views

Unicode Characters in Ubuntu Server

I recently migrated from Ubuntu Desktop 13.04 to Ubuntu Server 13.10 and now my filesystem doesn't seem to support unicode characters. I use rsync to backup/sync files and it shows the proper ...
James's user avatar
  • 453
9 votes
1 answer
9k views

scp: How to copy only the last 10% of a file?

I have a relatively large log file (46M) on a vServer, of which I'm only interested in the most recent part. How can I download only the last 10% of the file? The server is running Debian and I'm ...
n.st's user avatar
  • 1,968
9 votes
3 answers
16k views

rsync N newest files in a directory

What would be the easiest way to go about rsyncing the n newest files in a directory to a remote server?
Leda's user avatar
  • 431
8 votes
3 answers
24k views

How can rsync fail due to missing permissions if remote login occurs with root?

I can't think of any reason why the transfer of a simple file with rsync -e 'ssh -p 19' -vvv /path/to/file [email protected]: fails with opening connection using: ssh -p 19 -l root 192.168.179.3 ...
Kalle Richter's user avatar
8 votes
4 answers
16k views

Rsync and Cygwin based backup on Windows gives permission denied errors

Background I use rsync/cygwin on Windows 10 to backup all my local files (source) to an external hard drive (destination). I used this guide http://www.howtogeek.com/175008/the-non-beginners-guide-to-...
Zythyr's user avatar
  • 271
7 votes
2 answers
13k views

Rsync, two-way sync, and syncing file-deletion operations

I use rsync in the following manner: rsync -Pvaz [email protected].*.***:Documents/ /Users/me/Documents/ rsync -Pvaz /Users/me/Documents/ [email protected].*.***:Documents/ The problem: if I delete a file on my ...
David Zureick-Brown's user avatar
6 votes
5 answers
6k views

Copy a large file over an unreliable link

This isn't really a question about programming, but it is a question about working as a programmer. I hope this is an appropriate forum for this question. I work from home. My Windows XP based ...
user12701's user avatar
  • 183
5 votes
5 answers
2k views

Why every OS still can't resume file transferring? [closed]

I mean, Windows 7, Ubuntu 9.10 and Snow Leopard... All newest and top of line desktop operating system still use regular copy to transfer files, as it seems to me from experience. Instead of using ...
5 votes
2 answers
475 views

Creating backup process with a pi, should I use push or pull?

I have a raspberry pi 4 and would like to use it as a backup server at home. Now I am unsure how to do this, I have an encrypted disk that is connected to the pi and I want to do the backup ...
Jeno's user avatar
  • 437
4 votes
1 answer
910 views

rsync: identical files (contents, size, timestamp) between source and destination are not being seen as identical

NOTE: Sadly, it turns out that this has nothing to do with file timestamps. Per the info given in that other post, I tried --modify-window=30 and even --modify-window=300, but that did not change the ...
HippoMan's user avatar
  • 357
4 votes
4 answers
14k views

Rsyncing directories through ssh tunnel

I have 3 computers/servers, let's call them as computer A, computer B and computer C. Computer A has access via ssh to computer B. Only computer B has access via ssh to computer C. Computer A ...
ehuarotop's user avatar
4 votes
1 answer
18k views

rsync from Linux to Windows over SSH

Right now, I'm using SCP to copy directories from a Linux Server to a Windows 10 box. I'd like to use something like rsync instead, since the directory is fairly big and only a couple files change. I ...
surj's user avatar
  • 218
4 votes
1 answer
4k views

rsync on NTFS - permissions

I'm backing up directories on a Fedora machine onto an NTFS drive (fuseblk according to df -T) and it seems to go just fine with this: ls -t | sed -e "1,"$n"d" | xargs -d '\n' rm -rf nice rsync -azv ...
KirkD_CO's user avatar
  • 167
4 votes
1 answer
4k views

Rsync incredibly slow in Cygwin - am I doing something wrong?

I am trying to back up my C: and D: drives (each 1 TB, C: has around 210 GB of data on it, D: has around 345 GB on it) onto a 3 TB external HDD using Cygwin in Windows 8. I am doing this with rsync....
drjrm3's user avatar
  • 1,496
3 votes
4 answers
12k views

Rsync root files between systems without specifying password

This seems very tricky to me. I've set up my two systems so that I can rsync files between them as me, without specifying password. Now the the problem is to rsync files that belong to root. On both ...
xpt's user avatar
  • 8,651
3 votes
1 answer
5k views

Rsync difference between two directories to a 3rd directory

How would I go about rsyncing the difference between two directories to a 3rd directory. For example, if I have the command rsync -av --progress --stats /hdd1/ /hdd2/ I would like to copy the ...
Leda's user avatar
  • 431
3 votes
1 answer
1k views

Rsync: Only preserve meta (time, group, etc) on files and sub-directories, not root directory

I am copying some files (all except hidden ones) using rsync from one place to another using this command: rsync -Cav --delete --exclude=.* /Some/Directory/ other-host:/Other/Directory It works nice ...
Svish's user avatar
  • 39.5k
3 votes
1 answer
3k views

How to control permissions on external USB hard disk

I'm using RHEL 6.5, andhave an auto-mounted external USB drive. Any and all files created in the mounted filesystem are given permission 700 for dirs and 777 for files. The chmod command does not ...
Craig's user avatar
  • 33
3 votes
2 answers
2k views

Very slow file comparison when running Rsync

Something is wrong with rsync speeds in one scenario. I sync files from a SSD disk to an exFAT VeraCrypt container on an HDD (entire HDD is encrypted with VeraCrypt, the encrypted container is ...
Łukasz Nojek's user avatar
3 votes
1 answer
4k views

Set permissions with rsync for all files but the root directory

I want to sync two directories with rsync, preserving the permissions of all files. My user foo does have write access to the target directory, but does not own it. $ ls -l ...
mat's user avatar
  • 936
3 votes
2 answers
2k views

Redirect all SSH traffic through a "middleman" server

this is my setup right now: A. My NAS with static IP, reachable via SSH from the Internet (OS X) B. a VPS (Ubuntu Server) C. a dedicated server (Gentoo) My question: Due to bad peering i want to ...
mediocre's user avatar
  • 151
2 votes
2 answers
2k views

Why does rsync update NTFS directories when the source has not changed?

I'm taking classes with lots of phonetic and grammatical analysis. They've given me an account on a Windows 10 network. Since I am much more comfortable with Mac and Linux (and since the Windows ...
WGroleau's user avatar
  • 784
2 votes
1 answer
289 views

GNU parallel & RSync via intermediate server

I'm trying to spawn multiple rsync instances with gnu parallel to download via an intermediate server. This is the command I use - cat ~/filelist | parallel --will-cite -j 5 --verbose --progress --...
ps5460's user avatar
  • 61
2 votes
2 answers
6k views

Is it possible to make rsync make a log-file on a remote system?

I'm using rsync to connect and back up to a hard drive on a remote computer that I have ssh access to. rsync is connecting correctly. The code that's working is rsync -av --progress -e "ssh -p ...
J L's user avatar
  • 177
2 votes
1 answer
599 views

Identify files that would be deleted when removing an rsync --link-dest directory?

I have a Time Machine-style backup system set up on my NAS (running BusyBox v1.16.1), using rsync --link-dest as described here: http://blog.interlinked.org/tutorials/rsync_time_machine.html Is there ...
JDS's user avatar
  • 23
2 votes
3 answers
2k views

How can this backup strategy work?

I am trying to script a very simple backup strategy. Here is the general idea. Daily - Backup the entire filesystem using rsync, overwriting the previous day's backup. Weekly - Once a week copy the ...
Dan's user avatar
  • 181
1 vote
2 answers
1k views

Script/Batch command to initiate file transfer between Windows and Ubuntu

So I've setup a backup system for my notebook. Using Rsync, I am able to backup specific folders to my Ubuntu Home Server by executing a batch file. My question is about the possibility of automating ...
techtechmo's user avatar
1 vote
2 answers
409 views

Ubuntu 16.04 rsync - doing backups of the NAS server, can I tell it to exclude all the .Trash directories?

I use my NAS to back up several smaller systems that monitor the solar plant, using rsync. It works great. Now I want to back up the entire NAS drive. There are subdirectories for each linux ...
SDsolar's user avatar
  • 1,626
1 vote
1 answer
1k views

How can I limit the disk I/O priority for a process in Windows XP?

I have a setup where a Windows XP machine gets backed up to a server on the LAN, using rsync. Because of operational requirements, the backup needs to happen while the machine is in use. While this is ...
jstarek's user avatar
  • 988
1 vote
2 answers
2k views

Is there a way to keep a backup of only the modified files in a directory (when being compared to another directory)?

Note: I'm new to working with Linux but I've briefly researched the rsync command and I'm pretty sure it's what I'll be using. Unfortunately, there's a lot of different options to this commands and I'...
Paul Warnick's user avatar
1 vote
0 answers
136 views

rsync hard linking bug when using -R?

Following on File copy tools that will preserve hard links at destination, I found the problem is not at copying hard linked files to another volume part, but the source hard linked files themselves. ...
xpt's user avatar
  • 8,651
1 vote
1 answer
758 views

File copy tools that will preserve hard links at destination

rsync has a --hard-links option: -H, --hard-links This tells rsync to look for hard-linked files in the source and link together the corresponding files on the destination. ...
xpt's user avatar
  • 8,651
1 vote
2 answers
2k views

Rsync-like automatic delta backup of a removable hard drive on windows

Well a lot of questions have been asked on the SE network about using rsync on Windows. But nothing seems to really do the trick so I'd like to expose the specific mechanism I need to setup. Lets say ...
Armel Larcier's user avatar
1 vote
1 answer
563 views

How do I setup rsync and any other scripts to mimic a minimal viable replica of DropBox?

The tools I use to mimic the service are not as important as creating a reliable replacement in case something happens to the DropBox company (price flux, acquisition, etc) My original question was ...
Mark Essel's user avatar
1 vote
1 answer
716 views

Divide out local files in different servers with limited space with rsync

I have 80 GB of files in a local directory that I want to back up, dividing them out onto different servers with a limited space quota, using rsync, like so: LOCAL 80 Gb ====> server1: first 30 Gb ...
fradeve's user avatar
  • 453
1 vote
0 answers
131 views

Why does Win10 version of rsync modify file owner/perms even if --perms option is set?

I use Grsync's bundled rsync.exe, and have a following simple .bat script in place to sync the folder to an E drive: rsync.exe -r --perms -og --verbose --progress "/cygdrive/C/Users/User1/Desktop/...
Noideas's user avatar
  • 43
1 vote
2 answers
2k views

Time Machine size explodes when copied to new drive

I'm trying to replace a 640GB USB2 drive which I use as my Time Machine backup device with a 1TB FireWire 400 drive without losing the current backup history. Given that the 640GB drive is nearly ...
rpspringuel's user avatar
1 vote
5 answers
2k views

What is the best way to perform daily/weekly/monthly backups?

I am currently running a script in leopard every few days to make sure I have backed up my data on a remote server using: #!/bin/bash rsync -avvz ~/Documents ~/Workspace -e ssh [email protected]:~/...
Penang's user avatar
  • 378
1 vote
1 answer
5k views

Which flags to use on rsync to achieve full replication?

Hi since I have searched stack overflow and did not get info about this, I need to ask again with specific requirements. I have an old storage with approx. 4TB of data and I would like to sync it with ...
dovla110010101's user avatar
0 votes
2 answers
189 views

Diff directory contents from Mac to PC on same network

I have a Mac and a PC on the same LAN. The PC is running OpenSSH. I copied a folder of (subfolders containing) 30 GB of files from the Mac to PC via: scp -r ~/orig_folder/* [email protected]:...
Ryan's user avatar
  • 1,934
0 votes
2 answers
263 views

Does using splitted VM-images make RSYNC-backups more efficient when using "--whole-file"?

I'm backing up some VMs of VirtualBox with somewhat large image files for their HDDs using RSYNC currently. Some of those images are 100 GiB in size, one is even 750. Backing those files up by letting ...
Thorsten Schöning's user avatar
0 votes
1 answer
372 views

More meaningful recap of changes in rsync dry-run while backing up the Linuix home folder

I want to use rsync (I'm actually using Grsync) to backup my home folder. The final command I decided to use is: rsync -r -t -p -v --progress --delete -l -s --exclude-from [MY_FILE_WITH_EXCLUSIONS] --...
Frank's user avatar
  • 283
0 votes
3 answers
310 views

Does rsync require 2 computers?

I am wanting to use something like rsync (i think). I am using Windows 7, I would like to be able to sync files/folder to other Disks on 1 computer, sometimes, just keep 2 folders or more in sync on ...
JasonDavis's user avatar
  • 5,042
0 votes
1 answer
221 views

rsync - How to make it delete directories or files recently added to the exclusions list

I use my NAS to back up several smaller systems - 8 of them. As I have learned more and tuned my exclusions I see a whole lot of leftovers that I forgot to exclude earlier. Say I decide to exclude ...
SDsolar's user avatar
  • 1,626
-1 votes
2 answers
334 views

Problems using rsync with macOS Sonoma

I bought a new Mac mini. Before I was on Catalina. I used rsync a lot to make backups of my photos. My old scripts do not work anymore and I don't know what to do. I am using the version of Rsync that ...
Frederic B.'s user avatar

1
2