Questions tagged [rsync]

Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.

Filter by
Sorted by
Tagged with
2 votes
1 answer
2k views

How to use rsync include and exclude to capture distributed set of files?

I'm trying to backup a machine using rsync and after reading numerous SO QAs and the man pages, I'm still failing to understand how include/exclude precedence works so I can transfer the right set of ...
eriknelson's user avatar
1 vote
1 answer
566 views

Rsync from Windows10 to Mac does not allow multiple source paths

I used to run a nightly rsync client on a Raspberry Pi to backup some folders from a Windows 10 computer. This script has been running without an issue for more than 10 years. I've recently moved the ...
Ronopolis's user avatar
1 vote
1 answer
2k views

How to specify "no files except these extensions" in rsync?

I've created an rsync --include-from file by using a find command to find directory names of interest, and format them as such + dirname/***, which copies it and its contents. This works as intended, ...
Zamzamz's user avatar
  • 43
0 votes
1 answer
701 views

Why does rsync re-downloads unchanded files from server which allready exist locally?

I would like to use rsync to download files from a server to my local computer. This is no problem of course: $ rsync --progress -vr server-user@my-server:/path/to/remote/dir/ /local/dir/ receiving ...
Andrei Herford's user avatar
1 vote
1 answer
1k views

Rsync files between two remotes servers using SSH

Summary I want to copy files between 2 remote servers using Rsync and SSH. The way I found to do this is creating a SSH tunnel, but I tried with several examples and any of those worked. Details I ...
Jose Daniel's user avatar
0 votes
1 answer
287 views

rsync in cron without ssh-agent?

I'm setting up backup server, that will connect to production server and fetch backup with rsync via cron task. I have user on my backup server, I created public key and I can log with ssh to ...
dust_bg's user avatar
  • 101
0 votes
1 answer
158 views

Rsync detect if transfer on same filesystem

I want to alias the mv command to rsync -av --progress --remove-source-files to make the mv command more verbose. It works, but can I add a way to detect if I'm moving the file within the same ...
cclloyd's user avatar
  • 752
1 vote
2 answers
3k views

WSL (Ubuntu 20.04) - unstable permissions

I'm new to WSL and trying to use rsync for snapshot backups. Everything seems to be working as intended... except that rsync refuses to copy some files, citing a permission error with send_files. So I ...
mike rodent's user avatar
0 votes
1 answer
224 views

Why rsync found files who has vanished on exfat synology?

I try to transfer some files from an external hard drive in exfat to my synology Nas using rsync using the usb connection. During the transfert rsync found files who have vanished when it's time to ...
Fractale's user avatar
  • 647
1 vote
2 answers
269 views

How to make a file from destination don't be deleted when using the "--delete" flag in rsync?

The context Let's suppose we have the following directory organization mkdir -p a/foo a/bar b touch a/1.txt a/2.txt a/foo/b.txt a/bar/b.txt touch b/b.txt tree --noreport . ├── a │   ├── 1.txt │   ├──...
rdrg109's user avatar
  • 185
0 votes
1 answer
371 views

More meaningful recap of changes in rsync dry-run while backing up the Linuix home folder

I want to use rsync (I'm actually using Grsync) to backup my home folder. The final command I decided to use is: rsync -r -t -p -v --progress --delete -l -s --exclude-from [MY_FILE_WITH_EXCLUSIONS] --...
Frank's user avatar
  • 283
0 votes
1 answer
645 views

Show total progress on rsync

I'm trying to get Rsync to show total progress of the job using rsync -a -v -h -i --partial -r --no-inc-recursive --info=progress2 alex@RemoteLocation LocalLocation But I think it doesn't explore ...
ThomasHunter's user avatar
5 votes
3 answers
5k views

using rsync to quickly show only files that have different content

I've got a couple of disks which have a large set of files which are mostly the same. However, in a few cases there are files on one disk which differ from files on the other disk. There are also a ...
Michael's user avatar
  • 2,714
0 votes
1 answer
78 views

Perl/Bash Solution to Test if a Folder Has Changed, Then Create Copy of It

I'd like to put together a script for a very rudimentary backup system that checks a directory recursively for any changes since the date another directory (the backup) was created and, if it finds ...
Timothy R. Butler's user avatar
1 vote
1 answer
553 views

syncing two folders into one, removing deleted files

Given folders named Drive1/Folder1 and /Drive2/Folder2 I want to have a folder /Drive3/folder3 that contains the synced merged contents of both the source folders, but does not contain any files or ...
lbutlr's user avatar
  • 113
0 votes
1 answer
4k views

How do I solve the error "execv: No such file or directory" from rsync?

How do I solve the error "execv: No such file or directory" from rsync? I'm trying to back up several machines to a linux server using rsync and it's working in most scenarios: path-to-path ...
zolcos's user avatar
  • 43
3 votes
1 answer
2k views

Rsync to Linux from remote Windows 10 server

I have a Windows server which I would like to PULL data from using Rsync to my Linux server. Installed openSSH and WSL with Ubuntu on the Windows 10 machine (build 1709) and currently - I am able to ...
k_mishap's user avatar
  • 131
0 votes
0 answers
539 views

Rsync fails when copying to a mounted NFS share in Ubuntu

I run the command to copy data between one server and another. The /remote dir is mounted via /etc/fstab as an NFS share. root@server2:/usr/local/bin# rsync --bwlimit=10000 -axWSr --progress --timeout=...
GodAtum's user avatar
  • 101
1 vote
0 answers
166 views

How folder modification time affects unison file synchronization? (Windows)

I used unison to mirror a folder in Windows (using options -force and -times). It worked well, but the folders modification time has changed in the destination and now original and new folders differs ...
gavioto's user avatar
  • 171
2 votes
0 answers
902 views

rsync --ignore-missing-args not working

I'm trying to use rsync actually inside loop to backup a list of directories from remote. I just want to ignore if src directory do not exists. I got from most of the forums that --ignore-missing-args ...
Adil Saju's user avatar
  • 163
-1 votes
2 answers
606 views

How would I rsync from SRC to DEST, verify the DEST file, then delete the SRC file? (rcursively)

I have two directories in a bash script held by these two variables $SRC $DEST How would I do a rsync copying files from $SRC/ to $DEST/, Verifying that the $DEST/* files match the $SRC/ files (best ...
devLinuxNC's user avatar
1 vote
2 answers
5k views

rsync-like copy command on windows

tl;dr I'm looking for a near-exact replacement for rsync --recursive --update on vanilla Windows. details What is a command, in Windows, that works like: input: a filesystem pattern (restricted to ...
Keith Russell's user avatar
0 votes
1 answer
4k views

rsync extremely slow with exported/mounted folder, much faster with ssh

I have an NAS device set up as a backup for all my home systems, and currently it is set up to use ssh with code adapted from here. A shorted version of my code is: NAS=192.168.1.143 ...
KirkD_CO's user avatar
  • 167
1 vote
1 answer
24 views

Permissions after swapping NAS drives

I’ll start with a list of facts: I had a 1gb drive connected to my NAS. I use rsync to backup a /folder with many subdirectories for a server (bbs software) in which the permissions and file ...
Paul Lee's user avatar
1 vote
1 answer
152 views

USB flash drive no longer recognised after copying files

I have an R+M USB 3.0 that is no longer recognised by my PC (running Windows 10). The disk appears greyed out, 0 bytes available, as in this answer. I don't mind about lost data, what I want to know ...
leca's user avatar
  • 13
0 votes
1 answer
154 views

Sync huge file tree with rsyncd, and encryption

I need to do daily copy of large file tree over the public internet, and do that effectively. As far as I know, if I use rsyncd on receive part then sync is done quite effectively since during file ...
Alexander's user avatar
  • 292
1 vote
2 answers
647 views

Rsync doesn't work and reports total size is 0 speedup is 0.00 when the command is run

I saw this error and don't know why all file sizes are 0. Command: rsync -arvzh --delete public/ [email protected]:/var/www/blog/static-html/ Version Info: GitHub action VM source OS is macOS 10.15 ...
alanhg's user avatar
  • 11
1 vote
0 answers
109 views

Cron a database dump on an external SFTP server

I have a command to dump a database in a local server, and want a daily backup of that database in an external SFTP location. I checked out the scp command and it works smoothly, now I need (maybe ...
SYS64738's user avatar
1 vote
1 answer
3k views

Why do files disappear from an external USB hard drive when moved between Ubuntu servers?

Files saved on an external hard drive disappear when that drive is mounted to another computer. I have two Intel NUCs running Ubuntu 20.04 LTS server in separate physical locations, each with a 2TB ...
user1421347's user avatar
1 vote
1 answer
5k views

Which flags to use on rsync to achieve full replication?

Hi since I have searched stack overflow and did not get info about this, I need to ask again with specific requirements. I have an old storage with approx. 4TB of data and I would like to sync it with ...
dovla110010101's user avatar
4 votes
1 answer
731 views

Why does RSYNC use two reading processes with different files on my backup target?

Background I have one server hosting virtual machines and one older NAS Synology DS1512+ used as backup target for those virtual machines. The server uses ZFS, creates snapshots and transfers the ...
Thorsten Schöning's user avatar
2 votes
0 answers
345 views

Can rsync adjust sym-links to reflect their new location?

I have a directory tree that has internal, absolute sym-links, and I want to rsync it with a different disk. My problem is sym-links. After I rsync, the sym-links on the new disk all point to the ...
Chris Miller's user avatar
3 votes
5 answers
3k views

Why rsync keeps sending same files each invocation?

I'm using rsync to copy file from Linux to Mac over SSH. My command looks like this: rsync \ --exclude FOO \ --exclude BAR \ -e ssh \ -rclpvih \ --delete \ --stats \ /local/...
gavv's user avatar
  • 131
1 vote
1 answer
567 views

How do I restore rsync backup files with the correct owner on a new machine?

I have backed up my home folder to an external (ext4) hard drive, preserving ownership and permissions. Now I want to do a fresh Linux install and then restore my home folder from the backup. But the ...
Campground's user avatar
0 votes
1 answer
62 views

What is the best way to have a bi-directional off-site data backup where I manage both, but only have access to part of the data?

I convinced a friend to "share" data backup. He'd have some disks at his home where I can back up important data outside of my home (in case of fire or something like that), and vice versa. ...
Aephir's user avatar
  • 89
0 votes
2 answers
263 views

Does using splitted VM-images make RSYNC-backups more efficient when using "--whole-file"?

I'm backing up some VMs of VirtualBox with somewhat large image files for their HDDs using RSYNC currently. Some of those images are 100 GiB in size, one is even 750. Backing those files up by letting ...
Thorsten Schöning's user avatar
0 votes
2 answers
2k views

Rsync Over SSH without PWD as Root -Catch-22

I have a remote directory that I want to rsync to my local machine over a ssh without a password because I want it be run as a cronjob (root user) This command (no sudo) fails because it cannot write ...
mjones's user avatar
  • 307
0 votes
1 answer
199 views

Copy interrupted and difficulties to take it over by relaunch with cp -u or rsync

I have a huge data to transfer between 2 macOS (1.3 TB). Unfortunately, my copy from mac1 to mac2 (by mounting the concerned directory of mac1 on mac2 as network directory), the copy with 'rsync' (...
user avatar
1 vote
2 answers
3k views

How to improve performance of RSYNC's delta transfer on receiving host using software only?

I'm using RSYNC to backup VMs for Virtual Box from one server to some Synology NAS DS1512+. The important point is that I really want to backup the VM-images itself, NOT individual files within those ...
Thorsten Schöning's user avatar
0 votes
1 answer
49 views

I copied all files from /home/user excluding .ssh folder to another server (and could use passwordless ssh into it), now ssh requires password. why?

Both servers have the same user, I use rsync and exclude the ssh folder in /home/user/ , but every time I do this (part of my new server setup pipeline) suddenly I have to start typing the password ...
total-N00b's user avatar
0 votes
1 answer
287 views

What is the random argument used with "rsync --server"?

I'm using RSYNC to backup files from two hosts to one other NAS and because of the amount of data to backup, the currently used settings of RSYNC etc. those two backups overlap currently. The NAS is ...
Thorsten Schöning's user avatar
2 votes
1 answer
417 views

How to copy same file from different directories to different directories

I have multiple directories with the same file (remote) and I want to copy them to multiple directories on my local machine. So lets say remote I have ~/remote_folder/folder1/Myfile.log ~/...
C. Binair's user avatar
  • 123
0 votes
0 answers
61 views

how to delete COMMON files in source and destination via rsync

Help!!! I mistakenly rsynced the source folder into the wrong folder, and now I don't know which files were from the rsync and which were there initially. Is it possible to use rsync to delete in the ...
irene's user avatar
  • 113
0 votes
1 answer
161 views

rsync on macOS copies "phantom data" when drive disconnects

I'm trying to copy files off of a drive that is failing. It hasn't failed yet :) Basically it keeps disconnecting every 30 seconds. macOS then automatically remounts it, but Finder is having issues ...
None's user avatar
  • 1
0 votes
1 answer
937 views

rsync ntfs/ext4 (windows/synology diskstation) incremental backup

Im trying to incrementel backup my windows server via rsync from my synology nas. For that i mounted the windows server on my diskstation under /volume1/homes/multimedia Then running rsync: rsync -av -...
Marc's user avatar
  • 331
2 votes
2 answers
391 views

secure data backup to remote server: scenario of compromised client

I want to backup some filesystem folders from a client to an external server. My goal is to have a secure backup on the external server even if the client gets compromised/hacked in any way. I am ...
cpc's user avatar
  • 121
0 votes
0 answers
45 views

Ramdisk speeds on older server bottlenecked when rsyncing files vs dd

Why am I seeing poor copy performance in memory? Background and details: While testing a RAID 10 on an older server, I wanted to see whether or not other parts of my system were bottlenecking my ...
Tmanok's user avatar
  • 238
0 votes
1 answer
3k views

rsync exclude directory and all subdirectories

I'm trying to use rsync to synchronise some of my data but I'm unable to exclude what I want. This is my directory tree: tst/ ├── st1 │ ├── st11 │ │ └── txt.text │ ├── st12 │ ├── st13 │ ├──...
yaodav's user avatar
  • 103
0 votes
1 answer
331 views

rsync: chown "/some-destionation-path/.somefile.jpg.pY2TRG" failed: Permission denied (13)

I'm doing rsync -rlptoghv for transferring a folder from XFS to ZFS. Usually, no problems arise. But sometimes, for some files (and I can't find a pattern), rsync fails to sync file permissions and ...
jazzman's user avatar
  • 11
2 votes
2 answers
337 views

Why Can't I copy a folder to a disk that is larger than my folder?

I am using ubuntu 18.04-4 and want to move a large directory (yocto build directory for my project) from my ~/Desktop to an external drive (ext4 formatted). The external drive is a 512 GB empty drive. ...
Dis Play Name's user avatar

1
3 4
5
6 7
28