Questions tagged [rsync]

Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.

Filter by
Sorted by
Tagged with
4 votes
1 answer
900 views

rsync: identical files (contents, size, timestamp) between source and destination are not being seen as identical

NOTE: Sadly, it turns out that this has nothing to do with file timestamps. Per the info given in that other post, I tried --modify-window=30 and even --modify-window=300, but that did not change the ...
HippoMan's user avatar
  • 357
1 vote
1 answer
331 views

WSL: rsync not deleting files in destination when absent from source

This is using WSL on a W10 machine. I'm trying to mirror one drive to another. The command I'm using looks like this: root@M17A:/mnt/c/WINDOWS/system32# rsync -rtivlHu --delete --exclude "Backups&...
mike rodent's user avatar
0 votes
0 answers
23 views

rsync syntax error on round braces [duplicate]

I have this problem with rsync. If I run this command rsync -rltD --delete --update --itemize-changes /data/Program\ Files\ \(x86\)/ [email protected]:/backup-michele/Program\ Files\ \(x86\)/...
Michele Giorgio's user avatar
2 votes
2 answers
2k views

rsync "File name too long (36)" error for filenames with UTF-8 characters

Trying to copy files from an NTFS-formatted HDD to an EXT4-formatted HDD, rsync fails to copy some of them having relatively long file names consisting of Asian (UTF-8) characters. For example, there'...
Sepp A's user avatar
  • 23
0 votes
1 answer
509 views

rsync syntax error when using "--files-from" and "--list-only"

I have a working rsync call that takes a list of local directories to upload (simplified): $ rsync --files-from=dirs_to_backup.txt --recursive ./ remote: I now want to perform my own consistency ...
BoppreH's user avatar
  • 519
0 votes
0 answers
148 views

rsync filling destination, --delete-before not working

I've had a rsync task doing my backups for some time, copying data from my FreeNAS system to a raspberry pi (w/ external disk). The source size data directory is 2tb and the total size of the remote ...
jpi's user avatar
  • 1
0 votes
1 answer
223 views

Can rsync --remove-source-files to the same drive reduce fragmentation?

I know that rsync with --remove-source-files (which I use instead of mv so I can merge directory hierarchies) creates new inodes: stat 2021_07_30_20_18_17.pdf~ rsync --remove-source-files ...
Sridhar Sarnobat's user avatar
3 votes
2 answers
2k views

Very slow file comparison when running Rsync

Something is wrong with rsync speeds in one scenario. I sync files from a SSD disk to an exFAT VeraCrypt container on an HDD (entire HDD is encrypted with VeraCrypt, the encrypted container is ...
Łukasz Nojek's user avatar
0 votes
1 answer
437 views

rsync --dry-run then rsync --files-from

I backup big folders and at first I run rsync ... --dry-run to verify the list of files. Then I used to execute the same command, but this time without --dry-run to transfer the files. Because it was ...
Łukasz Nojek's user avatar
0 votes
0 answers
699 views

Rsync with hard links very slow compared to rclone

I'm using a self made docker to sync files between two machines. Inside the docker a sftp-folder is mounted using sshfs. I always used rclone to sync the files: rclone sync --create-empty-src-dirs -v /...
Rudolf's user avatar
  • 1
1 vote
1 answer
317 views

Restoring from backup made with rsync -M--fake-super

For years I have been regularly running the following command locally as a root filesystem backup in the hope I am safe: rsync -aAXv --progress --delete / --exclude={"/dev/*","/proc/*&...
kralg's user avatar
  • 11
2 votes
1 answer
861 views

Broken pipe on transfer from/to fedora system using rsync/rclone/scp

I'm trying to send some files with around 2GB to my home server running Fedora 36. On my Laptop, I have Pop OS! 22.04. Both are directly connected to my router via Ethernet. Sadly, I'm getting errors ...
MrMinemeet's user avatar
0 votes
0 answers
260 views

Getting No Data Available when using cp to copy a file (but file exists)

I am trying to copy a file with cp in Linux, and am getting an error: No Data Available The file exists in my FS: > ll formation_xrpu_personnalisation_27-09-2021\ 15\:33\:43.webm.mov -rw-rw-r-- 1 ...
alci's user avatar
  • 137
0 votes
1 answer
501 views

How to re-sync already transfered sparse file with rsync?

I have completely transferred a file using rsync without the use of the --sparse, -S option. I don't want to waste space and thus re-sync the file and turn it into a sparse file. Is there a way to ...
Jotschi's user avatar
  • 121
1 vote
0 answers
246 views

Rsync-Daemon Max Connections Error

I prefer to use rsync daemon for all of my rync needs because it provides clean centralized management and saves on system resources. Accordingly, my /etc/rsyncd.conf contains multiple module entries....
mjones's user avatar
  • 307
0 votes
1 answer
759 views

How to use rsync for Windows on both ends?

I install rsync for Windows through git-bash. If the remote end is Linux, it works fine. However, it does not work if the remote end is Windows. I install rsync on the remote end and test working as ...
user3108468's user avatar
0 votes
1 answer
1k views

Cygwin rsync cannot run outside of Cygwin terminal

I installed rsync 3.2.4 with cygwin in windows11 with the path C:\Cygwin\bin\rsync.exe. When I directly run rsync in windows terminal, I got the error code 12. But this command runs normally when ...
Whisht's user avatar
  • 121
5 votes
1 answer
977 views

Why does rsync give different output between rsyncing to a USB flash drive versus a hard disk?

How come rsync gives different outputs when there are no files for rsync to transfer, meaning (xfr#0) with rsync from hard disk to hard disk versus rsync from USB flash drive to hard disk? Using: ...
joseph22's user avatar
  • 345
2 votes
1 answer
286 views

GNU parallel & RSync via intermediate server

I'm trying to spawn multiple rsync instances with gnu parallel to download via an intermediate server. This is the command I use - cat ~/filelist | parallel --will-cite -j 5 --verbose --progress --...
ps5460's user avatar
  • 61
0 votes
1 answer
1k views

rsync "cannot stat destination" suddenly occurring with job that was running fine for months?

I run a daily rsync backup of my /var/www folder to a share on a Windows 2022 server. It's been running fine for a few months, but in the last couple of days has started failing with the error below. ...
user1175461's user avatar
0 votes
1 answer
512 views

BackupPC rsync failing because it is using the wrong SSH user

Permission denied, please try again. Permission denied, please try again. [email protected]: Permission denied (publickey,password). rsync_bpc: connection unexpectedly closed (0 bytes received so ...
Dax's user avatar
  • 125
2 votes
0 answers
22 views

How to change directories recursively in huge files

I tried to copy data between two huge NFS folders. I copied all the data, but I noticed that by mistake I made duplicate directories only in the 6th depth. For example, instead of copying: /mnt/nfs1/a/...
Yagel's user avatar
  • 121
1 vote
0 answers
165 views

Does the rsync command provide a safe means of transferring data from a Windows disk image to a Linux system?

I currently have Windows 10 on my computer, and I am planning on installing Ubuntu. Before installing Ubuntu, I am planning on creating a disk image to preserve my data. Once Ubuntu is installed, I ...
Casper the Friendly Grue's user avatar
0 votes
0 answers
234 views

What is the correct way to transfer Windows data from an external drive to a Linux system?

I currently have Windows on my computer, and I am planning on switching to Linux. Before making such a change, one first needs to back up Windows data. After installing Linux, one would transfer the ...
Casper the Friendly Grue's user avatar
0 votes
1 answer
353 views

rsync file duplication ignore is not working as expected

I am confused with the working of rsync. Here is what I did and expected. I created two folders named 'sbck' and 'dbck'. Scenario 1: I created a file named a.txt and created a copy of it using cp -rp ...
Thinker-101's user avatar
0 votes
0 answers
172 views

Reverse SSH on Windows Git BASH

I have multiples Windows 10 computer where I can't open anymore ports, neither install more software. But those computers have git bash installed on it. I would like to be able to run some bash script ...
olive007's user avatar
  • 121
2 votes
1 answer
735 views

How to specify TCP congestion algorithm to use for my long running rsync process?

I have a huge rsync task where I'd like to syncronize file colletion of my workstation and remote server (rsync over ssh). I assume the whole process to take weeks so I don't want to cripple my ...
Mikko Rantalainen's user avatar
0 votes
2 answers
381 views

Start Over With rsync

I've got an rsync job which I have been using over the course of several years. I'm a windows user and use Delta Copy Client. This job has become so messy that it errors out all the time and I've ...
onefootswill's user avatar
4 votes
1 answer
514 views

Offline MailDir Restoration Advice

Situation: I have an offline backup of gigs worth of email. After some reading, I confirmed that the email can be restored to MailDir on my new server via rsync. My rather basic question: File Names.....
mjones's user avatar
  • 307
0 votes
1 answer
705 views

Inodes in External Disk full. Actually not

Checking inode usage: [cold] > df -ih . Filesystem Inodes IUsed IFree IUse% Mounted on /dev/sdb1 59M 59M 7.9K 100% /home/doom/cold Here we see 100% Inode usage. 59 million inodes ...
Tickler_'s user avatar
0 votes
1 answer
914 views

rsync from MacOS to Ubuntu?

I'm trying to rsync some files from my macbook to an ubuntu laptop ( [email protected] ) using this command: rsync -vazh ~/Folder [email protected] But instead of syncing the files to the remote host, ...
Ole's user avatar
  • 175
1 vote
1 answer
9k views

Non-root User Rsync Daemon rsync error: error starting client-server protocol (code 5) at main.c(1675) [Receiver=3.1.3]

I am on on Ubuntu 20.04 Desktop and I am backing up a remote client Ubuntu 20.04 server using the following basic framework: In /etc/sudoers non-root-username ALL= NOPASSWD:/usr/bin/rsync From Desktop ...
mjones's user avatar
  • 307
0 votes
0 answers
78 views

multiple folder sync with rsync from server to local storage

im trying this for a first time, and im not the best in sh. #!/bin/sh SCRIPTPATH='server/cronscripts' SSHKEYNAME='keyid' FROMDIRPATH='server/source-folder/folderA/' TOSERVERANDPATH='local-...
Excyp's user avatar
  • 1
1 vote
1 answer
587 views

rsync curly braces with one item issue?

I have a problem with rsync when I pass the exclude list in curly braces, what is the difference between the following two lines? sudo rsync -aHAXxhvi --delete --exclude={/1111111/} /etc/ /media/...
Sagitariozod's user avatar
2 votes
1 answer
1k views

Why does copying a (large) file to USB report that it is done when it is not?

I have a Ventoy USB which I copy ISOs to and, when I copy it using my file manager (I use GNOME, so Nautilus) it tells me 100% but it is not, because the image gets corrupted. Same thing goes for ...
telometto's user avatar
  • 269
0 votes
2 answers
683 views

What does CVS stand for?

What does CVS stand for? What does it mean? In particular, I mean the --cvs-exclude option in rsync. -C, --cvs-exclude This is a useful shorthand for excluding a broad range of files that you ...
midnite's user avatar
  • 571
1 vote
1 answer
316 views

Rsync download to temporary directory until file is finished, then move to completed directory

So I am trying to wrap my head around rsync. I've been at it now for at least 5 hours straight, but I am not getting any smarter about it. I am connecting to a remote server, trying to download the ...
Kaizokupuffball's user avatar
0 votes
0 answers
203 views

Creating automatic backups with rsync from ext4 file system to afps file system on another device (local network)

I shared an external hard drive (AFPS file format) on my macosx via local file sharing to my ubuntu server (ext4 file format). I would like to use rsync to automatically sync folders from the ext4 ...
user avatar
0 votes
3 answers
7k views

rsync permissions errors at destination even though root, possibly due to sticky bit?

I'm using rsync to backup local files to a usb disk. That has been working fine for years, but now rsync is reporting filesystem permission errors, even though run as root on a rw filesystem. This is ...
meeque's user avatar
  • 65
1 vote
0 answers
174 views

Utilize `fswatch` to improve `rsync`'s speed?

I have some huge folders containing about 40000 files (and much, much more gitignored files like node_modules), and I want to rsync to a remote machine. Currently, I use a simple script like run_rsync;...
ch271828n's user avatar
  • 123
0 votes
1 answer
713 views

Reload nginx configuration when rsync updates nginx.conf

I have two web servers, server1 and server2. On server2 there is an rsync command, scheduled in crontab, that updates /etc/nginx folder when I make some changes on server1: */5 * * * * rsync -avzhe ...
Atman's user avatar
  • 25
1 vote
0 answers
3k views

File permission "b" of /var/lib/docker/volumes/backingFsBlockDev

I want to backup my files from a raspberry pi (rasbian) to my USB stick type (ext4) using backup software (RaspiBackup) but i'm getting an error. It looks like an authorization issue. The error: "...
Wimbre's user avatar
  • 11
0 votes
2 answers
215 views

rsync options so that source and dest are exactly the same?

My src folder is my local laptop. I have a dest folder which I use for backup (and is NAS mounted) but for historical reasons I have sometimes used the dest folder for exactly what I use now src (bear ...
unsafe_where_true's user avatar
1 vote
1 answer
2k views

Rsync always failing at the same point

I made a script for my Proxmox host to make a copy of its daily backups to another machine (running Windows Server 2022). The script mounts a NFS share from the Windows host and runs this rsync ...
alex3025's user avatar
0 votes
0 answers
423 views

rsync is deleting file containing special characters when file name was change in terminal instead of Finder

The problem I use macOS and try to sync two directories using rsync – one in my home directory and one in the external HDD (HFS+). Whenever I run the rsync with --delete option, I've observed that it ...
skrajewski's user avatar
0 votes
1 answer
248 views

How to programmatically detect whether rsync detected changes or not?

If I do: echo 'sup' > sup.txt echo 'nup' > nup.txt echo 'sup' > sup2.txt rsync -P --archive --human-readable --itemize-changes --dry-run sup.txt nup.txt rsync -P --archive --human-readable --...
balupton's user avatar
  • 435
1 vote
0 answers
4k views

rsync too slow between local disks. how to solve?

I'm not experienced in commandline utilities but I've tried to set up rsync to synchronize my document folder in linux mint to usb stick daily. It works fine, all files are up to date. the command in ...
amigo421's user avatar
  • 111
2 votes
0 answers
2k views

Rsync not deleting files in destination directory despite “--delete” being set

I have the following rsync command: rsync -ahv --progress --delete \ /source_dir1/file1.txt \ /source_dir2 \ /dest_dir/ It syncs everything as expected, but does not delete anything from ...
willco's user avatar
  • 21
2 votes
2 answers
5k views

Who is systemd-coredump and why is he on my system?

I have a rsync that has the following configuration: rsync -aur4zvq --force /root/folder/on/local/ root@remote:/root/folder/somewhere/on/remote This is run by a crontab as root for security reasons ...
Max Muster's user avatar
2 votes
0 answers
577 views

rsync with -X fails due to dot underscore files

I need to maintain sync copy from one external drive to another, on my macOS (Monterey). ext drive 1 (source) = ExFAT ext drive 2 (target) = APFS rsync v3.2.3 is used (not macOS default v2.6.9) rsync -...
C. Derx's user avatar
  • 121

1 2
3
4 5
28