Questions tagged [rsync]
Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.
1,392
questions
4
votes
1
answer
900
views
rsync: identical files (contents, size, timestamp) between source and destination are not being seen as identical
NOTE: Sadly, it turns out that this has nothing to do with file timestamps.
Per the info given in that other post, I tried --modify-window=30 and even --modify-window=300, but that did not change the ...
1
vote
1
answer
331
views
WSL: rsync not deleting files in destination when absent from source
This is using WSL on a W10 machine.
I'm trying to mirror one drive to another.
The command I'm using looks like this:
root@M17A:/mnt/c/WINDOWS/system32# rsync -rtivlHu --delete --exclude "Backups&...
0
votes
0
answers
23
views
rsync syntax error on round braces [duplicate]
I have this problem with rsync. If I run this command
rsync -rltD --delete --update --itemize-changes /data/Program\ Files\ \(x86\)/ [email protected]:/backup-michele/Program\ Files\ \(x86\)/...
2
votes
2
answers
2k
views
rsync "File name too long (36)" error for filenames with UTF-8 characters
Trying to copy files from an NTFS-formatted HDD to an EXT4-formatted HDD, rsync fails to copy some of them having relatively long file names consisting of Asian (UTF-8) characters.
For example, there'...
0
votes
1
answer
509
views
rsync syntax error when using "--files-from" and "--list-only"
I have a working rsync call that takes a list of local directories to upload (simplified):
$ rsync --files-from=dirs_to_backup.txt --recursive ./ remote:
I now want to perform my own consistency ...
0
votes
0
answers
148
views
rsync filling destination, --delete-before not working
I've had a rsync task doing my backups for some time, copying data from my FreeNAS system to a raspberry pi (w/ external disk). The source size data directory is 2tb and the total size of the remote ...
0
votes
1
answer
223
views
Can rsync --remove-source-files to the same drive reduce fragmentation?
I know that rsync with --remove-source-files (which I use instead of mv so I can merge directory hierarchies) creates new inodes:
stat 2021_07_30_20_18_17.pdf~
rsync --remove-source-files ...
3
votes
2
answers
2k
views
Very slow file comparison when running Rsync
Something is wrong with rsync speeds in one scenario.
I sync files from a SSD disk to an exFAT VeraCrypt container on an HDD (entire HDD is encrypted with VeraCrypt, the encrypted container is ...
0
votes
1
answer
437
views
rsync --dry-run then rsync --files-from
I backup big folders and at first I run rsync ... --dry-run to verify the list of files.
Then I used to execute the same command, but this time without --dry-run to transfer the files.
Because it was ...
0
votes
0
answers
699
views
Rsync with hard links very slow compared to rclone
I'm using a self made docker to sync files between two machines.
Inside the docker a sftp-folder is mounted using sshfs.
I always used rclone to sync the files:
rclone sync --create-empty-src-dirs -v /...
1
vote
1
answer
317
views
Restoring from backup made with rsync -M--fake-super
For years I have been regularly running the following command locally as a root filesystem backup in the hope I am safe:
rsync -aAXv --progress --delete / --exclude={"/dev/*","/proc/*&...
2
votes
1
answer
861
views
Broken pipe on transfer from/to fedora system using rsync/rclone/scp
I'm trying to send some files with around 2GB to my home server running Fedora 36. On my Laptop, I have Pop OS! 22.04. Both are directly connected to my router via Ethernet.
Sadly, I'm getting errors ...
0
votes
0
answers
260
views
Getting No Data Available when using cp to copy a file (but file exists)
I am trying to copy a file with cp in Linux, and am getting an error: No Data Available
The file exists in my FS:
> ll formation_xrpu_personnalisation_27-09-2021\ 15\:33\:43.webm.mov
-rw-rw-r-- 1 ...
0
votes
1
answer
501
views
How to re-sync already transfered sparse file with rsync?
I have completely transferred a file using rsync without the use of the --sparse, -S option. I don't want to waste space and thus re-sync the file and turn it into a sparse file. Is there a way to ...
1
vote
0
answers
246
views
Rsync-Daemon Max Connections Error
I prefer to use rsync daemon for all of my rync needs because it provides clean centralized management and saves on system resources. Accordingly, my /etc/rsyncd.conf contains multiple module entries....
0
votes
1
answer
759
views
How to use rsync for Windows on both ends?
I install rsync for Windows through git-bash. If the remote end is Linux, it works fine. However, it does not work if the remote end is Windows. I install rsync on the remote end and test working as ...
0
votes
1
answer
1k
views
Cygwin rsync cannot run outside of Cygwin terminal
I installed rsync 3.2.4 with cygwin in windows11 with the path C:\Cygwin\bin\rsync.exe. When I directly run rsync in windows terminal, I got the error code 12.
But this command runs normally when ...
5
votes
1
answer
977
views
Why does rsync give different output between rsyncing to a USB flash drive versus a hard disk?
How come rsync gives different outputs when there are no files for rsync to transfer, meaning (xfr#0) with rsync from hard disk to hard disk versus rsync from USB flash drive to hard disk?
Using:
...
2
votes
1
answer
286
views
GNU parallel & RSync via intermediate server
I'm trying to spawn multiple rsync instances with gnu parallel to download via an intermediate server. This is the command I use -
cat ~/filelist | parallel --will-cite -j 5 --verbose --progress --...
0
votes
1
answer
1k
views
rsync "cannot stat destination" suddenly occurring with job that was running fine for months?
I run a daily rsync backup of my /var/www folder to a share on a Windows 2022 server. It's been running fine for a few months, but in the last couple of days has started failing with the error below. ...
0
votes
1
answer
512
views
BackupPC rsync failing because it is using the wrong SSH user
Permission denied, please try again.
Permission denied, please try again.
[email protected]: Permission denied (publickey,password).
rsync_bpc: connection unexpectedly closed (0 bytes received so ...
2
votes
0
answers
22
views
How to change directories recursively in huge files
I tried to copy data between two huge NFS folders. I copied all the data, but I noticed that by mistake I made duplicate directories only in the 6th depth.
For example, instead of copying:
/mnt/nfs1/a/...
1
vote
0
answers
165
views
Does the rsync command provide a safe means of transferring data from a Windows disk image to a Linux system?
I currently have Windows 10 on my computer, and I am planning on installing Ubuntu. Before installing Ubuntu, I am planning on creating a disk image to preserve my data. Once Ubuntu is installed, I ...
0
votes
0
answers
234
views
What is the correct way to transfer Windows data from an external drive to a Linux system?
I currently have Windows on my computer, and I am planning on switching to Linux. Before making such a change, one first needs to back up Windows data. After installing Linux, one would transfer the ...
0
votes
1
answer
353
views
rsync file duplication ignore is not working as expected
I am confused with the working of rsync. Here is what I did and expected.
I created two folders named 'sbck' and 'dbck'.
Scenario 1:
I created a file named a.txt and created a copy of it using cp -rp ...
0
votes
0
answers
172
views
Reverse SSH on Windows Git BASH
I have multiples Windows 10 computer where I can't open anymore ports, neither install more software. But those computers have git bash installed on it.
I would like to be able to run some bash script ...
2
votes
1
answer
735
views
How to specify TCP congestion algorithm to use for my long running rsync process?
I have a huge rsync task where I'd like to syncronize file colletion of my workstation and remote server (rsync over ssh). I assume the whole process to take weeks so I don't want to cripple my ...
0
votes
2
answers
381
views
Start Over With rsync
I've got an rsync job which I have been using over the course of several years.
I'm a windows user and use Delta Copy Client.
This job has become so messy that it errors out all the time and I've ...
4
votes
1
answer
514
views
Offline MailDir Restoration Advice
Situation:
I have an offline backup of gigs worth of email. After some reading, I confirmed that the email can be restored to MailDir on my new server via rsync.
My rather basic question:
File Names.....
0
votes
1
answer
705
views
Inodes in External Disk full. Actually not
Checking inode usage:
[cold] > df -ih .
Filesystem Inodes IUsed IFree IUse% Mounted on
/dev/sdb1 59M 59M 7.9K 100% /home/doom/cold
Here we see 100% Inode usage. 59 million inodes ...
0
votes
1
answer
914
views
rsync from MacOS to Ubuntu?
I'm trying to rsync some files from my macbook to an ubuntu laptop ( [email protected] ) using this command:
rsync -vazh ~/Folder [email protected]
But instead of syncing the files to the remote host, ...
1
vote
1
answer
9k
views
Non-root User Rsync Daemon rsync error: error starting client-server protocol (code 5) at main.c(1675) [Receiver=3.1.3]
I am on on Ubuntu 20.04 Desktop and I am backing up a remote client Ubuntu 20.04 server using the following basic framework:
In /etc/sudoers
non-root-username ALL= NOPASSWD:/usr/bin/rsync
From Desktop ...
0
votes
0
answers
78
views
multiple folder sync with rsync from server to local storage
im trying this for a first time, and im not the best in sh.
#!/bin/sh
SCRIPTPATH='server/cronscripts'
SSHKEYNAME='keyid'
FROMDIRPATH='server/source-folder/folderA/'
TOSERVERANDPATH='local-...
1
vote
1
answer
587
views
rsync curly braces with one item issue?
I have a problem with rsync when I pass the exclude list in curly braces, what is the difference between the following two lines?
sudo rsync -aHAXxhvi --delete --exclude={/1111111/} /etc/ /media/...
2
votes
1
answer
1k
views
Why does copying a (large) file to USB report that it is done when it is not?
I have a Ventoy USB which I copy ISOs to and, when I copy it using my file manager (I use GNOME, so Nautilus) it tells me 100% but it is not, because the image gets corrupted.
Same thing goes for ...
0
votes
2
answers
683
views
What does CVS stand for?
What does CVS stand for? What does it mean? In particular, I mean the --cvs-exclude option in rsync.
-C, --cvs-exclude
This is a useful shorthand for excluding a broad range of files that you ...
1
vote
1
answer
316
views
Rsync download to temporary directory until file is finished, then move to completed directory
So I am trying to wrap my head around rsync. I've been at it now for at least 5 hours straight, but I am not getting any smarter about it. I am connecting to a remote server, trying to download the ...
0
votes
0
answers
203
views
Creating automatic backups with rsync from ext4 file system to afps file system on another device (local network)
I shared an external hard drive (AFPS file format) on my macosx via local file sharing to my ubuntu server (ext4 file format). I would like to use rsync to automatically sync folders from the ext4 ...
0
votes
3
answers
7k
views
rsync permissions errors at destination even though root, possibly due to sticky bit?
I'm using rsync to backup local files to a usb disk. That has been working fine for years, but now rsync is reporting filesystem permission errors, even though run as root on a rw filesystem. This is ...
1
vote
0
answers
174
views
Utilize `fswatch` to improve `rsync`'s speed?
I have some huge folders containing about 40000 files (and much, much more gitignored files like node_modules), and I want to rsync to a remote machine.
Currently, I use a simple script like run_rsync;...
0
votes
1
answer
713
views
Reload nginx configuration when rsync updates nginx.conf
I have two web servers, server1 and server2.
On server2 there is an rsync command, scheduled in crontab, that updates /etc/nginx folder when I make some changes on server1:
*/5 * * * * rsync -avzhe ...
1
vote
0
answers
3k
views
File permission "b" of /var/lib/docker/volumes/backingFsBlockDev
I want to backup my files from a raspberry pi (rasbian) to my USB stick type (ext4) using backup software (RaspiBackup) but i'm getting an error.
It looks like an authorization issue.
The error:
"...
0
votes
2
answers
215
views
rsync options so that source and dest are exactly the same?
My src folder is my local laptop.
I have a dest folder which I use for backup (and is NAS mounted) but for historical reasons I have sometimes used the dest folder for exactly what I use now src (bear ...
1
vote
1
answer
2k
views
Rsync always failing at the same point
I made a script for my Proxmox host to make a copy of its daily backups to another machine (running Windows Server 2022).
The script mounts a NFS share from the Windows host and runs this rsync ...
0
votes
0
answers
423
views
rsync is deleting file containing special characters when file name was change in terminal instead of Finder
The problem
I use macOS and try to sync two directories using rsync – one in my home directory and one in the external HDD (HFS+).
Whenever I run the rsync with --delete option, I've observed that it ...
0
votes
1
answer
248
views
How to programmatically detect whether rsync detected changes or not?
If I do:
echo 'sup' > sup.txt
echo 'nup' > nup.txt
echo 'sup' > sup2.txt
rsync -P --archive --human-readable --itemize-changes --dry-run sup.txt nup.txt
rsync -P --archive --human-readable --...
1
vote
0
answers
4k
views
rsync too slow between local disks. how to solve?
I'm not experienced in commandline utilities but I've tried to set up rsync to synchronize my document folder in linux mint to usb stick daily.
It works fine, all files are up to date.
the command in ...
2
votes
0
answers
2k
views
Rsync not deleting files in destination directory despite “--delete” being set
I have the following rsync command:
rsync -ahv --progress --delete \
/source_dir1/file1.txt \
/source_dir2 \
/dest_dir/
It syncs everything as expected, but does not delete anything from ...
2
votes
2
answers
5k
views
Who is systemd-coredump and why is he on my system?
I have a rsync that has the following configuration:
rsync -aur4zvq --force /root/folder/on/local/ root@remote:/root/folder/somewhere/on/remote
This is run by a crontab as root for security reasons ...
2
votes
0
answers
577
views
rsync with -X fails due to dot underscore files
I need to maintain sync copy from one external drive to another, on my macOS (Monterey).
ext drive 1 (source) = ExFAT
ext drive 2 (target) = APFS
rsync v3.2.3 is used (not macOS default v2.6.9)
rsync -...