Questions tagged [rsync]
Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.
1,338
questions
0
votes
0
answers
19
views
how to backup 2 sources with rsync to different destination
I didn't manage to find the solution to my need.
I'd like to backup two different sources in one command with rsync with an historic.
for example I have 2 sources :
/home/docker/
/var/volumes/
and ...
0
votes
0
answers
26
views
Why does `rsync` show directories even if it does not make any transfer
Sometimes when I use rsync, it does not transfer any files (which is expected) but for some reason it outputs some random directories in the shell. For example, take this command:
rsync --include=&...
Jonathan
1
vote
1
answer
20
views
rsync save and restore user-id/group-id
I'm trying to understand how to save and restore user/group while performing a backup using rsync.
It might be that I got it all wrong, but I was running the following command:
rsync -axqHAXWESR --...
- 13
2
votes
0
answers
57
views
Does rsync behave differently if it detects that a mount point is from a network instead of a local/external drive?
Note: I don't think I did a good job of explaining what I was looking for. The problem I'm running into is NOT which files rsync is selecting to mirror. The problem is that rsync is taking WAY ...
- 21
0
votes
0
answers
11
views
Trying to upload a zip file using rsync in Windows does not work: rsync: connection unexpectedly closed [duplicate]
I have got install rsync in Windows OS, now when I try to upload a zip file to a remote server, below error appears:
rsync: connection unexpectedly closed (0 bytes received so far) [Receiver]
rsync ...
- 235
0
votes
0
answers
22
views
Copying from a complex file directory with rsync
I have a complex file directory such as the one below.
Top_directory
Dir1
Dir2
File1
File2
Dir3
File3
File4
File5 > ../File1 (symbolic link)
Dir4
Dir5
Dir6
Dir7
I have a list of files in a ...
1
vote
0
answers
24
views
Mixing incremental with synchronised backups
I have a root directory on my laptop (source) which I want to backup to an external drive (destination).
In this folder there is data which I want to keep in sync with the destination (e.g. using ...
- 141
1
vote
0
answers
56
views
rsync permission issue when run as systemd service in userspace
Ssh:d to a raspberry pi with Raspbian 11 I'm trying to create a userspace systemd service unit and timer for running an rsync command that would sync two folders under the home folder of the user I'm ...
- 11
0
votes
1
answer
37
views
how to rsync sync between two servers web directory?
I would like to know can I sync two server's folders like server 1 plugin updated should reflect on server 2. If we do this from server 2 it should reflect on server 1.
What rsync command should I use ...
1
vote
4
answers
117
views
How to test scp without sending a file?
I have a setting where only scp connections are allowed to a remote server, with ssh login being disabled (i.e. you can't get a shell into that server), and I am seeking a clean way for testing ...
2
votes
1
answer
76
views
Rsync only specific filenames
I have a large directory tree and want to copy only files with specific names. I also want to preserve the directory structure, incrementally update, and maintain metadata, so rsync seems like the ...
- 148
2
votes
0
answers
39
views
use rsync with autossh
I'm trying to use rsync with autossh on my laptop, so it can also work when internet connection is less reliable, but it doesn't really do as I'd like it to do.
The starting point is that I have an ...
- 181
0
votes
1
answer
38
views
Include all files and folder inside a folder and exclude a specific sub folder with rsync
I have a deployment script which uses rsync with filter that uses a .txt file to merge. How can I include everything inside /web while excluding the folder /web/uploads? I'm using Bitbucket pipelines ...
- 3
0
votes
0
answers
146
views
Using rsync and ssh inside python script to specific folder
I am attempting to make a copy of the /home folder on a remote Raspberry Pi (pitwo) to a local Raspberry Pi (pizero) via rsync and ssh. The local Pi has a hard drive connected that is shared using ...
- 21
1
vote
1
answer
36
views
How to extract numbers from rsync stats output
I am using rsync to back up a Raspberry Pi. The rsync command runs inside a python script:
import os
os.system('sudo rsync -avzh --stats /etc /home /usr /mnt/BigMac/BigMac/PiBackups/PiZero')
The ...
- 21
-1
votes
1
answer
32
views
No way to get rsnapshot/rsync backup dot dir and file names
I'm trying rsnapshot to get incremental rsync of my remote server (AlmaLinux 9) to my local desktop (Ubuntu 20.04) performed locally.
I found that a 8GB source directory was only 4GB at the target dir....
2
votes
1
answer
126
views
rsync: No space left on device, although plenty of space available
When doing a backup with rscync to a USB stick, I sometimes get for one or another file the error message
rsync: [receiver] write failed on (FILENAME) : No space left on device (28)
rsync: [sender] ...
- 489
0
votes
2
answers
58
views
Why rsync keep sending the same files every time it's invoked, even though the files have the same checksum?
I am attempting to use rsync from Mac version 2.6.9 to transfer a file to Ubuntu version 22.04.1 LTS (GNU/Linux 5.15.0-1028-aws x86_64). However, every time I try, rsync shows the same file, even ...
- 101
3
votes
2
answers
134
views
Creating backup process with a pi, should I use push or pull?
I have a raspberry pi 4 and would like to use it as a backup server at home. Now I am unsure how to do this, I have an encrypted disk that is connected to the pi and I want to do the backup ...
- 397
0
votes
1
answer
54
views
Rsync disregard double quotes in script
When the varialble "$exclude_list" is called as parammeter, rsync disregard double quotes and somehow include the home folder even that isn't mentioned in the script. I try to wrap it up in &...
- 3
0
votes
1
answer
173
views
The files from Ubuntu has been submitted successfully, but from the Windows I got the error "error in rsync protocol data stream (code 12)"
If shortly, when I submit my files to VPS from Ubuntu PC by Rsync, everything going well, however if I do the same thing from Windows, I get the error
rsync: connection unexpectedly closed (0 bytes ...
0
votes
2
answers
409
views
Synology NAS DSM: SSH client to backup/rsync a REMOTE server locally
Scenario:
a remote Linux webserver (Ubuntu 22.04)
a local Synology DS220+ with DSM 7.1
I would like to use the Synology to access the remote server via SSH to rsync the server data locally. The ...
0
votes
1
answer
67
views
Can rsync compress only large files during a transfer?
Rsync can be slow to transfer small files when the option -z is enabled.
Consider a situation with thousands of very small files and a few very big files.
Is there a way to tell rsync to only compress ...
- 155
0
votes
1
answer
64
views
rsync files older than 7 days to password protected server
I am attempting to use a combination of find and rsync to backup all files in a directory older than 7 days, as a part of a weekly backup script to a password protected server.
I am using find /local/...
0
votes
1
answer
166
views
rsync skipping directory and not transferring files
I am trying to move files from one directory to a server. This is the code I am using.
sudo rsync --remove-source-files --verbose --progress --include '*.plot' --exclude '*.tmp' /media/nvme500/ /media/...
3
votes
1
answer
492
views
rsync error did not see server greeting
I want to upload files using rsync over SSH.
On server side I have:
In /root/.ssh/rsync.conf:
uid = root
gid = root
use chroot = false
[data]
path = /var/www/data
In /root/.ssh/authorized_keys I ...
- 163
0
votes
1
answer
284
views
Is there a way to determine how much the total disk usage of a directory will change after calling rsync?
I'm working on setting up automatic incremental backups for a system with rsync, using a method similar to rsnapshot. I'd like to know whether or not the backup disk has enough space to fit a new ...
- 748
0
votes
1
answer
101
views
How do you use Rsync's files-from option?
So I wanted to rsync a bunch of files from my mac to an external drive and tried this:
$ rsync -vv --files-from=backup.txt /Volumes/Seagate\ Expansion\ Drive/2022-12-27-imac-backup/
rsync version 2....
- 1,158
0
votes
0
answers
15
views
What is rsync's behaviour when it encounters a file in the destination directory that isn't in the source directory? [duplicate]
If I have one or more files in a destination directory (destdir/) that are not in the source directory that I'm copying from (srcedir/), will these be removed when I use rsync to copy files from ...
- 121
0
votes
0
answers
20
views
rsync - does source location matter?
I have 2 machines, 'a' and 'b' that sync certain content using an lsync task so as content is added / updated on machine 'a', 'b' is automatically updated with the changes.
I have recently added a 3rd ...
- 101
4
votes
2
answers
771
views
rsync errors with "stale file handle" or "error in file IO" sporadically when copying from server to HPC
I'm working on a server via SSH and need to copy a directory from the server to an HPC with rsync:
rsync -a -q "sourcedir" "username@hpc:~/destdir/"
In this example, sourcedir is ...
- 41
0
votes
1
answer
123
views
Using Rsync Transferring files from server to client too much slow?
Actually i am transferring files from one AM5728 Board to another AM5728 board (with Aargo Linux Kernel) with 1Gbps speed.
Tested iperf command speed is 750Mbps.
Transfer files from one board to ...
0
votes
3
answers
508
views
How to copy files from sub directories to one directory
Hi I have a folder full of music files on an ubuntu server. I am trying to copy all said music files *.mp3/flac to one directory without there subfolders.
I used this command in rsync, which works to ...
0
votes
0
answers
81
views
RAID 0 on rsync/rclone mounted drives
I have multiple cloud drives mounted with small capacities
Is there any way to set up raid 0 on them and combine there capacities and use them as a single drive
- 1
0
votes
1
answer
244
views
Starting ssh-agent from a script for use in multiple scripts (invoked by git)
I have some homepages in a git repository each. They are built by Jekyll. When I change something, I use git's pre-push hook to let Jekyll build the page and sync it with my HTTP server via rsync.
...
- 123
0
votes
1
answer
437
views
How to use rsync to overwrite only destination files which have changed from source?
We have a source folder which contains the correct base state of a test system.
Currently, we copy that source folder over to the destination folder each time and overwrite everything with the base ...
3
votes
1
answer
480
views
rsync: identical files (contents, size, timestamp) between source and destination are not being seen as identical
NOTE: Sadly, it turns out that this has nothing to do with file timestamps.
Per the info given in that other post, I tried --modify-window=30 and even --modify-window=300, but that did not change the ...
- 337
1
vote
1
answer
144
views
WSL: rsync not deleting files in destination when absent from source
This is using WSL on a W10 machine.
I'm trying to mirror one drive to another.
The command I'm using looks like this:
root@M17A:/mnt/c/WINDOWS/system32# rsync -rtivlHu --delete --exclude "Backups&...
- 643
0
votes
0
answers
23
views
rsync syntax error on round braces [duplicate]
I have this problem with rsync. If I run this command
rsync -rltD --delete --update --itemize-changes /data/Program\ Files\ \(x86\)/ michele-backup@192.168.1.26:/backup-michele/Program\ Files\ \(x86\)/...
1
vote
2
answers
816
views
rsync "File name too long (36)" error for filenames with UTF-8 characters
Trying to copy files from an NTFS-formatted HDD to an EXT4-formatted HDD, rsync fails to copy some of them having relatively long file names consisting of Asian (UTF-8) characters.
For example, there'...
- 13
0
votes
1
answer
132
views
rsync syntax error when using "--files-from" and "--list-only"
I have a working rsync call that takes a list of local directories to upload (simplified):
$ rsync --files-from=dirs_to_backup.txt --recursive ./ remote:
I now want to perform my own consistency ...
- 509
0
votes
0
answers
84
views
rsync filling destination, --delete-before not working
I've had a rsync task doing my backups for some time, copying data from my FreeNAS system to a raspberry pi (w/ external disk). The source size data directory is 2tb and the total size of the remote ...
- 1
0
votes
0
answers
105
views
rsync --partial with --write-batch-only
Using rsync 3.2.4 in cygwin:
I need to apply changes to a folder tree only when no user is logged onto a device. The actual sync of the folders can take a very long time. So I need to start the ...
- 1
0
votes
1
answer
100
views
Can rsync --remove-source-files to the same drive reduce fragmentation?
I know that rsync with --remove-source-files (which I use instead of mv so I can merge directory hierarchies) creates new inodes:
stat 2021_07_30_20_18_17.pdf~
rsync --remove-source-files ...
- 1,365
3
votes
2
answers
927
views
Very slow file comparison when running Rsync
Something is wrong with rsync speeds in one scenario.
I sync files from a SSD disk to an exFAT VeraCrypt container on an HDD (entire HDD is encrypted with VeraCrypt, the encrypted container is ...
- 153
0
votes
1
answer
167
views
rsync --dry-run then rsync --files-from
I backup big folders and at first I run rsync ... --dry-run to verify the list of files.
Then I used to execute the same command, but this time without --dry-run to transfer the files.
Because it was ...
- 153
0
votes
0
answers
377
views
Rsync with hard links very slow compared to rclone
I'm using a self made docker to sync files between two machines.
Inside the docker a sftp-folder is mounted using sshfs.
I always used rclone to sync the files:
rclone sync --create-empty-src-dirs -v /...
- 1
0
votes
1
answer
152
views
Restoring from backup made with rsync -M--fake-super
For years I have been regularly running the following command locally as a root filesystem backup in the hope I am safe:
rsync -aAXv --progress --delete / --exclude={"/dev/*","/proc/*&...
- 1
2
votes
1
answer
536
views
Broken pipe on transfer from/to fedora system using rsync/rclone/scp
I'm trying to send some files with around 2GB to my home server running Fedora 36. On my Laptop, I have Pop OS! 22.04. Both are directly connected to my router via Ethernet.
Sadly, I'm getting errors ...
- 141
0
votes
0
answers
98
views
Getting No Data Available when using cp to copy a file (but file exists)
I am trying to copy a file with cp in Linux, and am getting an error: No Data Available
The file exists in my FS:
> ll formation_xrpu_personnalisation_27-09-2021\ 15\:33\:43.webm.mov
-rw-rw-r-- 1 ...
- 137