Questions tagged [rsync]
Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.
1,392
questions
1
vote
0
answers
19
views
Why can't rsync be used in place of IMAP/POP?
Disclaimer: this relates to those who like to manage their email as files, using the likes of mutt or some other maildir reader.
Before I became familiar with the likes of rsync and scp, IMAP and POP ...
0
votes
0
answers
34
views
Vim/Nvim Remote Editing
I want to work from my local nvim client on a project on a remote machine. My job requires that I don't store any source code on my local machine and only work on remote (I think writes to /tmp are ...
0
votes
0
answers
13
views
Arch linux: How to exclude files from subfolder while using rsync for copying
I wanted to make a copy of files from one directory (folder "test2") to another directory (folder "Destination") while using rsync in linux console. The only problem? I want to ...
1
vote
0
answers
33
views
How to Safely Copy Entire Ubuntu Root Directory to Different Drive and use it as system drive via SSH?
I'm currently maintaining a remote Ubuntu server with two drives: one SSD and one HDD. The HDD is currently mounted at /, serving as the system drive, while the SSD is empty and mounted at /mnt/nvme. ...
-2
votes
2
answers
78
views
Can ionice reduce wear and tear on hard disks?
Without knowing how ionice works functionally, I was wondering if ionice more smartly batches disk I/O operations for more efficient physical movement (spinning disks specifically).
I run a lot of ...
0
votes
0
answers
23
views
rsync doesn't follow the exclude-from list of files and directories
I am trying to make the backup of my files to an external HD via rsync, I have been struggling to use the exclude-from as it doesn't behave as I think it should.
My home (home/user) contains the ...
0
votes
0
answers
23
views
trying to mirror one storage drive of size 2n to two storage drives of 1n each
use case:
I have two hard disk drives of 2tb each. Currently I am mirroring one to the other. The disks however are almost full.
I am now planning to get a 4tb hard drive and use that as the original ...
0
votes
0
answers
38
views
How to rsync to a server that does not have rsync but has the SCP tool
The remote server is a FreeBSD like system from which rsync is not installed :
$ ssh [email protected] which rsync scp
Password:
rsync not found
/usr/local/bin/scp
$ rsync -a /ring/0/share/...
0
votes
0
answers
50
views
--link-dest and --hard-links with rsync
I have my custom nightly backup solution using rsync with --link-dest to only update what's new, and --hard-links to keep a faithful representation of my source. Also, both options help minimize ...
1
vote
1
answer
129
views
Can transfer files using WinSCP but scp or rsync fail with errors like "Connection closed"
I get errors when trying to transfer files using scp or rsync, but I can transfer files using WinSCP, and it's using SCP protocol.
I'm running WinSCP on Windows 11 and scp rsync on WSL2, and when I'm ...
1
vote
0
answers
38
views
Can rsync ignore errors that happen due to NFS cache inconsistency?
I have a process running on Linux that repeatedly updates a file on an NFS filesystem. The process writes the new data to a tempfile (on the same NFS) and calls the rename() syscall to replace the ...
0
votes
1
answer
55
views
Unable to submit the files by Rsync from the Windows terminal to Ubuntu VPS (code 12 error) while normal SSH authentication works fine
Although the Rsync is available for Windows, there are some problems with SSH. Here is the first one: the files are simply could not be submitted because of unclear error "error in rsync protocol ...
0
votes
0
answers
92
views
Rsync to Synology NAS with public key does not work as expected
I know that this question is asked a lot, but none of the answers could help me so far. I am trying to copy files via rsync from an ubuntu server to a Synology nas without a password prompt.
I am ...
0
votes
0
answers
63
views
why does rsync not update times on remote even when itemize changes shows time differences
I'm using rsync to sync files from one NFS mount to another NFS mount. Files exist at the remote location already because of a previously executed scp command from the local mount. The consequence of ...
0
votes
0
answers
14
views
rsnapshot backup fails with cryptomator mounted volume
I have rsnapshot (on macos) setup for my backups and in the config file one of the locations I am trying to back up is a Volume mounted by Cryptomator. Relevant line in config file:
backup /Users/...
1
vote
0
answers
110
views
Is rsync vs gcloud storage rsync better for remote sync? [closed]
I need to recursively copy many videos to our gcloud storage bucket from a local Ubuntu system while maintaining metadata, providing for continuation and validation. I am setting up some equipment to ...
0
votes
0
answers
27
views
Creating a hybrid SELinux policy for a specific directory?
I have a machine "NFS-Server", a machine "Hybrid", and a machine "TFTP-Client" which I would like to connect in the following way:
NFS-Server allows Hybrid to mount to a ...
0
votes
0
answers
58
views
Why is explorer.exe much faster than rsync?
Copying some 150GB from Windows to WSL, doing
rsync /mnt/c/big_file big_file -aP
rsync manages about 400MB/s, but copying the file on explorer.exe and pasting in \\wsl.localhost\Ubuntu-22.04, ...
0
votes
0
answers
51
views
Copying files away from HFS+?
I own two old hard drives, which are formatted as HFS+. Since HFS+ stores files in a hidden directory, if they are referenced in multiple places, I was wondering what the most efficient way to migrate ...
1
vote
1
answer
115
views
Why is rsync so much slower than my Python script for syncing?
I have the following Python script that I sometimes use to mirror large directories (main logic for syncing is implemented within sync_directory()). It also tries to mirror other metadata such as file ...
0
votes
1
answer
48
views
Does rsync -D protect the root partition uuid in fstab?
I have a few partitions. One is for my main OS installation, and a second is set aside as the destination for a backup of the main OS. I have a secondary OS set aside for maintenance purposes, with ...
0
votes
1
answer
83
views
Using rsync to merge two source directories
I have my photos on an external disk, which I back up to my server by manually running a script that uses rsync. This script ensures that my external disk and my backup are in sync, which means ...
-1
votes
2
answers
308
views
Problems using rsync with macOS Sonoma
I bought a new Mac mini. Before I was on Catalina. I used rsync a lot to make backups of my photos. My old scripts do not work anymore and I don't know what to do.
I am using the version of Rsync that ...
0
votes
1
answer
187
views
sudo rm -rf permission denied
I accidentally copied my entire disk with rsync -a / ... to my backup server. When trying to delete this backup with sudo rm -rf backup_dir I get a permission denied error on some sub directories of ...
1
vote
3
answers
248
views
How to create a read only user for rsync?
I have A and B linux servers. I have many users with their home directories in /home.
I want to run rsync in B to sync /home from A. I want to consider the following:
I want to use SSH key auth for ...
1
vote
0
answers
189
views
Is it possible for Ansible to reuse the existing SSH connection to the remote host in order to rsync some directories?
Following script is meant to be copied and run on the remote host, i.e. 192.168.1.142, ansible-playbook -u root -i inventory.ini sync-w-ctrl.yml:
#!/usr/bin/bash
au=jimmy
dirs=(
"/home/${au}/...
0
votes
0
answers
21
views
Mount or sync an S3 versioned bucket with rewind - back in time
Assuming I have an S3 versioned bucket (backed by Ceph), I would like to restore from it at a specific time. mcli has a --rewind feature that allows some operations to time-travel into the past taking ...
1
vote
0
answers
89
views
Using rsync to mirror the contents of a directory on a NAS
I have two network attached storages (NAS). I am trying to mirror a directory on nasA (IP ending .69) to nasB (IP ending .11) using a Windows Subsystem for Linux.
On my laptop I SSH to nasA and try ...
0
votes
0
answers
57
views
How to emulate rsync into cp to copy all files from source that dont exist in destination disk and update existing ones?
Rsync is halting when reading bad sectors, then the hdd is going in a very bad mode than needs special rescue. It is the 3rd time that this happens to my disks. The disk was very functional except for ...
0
votes
2
answers
117
views
rsync to server and set ownership and permissions, use sudo
I have a server with a website, /var/www/html/website.
I use rsync to transfer updated files over:
rsync -avzu --no-perms --no-owner --no-group --chown=user:www-data --progress /mnt/c/xampp7/htdocs/...
0
votes
0
answers
86
views
Why is rsync slower within my SSD than to an external HDD?
I have partitioned my primary SSD, and mounted two partitions in my /media directory. rsync between these two partitions are slower than rsync-ing the same files to an external HDD, and I don't ...
0
votes
0
answers
48
views
How to transfer very large folders from a server which I access sudo and ssh to another server with ftp access?
I have some big folders (each around 1T) on a server which I have sudo access to that. I want to transfer them to another server which I have ftp access (with username and password). What it came in ...
0
votes
0
answers
35
views
rsync delete-excluded without implied delete
I'd like to use rsync to back up my home directory to another drive, but I have some directories I want to exclude. I have a past backup that contains those directories but I want them gone from the ...
0
votes
0
answers
208
views
rsync copying same files over and over again on macOS Sonoma
I've recently updated macOS to Sonoma from Monterey. I noticed that when I used rsync --av, it would keep copying the same files over and over again, even when I just reran the same command.
It's as ...
-1
votes
1
answer
149
views
How can I make rsync work on a bad internet connection?
I'm in a country with a really bad internet connection.
I try to delete files on my laptop that have already been transferred to a server with the following command line:
rsync -aic --existing --...
0
votes
0
answers
72
views
GlusterFS help on setting up or a alternative option
I currently have a mergerFS mount set up with 3 disks, but want to add a way for another server so i can use docker swarm and have both hosts with the same data and setup. All i could find was rsync ...
0
votes
0
answers
52
views
rsync -ru does not copy latest version from two sources to one destination
I have two drives I normally use. One main drive -A- and another as a backup -B- when the first one is full.
Then I have a third larger -C- drive which I have tried to rsync to from both source drives,...
0
votes
0
answers
181
views
Reason for slow download speeds in scp and rsync
I am trying to download some files using scp and rsync from a remote computer. The files are ~20 MB to few GB in size. Trying to download them gives me ~20-30 KBps during the day and ~5 MBps at night (...
0
votes
1
answer
83
views
Synology shared folder created from other synology rsync: authorization, permissions access denied
I set up a synology rsync from an old NAS (DSM 6.15) to a new one (DSM 7.2). (in synology DSM : shared folder sync ("synchro du dossier partagé" in French).)
When you do so, the task creates ...
0
votes
0
answers
43
views
How to combine 2 rsync outputs into 1 command?
using:
neofetch --stdout |grep 'OS:'
OS: Kubuntu 22.04.3 LTS x86_64
Shell: bash 5.1.16
rsync --version
rsync version 3.2.7 protocol version 31
variables, SourceDisK1 src1 and destination ...
2
votes
1
answer
810
views
How to copy a file from my WSL directory to a machine I can only SSH to from windows
I have a server that I would like to copy some files to, but I can only access that server via tailscale and only my Windows machine address is registered with that VPN, not my WSL distribution on the ...
0
votes
0
answers
51
views
Is rsync idempotent?
To my understanding one advantage of rsync over cp is that it doesn't actually transfer any data if it's already there.
I'm currently trying to restore a backup to my raspi's micro SD (after apt ...
0
votes
1
answer
100
views
Can rsync target tar archives instead of filesystems?
Rsync out the box allows files on a filesystem to be synchronised with remote files on a filesystem.
Can rsync allow files on a filesystem to be synchronised with a remote files on a remote set of tar ...
1
vote
1
answer
19
views
Make rsync update files transferred in previous executions
Minimal working example
Let's suppose we have two directories a and b
File 1.txt exists in a and it contains foo
We copy a/1.txt to b using rsync
File a/1.txt gets modified and now it contains bar
In ...
0
votes
1
answer
675
views
rsync permission denied in www subfolder
I need to allow a specific user to download files from my web server. The files will be in a specific directory and I don't want the downloader to read, write or do anything outside of that directory....
1
vote
1
answer
196
views
Fast and reliable network transfer on Linux
I have had to do a significant number of filesystem backups and other large file transfers between Linux machines over the internet lately, and the overall experience with the default tools has been ...
0
votes
1
answer
291
views
rsync - Operation not permitted when script is launched by cron
I've got a script that basically launches the following command
rsync -avh --progress --no-relative "$SOURCE_PATH/" "$DESTINATION_PATH"
and vice-versa (destination to source). ...
0
votes
0
answers
22
views
Best way to handle remote storage without local copy
I have a directory of data which, until now, has been manually rsyncd to a Synology based remote storage. The problem is that I don't have enough space anymore on the local drive, so I'd like to find ...
1
vote
0
answers
129
views
Why does Win10 version of rsync modify file owner/perms even if --perms option is set?
I use Grsync's bundled rsync.exe, and have a following simple .bat script in place to sync the folder to an E drive:
rsync.exe -r --perms -og --verbose --progress "/cygdrive/C/Users/User1/Desktop/...
0
votes
1
answer
340
views
How to shrink sparse files in same way as rsync does in linux after copied them without "-S" operator?
I try to take a backup of a disk.
I use rsync to backup files between disks.
However, while used --delete option in rsync alone and then backup, destination disk is almost full while source not.
By ...