Questions tagged [rsync]

Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.

Filter by
Sorted by
Tagged with
1 vote
1 answer
22 views

File transfer: Windows WinSCP orders-of-magnitude faster than Linux scp/rsync

My goal is to transfer a large file from a remote HPC to my local machine. My experience is in Windows, but I recently got a workstation with Fedora. On my Windows machine, I use WinSCP. Downloading ...
P. May's user avatar
  • 11
0 votes
1 answer
38 views

Rsync Compare-Dest not Recognizing Wildcard

I am trying to use rysnc to do multi level incremental backup, however I am running into some issues. It seems as though rsync does not recognize wild cards in compare-dest. I run the following code ...
Jam's user avatar
  • 3
0 votes
1 answer
24 views

rsync dry-run to determine whether there is enough space on the destination drive

I'd like to write current data from a failing drive (some data loss due to a few defective sectors) to a drive with an old backup (data since has been reorganized and grown). Piling the current data ...
handle's user avatar
  • 287
0 votes
0 answers
44 views

Transfer speed between distant computers A and B differs wildly from speed tests

For almost 15 years I've suffered the following problem (sometimes chronically and sometimes only rarely), across multiple machines, router hardware, and ISPs at both ends of the connection: My home ...
dg99's user avatar
  • 700
0 votes
2 answers
23 views

How would I go about excluding all but certain directories and one filetype in rsync?

For a project on NLP I need a copy of the Project Gutenberg library. Now, the project allows the download of their files, especially if it's for mirroring purposes (I'm planning on setting one up ...
Gallifreyan's user avatar
0 votes
2 answers
42 views

Prevent rsync from overwriting already copied files

We used to do backup on (source) server to another server by running rsync on source server. On recieving server there is rsyncd running and its config changed each day pointing to different dir (dir ...
Alexander's user avatar
  • 292
1 vote
0 answers
30 views

Why can't rsync be used in place of IMAP/POP? [closed]

Disclaimer: this relates to those who like to manage their email as files, using the likes of mutt or some other maildir reader. Before I became familiar with the likes of rsync and scp, IMAP and POP ...
Seán Healy's user avatar
0 votes
0 answers
129 views

Vim/Nvim Remote Editing

I want to work from my local nvim client on a project on a remote machine. My job requires that I don't store any source code on my local machine and only work on remote (I think writes to /tmp are ...
ataha322's user avatar
0 votes
1 answer
40 views

Arch linux: How to exclude files from subfolder while using rsync for copying

I wanted to make a copy of files from one directory (folder "test2") to another directory (folder "Destination") while using rsync in linux console. The only problem? I want to ...
Minja Culic's user avatar
1 vote
0 answers
113 views

How to Safely Copy Entire Ubuntu Root Directory to Different Drive and use it as system drive via SSH?

I'm currently maintaining a remote Ubuntu server with two drives: one SSD and one HDD. The HDD is currently mounted at /, serving as the system drive, while the SSD is empty and mounted at /mnt/nvme. ...
dzwiedzn7's user avatar
-2 votes
2 answers
86 views

Can ionice reduce wear and tear on hard disks?

Without knowing how ionice works functionally, I was wondering if ionice more smartly batches disk I/O operations for more efficient physical movement (spinning disks specifically). I run a lot of ...
Sridhar Sarnobat's user avatar
0 votes
0 answers
29 views

rsync doesn't follow the exclude-from list of files and directories

I am trying to make the backup of my files to an external HD via rsync, I have been struggling to use the exclude-from as it doesn't behave as I think it should. My home (home/user) contains the ...
Jaboto's user avatar
  • 1
0 votes
0 answers
24 views

trying to mirror one storage drive of size 2n to two storage drives of 1n each

use case: I have two hard disk drives of 2tb each. Currently I am mirroring one to the other. The disks however are almost full. I am now planning to get a 4tb hard drive and use that as the original ...
ChiggyClaus's user avatar
0 votes
1 answer
55 views

How to rsync to a server that does not have rsync but has the SCP tool

The remote server is a FreeBSD like system from which rsync is not installed : $ ssh [email protected] which rsync scp Password: rsync not found /usr/local/bin/scp $ rsync -a /ring/0/share/...
SebMa's user avatar
  • 1,803
0 votes
0 answers
90 views

--link-dest and --hard-links with rsync

I have my custom nightly backup solution using rsync with --link-dest to only update what's new, and --hard-links to keep a faithful representation of my source. Also, both options help minimize ...
ciobi's user avatar
  • 33
1 vote
1 answer
180 views

Can transfer files using WinSCP but scp or rsync fail with errors like "Connection closed"

I get errors when trying to transfer files using scp or rsync, but I can transfer files using WinSCP, and it's using SCP protocol. I'm running WinSCP on Windows 11 and scp rsync on WSL2, and when I'm ...
李昊泽's user avatar
1 vote
0 answers
53 views

Can rsync ignore errors that happen due to NFS cache inconsistency?

I have a process running on Linux that repeatedly updates a file on an NFS filesystem. The process writes the new data to a tempfile (on the same NFS) and calls the rename() syscall to replace the ...
Kerrick Staley's user avatar
0 votes
1 answer
80 views

Unable to submit the files by Rsync from the Windows terminal to Ubuntu VPS (code 12 error) while normal SSH authentication works fine

Although the Rsync is available for Windows, there are some problems with SSH. Here is the first one: the files are simply could not be submitted because of unclear error "error in rsync protocol ...
Tokugawa Takeshi YD's user avatar
0 votes
0 answers
122 views

Rsync to Synology NAS with public key does not work as expected

I know that this question is asked a lot, but none of the answers could help me so far. I am trying to copy files via rsync from an ubuntu server to a Synology nas without a password prompt. I am ...
Jan T.'s user avatar
  • 21
0 votes
0 answers
133 views

why does rsync not update times on remote even when itemize changes shows time differences

I'm using rsync to sync files from one NFS mount to another NFS mount. Files exist at the remote location already because of a previously executed scp command from the local mount. The consequence of ...
Daniel Klisiewicz's user avatar
0 votes
0 answers
15 views

rsnapshot backup fails with cryptomator mounted volume

I have rsnapshot (on macos) setup for my backups and in the config file one of the locations I am trying to back up is a Volume mounted by Cryptomator. Relevant line in config file: backup /Users/...
christopher.online's user avatar
1 vote
0 answers
192 views

Is rsync vs gcloud storage rsync better for remote sync? [closed]

I need to recursively copy many videos to our gcloud storage bucket from a local Ubuntu system while maintaining metadata, providing for continuation and validation. I am setting up some equipment to ...
A Bit of Help's user avatar
0 votes
0 answers
31 views

Creating a hybrid SELinux policy for a specific directory?

I have a machine "NFS-Server", a machine "Hybrid", and a machine "TFTP-Client" which I would like to connect in the following way: NFS-Server allows Hybrid to mount to a ...
eakirk16's user avatar
0 votes
0 answers
65 views

Why is explorer.exe much faster than rsync?

Copying some 150GB from Windows to WSL, doing rsync /mnt/c/big_file big_file -aP rsync manages about 400MB/s, but copying the file on explorer.exe and pasting in \\wsl.localhost\Ubuntu-22.04, ...
hanshenrik's user avatar
  • 1,695
0 votes
0 answers
52 views

Copying files away from HFS+?

I own two old hard drives, which are formatted as HFS+. Since HFS+ stores files in a hidden directory, if they are referenced in multiple places, I was wondering what the most efficient way to migrate ...
datafan's user avatar
1 vote
1 answer
162 views

Why is rsync so much slower than my Python script for syncing?

I have the following Python script that I sometimes use to mirror large directories (main logic for syncing is implemented within sync_directory()). It also tries to mirror other metadata such as file ...
j-gopal's user avatar
  • 11
0 votes
1 answer
53 views

Does rsync -D protect the root partition uuid in fstab?

I have a few partitions. One is for my main OS installation, and a second is set aside as the destination for a backup of the main OS. I have a secondary OS set aside for maintenance purposes, with ...
RTD's user avatar
  • 101
0 votes
1 answer
121 views

Using rsync to merge two source directories

I have my photos on an external disk, which I back up to my server by manually running a script that uses rsync. This script ensures that my external disk and my backup are in sync, which means ...
Jure Merhar's user avatar
-1 votes
2 answers
373 views

Problems using rsync with macOS Sonoma

I bought a new Mac mini. Before I was on Catalina. I used rsync a lot to make backups of my photos. My old scripts do not work anymore and I don't know what to do. I am using the version of Rsync that ...
Frederic B.'s user avatar
0 votes
1 answer
277 views

sudo rm -rf permission denied

I accidentally copied my entire disk with rsync -a / ... to my backup server. When trying to delete this backup with sudo rm -rf backup_dir I get a permission denied error on some sub directories of ...
Meinrad's user avatar
1 vote
3 answers
311 views

How to create a read only user for rsync?

I have A and B linux servers. I have many users with their home directories in /home. I want to run rsync in B to sync /home from A. I want to consider the following: I want to use SSH key auth for ...
MAMProgr's user avatar
  • 113
1 vote
0 answers
223 views

Is it possible for Ansible to reuse the existing SSH connection to the remote host in order to rsync some directories?

Following script is meant to be copied and run on the remote host, i.e. 192.168.1.142, ansible-playbook -u root -i inventory.ini sync-w-ctrl.yml: #!/usr/bin/bash au=jimmy dirs=( "/home/${au}/...
John Smith's user avatar
0 votes
0 answers
24 views

Mount or sync an S3 versioned bucket with rewind - back in time

Assuming I have an S3 versioned bucket (backed by Ceph), I would like to restore from it at a specific time. mcli has a --rewind feature that allows some operations to time-travel into the past taking ...
Robert Cutajar's user avatar
1 vote
0 answers
111 views

Using rsync to mirror the contents of a directory on a NAS

I have two network attached storages (NAS). I am trying to mirror a directory on nasA (IP ending .69) to nasB (IP ending .11) using a Windows Subsystem for Linux. On my laptop I SSH to nasA and try ...
Pete Whelan's user avatar
0 votes
0 answers
75 views

How to emulate rsync into cp to copy all files from source that dont exist in destination disk and update existing ones?

Rsync is halting when reading bad sectors, then the hdd is going in a very bad mode than needs special rescue. It is the 3rd time that this happens to my disks. The disk was very functional except for ...
Estatistics's user avatar
0 votes
2 answers
174 views

rsync to server and set ownership and permissions, use sudo

I have a server with a website, /var/www/html/website. I use rsync to transfer updated files over: rsync -avzu --no-perms --no-owner --no-group --chown=user:www-data --progress /mnt/c/xampp7/htdocs/...
Daviid's user avatar
  • 156
0 votes
0 answers
107 views

Why is rsync slower within my SSD than to an external HDD?

I have partitioned my primary SSD, and mounted two partitions in my /media directory. rsync between these two partitions are slower than rsync-ing the same files to an external HDD, and I don't ...
genbatro's user avatar
0 votes
0 answers
62 views

How to transfer very large folders from a server which I access sudo and ssh to another server with ftp access?

I have some big folders (each around 1T) on a server which I have sudo access to that. I want to transfer them to another server which I have ftp access (with username and password). What it came in ...
Nmgh's user avatar
  • 1
1 vote
0 answers
43 views

rsync delete-excluded without implied delete

I'd like to use rsync to back up my home directory to another drive, but I have some directories I want to exclude. I have a past backup that contains those directories but I want them gone from the ...
The Bic Pen's user avatar
0 votes
0 answers
234 views

rsync copying same files over and over again on macOS Sonoma

I've recently updated macOS to Sonoma from Monterey. I noticed that when I used rsync --av, it would keep copying the same files over and over again, even when I just reran the same command. It's as ...
andrewj's user avatar
  • 161
-1 votes
1 answer
185 views

How can I make rsync work on a bad internet connection?

I'm in a country with a really bad internet connection. I try to delete files on my laptop that have already been transferred to a server with the following command line: rsync -aic --existing --...
Fractale's user avatar
  • 647
0 votes
0 answers
81 views

GlusterFS help on setting up or a alternative option

I currently have a mergerFS mount set up with 3 disks, but want to add a way for another server so i can use docker swarm and have both hosts with the same data and setup. All i could find was rsync ...
user2029325's user avatar
0 votes
0 answers
53 views

rsync -ru does not copy latest version from two sources to one destination

I have two drives I normally use. One main drive -A- and another as a backup -B- when the first one is full. Then I have a third larger -C- drive which I have tried to rsync to from both source drives,...
oppelpopp's user avatar
0 votes
0 answers
211 views

Reason for slow download speeds in scp and rsync

I am trying to download some files using scp and rsync from a remote computer. The files are ~20 MB to few GB in size. Trying to download them gives me ~20-30 KBps during the day and ~5 MBps at night (...
Guddu's user avatar
  • 171
0 votes
1 answer
94 views

Synology shared folder created from other synology rsync: authorization, permissions access denied

I set up a synology rsync from an old NAS (DSM 6.15) to a new one (DSM 7.2). (in synology DSM : shared folder sync ("synchro du dossier partagé" in French).) When you do so, the task creates ...
TanaT's user avatar
  • 1
0 votes
0 answers
46 views

How to combine 2 rsync outputs into 1 command?

using: neofetch --stdout |grep 'OS:' OS: Kubuntu 22.04.3 LTS x86_64 Shell: bash 5.1.16 rsync --version rsync version 3.2.7 protocol version 31 variables, SourceDisK1 src1 and destination ...
joseph22's user avatar
  • 357
2 votes
1 answer
1k views

How to copy a file from my WSL directory to a machine I can only SSH to from windows

I have a server that I would like to copy some files to, but I can only access that server via tailscale and only my Windows machine address is registered with that VPN, not my WSL distribution on the ...
Christopher Clark's user avatar
0 votes
0 answers
54 views

Is rsync idempotent?

To my understanding one advantage of rsync over cp is that it doesn't actually transfer any data if it's already there. I'm currently trying to restore a backup to my raspi's micro SD (after apt ...
Poohl's user avatar
  • 403
0 votes
1 answer
115 views

Can rsync target tar archives instead of filesystems?

Rsync out the box allows files on a filesystem to be synchronised with remote files on a filesystem. Can rsync allow files on a filesystem to be synchronised with a remote files on a remote set of tar ...
Graham Leggett's user avatar
1 vote
1 answer
19 views

Make rsync update files transferred in previous executions

Minimal working example Let's suppose we have two directories a and b File 1.txt exists in a and it contains foo We copy a/1.txt to b using rsync File a/1.txt gets modified and now it contains bar In ...
rdrg109's user avatar
  • 185

1
2 3 4 5
28