Questions tagged [rsync]

Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.

Filter by
Sorted by
Tagged with
0 votes
0 answers
19 views

multiple folder sync with rsync from server to local storage

im trying this for a first time, and im not the best in sh. #!/bin/sh SCRIPTPATH='server/cronscripts' SSHKEYNAME='keyid' FROMDIRPATH='server/source-folder/folderA/' TOSERVERANDPATH='local-...
user avatar
  • 1
0 votes
1 answer
14 views

rsync curly braces with one item issue?

I have a problem with rsync when I pass the exclude list in curly braces, what is the difference between the following two lines? sudo rsync -aHAXxhvi --delete --exclude={/1111111/} /etc/ /media/...
user avatar
0 votes
1 answer
23 views

Why does copying a (large) file to USB report that it is done when it is not?

I have a Ventoy USB which I copy ISOs to and, when I copy it using my file manager (I use GNOME, so Nautilus) it tells me 100% but it is not, because the image gets corrupted. Same thing goes for ...
user avatar
  • 181
0 votes
0 answers
39 views

Large data transfer from supercomputer to local computer extremely slow

I am working with a supercomputer to perform complex calculations that generates several GB of data. I then need to transfer the directory containing all of the files back to my local computer in ...
user avatar
0 votes
2 answers
46 views

What does CVS stand for?

What does CVS stand for? What does it mean? In particular, I mean the --cvs-exclude option in rsync. -C, --cvs-exclude This is a useful shorthand for excluding a broad range of files that you ...
user avatar
  • 481
1 vote
1 answer
22 views

Rsync download to temporary directory until file is finished, then move to completed directory

So I am trying to wrap my head around rsync. I've been at it now for at least 5 hours straight, but I am not getting any smarter about it. I am connecting to a remote server, trying to download the ...
user avatar
0 votes
0 answers
25 views

Is there a way to have rsync display the progress for all files AND the average speed of the ENTIRE transfer?

Is there a way to have rsync display the progress for all files AND the average speed of the ENTIRE transfer? I know about --info=progress2 but I don't like the fact that the transfer speed shown ...
user avatar
0 votes
0 answers
35 views

Creating automatic backups with rsync from ext4 file system to afps file system on another device (local network)

I shared an external hard drive (AFPS file format) on my macosx via local file sharing to my ubuntu server (ext4 file format). I would like to use rsync to automatically sync folders from the ext4 ...
user avatar
0 votes
3 answers
198 views

rsync permissions errors at destination even though root, possibly due to sticky bit?

I'm using rsync to backup local files to a usb disk. That has been working fine for years, but now rsync is reporting filesystem permission errors, even though run as root on a rw filesystem. This is ...
user avatar
  • 3
0 votes
0 answers
23 views

Utilize `fswatch` to improve `rsync`'s speed?

I have some huge folders containing about 40000 files (and much, much more gitignored files like node_modules), and I want to rsync to a remote machine. Currently, I use a simple script like run_rsync;...
user avatar
  • 113
0 votes
1 answer
57 views

Reload nginx configuration when rsync updates nginx.conf

I have two web servers, server1 and server2. On server2 there is an rsync command, scheduled in crontab, that updates /etc/nginx folder when I make some changes on server1: */5 * * * * rsync -avzhe ...
user avatar
  • 25
0 votes
0 answers
240 views

File permission "b" of /var/lib/docker/volumes/backingFsBlockDev

I want to backup my files from a raspberry pi (rasbian) to my USB stick type (ext4) using backup software (RaspiBackup) but i'm getting an error. It looks like an authorization issue. The error: "...
user avatar
  • 1
0 votes
2 answers
28 views

rsync options so that source and dest are exactly the same?

My src folder is my local laptop. I have a dest folder which I use for backup (and is NAS mounted) but for historical reasons I have sometimes used the dest folder for exactly what I use now src (bear ...
user avatar
0 votes
0 answers
53 views

Backup failure to USB flash drive using rsync

I want to backup my files on a Raspberry Pi to a USB flash drive using backup software (raspiBackup) but I’m getting an error. It seems to be an authorization issue. I'm logging in via a terminal ...
user avatar
  • 1
0 votes
0 answers
47 views

Migrating existing Server running on MDRAID5 lvm with EXT4 to ZFS

Im actually trying to migrate my server from ext4 to zfs. My plan was the following: backing up the whole filesystem with rsync to an external drive (which foldes should i take into?) Then put in 4 ...
user avatar
0 votes
0 answers
82 views

rsync backup data inside proxmox or inside vm to another server

I am investigating how to backup data from my proxmox server or more precisely the VMs and containers to another fileserver. The proxmox server uses a large hardware raid. And any VM/Container that ...
user avatar
0 votes
1 answer
104 views

Rsync always failing at the same point

I made a script for my Proxmox host to make a copy of its daily backups to another machine (running Windows Server 2022). The script mounts a NFS share from the Windows host and runs this rsync ...
user avatar
0 votes
0 answers
49 views

rsync is deleting file containing special characters when file name was change in terminal instead of Finder

The problem I use macOS and try to sync two directories using rsync – one in my home directory and one in the external HDD (HFS+). Whenever I run the rsync with --delete option, I've observed that it ...
user avatar
0 votes
1 answer
27 views

How to programmatically detect whether rsync detected changes or not?

If I do: echo 'sup' > sup.txt echo 'nup' > nup.txt echo 'sup' > sup2.txt rsync -P --archive --human-readable --itemize-changes --dry-run sup.txt nup.txt rsync -P --archive --human-readable --...
user avatar
  • 303
0 votes
0 answers
16 views

How to delete files and folders in source dir that already exist in dest dir?

I tried this but it didn't do anything. Also I don't want to just compare the filenames, I want to compare the actual content of the file too. cd source-dir && find dest-dir -print0 | xargs -0 ...
user avatar
  • 1
0 votes
0 answers
282 views

rsync too slow. how to solve?

I'm not experienced in commandline utilities but I've tried to set up rsync to synchronize my document folder in linux mint to usb stick daily. It works fine, all files are up to date. the command in ...
user avatar
  • 101
1 vote
0 answers
45 views

Rsync not deleting files in destination directory despite “--delete” being set

I have the following rsync command: rsync -ahv --progress --delete \ /source_dir1/file1.txt \ /source_dir2 \ /dest_dir/ It syncs everything as expected, but does not delete anything from ...
user avatar
  • 11
1 vote
2 answers
295 views

Who is systemd-coredump and why is he on my system?

I have a rsync that has the following configuration: rsync -aur4zvq --force /root/folder/on/local/ root@remote:/root/folder/somewhere/on/remote This is run by a crontab as root for security reasons ...
user avatar
0 votes
0 answers
61 views

rsync with -X fails due to dot underscore files

I need to maintain sync copy from one external drive to another, on my macOS (Monterey). ext drive 1 (source) = ExFAT ext drive 2 (target) = APFS rsync v3.2.3 is used (not macOS default v2.6.9) rsync -...
user avatar
1 vote
0 answers
130 views

rsync --append or --append-verify flags causing transfer to error on resume

Trying to do a transfer with rsync using rsync -rtlv --no-i-r --no-perms --partial --inplace --append-verify /srv/raid /mnt/backup. I use it in a script to transfer the contents of a server's RAID ...
user avatar
  • 111
0 votes
1 answer
22 views

Is there any risk in losing "Photo Booth Library" and "Photos Library.photoslibrary"?

I have observed from this question that the above directories are where the 'true' location of the photos lives and is only viewable on macOS. However a critical part of these photos is the metadata ...
user avatar
  • 131
1 vote
0 answers
81 views

How do I use rysnc to copy my entire Google Drive to an external hard drive?

I am trying to copy my entire Google drive contents to an external hard drive. I am using rsync with the built in Linux environment on my Chromebook. I do not want to install a third party app on ...
user avatar
0 votes
1 answer
341 views

Rsync: backup Windows to Linux (remote)

I have a Linux computer (Ubuntu Server) connected to the net which have rsync installed. And, I would like to backup a Windows machine (Windows 10) to it, using rsync with a security layer. I heard ...
user avatar
  • 5
0 votes
0 answers
18 views

Rsync creates folder named "?" at destination

I just ran rsync to sync my music folder between 2 macs. Instead of syncing the contents of the music folder it created a new folder named "?" at the destination (correct destination path at ...
user avatar
  • 1
0 votes
1 answer
39 views

Rsync from macOS to a system running an older version of macOS

I am having a hard time creating an Automator app to sync my music library from one Mac (new macOS) to my Mac mini server (different, older OS). I installed the current version of rsync with Homebrew. ...
user avatar
  • 1
0 votes
0 answers
29 views

Using rsync to sync music libraries edited on different computers

I am trying to use rsync to sync my music libraries between two computers. The goal is to edit (ID3 Tags, naming etc.) on one machine, then running a script on that machine to transfer it to the other ...
user avatar
  • 1
0 votes
0 answers
95 views

rsync and scp start but stuck at 0% and then timeout

I am struggling to copy files from a server(ServerA) via scp/rsync to my machine (ServerB). The problem is weird since some rsync commands work and keyless ssh login also works. However the ...
user avatar
  • 113
0 votes
0 answers
31 views

rsync and checking file status for read-only targets?

I have some local files, that I would like to update on a remote server, with rsync. The problem is that, some of the targets on the remote server are actually read-only. So when I try to update those,...
user avatar
  • 744
0 votes
1 answer
49 views

Copying a large file from an USB 3 disk (NTFS or EXT4) to another one (UFS/FreeBSD) is a very slow process

I'm copying a large file from a NTFS formatted disk to another one,UFS/FreeBSD disk,both are removable disks attached to the USB 3 port. The file is 200 GB large and it is transferred very slowly. Why ...
user avatar
1 vote
1 answer
74 views

Straight rsync with intermediate SSH host

There's a bunch of great tips here regarding using rsync with "proxy" host, but all I found assume there's SSH server everywhere. What I have is: host A - rsync client, SSH client (Linux), ...
user avatar
0 votes
1 answer
104 views

Am I using Rsync properly?

This is my desired outcome: Where I would like such an outcome across ALL sub-directories and files, in syncing all the contents of parent directory Work from my computer's desktop to an older ...
user avatar
  • 111
0 votes
0 answers
35 views

Rsync hangs on copying data from couchdb from remote server over ssh

I'm using rsync to copy data from a CouchDB instance from a server using this command: rsync -r --exclude=".*/" --progress --verbose --copy-links --copy-dirlinks --update user@<hostname&...
user avatar
  • 101
0 votes
2 answers
100 views

rsync through ssh proxy using a key that is on the proxy

I am trying to copy files using rsync from a server A, to a server C, through a bastion server B. A -> B -> C This can be achieved normally through using the -e option, like: rsync -e 'ssh user@...
user avatar
  • 3
0 votes
0 answers
23 views

How to elegantly count failures? Increment by 1

. When comparing 2 directories ... dir1='/media/user/LabelDisk/Temp1' ; dir2='/home/u3/Desktop/Temp1' ; A command: rsync -ax --dry-run --itemize-changes $dir1/ $dir2 ; echo $? rsync exit code is ...
user avatar
0 votes
2 answers
52 views

Atomic Rsync? cron'd backup of regularly changing directory to remote: insuring one complete backup?

I've got a directory that changes regularly, but whose files are related. I want to rsync that to a remote location, insuring that I always have one complete set of files at the remote. That is, if ...
user avatar
  • 676
1 vote
1 answer
58 views

rsync: transferred file twice as large as original file

I have transferred a file from a client to a remote host with rsync through a ssh bridge, and now the resulting file on the remote host is more than twice as large as the original file on the client. ...
user avatar
  • 197
1 vote
1 answer
65 views

How to distinguish between Rsync and SSH access in a “.bashrc” script

I have the following .bashrc on a remote host: #!/bin/bash DEFAULT=$PS1 PS1="\h:\w\$ " source ~/.bash_aliases if [[ $(hostname -s) = host_name ]]; then source /path/somescript.sh ...
user avatar
  • 197
0 votes
0 answers
116 views

Ubuntu VM on Synology NAS for easier rsync & rdiff-backup usage?

I am considering buying a Synology NAS such as the DS720+ (Intel processor, 2 GB RAM) for storing backups of multiple users, which are all using Ubuntu on their computers. My current plan is that ...
user avatar
1 vote
1 answer
84 views

Veracrypt: rsync syncs all files every time

I try to backup my files with rsync on a HDD that I encrypted with Veracrypt. But the problem is that it copies all files every time. That is my command: rsync -av --delete "$source/" "$...
user avatar
0 votes
0 answers
37 views

rsync doing bad copies of files

I'm doing a full system backup with rsync from a ext4 formatted Micro SD Card (64GB) with Parabola GNU/Linux-libre ARMv7h installed to a f2fs formatted 1TB Micro SD Card (ext4 got corrupted for some ...
user avatar
  • 157
0 votes
1 answer
28 views

Files after copy via rsync-ssh all at least 1 MB in size

After rsyncing an 200 MB directory mostly containing a few KB php files, the directory is now over 70 GB on the target machine. The disk usage of every file is now at least 1 MB. du -hxd1 /path/to/...
user avatar
0 votes
0 answers
52 views

Simple rsync log: transfer errors + number of transferred files

I am setting up an hourly rsync job and want a simple log for that job. If the rsync succeeds without errors, I would only like the following line to be added to the log [TIMESTAMP] [X] files ...
user avatar
0 votes
1 answer
31 views

Dovecot LDA to deliver to 2 servers at once

I'd like to build robust mail system that can withstand outages. For this purpose I rent 2 servers (lets call it mx1 and mx2) in 2 different datacenters, set up Exim on both as SMTP, and Dovecot as ...
user avatar
  • 160
0 votes
0 answers
113 views

SSH/rsync failure on Synology machines

I have two Synology machines - a DS1813+ (Codex) and a DS1817+ (Crypt), both running DSM 6.2.4. I have an rsync task on the source server (Codex) that moves a growing (currently 10TB) folder over to ...
user avatar
  • 11
1 vote
1 answer
216 views

Rsync daemon to mirror local files in WSL

I want to mirror C:\path\to\docs to E:\path\to\mirror using an rsync daemon launched as a WSL service. Both drive C and E are on the same computer. I understand that: rsync -rtvuc -delete ...
user avatar

1
2 3 4 5
26