Questions tagged [rsync]
Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.
1,393
questions
2
votes
1
answer
2k
views
How to use rsync include and exclude to capture distributed set of files?
I'm trying to backup a machine using rsync and after reading numerous SO QAs and the man pages, I'm still failing to understand how include/exclude precedence works so I can transfer the right set of ...
1
vote
1
answer
566
views
Rsync from Windows10 to Mac does not allow multiple source paths
I used to run a nightly rsync client on a Raspberry Pi to backup some folders from a Windows 10 computer. This script has been running without an issue for more than 10 years. I've recently moved the ...
1
vote
1
answer
2k
views
How to specify "no files except these extensions" in rsync?
I've created an rsync --include-from file by using a find command to find directory names of interest, and format them as such + dirname/***, which copies it and its contents. This works as intended, ...
0
votes
1
answer
701
views
Why does rsync re-downloads unchanded files from server which allready exist locally?
I would like to use rsync to download files from a server to my local computer. This is no problem of course:
$ rsync --progress -vr server-user@my-server:/path/to/remote/dir/ /local/dir/
receiving ...
1
vote
1
answer
1k
views
Rsync files between two remotes servers using SSH
Summary
I want to copy files between 2 remote servers using Rsync and SSH. The way I found to do this is creating a SSH tunnel, but I tried with several examples and any of those worked.
Details
I ...
0
votes
1
answer
287
views
rsync in cron without ssh-agent?
I'm setting up backup server, that will connect to production server and fetch backup with rsync via cron task. I have user on my backup server, I created public key and I can log with ssh to ...
0
votes
1
answer
158
views
Rsync detect if transfer on same filesystem
I want to alias the mv command to rsync -av --progress --remove-source-files to make the mv command more verbose.
It works, but can I add a way to detect if I'm moving the file within the same ...
1
vote
2
answers
3k
views
WSL (Ubuntu 20.04) - unstable permissions
I'm new to WSL and trying to use rsync for snapshot backups. Everything seems to be working as intended... except that rsync refuses to copy some files, citing a permission error with send_files.
So I ...
0
votes
1
answer
224
views
Why rsync found files who has vanished on exfat synology?
I try to transfer some files from an external hard drive in exfat to my synology Nas using rsync using the usb connection.
During the transfert rsync found files who have vanished when it's time to ...
1
vote
2
answers
269
views
How to make a file from destination don't be deleted when using the "--delete" flag in rsync?
The context
Let's suppose we have the following directory organization
mkdir -p a/foo a/bar b
touch a/1.txt a/2.txt a/foo/b.txt a/bar/b.txt
touch b/b.txt
tree --noreport
.
├── a
│ ├── 1.txt
│ ├──...
0
votes
1
answer
371
views
More meaningful recap of changes in rsync dry-run while backing up the Linuix home folder
I want to use rsync (I'm actually using Grsync) to backup my home folder.
The final command I decided to use is:
rsync -r -t -p -v --progress --delete -l -s --exclude-from [MY_FILE_WITH_EXCLUSIONS] --...
0
votes
1
answer
645
views
Show total progress on rsync
I'm trying to get Rsync to show total progress of the job using
rsync -a -v -h -i --partial -r --no-inc-recursive --info=progress2 alex@RemoteLocation LocalLocation
But I think it doesn't explore ...
5
votes
3
answers
5k
views
using rsync to quickly show only files that have different content
I've got a couple of disks which have a large set of files which are mostly the same. However, in a few cases there are files on one disk which differ from files on the other disk. There are also a ...
0
votes
1
answer
78
views
Perl/Bash Solution to Test if a Folder Has Changed, Then Create Copy of It
I'd like to put together a script for a very rudimentary backup system that checks a directory recursively for any changes since the date another directory (the backup) was created and, if it finds ...
1
vote
1
answer
553
views
syncing two folders into one, removing deleted files
Given folders named Drive1/Folder1 and /Drive2/Folder2 I want to have a folder /Drive3/folder3 that contains the synced merged contents of both the source folders, but does not contain any files or ...
0
votes
1
answer
4k
views
How do I solve the error "execv: No such file or directory" from rsync?
How do I solve the error "execv: No such file or directory" from rsync?
I'm trying to back up several machines to a linux server using rsync and it's working in most scenarios:
path-to-path ...
3
votes
1
answer
2k
views
Rsync to Linux from remote Windows 10 server
I have a Windows server which I would like to PULL data from using Rsync to my Linux server.
Installed openSSH and WSL with Ubuntu on the Windows 10 machine (build 1709) and currently - I am able to ...
0
votes
0
answers
539
views
Rsync fails when copying to a mounted NFS share in Ubuntu
I run the command to copy data between one server and another. The /remote dir is mounted via /etc/fstab as an NFS share.
root@server2:/usr/local/bin# rsync --bwlimit=10000 -axWSr --progress --timeout=...
1
vote
0
answers
166
views
How folder modification time affects unison file synchronization? (Windows)
I used unison to mirror a folder in Windows (using options -force and -times).
It worked well, but the folders modification time has changed in the destination and now original and new folders differs ...
2
votes
0
answers
902
views
rsync --ignore-missing-args not working
I'm trying to use rsync actually inside loop to backup a list of directories from remote.
I just want to ignore if src directory do not exists.
I got from most of the forums that --ignore-missing-args ...
-1
votes
2
answers
606
views
How would I rsync from SRC to DEST, verify the DEST file, then delete the SRC file? (rcursively)
I have two directories in a bash script held by these two variables
$SRC
$DEST
How would I do a rsync
copying files from $SRC/ to $DEST/,
Verifying that the $DEST/* files match the $SRC/ files (best ...
1
vote
2
answers
5k
views
rsync-like copy command on windows
tl;dr
I'm looking for a near-exact replacement for rsync --recursive --update on vanilla Windows.
details
What is a command, in Windows, that works like:
input:
a filesystem pattern (restricted to ...
0
votes
1
answer
4k
views
rsync extremely slow with exported/mounted folder, much faster with ssh
I have an NAS device set up as a backup for all my home systems, and currently it is set up to use ssh with code adapted from here. A shorted version of my code is:
NAS=192.168.1.143 ...
1
vote
1
answer
24
views
Permissions after swapping NAS drives
I’ll start with a list of facts:
I had a 1gb drive connected to my NAS.
I use rsync to backup a /folder with many subdirectories for a server (bbs software) in which the permissions and file ...
1
vote
1
answer
152
views
USB flash drive no longer recognised after copying files
I have an R+M USB 3.0 that is no longer recognised by my PC (running Windows 10). The disk appears greyed out, 0 bytes available, as in this answer.
I don't mind about lost data, what I want to know ...
0
votes
1
answer
154
views
Sync huge file tree with rsyncd, and encryption
I need to do daily copy of large file tree over the public internet, and do that effectively. As far as I know, if I use rsyncd on receive part then sync is done quite effectively since during file ...
1
vote
2
answers
647
views
Rsync doesn't work and reports total size is 0 speedup is 0.00 when the command is run
I saw this error and don't know why all file sizes are 0.
Command:
rsync -arvzh --delete public/ [email protected]:/var/www/blog/static-html/
Version Info:
GitHub action VM source OS is macOS 10.15
...
1
vote
0
answers
109
views
Cron a database dump on an external SFTP server
I have a command to dump a database in a local server, and want a daily backup of that database in an external SFTP location.
I checked out the scp command and it works smoothly, now I need (maybe ...
1
vote
1
answer
3k
views
Why do files disappear from an external USB hard drive when moved between Ubuntu servers?
Files saved on an external hard drive disappear when that drive is mounted to another computer.
I have two Intel NUCs running Ubuntu 20.04 LTS server in separate physical locations, each with a 2TB ...
1
vote
1
answer
5k
views
Which flags to use on rsync to achieve full replication?
Hi since I have searched stack overflow and did not get info about this, I need to ask again with specific requirements. I have an old storage with approx. 4TB of data and I would like to sync it with ...
4
votes
1
answer
731
views
Why does RSYNC use two reading processes with different files on my backup target?
Background
I have one server hosting virtual machines and one older NAS Synology DS1512+ used as backup target for those virtual machines. The server uses ZFS, creates snapshots and transfers the ...
2
votes
0
answers
345
views
Can rsync adjust sym-links to reflect their new location?
I have a directory tree that has internal, absolute sym-links, and I want to rsync it with a different disk. My problem is sym-links. After I rsync, the sym-links on the new disk all point to the ...
3
votes
5
answers
3k
views
Why rsync keeps sending same files each invocation?
I'm using rsync to copy file from Linux to Mac over SSH.
My command looks like this:
rsync \
--exclude FOO \
--exclude BAR \
-e ssh \
-rclpvih \
--delete \
--stats \
/local/...
1
vote
1
answer
567
views
How do I restore rsync backup files with the correct owner on a new machine?
I have backed up my home folder to an external (ext4) hard drive, preserving ownership and permissions. Now I want to do a fresh Linux install and then restore my home folder from the backup. But the ...
0
votes
1
answer
62
views
What is the best way to have a bi-directional off-site data backup where I manage both, but only have access to part of the data?
I convinced a friend to "share" data backup. He'd have some disks at his home where I can back up important data outside of my home (in case of fire or something like that), and vice versa.
...
0
votes
2
answers
263
views
Does using splitted VM-images make RSYNC-backups more efficient when using "--whole-file"?
I'm backing up some VMs of VirtualBox with somewhat large image files for their HDDs using RSYNC currently. Some of those images are 100 GiB in size, one is even 750. Backing those files up by letting ...
0
votes
2
answers
2k
views
Rsync Over SSH without PWD as Root -Catch-22
I have a remote directory that I want to rsync to my local machine over a ssh without a password because I want it be run as a cronjob (root user)
This command (no sudo) fails because it cannot write ...
0
votes
1
answer
199
views
Copy interrupted and difficulties to take it over by relaunch with cp -u or rsync
I have a huge data to transfer between 2 macOS (1.3 TB).
Unfortunately, my copy from mac1 to mac2 (by mounting the concerned directory of mac1 on mac2 as network directory), the copy with 'rsync' (...
1
vote
2
answers
3k
views
How to improve performance of RSYNC's delta transfer on receiving host using software only?
I'm using RSYNC to backup VMs for Virtual Box from one server to some Synology NAS DS1512+. The important point is that I really want to backup the VM-images itself, NOT individual files within those ...
0
votes
1
answer
49
views
I copied all files from /home/user excluding .ssh folder to another server (and could use passwordless ssh into it), now ssh requires password. why?
Both servers have the same user, I use rsync and exclude the ssh folder in /home/user/ , but every time I do this (part of my new server setup pipeline) suddenly I have to start typing the password ...
0
votes
1
answer
287
views
What is the random argument used with "rsync --server"?
I'm using RSYNC to backup files from two hosts to one other NAS and because of the amount of data to backup, the currently used settings of RSYNC etc. those two backups overlap currently. The NAS is ...
2
votes
1
answer
417
views
How to copy same file from different directories to different directories
I have multiple directories with the same file (remote) and I want to copy them to multiple directories on my local machine.
So lets say remote I have
~/remote_folder/folder1/Myfile.log
~/...
0
votes
0
answers
61
views
how to delete COMMON files in source and destination via rsync
Help!!! I mistakenly rsynced the source folder into the wrong folder, and now I don't know which files were from the rsync and which were there initially. Is it possible to use rsync to delete in the ...
0
votes
1
answer
161
views
rsync on macOS copies "phantom data" when drive disconnects
I'm trying to copy files off of a drive that is failing. It hasn't failed yet :)
Basically it keeps disconnecting every 30 seconds. macOS then automatically remounts it, but Finder is having issues ...
0
votes
1
answer
937
views
rsync ntfs/ext4 (windows/synology diskstation) incremental backup
Im trying to incrementel backup my windows server via rsync from my synology nas.
For that i mounted the windows server on my diskstation under /volume1/homes/multimedia
Then running rsync: rsync -av -...
2
votes
2
answers
391
views
secure data backup to remote server: scenario of compromised client
I want to backup some filesystem folders from a client to an external server. My goal is to have a secure backup on the external server even if the client gets compromised/hacked in any way.
I am ...
0
votes
0
answers
45
views
Ramdisk speeds on older server bottlenecked when rsyncing files vs dd
Why am I seeing poor copy performance in memory?
Background and details:
While testing a RAID 10 on an older server, I wanted to see whether or not other parts of my system were bottlenecking my ...
0
votes
1
answer
3k
views
rsync exclude directory and all subdirectories
I'm trying to use rsync to synchronise some of my data but I'm unable to exclude what I want. This is my directory tree:
tst/
├── st1
│ ├── st11
│ │ └── txt.text
│ ├── st12
│ ├── st13
│ ├──...
0
votes
1
answer
331
views
rsync: chown "/some-destionation-path/.somefile.jpg.pY2TRG" failed: Permission denied (13)
I'm doing rsync -rlptoghv for transferring a folder from XFS to ZFS. Usually, no problems arise. But sometimes, for some files (and I can't find a pattern), rsync fails to sync file permissions and ...
2
votes
2
answers
337
views
Why Can't I copy a folder to a disk that is larger than my folder?
I am using ubuntu 18.04-4 and want to move a large directory (yocto build directory for my project) from my ~/Desktop to an external drive (ext4 formatted). The external drive is a 512 GB empty drive. ...