Questions tagged [rsync]

Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.

Filter by
Sorted by
Tagged with
0
votes
0answers
18 views

rsync server: please follow symlinks in target directory

Background I have two Windows machines. The first - let's call it Newfs - is basically a file server. Newfs inherited all of its disks, except the boot disk, from another machine - let's call this ...
0
votes
0answers
13 views

One way sync from web server (cross platform) [closed]

I have files generated through a CMS and wan't to make a copy/sync these files to computer (Windows or Linux). Features that I am looking for: Download an entire folder - mainly json and images The ...
0
votes
1answer
53 views

Getting error while using Rsync on Cygwin

I am using rsync, to transfer data to HPC cluster, using Cygwin for windows 7. I type the following command to transfer a folder from my computer to the HPC remote server. rsync -rzv /cygdrive/C/...
0
votes
1answer
75 views

Copying Data from a hard drive to another hard drive with different partitioning

I have a System HardDrive - "sda", 64GB big with the following partitioning: sdb is a second harddrive, 128GB big, on which sda is cloned with rsync. It has only 1 partition, taking the full size of ...
0
votes
1answer
30 views

Gitlab and Rsync updates servers files incorrectly

I don't know how necessarily say this correctly, as I simply am not sure what is happening. I've got a website that is being updated using gitlab ci. When attempting to push new code today I received ...
0
votes
1answer
21 views

rsync - exclude files in directories with specific conditions

I am setting up an rsync based backup from our FreeNAS server to a QNAP server. The structure looks something like this: Sequence ├── SHOT01 │ ├── comp │ │ ├── work │ | │ └── images │ |...
0
votes
0answers
16 views

Rsync include certain files and directories but do not send directories that end up empty because of the include

This seems to be a bit of a specific question as I have found many that resemble it but are slightly different. The idea is to include certain directories from within a node_modules directory but not ...
1
vote
0answers
14 views

Why can't rsync hard link certain files on a Mac?

I am running rsync to sync files from Linux to a mounted Mac OS X (HFS+) disk image. I am getting a lot of errors of the form: rsync: link "/Volumes/Archive/blahblahblah" => blahblahblah failed: ...
1
vote
2answers
37 views

Cloning hard drive with rsync and accidently deleted home folder

I want to replace my old SSD hard drive with a new one that has double the size, but somehow fail to understand how rsync is working. I read this post Copy entire file system hierarchy from one drive ...
0
votes
0answers
7 views

Why simple-mtpfs rsync stalls when transferring files?

I am mounting my USB-connected Android phone in my Linux box with the command simple-mtpfs -o allow_root -o enable-move /mnt/phone It mounts fine, I can see both my internal and external storages, ...
0
votes
0answers
19 views

rsync --hard-links not working?

I am trying out the --hard-links flag in a test rsync run to see if it works to preserve the hard links in my source directory as opposed to making separate copies of the files - which is what I'm ...
3
votes
2answers
778 views

Are backed up files from an encrypted /home folder themselves encrypted?

I'm setting up my backup and restoration scripts on my Linux Mint machine to an external hard-drive using rsync. When I installed the system it was marked the option to encrypt the /home partition. ...
0
votes
1answer
18 views

rsync command with multiple jump servers

I have a server than I can only access via 2 jump servers: user@mylaptop$ ssh jumpserver1 ssh user2@jumpserver2.other.network ssh targetserver "bash -c 'hostname;whoami'" targetserver user2 ...
0
votes
0answers
14 views

Rsync inflation and hard links

Super simple question here (hopefully). I'm using rsync to copy over/update a large (6TB) directory from one Synology NAS to another. I'm dealing with a size-inflation problem of the source ...
0
votes
1answer
68 views

trouble with spaces in environment variable in rsync script on MacOS

I have a Bash script that I plan to run for daily backups (my HOME is /Volumes/Norman Data/me): #!/bin/bash # Halt the script on any errors. set -e # Remote server where remote_server="example.com" ...
0
votes
0answers
14 views

Exclude files matching literal of wildcard

I would like use the rsync option --exclude-from to exclude a file containing expressions that exclude file paths with the following characters: |, :, ?, >, or <. It is unclear from the Rsync ...
0
votes
1answer
27 views

Why does it say no space available when a lot are avaliable?

$ df -h Filesystem Size Used Avail Use% Mounted on /dev/sda1 30G 290M 28G 2% / devtmpfs 63G 0 63G 0% /dev tmpfs 63G 0 63G 0% /dev/shm tmpfs ...
0
votes
0answers
14 views

lsyncd: restrict users to modify file

So, I have a following setup: srvRemote: vsftpd server ftp users are write only host: has a local directory mounted to srvRemote using sshfs (dirMounted) has a local log directory (dirLocal) ...
2
votes
0answers
34 views

Copy symbolic link and its target subdir to new dir

I have a dir with a symbolic-linked subdirectory: greg:/testA> ls foo -> alice alice/ I need to copy the link "foo-> alice" (preserve it at destination) AND the subdirectory alice/ to a new ...
1
vote
1answer
50 views

How to prevent a corrupted file from being rsynced to remote server and good/non-corrupted copy being on the destination deleted?

I am using this command: rsync -avzh --delete --progress source folder remote folder My source folder contains many video *.mp4 files. I want all the videos to be rsynced to a destination folder in ...
1
vote
2answers
83 views

Best way to compare two very large directories in Linux

I need to compare two directories on Linux filesystems on two separate servers in order to identify whether all the files from SERVER1 are present on SERVER2. The total data set is about 4TB of files ...
2
votes
0answers
86 views

rsync: send_files failed to open “filename”: Invalid argument (22)

I use rsync to copy files from a mounted davfs box.com folder to an ext4 partition. For files containing the symbols [, ", and {, I receive the following error: rsync: send_files failed to open "...
0
votes
0answers
196 views

rsync from Linux to Windows 2019 server makes no progress

I created a Windows Server 2019 VM on Google Compute Engine and installed sshd and rsync with choco. I can connect with ssh from Ubuntu 19.10. However a simple rsync --rsync-path=C:\ProgramData\...
0
votes
0answers
7 views

Profile rsync timings

An rsync command with a remote server takes a long time. How can I profile it in order to detect the main bottlenecks?
0
votes
1answer
36 views

rsync --remove-source-files that exist on remote

I'm periodically calling rsync --remove-source-files -r source/logs/ dest:logs/ to synchronize log files from a mobile unit with inadequate storage to my reliable server with ample storage. Sometimes,...
0
votes
0answers
31 views

Is there a way to keep two directories (on two servers) in sync with each other, truly?

I have two servers in AWS that we are using to store a software packages codebase that is accessed by the web application/server. /var/www/vhosts/application-dua/content/ This same folder structure ...
1
vote
2answers
32 views

DIfferent behaviours of rsync

According to what I have understood, rsync without the -o and -g options is meant to copy without changing the owner and group of the destination. However, I found out a very strange behaviour of ...
0
votes
1answer
53 views

Access drive by label under rsync/cygwin?

I have downloaded rsync for Windows. It uses cygwin. My rsync command is this: rsync.exe -W -a -v --delete --exclude=cache2 --exclude=Cache "/cygdrive/C/Users/user1/" "/cygdrive/F/backup/" As you ...
0
votes
2answers
68 views

Rsync don't create directory at target if if doesn't exist

I have set rsync to backup the root filesystem on a Raspberry Pi to an USB drive every day using /usr/bin/rsync -ahPHAXx --stats --delete-during / /mnt/backup/pi-backup/. However, if the USB disk isn'...
0
votes
1answer
113 views

Terminate SSH Connections That Hang or Become Idle

I have come across some instances where an SSH connection on my Linux OS will become idled, freezing and staying open. Eventually, this causes a fork bomb and the following error messages: /etc/...
1
vote
1answer
38 views

Deal with reserved characters when syncing volumes with different formatting

I have a NAS and I want to copy some directories on it to an exfat formatted external HDD. Problem is paths / filenames may contain reserved characters for exfat (see https://en.wikipedia.org/wiki/...
0
votes
0answers
55 views

rsync - list all options alphabetically?

I'm just starting to get acquainted with rsync... it has hundreds of options, both short (single-dash) and long (double-dash). The man pages don't list these alphabetically, either under "OPTIONS ...
2
votes
1answer
142 views

Rsync from Mac OS to synology with btrfs having issues with file and directories that contain umlauts and similar characters

I want to copy a folder from my local Mac (Catalina with APFS) to my Synology (btrfs filesystem) on my local network. And all files that have an umlaut in it (ö,ä,ü,....) gets in trouble somehow. ...
0
votes
0answers
34 views

rsync: what flags to use to make it delete FILE /dest/foo and replace it with DIRECTORY /src/foo

What flags should I use to make rsync delete a FILE /dest/foo and replace it with DIRECTORY /src/foo? Also, the reverse, replace DIRECTORY /dest/foo with FILE /src/foo?
1
vote
1answer
242 views

rsync fails on MacOS for IPV6 addresses with “ssh: Could not resolve hostname”

Copying files with rsync to a remote computer using the remotes IPv6 address fails on MacOS 10.14.6. It seems that the IPv6 address is not correctly forwarded to ssh, but all my attempts using ...
0
votes
1answer
173 views

Lsyncd 2.2.2 ownership and permission issue

I'm having an issue where files are been copied to the remote server except the owner/group of replicated files on the target server is always '1002'. The permissions of the source are respected and ...
1
vote
0answers
15 views

How to use rsync with --delete while leaving non-backupped directories intact?

I know that there are quite a number of “rsync and symlinks” threads, but I can’t find one that applies to my problem. I want to use rsync to make backup copies of a /home partition, with the added ...
2
votes
1answer
408 views

How to verify rsync daemon on a remote server is accepting connections

I've got an rsync daemon running on an android phone. I just want to netcat the rsync port on the phone (configured on 1873), to verify the daemon is up and listening to the port, but strangely the ...
0
votes
0answers
24 views

Mirror remote directory locally and update remote on local change

I currently have my source code on machine A, and I want to be able to access that source code from machine B and machine C The idea being, I use one central point to store the source code, then I ...
0
votes
1answer
60 views

How would I get files deleted from source before all files are finished copying?

Background I'm using rsync to download a whole bunch of large files, from a webserver to my local machine (running rsync off the local machine). On the webserver end, it is important that these files ...
0
votes
0answers
31 views

How to transfer the creation date of a file with rsync or similar on MacOS

Actually rsync is not able to manage the copy of creation time. Although you use the -a (which includes -t) and -E flags, it still copies all metadata, but in terms of dates it copies only last modify ...
0
votes
0answers
76 views

permissions issue when running rsync via crontab

I'm using rsync to backup directories on my local machine to a remote server. I have SSH key-based access set up and working for my user, so when I run the command: rsync --update -razvP --progress ~/...
0
votes
0answers
18 views

Another RSYNC issue regarding syncing only specific subdirectories

I have a dir structure like this: /srv/web/project_a/modules/module_b/data/files/ (here files and subdirs) /srv/web/project_c/subdir_a/subdir_b/files/ (here files and subdirs) I would like to sync ...
0
votes
0answers
37 views

rsnapshot/rsync - excluding directories with identical names in different backup sets - will this work?

The challenge: I have discovered that at a fairly complex client (multiple locations with multiple machines per location), one of the staff has created directories named Archive on different machines. ...
0
votes
1answer
102 views

Strange Rsync behavior between two Linux machines - SOLVED

Machine A: Debian Testing (SparkyLinux 6) rsync 3.1.3 Machine B: Ubuntu Ubuntu 16.04.6, rsync 3.1.1 I have a bash script to backup a directory to a network connected machine. I have tried it both ...
2
votes
1answer
41 views

`rsync` ignores file containing ñ

I am using rsync -avp and one directory containing ñ is completely ignored. Is this a bug in rsync?
0
votes
0answers
209 views

SCP stuck on file copying

I have a test file with a simple text inside. If filesize more then 750 bytes I can not transfer it via SCP or rsync. Internet works fine on the host and has Download: 16.53 Mbit/s Upload: 2.83 ...
0
votes
1answer
78 views

Quick permanent erase with 3 modes of unnecessary files, short time and recovery search optimisation [duplicate]

My sister asked me to back her photos up to my external HDD and to format his laptop. Days later, my external HDD suffered a fail, resulting in loss of photos. I used Windows' Recuva, Linux's RD-Linux ...
0
votes
1answer
77 views

Rsync is not deleting files and complains of “No space left on device (28)”

I am using rsync (2.6.9, protocol version 29) on macOS 10.14.6 (Mojave) to backup a disk with videos. The source has 999GB capacity with 75GB free and the backup has 1TB capacity. The command is: $ ...
0
votes
1answer
167 views

Selectively uploading multiple folders to AWS S3 using CLI

I have around 50 folders, which contain subfolders, I want to upload the folders and subfolders to an S3 bucket, while keeping the subfolders structure. I read I can use --include command multiple ...

1
2 3 4 5
24