Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange
Join us in building a kind, collaborative learning community via our updated Code of Conduct.

Questions tagged [rsync]

Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.

0
votes
2answers
20 views

rsync with cron job every minute issue

I am transferring files over the network using rsync in cron job that runs every 1 one minute, task is whenever new file come it has to start uploading on remote server: Since I am new so doing big ...
1
vote
0answers
25 views

Rsync and accents in filename on macOS

When I use rysnc to backup my media hard drive that's plugged into my Ubuntu server using the command rsync -av --delete source destination it deletes and recopies all files that have accents in them, ...
1
vote
0answers
27 views

rsync-3.1.1 not syncing with rsync-3.1.3

I recently upgraded to Rtools-3.5 (ancillary to this question) which includes rsync-3.1.3. On a different laptop using Rtools-3.4 (rsync-3.1.1), a simple command of rsync -aHAX remote:/path/to/dir/* . ...
0
votes
0answers
3 views

Why does rsync -x copy files under a bind mount?

I just learn that the -xx switch has different behavior than the simply -x However, I'm confused as to why a single -x still traverses bind mounts on the source side? The man page (below) seems to ...
0
votes
0answers
11 views

Rsync displays wrong speed (grossly overestimated)

I realize that there are many threads about rsync. In any case, I did not find anything about a gross overestimation of displayed copy speed. At this moment, speed optimization is a the priority, ...
0
votes
0answers
11 views

Are the commands in the detached GNU Screen slower?

Sometimes, I use GNU Screen program to execute some long copying task with rsync. However I notice it takes so much time. I would like to know if commands inside GNU screen are slower than "normal" ...
0
votes
0answers
10 views

rsync seems to ignore chmod

I'm trying to rsync files and folders to a remote location through ssh. On the remote location (/home/public_html/my_project/) I have the setgid set in order to have new files and new folders created ...
0
votes
0answers
18 views

Copy directory but not recurse

I want to copy a directory without recursing, preserving "everything", sort of like cp -a except that -a will do the unwanted recursing. The reason is I am making a script to copy/backup from an ...
0
votes
1answer
33 views

How to merge multiple folders together using rsync

I want to use rsync to merge these multiple folders together into one folder. Each folder contains unique file names so there are no conflicts in terms of filenames. My folders are the following ...
0
votes
0answers
20 views

rsync on Cygwin: rsync: [sender] write error: Connection reset by peer (104)

I'm trying to rsync some files to my phone from Windows, using Cygwin. I'm trying to make it work via ssh on USB tethering as described in the comments here. I have SSHelper on my phone. My command is ...
-1
votes
1answer
73 views

Windows Linux Subsystem - Accessing restricted Files outside of WSL

I want to run rsync from within WSL and backup my windows copy. (Because the windows tool does not work. If you use it, check your backups! Anyway, so...) I am mounting my backup drive with sudo mount ...
1
vote
1answer
60 views

rsync on Windows

I'm new to rsync and need some help with syntax or common understanding. I have 3 servers: Source (SRC) Destination (DST) Server where rsync and ssh are installed. I use rsync from Cygwin Note:...
0
votes
1answer
7 views

rsync fails to transfer specific files

I use rsync to backup my ~/Document to an external drive, as shown in the Image. Since adding a new folder containing html pages, it hangs during transfer. When I move the folder to the trash, it ...
0
votes
0answers
7 views

Can I tell rsync to create folders just-in-time so that I can get an idea of what files have been copied so far?

When I rsync a large directory, it seems that the first thing rsync does is recreate the entire folder structure, then start copying all the files. This makes it difficult to determine what folders ...
0
votes
0answers
19 views

Io fall very low when using network

Hello I use manjaro linux from some mounth. My computer work really well but when i am downloading something it start to be really slow even when i have an ssd and fiber. Yesteday I tried to download ...
2
votes
0answers
14 views

How to copy Epichrome (SSB Chrome) apps to other workstations with active Extensions?

Epichrome is an absolutely great tool when it comes to site-specific-browsing. I've found it's useful to be able to copy Epichrome apps to other systems, however it appears that Chrome itself must ...
0
votes
1answer
28 views

Rsync options I should use to clone external drive

I need to clone an external drive to another identically sized drive. Rsync seems like the best simplest option for this, and I'll just hook it up to a cron job to run periodically. But what options ...
0
votes
0answers
31 views

Rsync No such File or Directory

I am getting an error from rsync.exe saying a directory not found eventhough it does exist. I am calling this via C# Here is my rsync call and the error rsync.exe -rtvv --modify-window=2 --exclude=...
0
votes
0answers
41 views

rsync remote to local only files older than certain time

I want to rsync from a remote to local files that are older (or newer) than a certain time. I've seen answers that say find /src/path -mtime -1 | rsync ... but that only work if the dir is seen ...
0
votes
1answer
16 views

Rsync from “files-from” list but also delete extraneous files in destination

I'm using rsync to load my mp3 player with music from a text file, and as such I'd like to delete extraneous files that aren't included in the "files-from" list. (Say if I no longer want a particular ...
0
votes
1answer
69 views

Use rsync with nc as transport layer

By default, rsync uses ssh as a transport layer. Unfortunately with fast local network, ssh is very slow. Is it possible use rsync with netcat / nc ? I have make some experiments, but it does not ...
0
votes
0answers
17 views

File possibly 'corrupted' after copying using rsync command in Ubuntu

I used rsync to copy a 19.2GB .pst file (Outlook files extension) from an old hard drive to a new one using rsync -avzPSX Outlook\ Files.pst /media/new_drive. I read that the -z option compresses the ...
0
votes
1answer
260 views

How can I backup remotely the entire Linux server using rsync over SSH?

I own a CentOS 6.9 box I need to backup remotely my entire CentOS installation to my Rsync.net storage account through SSH. How would that be possible including incremental updates and excluding ...
0
votes
0answers
21 views

ssh can rsync in WITHOUT a passkey (not good)

I have an Arch Linux SSH backup server. I use this server to backup all my files with rsync. I am using root to do this. All of my Linux systems are required to input a passkey as well as the root ...
0
votes
0answers
94 views

Rsync detect move without --delete-after function possible?

Iam woking on a bash script witch rsysc's between two NAS devices Onsite and Offsite. The goal is to have a backup off the onsite NAS on the offsite NAS. We working on the onsite map with quite big ...
0
votes
0answers
12 views

copy files and directory structures using rsync while appending files with similar names

I have this setup: NODE123 # cd /var/src/ NODE123 # find . . ./dir1 ./dir1/dir2 ./dir1/innerf ./log ./messages and NODE123 # cd /var/dest NODE123 # find . . ./dir1 ./dir1/dir2 ./dir1/innerf ./log ....
1
vote
1answer
75 views

When is -av NOT the appropriate option for rsync?

I somehow never really get around to learning the use of rsync – whenever I need to do some copying/syncing, I think about it, then decide nah, I'll just use scp. Which is probably not a good idea ...
0
votes
0answers
25 views

Making rsync run a special command both locally and on on remote host before performing copy

My situation is as follows. I use rsync to copy some special files from a remote host to a local host. I call these files special because they are protected by a special group My useraccount is part ...
2
votes
1answer
62 views

How can I do an efficient incremental backup to cloud?

I have a folder that contain files of current and previous projects that I plan backup using versioned rsync. For more a more robust backup strategy I want to store a monthly snapshot offsite (eg ...
0
votes
0answers
76 views

How do I mirror sync on Xubuntu from a SSD NTFS partition to an Android SD Card through MTP?

I've decided to switch to a Linux OS since it's lighter and faster than Windows 10. I've got most of my usual applications running but Xubuntu 16.04.01 is really showing how terrible it is at handling ...
0
votes
0answers
58 views

Deploying pelican through gitlab CI

I have setup a Gitlab CI docker job to deploy a pelican blog using rsync+ssh. The problem is authentication. For this I have created a ssh key pair. Added them as secret variables to the Gitlab ...
0
votes
1answer
66 views

Capture actual rsync error

We are transferring files from local (Windows) to a remote system (Unix). On several setups we are getting Error Code #13. The man page says that it is Errors with program diagnostics. On our systems,...
0
votes
1answer
63 views

How can we transfer the logs form the running container to other server using Rsysnc?

I have already tried to publish the logs to the host machine(using docker run -v src:/des) now I want to transfer the logs to a different server Commands I've used : rsync -u -avze ssh source/* ...
0
votes
0answers
53 views

Qnap rsync to WD My Cloud EX2 Ultra

Trying to do multiple timed backups within a local network to another NAS (don't need to use WAN). Anyone have any experience/instructions to help with this? QNAP --> WD My Cloud EX2 Ultra
-2
votes
1answer
96 views

Rsync returns “such file or directory” when running command

I am new to Linux and I am using rsync in order copy logs from one server to another but the command I am running says directory not found. What is going wrong? 001 rsync -u -avze ssh /apps/container-...
1
vote
0answers
94 views

MacOS 10.13.3 rsync and terminal: filenames with scandic letters

I have a rsync backup script that copies my personal files to an external drive with rsync: rsync -vr —-delete --progress /Users/omistaja/Documents/ /Volumes/MacExternal/Backups.Omistaja/ Edit: It ...
2
votes
1answer
113 views

Find NFD-encoded filenames

I have rsync'd a directory from a Mac to a linux box containing files and folders with special characters (umlauts). Unfortunately, the Mac uses NFD encoding (thanks, Apple!) which rsync didn't ...
0
votes
0answers
52 views

Efficient off-site Windows system image backup

I want to create efficient offsite System image-based backups of a Windows machine over a slow WAN connection (6 Mbit Upload) on regular basis (e.g. once a week). The Image is 71GB with no ...
0
votes
0answers
147 views

copying files from external HD to Shared folder using rsync on Mac os X

I'm trying to move/copy files from an external HD to the Shared user folder. (I'm running Mac Os x 10.11.6 El Capitan) Due to the fact that the Shared folder isn't really shared (https://apple....
0
votes
1answer
29 views

I am trying to push a directory to a server using rsync. What is wrong with this command?

I am trying to push a directory to a server using rsync. What is wrong with this command? Hello, I am trying to push a directory to my computer running SSH on port 2222. See below. I get a ...
0
votes
2answers
141 views

Is there a way to backup deduplicated NTFS drive with rsync or other linux tool?

Is there a Linux way or a tool that is aware of Windows Deduplication on NTFS? Here I use rsync to sync files from a AD file server shares. The shares are mounted, readonly, using mount.cifs on linux. ...
0
votes
0answers
55 views

rsync with a remote keep asking for password

I own a server and I have created a bash script calling rsync which I want to make automatically run on my laptop every hour, but I am not able to get rsync working without it asking me for the ...
0
votes
1answer
15 views

`rsync src/ des` vs `rsync src des` not working with `--files-from`

I have the following folder structure src ├── sub0 ├── sub1 └── sub2 and I use the command rsync -avh src/ des in order to copy the content of src inside a folder named des. I am trying to ...
2
votes
0answers
292 views

rsync exclude a folder containing a .git sub dir (--filter)

I want to backup multiple folders. In this multiple folders I want to exclude all directories, which contain a .git subdirectory. So for example in this folder hierarchy: ├── gitrepo <-- ...
0
votes
1answer
40 views

SSH fails with host key error when sending a command, but works without one

I am setting up a server to be able to support SSH with host key authentication which is currently handled by an old dying server. As of right now I can successfully connect with SSH and interact in ...
1
vote
0answers
146 views

Remote sync without rsync

My setup is as follows: Two Linux machines running Debian 9 A "storage box" on the internet rented from a cloud hosting company. This box can only be accessed via the SFTP, Samba and WebDAV protocols ...
0
votes
0answers
179 views

Rsync on Windows to external drive

I have installed cwRsync on a Windows 7 machine. I am now attempting to backup the contents of C:\testFolder to E:\BackupFolder I have ran rsync -avr C:\testFolder E:\BackupFolder But rsync is ...
1
vote
0answers
71 views

How to stop rsync from canceling when encountering a symlink without a referent

I use rsync to backup home dir of my computer 1 to computer 2 like this: rsync --recursive --archive --copy-unsafe-links --hard-links \ --delete-after --fuzzy --compress --human-readable \ ...
1
vote
2answers
764 views

why is scp faster than rsync?

I always got the impression that rsync should be at least as fast as scp. But here I have a problem. When I use rsync -avr to copy data from the remote machine, I get something like 11 mb/s. If I use ...
0
votes
0answers
34 views

Autosync folder with external drive on Debian

I have a HP MicroServer running Debian 9, with a raid 1 array, on which I have a 'photos' folder. Needless to say, that folder is very important. I also have an external HDD, which I would like to ...