Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [rsync]

Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.

0
votes
0answers
3 views

macOs copy and rsync commands exit with “Argument list too long”

I am trying to copy a directory of images to another location, however, I am getting the following errors ┌─[jlroberts@Jeffreys-iMac]─[~/Projects/pila] └──╼ cp -R old/site/app/webroot/plate_images/* ...
0
votes
0answers
9 views

Cygwin rsync backgroud job

We are moving windows server from a very old version (2008) to a new one. We are putting the storage on a nfs system that will be shared between several servers. All good and well - but the 2008 ...
0
votes
1answer
24 views

How can I use rsync to backup personal files to an external hard drive or network drive without having permission related issues?

Background What is the "correct" method to use rsync to backup data? The reason why I ask for the "correct" method is because my past experience of using rsync has resulted in permissions, file/...
0
votes
2answers
74 views

Backup files from server (static IP) to home server (Dynamic IP)

I am already familiar and use rsync, scp transfers, tar, 7z etc however none of which solve a backup I intend to do rather regularly. I have a remote server with 80% used space on 100GB SSD that I ...
1
vote
1answer
28 views

Using rsync to write specific data from a complex file structure

I am looking to use rsync to write log data to an external USB drive connected to a linux server. The command below is writing all data and not just from October. sudo rsync -av -r --progress --...
1
vote
0answers
24 views

rsync: listing only changed files/attributes

I am trying to achieve the following: In order to check whether I correctly rsynced all data from my old NAS to my new, I am executing: rsync --rltD -hvinu /path/to/old/NAS/ /path/to/new/NAS Now: -...
0
votes
1answer
23 views

rsync - unexpected remote arg

I am trying to rsync a folder from remote to local but get an error below. I have looked in many threads but can't find a solution that works. kong@kong-P15SM:/media/kong/Elements$ rsync -r -i /home/...
0
votes
0answers
20 views

rsync spawning excessive threads

The objective is to use rsync to synchronize a daily single .gz backup file. The command is: rsync -auvx /backup/source/*.gz /save/dest/ The files are on two separate systems; the source is mounted ...
0
votes
0answers
20 views

Sending large backups over unreliable and slow internet connection

I have several remote computers running an application. This application has a backup feature, zipping configurations, the program itself, the database, etc. This file is, let's say, about 500mb. The ...
1
vote
1answer
42 views

rsync sends file to remote daemon server but keeps original ownership and group

When running the following command, I hope the ownership and group id (o-and-g) is remained in the remote rsync daemon server. However, every file has the o-and-g the same as configured in rsync.conf, ...
2
votes
1answer
34 views

Copy folders and keep their modified date

I want to copy a couple of folders and preserve their modified date for historic reasons and not to change the sorting I'm used to. I have tried using rsync with flags to preserve times and the ...
1
vote
0answers
21 views

Rsync between two remotes via a control server without agent forwarding or key sharing?

I have a control server (CS) that has SSH access to many others (H1, H2, etc). I would like CS to be able to initiate a rsync transfer between any two H* servers without those hosts knowing how to ...
0
votes
0answers
32 views

rsync transfer new files, remove transferred and identical files from source

I want to use rsync copy new files from source to destination and delete any files that were transferred successfully and any that were already in sync from the source. The only files that should ...
0
votes
0answers
35 views

File integrity is occasionally compromised after being transferred via Wifi / ssh with with scp and rsync

I have a Raspberry Pi 3 that I use as a media server (with Plex). The RPi3 is connected to my home LAN both via WiFi and via Ethernet cable. I use the WiFi to transfer files from my laptop to the RPi3 ...
0
votes
1answer
53 views

How to make rsync copy to symlinks?

I have to push data from a server to another. On the source, I have a folder (named vhosts) containing files, folders and symlinks. I want all this to be copied as files (not as symlinks) On the ...
0
votes
1answer
22 views

What is the most efficient way to migrate a website over SFTP without full SSH Access?

I need to migrate a reasonably large website to a new server for a client with the least amount of downtime as possible. Unfortunately the client's current host only allows SFTP access without full ...
0
votes
1answer
18 views

How do I make rsync skip files that failed to transfer?

My destination has FAT32 file system, but the directory to sync has files larger than 4G, which result in File too large (27) error. How can I tell rsync to continue to the next file when it ...
0
votes
0answers
18 views

Rsync mkstemp failed: Resource Unavailable

I'm developing a laravel project on my Windows 8.1 64 machine with the latest Vagrant VituralBox Homestead box installed. I have the following in my yaml file authorize: ~/.ssh/id_rsa.pub keys: -...
1
vote
1answer
34 views

Can Unison be made to ignore bind mounts or hard links?

I'm looking for the best way to sync my home directory to and from a 120GB USB drive. The catch is that I use bind mounts (which I don't want to be followed) and hard links (which I do want to be ...
0
votes
0answers
42 views

Rsync on Windows issue

I want to get SQL database file from a remote machine using rsync. I've already installed DeltaCopy on my Win7 PC, but all I have is the one URL: rsync://export@10.123.101.225/folder/dmp_db.sql.gz ...
0
votes
0answers
15 views

Why, if NFS is sharing the destination, is it recommended to use rsync --omit-dir-times?

From the rsync manual: -O, --omit-dir-times This tells rsync to omit directories when it is preserving modification times (see --times). If NFS is sharing the directories on the receiving side,...
2
votes
1answer
117 views

Can I hard link files with rsync instead of copying them?

cp -l hard links files instead of copying them, saving filesystem space. I need to use rsync instead of cp because of its --exclude capabilities. So my question is, how do I get rsync to hard link ...
1
vote
1answer
43 views

Storing and displaying dates in a script (bash)

On my Linux (Ubuntu) I have a very simple backup script, essentially: rsync <params> dir_src_a dir_dest_b rsync <params> dir_src_aa dir_dest_bb rsync <params> dir_src_aaa ...
3
votes
1answer
149 views

Ignore line endings when using Rsync

I want to sync two directories. The first one has CRLF and normal line endings, the second directory also has files with CRLF and normal line endings. The problem is, when I execute this code: ...
4
votes
1answer
132 views

Very slow on USB i/o

(Disclaimer: Linux noob switching from Windows 7 to Linux.) I have a dual-boot PC with 3rd gen core i5 CPU (4 real cores), 12GB RAM and a 240GB Samsung EVO850 SSD. This system is not the fastest under ...
0
votes
1answer
44 views

Sync folder between two computers using both local network and cloud

I'm looking for a way to do the following: Sync folder A on my laptop with folder B on my PC by transferring any changes on one machine onto the other machine using the local network. If I modify ...
1
vote
1answer
102 views

Btrfs copy snapshot with rsync

So I have been searching for this up and down, but must be doing something fundamentally wrong. What I want to do: I have configured my NAS to make snapshots of my home folder, file system is btrfs. ...
0
votes
1answer
309 views

Rsync stopped working and returns “rsync error: unexplained error (code 255) at io.c(235) [sender=3.1.2]”

I am using rsync over ssh to perform backups from a client to a remote server. rsync -azLvv --progress -e 'ssh -p22 -vvv' --exclude 'foo' /home/user/ server.tld:Documents/backup/ It was working fine ...
0
votes
0answers
20 views

Reconstructing directory structure lost after rsync --remove-source-files

I expect the answer to this will be "sort the files manually and be extra careful next time", but here goes anyway in case I've overlooked something. Some time ago—months—I needed to free up space on ...
1
vote
1answer
57 views

Linux binary executable source

I am new to Linux. in the below commands, I can see rsync is listed in ls. but I am not able vi or cat to read it. bash-3.1# ls /usr/local/bin admenu canreqs cwtmp pidof procan rsync rsyncTransfers....
0
votes
0answers
141 views

How to exclude hidden files and include some hidden files in rsync?

I would like to backup my home folder in Linux using rsync. I am using the option --exclude=".*" to avoid backing up hidden files and folders. However, I would like to sync .bashrc and .bash_history ...
0
votes
2answers
107 views

rsync with cron job every minute issue

I am transferring files over the network using rsync in cron job that runs every 1 one minute, task is whenever new file come it has to start uploading on remote server: Since I am new so doing big ...
1
vote
0answers
60 views

Rsync and accents in filename on macOS

When I use rysnc to backup my media hard drive that's plugged into my Ubuntu server using the command rsync -av --delete source destination it deletes and recopies all files that have accents in them, ...
1
vote
0answers
125 views

rsync-3.1.1 not syncing with rsync-3.1.3

I recently upgraded to Rtools-3.5 (ancillary to this question) which includes rsync-3.1.3. On a different laptop using Rtools-3.4 (rsync-3.1.1), a simple command of rsync -aHAX remote:/path/to/dir/* . ...
0
votes
0answers
66 views

Why does rsync -x copy files under a bind mount?

I just learn that the -xx switch has different behavior than the simply -x However, I'm confused as to why a single -x still traverses bind mounts on the source side? The man page (below) seems to ...
0
votes
0answers
20 views

Rsync displays wrong speed (grossly overestimated)

I realize that there are many threads about rsync. In any case, I did not find anything about a gross overestimation of displayed copy speed. At this moment, speed optimization is a the priority, ...
0
votes
0answers
11 views

Are the commands in the detached GNU Screen slower?

Sometimes, I use GNU Screen program to execute some long copying task with rsync. However I notice it takes so much time. I would like to know if commands inside GNU screen are slower than "normal" ...
0
votes
0answers
41 views

rsync seems to ignore chmod

I'm trying to rsync files and folders to a remote location through ssh. On the remote location (/home/public_html/my_project/) I have the setgid set in order to have new files and new folders created ...
0
votes
0answers
20 views

Copy directory but not recurse

I want to copy a directory without recursing, preserving "everything", sort of like cp -a except that -a will do the unwanted recursing. The reason is I am making a script to copy/backup from an ...
0
votes
1answer
182 views

How to merge multiple folders together using rsync

I want to use rsync to merge these multiple folders together into one folder. Each folder contains unique file names so there are no conflicts in terms of filenames. My folders are the following ...
0
votes
0answers
132 views

rsync on Cygwin: rsync: [sender] write error: Connection reset by peer (104)

I'm trying to rsync some files to my phone from Windows, using Cygwin. I'm trying to make it work via ssh on USB tethering as described in the comments here. I have SSHelper on my phone. My command is ...
-1
votes
1answer
252 views

Windows Linux Subsystem - Accessing restricted Files outside of WSL

I want to run rsync from within WSL and backup my windows copy. (Because the windows tool does not work. If you use it, check your backups! Anyway, so...) I am mounting my backup drive with sudo mount ...
1
vote
1answer
753 views

rsync on Windows

I'm new to rsync and need some help with syntax or common understanding. I have 3 servers: Source (SRC) Destination (DST) Server where rsync and ssh are installed. I use rsync from Cygwin Note:...
0
votes
1answer
11 views

rsync fails to transfer specific files

I use rsync to backup my ~/Document to an external drive, as shown in the Image. Since adding a new folder containing html pages, it hangs during transfer. When I move the folder to the trash, it ...
0
votes
0answers
8 views

Can I tell rsync to create folders just-in-time so that I can get an idea of what files have been copied so far?

When I rsync a large directory, it seems that the first thing rsync does is recreate the entire folder structure, then start copying all the files. This makes it difficult to determine what folders ...
0
votes
0answers
25 views

Io fall very low when using network

Hello I use manjaro linux from some mounth. My computer work really well but when i am downloading something it start to be really slow even when i have an ssd and fiber. Yesteday I tried to download ...
2
votes
0answers
25 views

How to copy Epichrome (SSB Chrome) apps to other workstations with active Extensions?

Epichrome is an absolutely great tool when it comes to site-specific-browsing. I've found it's useful to be able to copy Epichrome apps to other systems, however it appears that Chrome itself must ...
1
vote
1answer
198 views

Rsync options I should use to clone external drive

I need to clone an external drive to another identically sized drive. Rsync seems like the best simplest option for this, and I'll just hook it up to a cron job to run periodically. But what options ...
0
votes
0answers
123 views

Rsync No such File or Directory

I am getting an error from rsync.exe saying a directory not found eventhough it does exist. I am calling this via C# Here is my rsync call and the error rsync.exe -rtvv --modify-window=2 --exclude=...
0
votes
1answer
126 views

rsync remote to local only files older than certain time

I want to rsync from a remote to local files that are older (or newer) than a certain time. I've seen answers that say find /src/path -mtime -1 | rsync ... but that only work if the dir is seen ...