Questions tagged [rsync]
Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.
1,393
questions
56
votes
5
answers
54k
views
Rsync files via intermediate host
I am currently away from my LAN and I need to do a backup of my laptop. I have a somewhat recent copy of my laptop on my server and I usually back the laptop up using rsync. Now I wish to do that, but ...
1
vote
1
answer
69
views
Unexpected results from rsync on iMac
I've asked this question on other forums, hoping for some guidance.
I have an iMac running 10.11.6 and have updated rsync to 3.1.2 (using homebrew). I am trying to use rsync to back up from my iMac ...
2
votes
2
answers
2k
views
Why does rsync update NTFS directories when the source has not changed?
I'm taking classes with lots of phonetic and grammatical analysis. They've given me an account on a Windows 10 network. Since I am much more comfortable with Mac and Linux (and since the Windows ...
1
vote
1
answer
661
views
Syncing immutable folders on linux (rsync/unison/some thing else?)
Consider the following directory layout:
/foo
/ABZE1
a1.txt
a2.txt
...
a59682.txt
/BBSDF
b1.txt
b2.txt
....
b42333.txt
...
foo is the parent folder, ...
3
votes
2
answers
10k
views
How to rsync files older than x min on linux
Here is what I have now:
rsync --remove-source-files -vr user@server:/foo/bar/in/ /some/local/path
Is there a way I can instruct rsync to only fetch files that are older than x min/hours from the ...
3
votes
0
answers
539
views
Rsync strangely gets auto killed and then binary is broken
I got a strange situation with Rsync on my remote Ubuntu 14.04.3 LTS (Trusty Tahir) instance.
Whenever I execute it, it runs for a while (not completed) then seems get auto killed. After that it's ...
1
vote
2
answers
2k
views
How do I copy a file from one server to another without downloading first?
Is it possible to copy a file from one server to another without downloading first?
I have a backup file that is 10gb that I'm wanting to copy from my production server to my staging server.
...
0
votes
1
answer
155
views
Could RSync be used to backup Parallels vm to KVM?
So I am currently using Parallels on my macbook pro but I am wanting to also use them on my desktop, which uses KVM.
Since I don't believe KVM can read the parallels file format, would it be possible ...
2
votes
1
answer
3k
views
How to interpret extended attributes on MacOS X?
I have a problem with rsync (version 2.6.9 which is outdated, but this is another problem) not correctly synchronizing files from MacOS X to MacOS X (versions Mountain Lion, Mavericks, Yosemite and ...
15
votes
2
answers
16k
views
Why does rsync over SSH give me 10x the throughput of SCP?
scp user@aws-ec2:~/file file
rsync --partial --progress -Pav -e ssh user@aws-ec2:~/file file
scp only gives me 200K/s, but rsync gives me 1.9M/s
I tested several times, all same results.
rsync ...
2
votes
2
answers
10k
views
Rsync only certain directories and only certain sub-directories within them
In /opt I have many different directories, some of which contain _pkg_linux_deb_ or _pkg_android_apk_ in the middle of their name. Those directories also contain many sub-directories, one of which is ...
2
votes
3
answers
3k
views
File synchronization on Linux over network: scp or rsync?
I have two Linux (Debian) machines "A" and "B" connected to each other wireless over the router.
On the machine "A" I run a script that generates every 5 seconds a new 1MB file in the specific ...
3
votes
0
answers
2k
views
rsync SSD migration: lsetxattr failed: Operation not supported (95) -- consequences?
I just got an SSD and have been trying to migrate to it, poring through tons of how-to's I finally decided on this command (I have multiple partitions that needed migrating):
time rsync -avHAXx /...
2
votes
5
answers
13k
views
How can I check whether rsync transfered files or not?
I use rsync (cygwin) to transfer files between server and my PC.
Rsync runs every 2 minutes, and sometimes there are some files to transfer, sometimes not. I need to execute some actions, but only ...
1
vote
1
answer
536
views
rsync creates wrong backup directory names with a middle dot (·)
Under Windows, I use rsync to periodically clone some directory to ${LATEST_BACKUP_DIR}. I also use the --backup-dir="${OLD_BACKUP_DIR}" option to keep backups of files' old versions that have changed ...
0
votes
1
answer
365
views
Inplace modification of incron monitored files
I have samba share where users create video files, i need to stripe audio tracks from that video files and rsync new files to remote folder.
I monitor the samba share with CLOSE_WRITE option, to strip ...
0
votes
2
answers
40
views
Can rsync be used to update restoration hdd?
I have two identical hard disks (say HDD1 and HDD2) with 4TB capacities. I want to create install CentOS, update it, install services and create users on one of the hard disk, say HDD1, meant only ...
0
votes
1
answer
969
views
rsync isn't understanding what is the relative part in --files-from=FILE
I've a file that looks like this:
/cygdrive/d/path/to/my/file1.png
/cygdrive/d/path/to/my/file2.png
/cygdrive/d/path/to/my/file3.png
/cygdrive/d/path/to/my/file4.png
I'm calling rsync with:
rsync --...
13
votes
1
answer
21k
views
warning message "kex protocol error: type 7" during scp, rsync or shell work
Lately, I get lots of these errors on my home server.
Their occurrence seems proportional to the traffic, so if I am working in a shell on the server I may seem 1-2 a day. But If I start some rsync, ...
1
vote
1
answer
2k
views
Diagnose why rsync is or is not copying certain files
I have a script that uses rsync to fetch files from a remote server, then process them. These local copies are not deleted between runs, so rsync should only have to fetch new files. However, it seems ...
0
votes
2
answers
1k
views
Patch a very big binary file over a slow connection
for backup purposes, I have transfered a very big binary file over a comparably upstream-wise slow connection (transfer took 2 weeks), by rsyncing it on a mounted cifs-share (so I could and can access ...
1
vote
1
answer
445
views
Performance with multiple instances of rsync across different direct-attached storage devices?
Would running multiple instances of rsync with all the sources and destinations on different direct-attached storage devices cause any performance hits, or would the speed limits for each individual ...
13
votes
5
answers
5k
views
How to get rsync to not print directories
I use rsync to create backups on an external hard drive. I usually run a dry-run first just to sanity check. Specifically, I will use
rsync -auvn path/to/source path/to/dest
However this prints all ...
1
vote
1
answer
143
views
Why would rsync be limiting syncs to ~252Kilobytes?
Here's a head scratcher for you... or at least it is for me.
I am transferring a Wordpress site away from WP Engine to an Amazon instance.
I am trying to upload the original Wordpress files from my ...
1
vote
1
answer
721
views
How to find the user who is running rsync?
In Linux, if rsync is already running, how can we identify which user is running it? And what if it is running as cron job, will the cron job user be different?
6
votes
2
answers
11k
views
rsync error - Unexpected remote arg: [email protected]:/*
I'm trying to migrate centos server to a new box with rsync and I run this command in the destination server:
rsync -auHxv –numeric-ids –exclude=/etc/fstab
–exclude=/etc/sysconfig/network-scripts/* ...
0
votes
1
answer
278
views
Chain several ssh tunnels
I'm new on this forum.
I have the following configuration:
my_computer gateway1 gateway2 host_to_reach.
I can access gateway1 only with an ssh tunnel which has been created by a server where I have ...
2
votes
0
answers
2k
views
How to force rsync to stop if destination disk is full?
I am using rsync (version 3.1.0 on a centos) to do some backup task. I develop a software that monitor my rsync processes to fit the backup configuration to my buisness logic.
My software launch some ...
0
votes
0
answers
391
views
rsync, symbols not resolved but libraries found
In an embedded system I can't run rsync:
$ rsync
/usr/bin/rsync: symbol 'poptHelpOptions': can't resolve symbol
/usr/bin/rsync: symbol '_poptBitsN': can't resolve symbol
/usr/bin/rsync: symbol '...
0
votes
1
answer
4k
views
Linux rsync without recursive folders
I have a hierarchy of folders and want to rsync the file contents of one to another.
So a simple rsync dirA to dirB
However without the recursive element it does not include the files in the folder.
...
0
votes
0
answers
168
views
rsync is copying all files
I have 3 servers, two of which share a drive with nfs, and other server and nfs driver share data with rsync. changes made on 3rd server transfered to nfs drive via rsync. earlier it was working fine,...
1
vote
0
answers
4k
views
Problems with rsync and ssh-key
I created a ssh-key to log into my CentOS VPS, altered the default port to 2020 and disabled password connection, so I can only log in this VPS using the key (that need a password to be unlocked). My ...
1
vote
1
answer
1k
views
Can rsync use a remote environment variable?
Say I want to use rsync to copy a remote folder to my local desktop:
rsync -av remote:$REMOTEDATA $LOCALDATA
But I want to access the $REMOTEDATA environment variable on the remote server, not the ...
-1
votes
1
answer
292
views
Linux - Copy a folder including the subfolders, BUT don't copy any file that is over 5MB
I'm managing 2 linux servers and looking to copy the data from one to the other. I'm looking to just copy these files on one server first then zip it and then scp it over.
I need to copy a 100GB ...
1
vote
1
answer
61
views
How to make unique dump results?
I am trying to check if my read-only partitions in FreeBSD remains unchanged. I do this using dump:
dump -R -h 0 -0Laf /dumps/boot.dump /dev/ufs/boot
and then I compute its SHA256. I used -R to be ...
0
votes
1
answer
71
views
cloning hard drive as backup strategy - ensure bootable
I've found a number of similar scenarios on this site and serverfault but still unclear about one thing.
Basically I want to rsync from one 2TB drive to another 2TB drive and run this nightly.
In ...
-1
votes
1
answer
74
views
Ramdisk that persists old files
I've got a program that writes a file to disk, then another processes it. Usually this happens within a second or so, so the file is nearly temporary. To avoid disk IO, I write to /dev/shm. However, ...
-1
votes
1
answer
2k
views
Rsync --checksum does not catch changed files
I am transferring files from a Linux computer to a Mac. The connection sometimes drops and I restart. This is usually fine, but I check everything for a possible data corruption using md5sum.
With ...
0
votes
1
answer
2k
views
Can I check for multiple file extensions in one rsync filter rules file per line?
I have a working rsync script, which recursively traverses our directory structure and loads one .publish file per directory. Each file contains a list of files to be publish. Publish means to copy ...
4
votes
2
answers
7k
views
Upload only modified part of file using rsync
I am studying rsync to synchronize remote and local folders in windows(using cwrsync). I have a doubt that, is it possible to upload only part of changes ?
For example, I have a 100 MB file initially ...
0
votes
1
answer
330
views
External drive throwing ATA errors. What's the issue?
I have an SSD in my system and an external hard drive (attached via eSATA) as a backup medium. I use "rsync" to synchronize the internal drive to the external drive. My backup drive was once a Seagate ...
1
vote
1
answer
1k
views
synology: rsync via ssh requires full path
I found the following behaviour on a Synology RS814+
> ssh backup01 rsync
Permission denied, please try again.
> ssh backup01 'which rsync'
/usr/bin/rsync
> ssh backup01 'echo $PATH'
/usr/...
6
votes
1
answer
4k
views
How do you get rsync to load a list of (full rules, not limited like --include-from) filter rules from a file?
rsync has various options for reading various config from files so that you don't have to chain a bunch of individual --include or --exclude options together. All of these options (as far as I cantell)...
1
vote
0
answers
126
views
Rsync check available
Hi i have the following mesh from raspberry pi which is with protocol 802.11s.
In a pi5 with an ip 10.0.0.15 i have video capture who makes files in /home/pi/Desktop, And i need to make an arhive in ...
0
votes
2
answers
3k
views
Starting rsync command on every hour
im new in linux just want to asking you :
How to add this command to start every hour on the computer :
rsync -a --ignore-existing 130.68.124.219:/home/pi/Desktop/* /home/pi/test/
Thanks
1
vote
0
answers
563
views
rsync/scp without root password and without allowing root ssh login
This is the scenario. We have a multitude of servers, currently we simply ssh in as root using our keyfile and then when we need to rsync we use the root user.
All very easy.
What we would like to ...
1
vote
2
answers
2k
views
Time Machine size explodes when copied to new drive
I'm trying to replace a 640GB USB2 drive which I use as my Time Machine backup device with a 1TB FireWire 400 drive without losing the current backup history. Given that the 640GB drive is nearly ...
0
votes
1
answer
204
views
Is running rdiff-backup or rsnapshot save while source directory is written?
I'm wondering if it's safe to use rdiff-backup or rsnapshot on a source directory which is written to while backup is running. Will they backup a snapshot of source or will they eventually backup ...
1
vote
1
answer
2k
views
Why does rsync not create a hard link in my Backup Set?
I am trying to set up an rsync Backup from my Windows pc to my raspi. On the raspi I have an NTFS formatted usb stick.
When I sync files to the target everything works fine, except that rsync will not ...
11
votes
2
answers
5k
views
Unable to rsync to another volume with Git Bash
I use git bash on a windows machine: version 2.7.2 (32-bit version) of Git for Windows built on 2016-02-23 available from https://git-scm.com.
Within bash I can copy a directory from /c/ to /e/ (a USB ...