3
votes
1answer
20 views

Using pv(1) to limit rsync speed

I'm trying to use pv rather than rsync's builtin --bwlimit to limit the bandwidth of an rsync transfer because --bwlimit is implemented in an eventually-consistent way, and my transfers are so short ...
0
votes
1answer
24 views

Merging two directory trees with same structure, but different contents in Unix

I have two directories with the following structure: A |_0 |_1 |_2 B |_0 |_1 |_2 each 0,1,2 directory contains unique contents. I want all of the contents to simply exist as: A |_0 |_1 |_2 Is ...
1
vote
1answer
112 views

Does rsync delete files, folders at destination by default?

Files Suppose that /foo/src contains only A.c and that /foo/dest contains both A.c and B.c. And suppose I run the following command: rsync /foo/src/ /foo/dest Will rsync erase B.c? Folders Now ...
0
votes
0answers
39 views

Live rsync directory monitor

While developing websites locally on my Mac I would like it to sync with my remote server on changes to the files inside the x directory. I have looked around and found lsyncd which almost does what ...
3
votes
1answer
63 views

How can I rename files and subdirectories in a copied directory based on changes in the original?

I have a directory structure with many hundreds of files and folders underneath it for organising files (in this case photos). I create backups of that directory structure by rsyncing it to identical ...
2
votes
1answer
93 views

rsync via gateway ssh while defining .pem key

I need to sync my local files through a gateway to an Amazon EC2 instance that requires specifying my .pem key. I can do this as a three step like so (assuming no typos): rsync -avzh -e ssh ...
1
vote
2answers
75 views

Unix copy multiple folders based on a specified CSV list using rsync

I have done some research and it appears that rsync is the only method that can possibly help me achieve this. I want to specify a list of folders in a CSV which can tell rsync to copy them to ...
0
votes
1answer
442 views

How to have a complicated two way sync using rsync preserving deletions

I have gone thorough similar questions on stackoverflow but they dont cover the situation that I would like to ask here. I have all my music files on my remote machine. I would like to sync them to ...
1
vote
1answer
50 views

rsync all directories that start with a specific digit

I have directory loaded with thousands of sub directories: /home/tmp/ 1 12 123 1234 2345 234 3456 345 34 ...
2
votes
2answers
238 views

grep from one but not the other

How do I grep OUT the content of a file from another file Say I have a file "file1" and it has a b c and another file "file2" that has a b c d e f I would usually do cat file2 | grep -v a | ...
3
votes
1answer
65 views

Rsync with a little twist?

I have 3 drives. For this purpose, we will call them A, B and C respectively. A is 2 TB B is 1 TB C is 500 GB I have already run rsync -avz -progress A B Now B is full and I want to move/copy ...
0
votes
1answer
68 views

rsync specific dirs to another exact same path as before

I want to rsync dirs includes files from path to another exact path that has been rsynced from it For example :- path 1 have dir1/ dir1/mysql dir1/log1 dir1/log2 dir1/log3 dir1/home want to ...
1
vote
1answer
421 views

rsync from one source to multiple different target directories according to pattern?

Assume e.g. you want to backup all files matching pattern a to directory A and all files matching pattern b to directory B. The natural way to do this are two separate rsync commands. rsync ...
1
vote
1answer
609 views

How to avoid duplicates when copying files that have been renamed at the destination

I have to get pictures from a folder – with subfolders which are updated automatically – with their extensions. These files have to be copied in a folder where a website based on PHP will edit them ...
1
vote
3answers
2k views

scp certain files only

I am trying to copy changed files to godaddy via ssh. Godaddy is terrible and so they of course do not allow rsync. I can use scp, but I really only want to copy changed files. I don't think this is ...
1
vote
1answer
404 views

Is there a way to rsync in batches?

I have a huge chunk of data (11G) in a subversion repository that I'm using rsync to migrate to Alfresco, which lucene indexes new files as they hit the file system. I'm using a dav mount as a proxy ...
4
votes
1answer
877 views

How do I sync file permissions (chmod +x) with rsync?

I'm having problems synchronising file permissions with rsync. I'm trying to sync my /home/bin folder with the /home/bin folder on a remote machine. The problem is that when I write a new script and ...
1
vote
1answer
1k views

rsync and file permissions - linux

I'm trying to use rsync to copy a set of files from one system to another. I'm running the command as a normal user (not root). On the remote system, the files are owned by apache and when copied they ...
1
vote
1answer
548 views

rsync functionality wanted - but i need symlinks, not copies

Is there a way to perform what rsync does (compiles many directories into a single directory) - But instead of copying files/sub-directories I need it to create a directory with symlinks that point ...
0
votes
1answer
2k views

Get rsync to skip files with same size

I'm using the following command to copy a large number of big video files to external drives. rsync -Ph --inplace /Volumes/Production/Prefix* Prefix We had a power failure and the copying was ...
1
vote
1answer
796 views

rsync: avoiding deleting files that do not belong to a certain user

I am using rsync to keep a large shared document folder in sync with my laptop. More specifically, I am rsyncing FROM my laptop TO the shared repo. What I would like to do is rsyncing only those files ...
2
votes
1answer
431 views

Running rsync on network connect

I have one Mac which is always on and is my main computer. I also have a MacBook and I'm trying to sync my iPhoto library. So I can successfully use rsync to sync files. I'm using a cron to have it ...
1
vote
1answer
790 views

Rsync: Only preserve meta (time, group, etc) on files and sub-directories, not root directory

I am copying some files (all except hidden ones) using rsync from one place to another using this command: rsync -Cav --delete --exclude=.* /Some/Directory/ other-host:/Other/Directory It works ...
6
votes
4answers
4k views

Rsync over ssh, or something else?

I've been trying to use rsync on OSX to Linux or Unix box over which I don't have much control. I've been doing something like this rsync -avz -e ssh remoteuser@remotehost:/remote/dir /this/dir/ ...