Questions tagged [rsync]
Rsync is an open source command line tool for Unix and Windows systems that provides fast incremental file transfer to copy files and synchronize directories locally or between remote hosts. It is widely used for mirroring and backup.
1,393
questions
0
votes
1
answer
2k
views
Find modified files from rsync backup script
I'm using rsync on my Ububtu Linux server to take a time machine like backup of the system. Every hour, a cronjob runs the following script (partial excerpt):
rsync -a --link-dest=/backup/current --...
2
votes
1
answer
2k
views
Do Linux swap partitions need to be cloned?
I'm in the process of cloning my hard disk in order to test some unstable software.
One of the partitions is Linux-swap. From my understanding, it can be used by the os as additional ram. So this ...
2
votes
1
answer
1k
views
How to login a user with decrypted FileVault home directory?
I'm using OSX Snow Leopard and a FileVault protected home directory for my user. To backup my HDD I make a live rsync backup of a whole filesystem to external drive:
rsync [parameters] / /Volumes/...
2
votes
2
answers
4k
views
rsync fails after server restart
Usually I use the command
rsync -av --delete someroot/somedir user@remote_server_ip:/someroot/.
on my development server to synchronize somedir to a remote server. It worked fine. But after the ...
2
votes
3
answers
588
views
Single-user, multiple-computer versioning system
I have two computers (work and home) and wish to set up a version control system for source code and TeX documents. There are no collaborators (i.e., single-user/editor). Most of the source files are ...
4
votes
1
answer
4k
views
rsync from multiple sources
I have a 40G music collection that I need to sync to a server in another country.
At the moment I am rsyncing it across, however I have that same 40G collection on two machines with two internet ...
3
votes
4
answers
2k
views
Rsync on Windows XP works fine on-demand, but hangs when run as a scheduled task
I want to use Rsync to back up a web site to a Windows XP system that gets backed up to tape every night. I've looked at cwRsync and Grsync, and they both work fine, as long as I'm running them while ...
1
vote
0
answers
663
views
Rsync from Linux to Windows producing problems with back slash
I know if I was having an issue with rsync with characters I'd use --iconv= - but this issue is some file names have black slashes in them, and I don't have the ability to rename the original files.
...
5
votes
1
answer
2k
views
rsync with Cygwin creating weird directories
I'm trying to use rsync to backup data from a local shared drive to a remove server. Both the local machine and the remote server are running Cygwin under Windows XP. I use the following command:
...
12
votes
2
answers
9k
views
What if files change while rsync is running?
I am using rsync to copy ~10GB of small files. What happens if the files in the source directory are modified while rsync is running?
0
votes
4
answers
4k
views
Rsync with a list of variables
I am trying to write a bash script that will rsync only a specific subset of folders. I am trying to figure out a more slick so that I can just add a variables such as FOLDER1='name of folder in home ...
1
vote
2
answers
2k
views
rsync stuck with the --checksum option
I use back-in-time to backup my Linux installation. It serves as an advanced wrapper for the rsync command.
Today I tried to add /var/log to the list of folders to be backed up and it caused some ...
1
vote
1
answer
2k
views
How to avoid duplicates when copying files that have been renamed at the destination
I have to get pictures from a folder – with subfolders which are updated automatically – with their extensions.
These files have to be copied in a folder where a website based on PHP will edit them (...
1
vote
3
answers
9k
views
rsync option --log-file seems not to be working
I am using the --log-file option in rsync to see the logs. But when I tried to run, it says:
--log-file unrecognized option
Here is my command:
/usr/bin/rsync -av -u --log-file="/sreeni/log.txt&...
1
vote
1
answer
3k
views
Rsync and Windows 7
Can someone give me any tips on setting up some sort of Rsync server/client on Windows 7 to run rsync between both my web hosting server, and a backup server that I have running Ubuntu? I've tried ...
3
votes
2
answers
6k
views
Bash script: dealing with spaces when running indirectly commands
I have been struggling for a while with the folllowing problems I have written scripts in which any command run is first put into a string, and then executed. That way, the command is written only ...
14
votes
3
answers
14k
views
rsync complaining about `missing trailing-"` in a Bash script
Trying to rsync files from one server to the other in a screen session. Instead of writing the long command every single time, I decided to put in a Bash script. However, when I run it, I get a ...
0
votes
3
answers
310
views
Does rsync require 2 computers?
I am wanting to use something like rsync (i think). I am using Windows 7, I would like to be able to sync files/folder to other Disks on 1 computer, sometimes, just keep 2 folders or more in sync on ...
37
votes
9
answers
48k
views
Parallelizing rsync
I just moved and discovered after some trial and error that somewhere between my home and my remote server, there is some throttling going on...but the throttling is not very intelligent. It only ...
4
votes
2
answers
251
views
How to synchronize between differently structured directories using rsync (or other program)
Does anyone of you know how to perform the following task:
Suppose you have two directory trees, which I will call source and target. They may have a very different structure, but could contain many ...
4
votes
2
answers
3k
views
rsync over SSH with cron in osx-environment
I want to automatically download files and folders from a Linux server to which I have an SSH (and FTP) account. The files shall be downloaded on a regular basis (I suppose a cron is the right tool to ...
3
votes
1
answer
6k
views
Which rsync client can I use on windows 7?
I would like to know if, beside cwRsync, there exists a good rsync client for Windows (and more specially Windows 7 x64).
This client should support the following operations :
backup of a directory (...
0
votes
1
answer
1k
views
Rsync in bash script not recognizing spaces
An excerpt from a bash script I'm using to backup some photos:
#!/bin/bash
FROM="/cygdrive/f/\"Trip to Austria\""
TO="/cygdrive/s/\"Trip to Austria\""
rsync -av $FROM $TO
When I print the final ...
1
vote
1
answer
3k
views
rsync directory complete but some files md5sum is different
I'm using rsync to copy a directory from host A to host B. After the rsync is completed successfully, I check the files with the directory and find that some files' md5sum is different but the ...
10
votes
2
answers
4k
views
Live rsync/directory monitor for Windows?
Right now, we have a central Linux server and several satellite Windows servers dispersed around the region. Every 15 minutes, the Linux server rsyncs files from the others (which are running the ...
0
votes
2
answers
4k
views
Sync files from linux server to windows machine
I have a linux webserver, running apache and mysql. I want to back up on my windows desktop pc the remote files (/home and /var/lib/mysql) with a total capacity of 34 GB. The point is that i need to ...
1
vote
1
answer
390
views
SSH Rsync to a remote server through an intermediary server
I am on a linux server (server A), I can SSH to another linux server (server B). Once on server B, I can SSH to another linux server (Server C). So basically, Server A can not talk directly to Server ...
1
vote
0
answers
2k
views
How to achieve NAS to NAS rsync for offsite backup?
I'm interested in a home NAS solution that would look like this:
local NAS box for home backups
remote NAS box (at my parents) as an offsite copy
periodic rsync over the internet from "local" to "...
4
votes
2
answers
7k
views
rsync only a specific subset of directories
I need to use rsync to synchronize several directories from an rsync server.
The whole rsync module is quite large and I like to avoid coping the other, not required parts as well.
I have the wanted ...
5
votes
1
answer
8k
views
Don't copy files that cause an input/output error
When copying files from a faulty hd with cp, rsync, or scp, the faulty files which can't be read anymore are also partly copied to the destination directory.
Is there an option to automatically skip ...
4
votes
2
answers
1k
views
Is it more efficient to rsync uncompressed text data or the same data gzipped?
Rsync only copies over the changed parts of a file. So if I have a large data dump, for example a SQL database in text format, and I want to copy it to my local machine using as little bandwidth as ...
1
vote
1
answer
846
views
scp to server with encrypted home directory
I am setting up an ubuntu server to use as remote backup and I plan to use rsync to keep it up-to-date. I've encrypted the home directory though, which now prevents direct connection using standard ...
19
votes
4
answers
19k
views
Why cwRsync doesn't work on Windows?
I'm trying to run rsync on Windows with the cwrsync port.
I'm issuing the following command (note that this is just a dry run):
rsync -nPaAz [email protected]:/home/foobar/webapps/barbaz/ C:\...
1
vote
1
answer
380
views
Grant permissions using rsync
I want to use rsync (as a user) from "me" on a local computer to "another" user on a distant computer. However, I also want "another" user (on the distant computer) to own the files and to be able to ...
3
votes
3
answers
2k
views
Enter password only once for a script that uses rsync and SSH
I am trying to write a script that pushes a website to my server, where the website files are on my local machine for testing.
It works now, by using rsync to update the server, then ssh to get the ...
8
votes
2
answers
20k
views
How to make rsync to use relative path?
I want to sync remote database copy using command
rsync --relative user@remote:/backup/databases/*.sql /backup/snapshots/
As it's result command creates file /backup/snapshots/backup/databases/mysql....
2
votes
3
answers
5k
views
Any faster scp or rsync?
How can I transfer a large file quickly, when I don't really require a secure connection?
Often I would like to copy a large file from local machine to remote machine. The file does not already ...
12
votes
1
answer
4k
views
How do rsync show/hide filter rules differ from include/exclude?
I'm working on some intense rsync scripts, and I really want to understand the options at my disposal. In general the man page is the best place for information, with dense and precise prose. One ...
0
votes
1
answer
7k
views
How to set/keep directory permissions?
I'm using CwRsync to connect from my Windows development machine to a linux webserver :
rsync -avuz -e ./ssh --exclude=".svn" /cygdrive/c/xampp/htdocs/project123/ [email protected]:/home/user123/...
4
votes
2
answers
69k
views
rsync cron job with a password?
I want to set up an rsync command as a cron job, so I need to find a way to supply my server password automatically to rsync.
Currently I have a shell script that looks like this:
#!/bin/sh
rsync *....
1
vote
2
answers
144
views
rsync keeps copying
Four hours ago I started rsync to create a copy of my entire /home directory (I am using Ubuntu) to an external HDD. My /home lives on a separate partition of 150 GB of which 106 GB are used. I also ...
4
votes
3
answers
11k
views
scp certain files only
I am trying to copy changed files to godaddy via ssh. Godaddy is terrible and so they of course do not allow rsync. I can use scp, but I really only want to copy changed files. I don't think this is ...
0
votes
1
answer
453
views
Rsync sync two folders with a filetype
There is a serverA with a folder folder1, in folder1 there are different files: bar.htm, test.jpg, test2.jpg, foo.txt, folder1/subfolder1/test3.jpg, etc.
There is a serverB with an empty folder2
I ...
5
votes
4
answers
5k
views
Truecrypt Rsync Container
Is there a good way to incrementally sync truecrypt containers? I currently have large containers (200gb+), and I'd like to find a way to back them up without having to mount them. Rsync seems to not ...
0
votes
1
answer
2k
views
Using xcopy /exclude to exclude .o, but include .odt?
From xcopy /?
/EXCLUDE:file1[+file2][+file3]...
Specifies a list of files containing strings. Each string
should be in a separate line in the files. When any of the
...
18
votes
1
answer
30k
views
rsync takes a very long time to send file list
I'm trying to use rsync to backup some files from an internal harddisk to a usb-drive. (I'm working on a wd mybook world NAS)
There are two folders that I want to backup. A music folder and a video ...
0
votes
2
answers
4k
views
rsync over ssh questions - creating directories on remote host if they don't exist
I want to use rsync to backup some files over ssh which I have managed to get working fine using:
rsync --delete -avze ssh /home/malachi/www/site/ malachi@remote-host:~/backups/daily/sites/site/
How ...
1
vote
2
answers
1k
views
Help with Watch Directory Script
First, I should note that I am pretty new to writing scripts, but I know my way around ubuntu well enough that I don't mind getting my hands dirty...
I have a small script, which does a simple ...
8
votes
5
answers
12k
views
rsync synchronizing files only without creating folders on destination
Is it possible with rsync to not create directories on destination?
Imagine I have that source :
a/
a/x.txt
b/
b/y.txt
And that I have this destination :
a/
a/z.txt
The wanted result of rsync ...
1
vote
1
answer
1k
views
RSYNC - Ignore a Directory on destination box
I am performing a dry run using Rsync on 2 different boxes.
While i'm doing that, Under destination directory, I want a specific directory x to be ignored for sync.
Please let me know the exact ...