2
votes
2answers
69 views

Command line cp or rsync to crawl drive seeking only specific file types and put them somewhere?

Is it possible only using the command line to use something like the cp or rsync command to crawl a hard-drive seeking only image/video files? And maybe in the process of copying them over to another ...
1
vote
2answers
712 views

Linux: What is the best way to copy from a damaged HD, only the files that can be completely read?

I am copying from a damaged HDD (not SDD) where about 15% files would cause I/O error. I only want the rest of the 85% complete files, and get a list of damanged files. How to do that? cp stops on ...
2
votes
0answers
304 views

Rsync fails for files that start with underscore when destination is zfs

I'm using rsync3.1.0pre1 on Mac OS X 10.8.5, and am trying to rsync one folder to another. The destination is a ZFS volume mounted via SMB. The problem I'm having is that files that start with ...
1
vote
1answer
377 views

rsync include all directories and certain subdirectories and *.java of the last sub

I am trying to rsync include all directories but only one of each of those subdirectories which contain certain files. For example, rsync -auvz --include '*' --include '*/certain_sub/' --include ...
0
votes
1answer
49 views

Does a successful exit of rsync -acvvv s d guarantee identical directory trees?

I have two volumes, one xfs, and another ntfs - ntfs was empty, and xfs had 10 subitems. I needed to sync them. I initially copied a few of the subitems by dragging them over in a gui fm. Several of ...
1
vote
3answers
378 views

Moving files over SSH and delete on source after successful final copy

I have a folder of ~200 000 files with a total size around 300 GB that I need to transfer over an SSH connection to a remote host. I'm looking for a way to have the local files deleted after it's been ...
1
vote
1answer
54 views

rsync all directories that start with a specific digit

I have directory loaded with thousands of sub directories: /home/tmp/ 1 12 123 1234 2345 234 3456 345 34 ...
1
vote
2answers
3k views

Rsync statistics number of files

I'm using rsync with -vrlHh --delete --stats --force options to mirror two directories. The first directory is the source and it's my external hd, the destination directory is empty because I've just ...
6
votes
3answers
4k views

How to gzip a directory, transfer via scp, and decompress in one command?

I frequently transfer large directories over scp and it would be sweet if I could somehow compress the directory, send it, and decompress it all in one. Is something like this possible?
3
votes
1answer
1k views

Why does rsync skip a sub-folder named “core”?

I'm using the following command to synch files from one folder to another on my local OSX system: rsync -avC ./src ~/Sites Inside of ./src there are several sub-folders: ./src/assets ./src/core ...
5
votes
1answer
585 views

How to use RSYNC to get unchanged files hard-linked and appended files copied locally + appended?

I'm trying to figure out a way to use rsync (one or more times) and possibly other commands (such as cp -lr) to accomplish the following: Synchronize remote folder A to local folder B I already have ...
1
vote
0answers
161 views

How does rsync behave with --append and --link-dest together?

The question refers to the case where a file exists both in the origin and the link-dest folder, but it's larger in the origin. Will it hard-link it and append inplace (thus modifying the file in ...
17
votes
3answers
8k views

Resume rsync over SSH after broken connection?

I have to transfer large amounts of data (>80 GB) over ssh using rsync. Everything is working fine, but the DSL connection where the backup data is sent from will drop once every 24h for up to 3 ...
5
votes
2answers
9k views

Rsync only changed files

Is it possible to have rsync transfer all files in a directory that have changed or have been created? I don't need something as sophisticated as a CRC diff check; files with different timestamps ...
1
vote
1answer
436 views

rsync: delete only extraneous files with a timestamp earlier than the newest in the source directory

I am trying to keep two peer directories in sync using rsync. The problem I have is that new files can be added or deleted in either directory before a sync occurs. If a deletion occurs in one, then ...
3
votes
2answers
2k views

rsync by path/filename only?

Is there a way for me to rsync two directories comparing only filenames (and not file size, date modified, or any other criteria)?
10
votes
1answer
4k views

How to exclude rsync excludes from delete?

I'm using rsync to sync files across multiple machines, using the following: rsync -az -e "ssh -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no" \ --delete --delete-excluded --force ...
0
votes
4answers
63 views

rsyncing - ignoring checksums

Trying to copy a bunch of data over and time, unfortunately, is of the essence. I'd like to do an rsync of all the data in one direction, pretty much rsync just clobbers what's over on the ...
1
vote
1answer
179 views

rsync not writing files

I'm trying to setup rsync to backup a remote directory to my local drive. I cd to the directory that I want to pull the files to, then I enter: rsync -vrtW account@remote.com:~/public_html I enter ...
1
vote
2answers
701 views

rsync doesn’t sync files

I'm using rsync(with Cygwin) to sync 2 local folders. The folders contains binary files. I'm using the following command: rsync.exe -av dir1/ dir2/ but the files in dir2 are only partially ...
3
votes
2answers
1k views

rsync --remove-source-files but only those that match a pattern

Is this possible with rsync? Transfer everything from src:path/to/dir to dest:/path/to/other/dir and delete some of the source files in src:path/to/dir that match a pattern (or size limit) but keep ...
5
votes
2answers
8k views

Use rsync to copy all files except for certain filenames with a certain extension

I have two same-size flash cards, and I want to copy contents of one to the other based on the following rules: I want all directories and subdirectories in place I want to exclude files of type ...