0
votes
2answers
32 views

ssh, scp or rsync for deploying built applications? [on hold]

I need to write a "deployer" bash script that will take a bunch of compiled/packaged Java applications and copy them to specific directories on our app servers. My options, as I see them, are ssh, scp ...
0
votes
0answers
26 views

How to rsync merge two paths into one; opposite of --inplace

I have a large remote directory: remote://server/pathA/zupertoll And a large local directory that is 95% the same as the remote directory: local:///home/pathB/zupertoll I want to copy zupertoll to ...
0
votes
0answers
62 views

ssh proxycommand equivalent on server

Lets say we have three machines me, proxy, server I would like to have an ssh connection to server, so normally I would do me$ ssh proxy proxy$ ssh server server$ # and here we are ssh proxy ...
1
vote
2answers
150 views

SCP remember password

On debian, is there anyway for scp to remember the password I've typed in for the duration of my ssh logon, similar to how sudo does? i.e. PC ---ssh(putty)---> server 1 ---scp---> server 2 ...
2
votes
1answer
463 views

Rsync very slow

I have just setup a Debian server for backup of Windows PCs. I am currently testing various methods including: rsync (using Deltacopy on Windows), SMB via Samba and scp. Currently rsync (without SSH ...
3
votes
1answer
103 views

Differential copy from Windows to Linux

Is there any way to do differential copies of a directory from Windows to Linux over ssh, sftp, scp, or similar? Preferably not rsync since they are all cygwin based and force you to use the ...
0
votes
1answer
28 views

rsync not skipping untouched files

I transferred about 300GB of files with scp from one server to another. Sadly I forgot the -r option, so part of the files that were in subdirectories were not copied. I verified that the files that ...
0
votes
1answer
82 views

How to copy directory from remote server

I came across following instruction to copy a directory to my local machine. copy the gems from styx server from "‪location/to/the/directory" to your local directory I know rsync and scp can do the ...
3
votes
1answer
349 views

scp: How to copy only the last 10% of a file?

I have a relatively large log file (46M) on a vServer, of which I'm only interested in the most recent part. How can I download only the last 10% of the file? The server is running Debian and I'm ...
0
votes
1answer
96 views

rsync transfer chunk size

I‘m transferring 1.1 Mb files over very poor GSM EDGE connection. My rsync command is: rsync --partial --remove-source-files --timeout=120 --append --progress --rsh=ssh -z LOCAL_FILE ...
0
votes
1answer
156 views

rsync - resume broken transfer (idea of rsync)

I have remote stations that collect data from sensors (ARM Debian) and transfers sets of data (about 1.1 MB) every 15 minutes (server is full Debian). On one station GSM reception is poor and standard ...
-1
votes
2answers
3k views

How to copy files from remote machine (ubuntu) to local machine (windows)?

I would like to know about two ways: scp and rsync and how exactly they are used to copy files. I tried doing scp ubuntu@ip-10-124-83-21:/home/* /home/ubuntu/crockonjs-2-hd.mov but it didn't work. ...
5
votes
3answers
5k views

How can I resume a large scp file transfer when using port forwarding?

I have a machine a couple of hops away, and I need to set up port forwarding in order to transfer files. Edit: To be clear, the multiple hops are needed in order to access the remote machine. From ...
1
vote
1answer
2k views

SSH SFTP: transfer local directory to remote server

I can't seem to transfer a simple local folder to a remote server via SFTP or SSH. I feel like the issue has to do with absolute paths or home directories, but here's what I've tried: scp -r ...
6
votes
3answers
4k views

How to gzip a directory, transfer via scp, and decompress in one command?

I frequently transfer large directories over scp and it would be sweet if I could somehow compress the directory, send it, and decompress it all in one. Is something like this possible?
3
votes
1answer
5k views

Difference between scp and rsync?

Title pretty much says it all. If I have a folder (mydir/) on server1.com, and want to copy it to a parent folder on server2.com, then what is the difference (performance, security, capabilities, ...
1
vote
1answer
861 views

Don't copy files that cause an input/output error

When copying files from a faulty hd with cp, rsync, or scp, the faulty files which can't be read anymore are also partly copied to the destination directory. Is there an option to automatically skip ...
0
votes
1answer
400 views

scp to server with encrypted home directory

I am setting up an ubuntu server to use as remote backup and I plan to use rsync to keep it up-to-date. I've encrypted the home directory though, which now prevents direct connection using standard ...
2
votes
3answers
2k views

Any faster scp or rsync?

How can I transfer a large file quickly, when I don't really require a secure connection? Often I would like to copy a large file from local machine to remote machine. The file does not already ...
1
vote
3answers
2k views

scp certain files only

I am trying to copy changed files to godaddy via ssh. Godaddy is terrible and so they of course do not allow rsync. I can use scp, but I really only want to copy changed files. I don't think this is ...
3
votes
2answers
342 views

Ubuntu - Problem with SCP / Git / Rsync

I'm having a really weird problem. For some reason, I can't scp, rsync, git pull or git push files larger than 1406 bytes. I can clone an entire repo no problem. I have no idea how to troubleshoot ...
2
votes
5answers
2k views

OSX SSH rsync - Keep remote directory up to date

I come primarily from a Windows background, migrating over to Mac. I've used WinSCP and loved a featured called "Keep Remote Directory Up To Date". Here's the question: is there an equivalent SCP ...
20
votes
6answers
19k views

Why is rsync -avz faster than scp -r?

I'm a bit puzzled by this? Why is rsync faster than scp? Doesn't rsync use scp beneath or does it do something more efficient? Is there some way to speed up scp?
12
votes
4answers
3k views

Resume recursive scp transfer (with rsync?)

I was transferring several thousand files each ~1MB via scp and my connection was broken after the first 2k files or so. I wanted to know if there was a way to resume the recursive transfer w/o ...
5
votes
3answers
2k views

Linux: Alternative to rsync? (ie, scp with resume)

I've been using rsync to automatically send files from one box to another, which is great compared to scp, since it supports resuming. However, when resuming a very large file (>10gb) rsync has to ...
7
votes
3answers
8k views

Is it possible to rate-limit an scp/sftp/rsync/etc transfer from the command-line? ie, manual QoS on a single command?

Specifically, I am looking to rate-limit an scp or sftp session (or other arbitrary network call) in the call itself. For example, let's say I want to copy 100MB to one server, and 1GB to another. ...
0
votes
2answers
3k views

How to replicate the directory structure to a remote Linux server

I want to replicate a complex directory structure from one Linux server to another remote server start at a certain sub-directory. I don't want the contents of the files, I just want to preserve the ...
25
votes
15answers
33k views

Best way to copy millions of files between 2 servers

I have roughly around 5 million small (5-30k) files in a single directory that I would like to copy to another machine on the same gigabit network. I tried using rsync, but it would slow down to a ...