0
votes
0answers
113 views

File transfer tools for linux with support of zero-copy transfer

Are there small and simple file transfer tools for Linux, which can use "zero-copy" style of transferring files from HDD (SSD) to tcp socket, and back? I want to often send huge amount of ...
1
vote
1answer
234 views

How to speed up data transfer between Portable HD and NAS (QNAP)?

I am trying to transfer data from a Western Digital USB2 Drive to a QNAP TS-212E. I am transfering the data between the portable HD and the NAS using rsync (see following command). rsync -v -r -h ...
0
votes
0answers
43 views

Win7 -> Linux cannot seem to copy large file without errors

I have a 70 GB file I am trying to copy from a Windows 7 machine to a Linux Mint 16 machine over a network, and I don't seem to be able to get the MD5 sums to match afterwards. I've so far tried two ...
0
votes
1answer
20 views

Below what network speed should I be using compression for an rsync transfer?

I'm transferring some files from a remote server. The speeds for the transfer are abysmal (~1 MBps), and have got me thinking about optimizing the transfer for speed. At what network speed does it ...
0
votes
0answers
33 views

web interface for server-to-server file transfer [duplicate]

I'm looking for a way to transfer files between two servers. I currently ssh into one server and use rsync inside a screen session to initiate a transfer from the other host. This works, but I'm ...
0
votes
1answer
713 views

Rsync Remote To Local Issue

I was wondering if I could get some help with this rsync command. I am trying to copy files from a remote system by running rsync on the local system. Here is my command: /usr/bin/rsync -avz ...
0
votes
0answers
335 views

Problems copying to VFAT formatted SD-card

I was going to copy my (mp3-encoded) music files (organized in one directory) to a (vfat-formatted) (micro-)sd-card to use it in my digital audio player (DAP) (on Linux). I used to use the same ...
0
votes
1answer
156 views

rsync - resume broken transfer (idea of rsync)

I have remote stations that collect data from sensors (ARM Debian) and transfers sets of data (about 1.1 MB) every 15 minutes (server is full Debian). On one station GSM reception is poor and standard ...
14
votes
5answers
2k views

Transfering about 300gb in files from one server to another

I have about 200,000 files that I am transferring to a new server today. I haven't done anything on such a large scale before, and wanted to get some advice on how I should go about this. I am ...
5
votes
3answers
5k views

How can I resume a large scp file transfer when using port forwarding?

I have a machine a couple of hops away, and I need to set up port forwarding in order to transfer files. Edit: To be clear, the multiple hops are needed in order to access the remote machine. From ...
3
votes
2answers
290 views

Tackling bandwidth optimization (possibly) through R-Sync

I am currently looking for solutions that can optimize network bandwidth usage. Scenario: Server has a file. Client downloads it through a REST API. Client makes some changes and uploads the changed ...
5
votes
1answer
3k views

How to rsync with a private key?

I'm trying to rsync from my MacOS machine to an Ubuntu server that's running on Windows Azure. To ssh to it, I have to do the following: $ ssh -i myPrivateKey.key -p 22 me@me.cloudapp.net I ...
1
vote
0answers
71 views

Where did my rsync'd file go?

I just copied a very large file (> 10 gb) from one EC2 server to another using rsync: rsync -asv -P xtrabackup_2012_07_08_21h20m.tar.gz staging:/mnt/backups This took a couple of hours. Then, after ...
5
votes
1answer
598 views

How to use RSYNC to get unchanged files hard-linked and appended files copied locally + appended?

I'm trying to figure out a way to use rsync (one or more times) and possibly other commands (such as cp -lr) to accomplish the following: Synchronize remote folder A to local folder B I already have ...
0
votes
1answer
235 views

move root with rsync -aHA but sudo not work. How to fix?

I ran rsync -aHA --delete --devices -S -xv /media/tmp/oldroot/ /media/newroot/. After I reboot, I can login. But I cannot use sudo and passwd. How to fix this? $ sudo ls sudo: must be setuid root ...
5
votes
2answers
9k views

Rsync only changed files

Is it possible to have rsync transfer all files in a directory that have changed or have been created? I don't need something as sophisticated as a CRC diff check; files with different timestamps ...
4
votes
5answers
871 views

Why every OS still can't resume file transferring? [closed]

I mean, Windows 7, Ubuntu 9.10 and Snow Leopard... All newest and top of line desktop operating system still use regular copy to transfer files, as it seems to me from experience. Instead of using ...