Super User is a question and answer site for computer enthusiasts and power users. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I have a directory containing around 1800 files in a directory , the directory size is now around 18gb. I need to create a single archive of the directory in order to download the whole contents. I have created a tar archive and downloaded the file , tried two times every time when I extract the archive file it says

The file is corrupted

so how can I create an archive of the whole 18gb directory with recovery record / verification such that it wont get corrupted. I don't need any compression on the archive. The 18gb directory exists on a Linux remote server with command line access only (minimal os)

Note: there is also some issues , cant split and combine the files because there are 1800 files. Also its difficult to download small small ranges of files from the 1800 files. The download is to local Windows machine from Linux remote machine over HTTP.

share|improve this question
How are you downloading it? If you're using FTP, be sure you're in binary mode. – Nicole Hamilton Nov 30 '12 at 19:56
downloading by HTTP – cc4re Nov 30 '12 at 19:59
You might want to look at rsync – Oliver Salzburg Nov 30 '12 at 19:59
Are you limited to clicking in your browser to download or is a script a possibility? I don't understand why you can't split your tar file into chunks, say, 50 of them, not 1800, then cat them together once you've downloaded them all. Can you run a sum utility on both ends to compare checksums? – Nicole Hamilton Nov 30 '12 at 20:16
If you split -b a file, then cat the chunks back together in the correct order and don't get exactly what you started with, you have either a bad split or a bad cat or bad both. – Nicole Hamilton Nov 30 '12 at 20:21

It might be an issue with the file system on the Windows side.

Wikipedia says

The maximum possible size for a file on a FAT32 volume is 4 GB minus 1 byte

This does not apply if you are using NTFS.

So if you are using FAT32 make sure that you combine your original list of files into 5 archives a bit smaller than 4GB each.

share|improve this answer
am using NTFS file system no issues – cc4re Dec 1 '12 at 4:43

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .