0
votes
1answer
201 views

How to compress a large file to many smaller zip files with defined size?

I have a very large file, e.g. 100GB, and I want to compress it to many smaller zip file, with each file cannot larger than 1GB, what would be the most suitable commands to do it? remark: I want to ...
0
votes
0answers
33 views

GZIP corruption with big files?

I came across a weird behavior: gzip v1.5 - Fedora r18 A file -rwxrwxrwx. 1 root root 3892576256 Apr 28 11:29 vm.qcow2 Initial checksum: md5sum vm.qow2 954c5461468d68daed3cef6a7b66bd8f vm.qcow2 ...
1
vote
1answer
33 views

Need help in the shell script - gunzip and file command

This is on Ubuntu 12.04. I have a custom webkit based application where "browser" saves bunch of cache files. When triaging the problems, I have to inspect the cache. The cache directory holds many ...
3
votes
1answer
49 views

Why does tar with -z option create archive with different hash everytime

Can you tell me why tar czf archive.tar dir creates archive with different hash everytime (I check with 'md5sum') Without compression parameter -z or with parameter -j instead all works fine. ...
0
votes
1answer
25 views

Tar up only 3 specific files in command line with linux

Is it possible with one command to tar up 3 files into one tar archive? For example, tar up: public_html.tar.gz dbapp.sql dbwp.sql into a tar file called bak.tar.gz
1
vote
2answers
32 views

Search zipped *and* non-zipped files in one hit

I have a folder with a mix of zipped and unzipped log files which i want to search. I can search the non-zipped with grep -r "my-search-string" /path/to/folder and search the zipped files with ...
0
votes
1answer
42 views

dd a partition and keep device structure

How can I dd a partition while keeping its device structure? Source device: [root@cal-7-3 ~]# lsblk NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT sda 8:0 0 37.3G 0 disk └─sda1 8:1 0 ...
1
vote
1answer
86 views

How to convert a file of format tar.gz to tar.bz2?

Like the title says, how do I do this conversion from the Linux console?
10
votes
3answers
1k views

Files with same content but with different md5sums when gzip'd?

I don't know why this is happening, but I upload some files to Amazon S3 then delete the sent files checking their md5sum both in Amazon and locally. But recently I found this issue about the same ...
4
votes
2answers
3k views

Time to zip very large (100G) files

I find myself having to compress a number of very large files (80-ish GB), and I am surprised at the (lack of) speed my system is exhibiting. I get about 500 MB / min conversion speed; using top, I ...
0
votes
2answers
403 views

What is the difference in various commands for compressing files in linux?

What are the commands for compressing files in linux and what are the difference between them? (for example: tar, gzip, rar). I'm working on Linux Mint 11 and doing a script for compressing files. I ...
2
votes
2answers
2k views

gzip several files in different directories and copy to new directory

I'm working with several files that are located in different directories that I need to compress into individual .gz files. I also need to move the compressed files to a single directory while leaving ...
2
votes
1answer
2k views

Shell Script to GZIP files without overwrite .gz files

I'm trying to create a shell script which receive as first parameter of a path to a folder which I would like to compress all files using gzip without overwrite the .gz files that already exist in ...
0
votes
1answer
118 views

gzip many files one by one

I have 100 files, n1.txt, n2.txt,… and I want to gzip each of them, but not in one file – finally I'd like to have 100 n*.txt.gz files. How can I do that in Linux with Bash?
0
votes
1answer
288 views

How to zgrep by file pattern and timestamp?

I have a list of several thousand gzip (*.gz) files that I'd like to zgrep through, but I only want to run it on files with a last-modified-timestamp on or after yesterday (11/22/2012) and that ...
1
vote
3answers
2k views

Is there a command to determine the compression ratio of a tar.bz2 file?

I have a file.tar.bz2 that's about 50GB and would like to extract it however I don't know how much space I will need. Is there a command to print the compression ratio of the tar.bz2 file?
22
votes
5answers
1k views

Why doesn't Gzip compression eliminate duplicate chunks of data?

I just did a little experiment where I created a tar archive with duplicate files to see if it would be compressed, to my awe, it was not! Details follow (results indented for reading pleasure): $ dd ...
0
votes
1answer
149 views

Looking for a gtk equivalent of ark

Does there exist a GTK equivalent (or improvement) of the Linux archiving tool known as Ark? If so, where might it be found; and if not, how well-received might be a new project which acts as a ...
2
votes
1answer
1k views

Zip/gzip compression ratio much less in Linux than in Windows

I have a bunch of very huge files located on a Linux machine that I would like to compress and save some space. I have tried using the tar/gzip combination and I have noticed that the compression ...
0
votes
1answer
582 views

Why my multiparted .tar unpacs just partly? (missing files)

I have 25 .tar files like: filename.tar.001 - filename.tar.025 When I want to unpack them with cat myarchive.tar.* | tar xvf - it does, but missing files: whole .tar is 1,2 GB, but unpacked files ...
12
votes
5answers
5k views

Fastest GZIP utility

I'm looking for the fastest gzip (or zip) utility. I have a LVM volume which 95% exists out of blank 0's, so compressing that is very easy. I'm looking for the most fastest solution, and don't really ...
6
votes
4answers
3k views

Which archiving method is better for compressing text files on Linux?

In my application I need do compress of logs that are text files. Seems that bzip2 and gzip have the same compression ratio. Is that correct?
2
votes
2answers
915 views

Utility to cat/gunzip a list of files

Is there a commonly-installed Linux utility that will take a list of files and cat or gzip -d (==zcat) them based on whether the file is compressed? An example of where I just needed this is when I ...
1
vote
2answers
359 views

Did gzip destroy my log file?

I had a rather big log file. So I thought I'd gzip it before transferring it to my pc. I did gzip bla.log which gave me a tiny bla.log.gz When I extract it using gunzip bla.log.gz I get back ...
0
votes
2answers
3k views

How can I compress a large file into smaller parts?

I'm looking for a way to compress a large file (~10GB) into several files that wont exceed 150MB each. Any thoughts?
1
vote
2answers
648 views

Excluding Path While Compressing with TAR/GZ

I am compressing list of files like this: tar cvzf mycompress.tar.gz /dir1/dir2/file1.txt /dir1/dir2/file2.txt However when I uncompressed them the directory /dir1/dir2/ is still preserved. How to ...
1
vote
2answers
278 views

Unzipping a huge file stalls the server

I want to extract a huge .tar.gz file but when I do extract it stalls the server. The server is write heavy and extracting seems to choke the disk. Is there a nice way to extract without stopping the ...
39
votes
4answers
39k views

How to specify level of compression when using tar -zcvf?

I gzip directories very often at work. What I normally do is tar -zcvf file.tar.gz /path/to/directory Is there a way to specify the compression level here? I want to use the best compression ...
9
votes
6answers
16k views

How do I uncompress vmlinuz to vmlinux?

I have already tried uncompress, gzip, and all other solutions that come up as google results and these have not worked for me. To get just the image search for the GZ signature - 1f 8b 08 00. ...
2
votes
2answers
820 views

can gunzip work on file without a suffix?

Is there a way to gunzip a file that isn't ending with a .zip even though I know for a fact the file is indeed a zip?
2
votes
3answers
558 views

Control gzip compression rates while archiving files with tar?

I have a script which periodically backs up a directory using the command "tar -czvf [name] [directory]" but my problem is that the script has recently been putting a lot of stress on the server ...
3
votes
1answer
2k views

Critical gzip mistake (HELP!) - how to undo 'gzip -r ./'

So I was hoping to make a gzipped backup of my entire directory stucture, but I was very stupid and issued the command 'gzip -r ./' hoping to add all files and folders to a single gzip archive. This ...
6
votes
4answers
15k views

Unexpected end of file. Gzip compressed file

I am going crazy with a gzip file. I can decompress the file in Windows using WinRAR but it is impossible on any UNIX operating system. the file seems to be ok. If I do file the_name_of_the_file.gz ...
1
vote
4answers
5k views

How do I know the gzip compression level?

Given a gzip compressed file, how do I know what compression level (1-9) was used for it?
19
votes
4answers
47k views

How to gzip multiple files into one gz file?

I have 100 files: cvd1.txt cvd2.txt ... cvd100.txt How to gzip 100 files into one .gz file so that after I gunzip it, I should have cvd1.txt, cvd2.txt ... cvd100.txt separately? Thanks for your ...
0
votes
2answers
2k views

uncompress gzipped encrypted file

I have got a backfile with extension .tar.gz.enc. After fooling around I found out that it is encrypted gzipped tarball. Now I want know how to decrypt it.
8
votes
3answers
3k views

Is there a way to mount a file.tar.bz2 without extracting it onto the filesystem?

Is there a way to mount a file.tar.bz2 without extracting it onto the filesystem? I don't care if the mount is read only. Hopefully your answer will also apply to file.tar.gz. "mount" in this ...
8
votes
4answers
6k views

gzip all files without deleting them

I need to gzip all files in a dir separately including all files in sub-directories without deleting the originals afterwards. So let's say I have index.html, I want to have at the end index.html.gzip ...
0
votes
2answers
3k views

How to make sure a .tar.gz file is valid and will uncompress correctly?

I have a few BIG .tar.gz files, and I want to make sure they will uncompress, but without actually doing it. If the file opens on "Archive Manager" on Ubuntu, and I can view it contents there, does ...
1
vote
2answers
511 views

Join with gzipped files

I want to use the command line join utility on two files. Unfortunately, they're gzipped. Because they're both gzipped, I can't use gzip -cd. Is there a slick way to do this without having to unzip ...
0
votes
2answers
1k views

Help on writing Linux script to backup and ftp files to another server

I am using MySQL as the database system for my application on a Linux system. Every week I update the system and take backups (mysqldump) of the databases changed (2 databases). I then .tar.gz them ...
-1
votes
3answers
9k views

How to remove gzip from Linux

I tried sudo aptitude remove gzip and it looked like it uninstalled but when I typed gzip at the terminal it still ran.
4
votes
1answer
1k views

Does Linux GZip Zip the File in Place or create a new file

I have a 1.5TB size text file that I need to gzip down, the current drive it is on has little to no space left. I have another drive with 400G left on it. My question is, if I gzip the file, will it ...
13
votes
4answers
5k views

Rsync friendly gzip

I must not be the only one - I'm rsyncing .tar.gz files and notice that every time the full file gets rsynced rather than the differences. Reading into it it seems back in 1999 someone created an ...
2
votes
4answers
449 views

Why are there binary differences among compressed files generated exactly the same way from the exact same starting file?

I use the "diff" command to compare two compressed files generated using zip on the exact same starting file and they are reported as being different. However, when I uncompress them and use the ...
1
vote
3answers
868 views

Linux Command line: recursively overwriting every file with a gzipped version?

______________ myFolder What can I replace with _____ to recursively gzip every file starting at myFolder and have the gzip be overwrite the file (rename the gzip file to the original filename)?