`gzip` (or GNU zip) is a file format and corresponding utility for compressing files using the DEFLATE algorithm. The usual extension is `.gz`.

learn more… | top users | synonyms

0
votes
1answer
15 views

How to extract single file from large tar/tar.gz file

What I want to do is to extract a single file from a huge tar file, instead of extracting the whole tar. I am using RHEL 6.4 I Googled it and tried the following: tar --extract --file=some.tar ...
1
vote
0answers
7 views

canot restore disk image with dd (target part filled with zero)

I have a RAID0 disk before, now I want change the size of it. From the manual, the only way is backup data, delete RAID, re-create with new size, and restore data. now I have many old 2.5" hdd, each ...
10
votes
4answers
13k views

How to obtain maximum compression with .tar.gz? [duplicate]

The way i understand the use of tar + gzip is that tar is normally used to consolidate a grouping of files into a single file, then gzip is used to compress that file. I recently learned that tar can ...
47
votes
5answers
55k views

How to password protect gzip files on the command line?

I want to create some tar.gz (and possibly tar.bz2) files, using the tar command on Ubuntu 10.04. I want to password protect the file. What is the command to do this (I have Googled, but found ...
1
vote
3answers
3k views

Between xz, gzip, and bzip2, which compression algorithim is the most efficient?

Between xz, gzip, and bzip2, which compression algorithm gives the smallest file size and fastest speed when compressing fairly large tarballs?
7
votes
5answers
4k views

Which archiving method is better for compressing text files on Linux?

In my application I need do compress of logs that are text files. Seems that bzip2 and gzip have the same compression ratio. Is that correct?
3
votes
2answers
2k views

How can I get the uncompressed size of gzip file without actually decompressing it?

Please find my OS details: $ uname -a AIX xxyy 1 6 000145364C00 I've tried the following command to get size of a file in gzip archive: $ gzip -l mycontent.DAT.Gz compressed uncompr. ratio ...
4
votes
1answer
189 views

Not sure gzip has decompressed the whole file

I am decompressing a list of files using gzip: At any time it skips from one file to the next, I read (I am using the verbose option): star_60out.txt.gz: 91.0% -- replaced with star_60out.txt or ...
1
vote
2answers
3k views

How to make sure a .tar.gz file is valid and will uncompress correctly?

I have a few BIG .tar.gz files, and I want to make sure they will uncompress, but without actually doing it. If the file opens on "Archive Manager" on Ubuntu, and I can view it contents there, does ...
0
votes
1answer
42 views

extracting multiple .gz files, and printing the name of the extracted file

I would think this is easy but I'm blocking… I have a directory with a series of log files (from minecraft server…): 2014-09-28-1.log.gz 2014-09-29-1.log.gz 2014-09-30-1.log.gz 2014-10-01-1.log.gz ...
4
votes
3answers
37k views

How do I gunzip a directory?

I have a gzipped directory called "new" which contains other directories and files, that I compressed in the following way gzip -cvr --no-name /path-to-directory/new > new.gz I have copied this ...
1
vote
2answers
79 views

Gzip thousands of files efficiently in a single pass

I want to gzip the contents of a couple of thousand of tiny files into a single file. While I could do it with something like for file in $(find . -iname 'pattern'); do; cat $file | gzip - >> ...
0
votes
1answer
23 views

can't open .gzip archives retrieved with wget

I'm trying to download the content of a directory hosted on a server using wget in a cygwin terminal. I have no problem getting the files but they are all .gz archive and once downloaded they are ...
9
votes
5answers
6k views

gzip all files without deleting them

I need to gzip all files in a dir separately including all files in sub-directories without deleting the originals afterwards. So let's say I have index.html, I want to have at the end index.html.gzip ...
4
votes
3answers
2k views

Why is gzip slow despite CPU and hard drive performance not being maxed out?

I have some JSON files, 20 GB each, that I want to compress with gzip: gzip file1.json This takes up one full CPU core, all fine. It processes around 25 MB/s (checked in atop), my hard drive can ...
0
votes
1answer
38 views

how to extract lots of gz files in windows

I have 36,348 .gz files. I need to extract them all the same directory. In unix I would use gunzip and so forth from the shell. How would I do it on my windows 7 machine? I can't even get winrar to ...
0
votes
0answers
15 views

Is there any way to have the `split` utility gzip its output by default?

I'd like to be able to do something like, my_long_running_process_producing_lots_of_output | split --gzip --lines 1000000 - part_ and have this produce things like part_aa.gz part_ab.gz instead ...
2
votes
2answers
6k views

What command to use to unpack a .tar.gz file in Windows?

I use to receive tar.gz files fromm colleagues but unpacking them with 7zip is not convenient as it unpacks a tar file from gz first while I usually seek to get the tar file contents (so I have to ...
1
vote
1answer
86 views

Running find…exec tar czvf only archives one file…need all files

When attempting to run find . -iname "*.gz" -mtime +7 -exec tar czvf all_gizip_$(date +%Y-%m-%d).tar.gz {} \; I get the list of files ./corosync.log-20140620.gz ./corosync.log-20140618.gz ...
8
votes
3answers
3k views

Is there a way to mount a file.tar.bz2 without extracting it onto the filesystem?

Is there a way to mount a file.tar.bz2 without extracting it onto the filesystem? I don't care if the mount is read only. Hopefully your answer will also apply to file.tar.gz. "mount" in this ...
1
vote
2answers
575 views

Join with gzipped files

I want to use the command line join utility on two files. Unfortunately, they're gzipped. Because they're both gzipped, I can't use gzip -cd. Is there a slick way to do this without having to unzip ...
-2
votes
4answers
103 views

“.gz” extension somehow appended itself to EVERY FILE on my site… how do I undo it?

Somehow I accidentally appended the extension .gz to ALL files in my entire website directory. How do I undo this? I need them to retain their original file extensions (EG: picture.jpg.gz -> ...
0
votes
0answers
42 views

List contents of zip archive via stdin

Is there a "magic" way to list the contents of a Zip archive piped in via stdin? For instance: $ some_process_sending_files_in_one_zip_stream_to_stdout | gunzip -l - ... listing of files ... When ...
52
votes
2answers
3k views

Why is piping 'dd' through gzip so much faster than a direct copy?

I wanted to backup a path from a computer in my network to another computer in the same network over a 100 Mbit/s line. For this I did dd if=/local/path ...
19
votes
3answers
13k views

How to know if a site is gzipped?

I am accessing some web sites which are really really slow, and I would like to know if those sites are gzipped. Is there an easy way to find this out?
1
vote
1answer
29 views

How to revert a “gzip -r folder/” command?

I accidentally compressed all the files using the Gzip method which compresses all the files (not directories) individually, replacing the uncompressed files with the .gz compressed files. How can I ...
1
vote
4answers
6k views

How do I know the gzip compression level?

Given a gzip compressed file, how do I know what compression level (1-9) was used for it?
14
votes
4answers
6k views

Rsync friendly gzip

I must not be the only one - I'm rsyncing .tar.gz files and notice that every time the full file gets rsynced rather than the differences. Reading into it it seems back in 1999 someone created an ...
0
votes
1answer
705 views

How to compress a large file to many smaller zip files with defined size?

I have a very large file, e.g. 100GB, and I want to compress it to many smaller zip file, with each file cannot larger than 1GB, what would be the most suitable commands to do it? remark: I want to ...
21
votes
4answers
56k views

How to gzip multiple files into one gz file?

I have 100 files: cvd1.txt cvd2.txt ... cvd100.txt How to gzip 100 files into one .gz file so that after I gunzip it, I should have cvd1.txt, cvd2.txt ... cvd100.txt separately? Thanks for your ...
2
votes
2answers
170 views

Compressing compressed .tar.gz files deterministically

I want to perform a series of recompressions of compressed files to study their properties. At first, I tried simply recompressing .zip files in a loop: for f in $(seq 1 100) do zip $f.zip -9 -v ...
0
votes
0answers
64 views

GZIP corruption with big files?

I came across a weird behavior: gzip v1.5 - Fedora r18 A file -rwxrwxrwx. 1 root root 3892576256 Apr 28 11:29 vm.qcow2 Initial checksum: md5sum vm.qow2 954c5461468d68daed3cef6a7b66bd8f vm.qcow2 ...
1
vote
1answer
59 views

Need help in the shell script - gunzip and file command

This is on Ubuntu 12.04. I have a custom webkit based application where "browser" saves bunch of cache files. When triaging the problems, I have to inspect the cache. The cache directory holds many ...
3
votes
1answer
588 views

Google Chrome Developer Tools data transfer size

In Google Chrome when using the Network Panel to monitor files being transfered from a site, the total size of the data transfered is given at the bottom of the list. Does this figure reflect the size ...
3
votes
1answer
78 views

Why does tar with -z option create archive with different hash everytime

Can you tell me why tar czf archive.tar dir creates archive with different hash everytime (I check with 'md5sum') Without compression parameter -z or with parameter -j instead all works fine. ...
0
votes
1answer
69 views

Concatenate header of one file with tail of another

I have a large gzipped mysqldump file which contains some table definitions and then many insert statements. I'd like to edit the table definitions but leave the insert statements alone. The file is ...
5
votes
6answers
4k views

Converting gzip files to bzip2 efficiently

I have a bunch of gzip files that I have to convert to bzip2 every now and then. Currently, I'm using a shell script that simply 'gunzip's each file and then 'bzip2's it. Though this works, it takes a ...
0
votes
0answers
107 views

Error uncompressing file when piping curl to gunzip

I need to download a gzipped xml feed to parse in my Ruby app. It may well be quite large, 30Mb compressed, 300Mb uncompressed. So I do this: curl -s http://example.com/file.xml.gz | gunzip and read ...
0
votes
1answer
19 views

Copying Jar files into single zip file

I am trying to compress the hundreds of jar files into a single zip file that can be transferred to a different location. Please help.
0
votes
0answers
13 views

Maximum Gzip Output Increase

I am wondering what the maximum gzip output size is given an incompressible file. Basically, what is the worst case scenario for gzip? When an incompressible file is compressed with gzip, it grows ...
0
votes
1answer
59 views

Tar up only 3 specific files in command line with linux

Is it possible with one command to tar up 3 files into one tar archive? For example, tar up: public_html.tar.gz dbapp.sql dbwp.sql into a tar file called bak.tar.gz
1
vote
2answers
70 views

Search zipped *and* non-zipped files in one hit

I have a folder with a mix of zipped and unzipped log files which i want to search. I can search the non-zipped with grep -r "my-search-string" /path/to/folder and search the zipped files with ...
0
votes
1answer
52 views

dd a partition and keep device structure

How can I dd a partition while keeping its device structure? Source device: [root@cal-7-3 ~]# lsblk NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT sda 8:0 0 37.3G 0 disk └─sda1 8:1 0 ...
43
votes
4answers
47k views

How to specify level of compression when using tar -zcvf?

I gzip directories very often at work. What I normally do is tar -zcvf file.tar.gz /path/to/directory Is there a way to specify the compression level here? I want to use the best compression ...
0
votes
2answers
75 views

rsync: gzip on source tolerant

I need to transfer a couple of log-files each hour to a logstorage which all users can reach, and I use rsync for do that, but the problem comes when the log-file is rotated and automatically zipped, ...
1
vote
1answer
155 views

How to convert a file of format tar.gz to tar.bz2?

Like the title says, how do I do this conversion from the Linux console?
26
votes
7answers
42k views

tar: Exiting with failure status due to previous errors

I have written a little script that tars and compresses a list of directories + files. The script appears to run succesfully, in that a useable .tar.gz file is created after the script runs. ...
2
votes
2answers
2k views

gzip compressed file ownership and permissions

I'm trying to find out how gzipping a file changes its permissions. The gzip manual (man gzip) says: Whenever possible, each file is replaced by one with the extension .gz, while keeping the ...
2
votes
3answers
2k views

gzip change file ownership

Here is a case i don't understand i have a group 'bar', and this group has two users; 'foo' and 'bar'. I have a test.txt file, 'foo' is the owner and 'bar' user only can read it. However, if 'bar' ...
0
votes
0answers
300 views

Caveats with gzip --rsyncable - no speedup

I am using (trying) gzip to compress an SQL file in an rsyncable way in order to transfer the backup with minimal delay. However it appears that this is not working, since the speedup is always 1.00. ...