Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [gzip]

`gzip` (or GNU zip) is a file format and corresponding utility for compressing files using the DEFLATE algorithm. The usual extension is `.gz`.

2
votes
0answers
16 views

Why is my .tar.gz larger than the sum of the separately compressed files in it?

I observed the following situation which is somewhat unexpected to me: I have a csv file and a corresponding txt file. Uncompressed, their sizes are 375MB and 5KB. When I compress the csv file ...
0
votes
2answers
91 views

Not enough disk space to unzip 50 GB file on Ubuntu 16.04: Can I extract and reduce zip file size at the same time?

I have a 50 GB zip file, which contains roughly 50.000 jpg images. The jpgs are, unzipped, around 55 GB. I am on Ubuntu 16.04. But I only have 70 GB disk size on that system. So I get a disk error in ...
1
vote
1answer
83 views

DD image smaller than drive copied

I took a backup of my server's OS disk through a live USB. Using the command: dd if=/dev/sda bs=512 count=(30 gb worth of sectors) conv=noerror,sync status=progress | gzip -c > /path/to/removable/...
0
votes
1answer
140 views

How do I use 7-Zip GUI for Windows to create .tar.gz files?

How can I use the 7-Zip GUI on Windows to create .tar.gz files?
1
vote
1answer
41 views

Why does gzip -c give different results than gzip?

I am writing unit tests for some code and found that a simple gzip is causing a difference in my results. Upon further investigation I found that gzip gives a different .gz file than gzip -c does. Why ...
1
vote
1answer
200 views

Gzip -c over pipe matter?

I saw sometime 2 ways of writting: with and without -c Do the 2 following case output the same and have equal speed ? mysqldump -u root dbname | gzip > test.sql mysqldump -u root dbname | gzip -c ...
0
votes
0answers
18 views

Restoring file after zipping, when it become binary [duplicate]

I zip my python file into file.py.gz on Linux. After that my file become something like a binary file. When I am open file with vim, on the bottom was a text " [noeol] [converted]. I want to restore ...
0
votes
0answers
31 views

How to view specific path inside tar.gz?

tar -tf file.tar.gz let's me view inside the whole archive. How do you view a specific path without viewing the whole thing? E.g., I want to view only /path/foo/ Update: This command almost works ...
0
votes
1answer
153 views

Can I decompress a .gzip file with tar?

I downloaded a .gz file with anonymized Census data and around 1 GB compressed. I am unable to inspect it with tar: $ tar -tf census.csv.gz tar: Unrecognized archive format tar: Error exit delayed ...
0
votes
1answer
60 views

MNIST Dataset - .gz files do not contain “raw” bytes

I am trying to use the MNIST dataset. However, when I download the .gz image file and then unzip it, I get a lot of "compressed" bytes. Here's a bit of it: 'Tπüó<$fi˛˛˛˛Ò∆∆∆∆∆∆∆∆™4CrHr£„˛·˛˛˛˙²˛...
0
votes
0answers
150 views

IIS10 enable pre-compressed gzip

my angular2 projects build pre-compressed gzip files for my web-app but my IIS only servers the normal ".js" files instead of the compressed ".gzip" files. My browser is willing to accept gzip. What ...
1
vote
1answer
61 views

Append to compressed log

There is a couple of z-utilities (zless, zcat), which are able to read contents of zipped file in transparent manner. Is it possible to append to compressed log file (in either format, not ...
0
votes
1answer
250 views

simple way to extract tar.gz in-place with no hard-drive overhead

I'm working with a tar.gz file (196 GB). This file needs to be extracted (240 GB) in place, and I would like the total disk usage not to go over 240 GB during the process (or close to it as possible). ...
1
vote
1answer
113 views

Looking for the best way to backup and restore a directory of sparse files

We have a directory of sparse files (du returns 240M for one of these files; ls returns 960M). When we copy one of these files over to S3, we end up uploading the entire 960M, and on downloading ...
0
votes
0answers
297 views

AWS Redshift failed to inflateinvalid or incomplete deflate data while inserting a zipped csv file

I have a zipped csv file which is a part of a huge file, and extracted from the original huge file using the following command: gunzip -c myFile.csv.gz | head -n 500000 > myFile.csv.gz_p1 after ...
1
vote
1answer
7k views

“gzip: stdin has more than one entry--rest ignored” and “gzip: tmp.gz has more than one entry — unchanged”

I have a certain file named tmp.gz. When I try to decompress it using gzip -d, I get an error-message that it has multiple entries: $ gzip -d tmp.gz gzip: tmp.gz has more than one entry -- unchanged ...
1
vote
2answers
501 views

Md5 checksum different after gunzip and gzip

I accidentally deleted a handful of gzipped files from a folder. Thankfully, I had uncompressed them in a different location, and am in the process of restoring them. I had the md5 checksums for the ...
3
votes
1answer
1k views

How to use gzip or gunzip in a pipeline with curl (For binary gz files)

I am using curl to download a file using the following command. curl -O https://s3.amazonaws.com/dl4j-distribution/GoogleNews-vectors-negative300.bin.gz I want to unpack it in a pipeline in the ...
1
vote
2answers
1k views

Fast compression in 7z format (like zip or gzip)

In short: can the Deflate compression be used only with the zip format (-tzip) in 7zip? I want to archive a big directory (hundreds GiB) from a disk to another, while keeping I/O speed the same or ...
5
votes
1answer
966 views

Is .gz the same as .gzip?

I'm decompressing a file with a .gzip extension and then re-compressing it using 7Zip. When re-compressed though it has a .gz extension. Are a .gz and .gzip extension the same thing?
0
votes
1answer
2k views

Create a tar.gz from an image file (Linux or Mac) [closed]

Hi I have an img of a custom linux distro and I would like to convert it to a tar.gz file. (I am using Mac or Linux OS) What is the most straight forward way to do it? Thank you
1
vote
1answer
66 views

Is running gzip compression on a directory tree already in the process of being gzip'd safe?

Can I simultaneously compress the same directory tree using tar -zcvf (gzip) (e.g. in two separate shells, one after the other but the second one running before the first one finished) with two ...
0
votes
1answer
81 views

Drobo FS on Fedora tar backups fail w Input/output error, Child returned status 1

We're been running tar/gzip backups for a while on Fedora 25 Linux servers and we'd like to make sure aquota.user files get backed up. From the comments in the drobo-backup.conf file here's what we ...
1
vote
1answer
165 views

Reading ZFS snapshots from tape is slow

I backed up my a zfs snapshot to tape using zfs send tank/vertex@2017-01-20 | pv -cCTrbB 1g | pigz -c | pv -cCTrbB 1g | dd of=/dev/nst0 bs=1M and then read it back using dd if=/dev/nst0 bs=1M | pv -...
0
votes
1answer
96 views

Compare compression: gzipping individual files vs. gzipping tar of same files

Consider a hypothetical archive format that does the following under the covers, given a list of files to pack: gzip each file individually Tar the gzips together Contrast this with traditional tar ...
2
votes
1answer
156 views

Gzip huge directory into separate .gz files for ssh transfer

I have a directory of ~200.000 .npy files with a total size ~100 gb. All files are stored directly below the main directory (i.e. there's no sub-directories). I need to transfer the directory and ...
0
votes
0answers
20 views

how much time takes to check the compressed file is available or not in that directory while using gzip compression in apache?

I am using static compression.(i.e.)In my application, When xml is generated, then I also creates its gzipped version and place near in it. I am having little confusion in it. When clients sends ...
4
votes
0answers
327 views

What is the difference in gzip compression levels?

Have been using gzip for a few years and usually I always gzip -9 out of habit as it is the highest level of compression. I understand that lower levels means less compression but quicker compress ...
2
votes
2answers
174 views

Optimizing gzipped files for block-level deduplication

I have about 100TiB of compressed gzip data on cloud volumes. On my way to run a block-level dedup (duperemove for btrfs) I find that it was compressed without -n, which causes block-level difference ...
1
vote
1answer
202 views

How to enable Opencl for gzip?

gzip is a widely used lossless compression program. I have installed gzip and the version is as follows gzip 1.2.4 (18 Aug 93) Compilation options: DIRENT UTIME STDC_HEADERS HAVE_UNISTD_H How to ...
2
votes
3answers
2k views

Ungzip all gz files in Windows

I have many .gz files and I want to unzip all of them keeping their name and folder nesting. How can I do this with Windows? Does 7zip have functionality that could complete this?
1
vote
1answer
89 views

Download very large files with HTTP

I'm downloading the PlaceNet compressed database of place images (~132GiB). Unluckily the downloaded file is corrupted. I have tried several times, each time the extraction is stopped at different ...
0
votes
1answer
319 views

Tar & save the output of a command

I want to tar the output of a command, say cat hello.world, to a compressed tar file. I don’t want to save a temporary file and later tar it manually. How can I do this?
-1
votes
2answers
223 views

gzip unix command with tar command

I want to zip more than one file using gzip, but when I unzip it I should get multiple files. I tried tar with zip but tar created extra folders that I don't want. The files I want to zip are cp1....
0
votes
1answer
99 views

Decompress all gz files in a tree

I am working on an Ubuntu 14 server. Trying to create a tar.gz backup of my website, I accidentally gzipped every individual file in my /var/www/ directory, recursively. Now the whole tree consists ...
0
votes
1answer
321 views

Tar Archive All Files with Extension

I'm using this command to archive all PHP files: find -name "*.php" | sudo tar -zcpvf my-archive.tar.gz -T - It works great, except that the output is like this: ./file1.php ./file2.php ./file3.php ...
0
votes
0answers
355 views

How can I restore a MySql database dump direct from S3?

I have a gzipped database backup stored on S3 and would like to restore it to MySql without having to first download it due to disk space constraints. I tried the two commands below but got gzip: ...
0
votes
1answer
183 views

Apache2 with mod_deflate serve bad css and js

Problem I am having is with css and js files served as file.css.gz and file.js.gz on one of enabled sites. The content is served as this gibberish: û—Û6’0ú»ÿ ­sæÚNZ²H½ZΉ¿yìN&9Iv¿yå5sï¡H¨Å˜5$Õïõ÷·...
1
vote
0answers
225 views

Gzip'd tar archive Spanning Multiple Disks

Very similar to (How to create tar archive split into, or spanning, multiple files?), but specifically I would like to simultaneously: tar and compress a 10 tb directory, having insufficient local ...
3
votes
1answer
2k views

Linux pv | gzip doesn't delete original file

I'm pretty new to unix so go easy. Normally gzip file replaces file with file.gz (which i'm guessing is: create file.gz then rm file). I have some rather large files I'm compressing and I like to ...
4
votes
2answers
1k views

Archive (.tar.gz) Corruption

I've got a .tar.gz archive that has definitely suffered some kind of corruption. The data inside the archive is obviously very precious to me and I'd really like to get my hands on as much as possible....
1
vote
0answers
42 views

Simultaneously enable gzip and $STR_REPLACE in CGI in apache

I have a code in my CGI script for text replacement (for example replace 'red' with 'blue') $STR_SEARCH='red' $STR_REPLACE='blue' I am using the below code in .htaccess for enable replace function: ...
0
votes
0answers
26 views

gzip archive with damaged begin

How to recover as much as possible gzip file content when begin of this file is damaged? Is it possible? I tried commands gunzip -c , zcat, openssl zlib -d etc. Unfortunately that commands doesn't ...
2
votes
1answer
383 views

Change the directory structure in tar.gz without extracting it

I have a tar.gz file that has the following structure when I extract. /dir1/dir2/dir3/many_text_files(.txt) I would like to change the structure as dir3/many_text_files(.txt) A simple solution is to ...
0
votes
2answers
2k views

How to zip an entire folder via gzip?

I am trying to zip an entire folder. There's this -r command to zip a folder recursively. Now this is good to zip all the files in a folder, but my predicament is I want to zip the folder in it's ...
0
votes
1answer
250 views

Ignore Zeros Not Working When Trying To Open Tar

I have a backup file from my system admins called backup.tar.gz. They mentioned that I need to use the --ignore-zeros/-i command when unzipping the file. However when I run the command as suggested ...
2
votes
1answer
77 views

How to Tar/GZip just the files folders in the data directory?

I have a bunch of folders and files in /usr/local/bin/data that I want to tar.gz. I have a bash script that sets the source folder to backup src='/usr/local/bin/data/* When I open up the .tar.gz ...
3
votes
1answer
715 views

Using dd to backup disk to same disk

I've tried using dd to back up my computer's hard drive, but I met with some rather confusing results. I've seen on multiple sources (e.g.: http://www.backuphowto.info/linux-backup-hard-disk-clone-dd,...
1
vote
0answers
92 views

GZIP file system code for Linux?

GZIP allows one to use file system codes. See page 7 of RFC 1952. What is (are?) the GZIP file system code(s) to use for Linux?
0
votes
1answer
139 views

using compressed (.gz) files with command line scripts expecting uncompressed files

In order to save disk space, I've gunzip-ed a lot of my files that I regularly use. What is a best-practice way to still use the .gz version of these text files with, say, python scripts? More ...