Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [gzip]

`gzip` (or GNU zip) is a file format and corresponding utility for compressing files using the DEFLATE algorithm. The usual extension is `.gz`.

1
vote
1answer
62 views

DD image smaller than drive copied

I took a backup of my server's OS disk through a live USB. Using the command: dd if=/dev/sda bs=512 count=(30 gb worth of sectors) conv=noerror,sync status=progress | gzip -c > /path/to/removable/...
0
votes
1answer
24 views

How do I use 7-Zip GUI for Windows to create .tar.gz files?

How can I use the 7-Zip GUI on Windows to create .tar.gz files?
1
vote
1answer
36 views

Why does gzip -c give different results than gzip?

I am writing unit tests for some code and found that a simple gzip is causing a difference in my results. Upon further investigation I found that gzip gives a different .gz file than gzip -c does. Why ...
1
vote
1answer
87 views

Gzip -c over pipe matter?

I saw sometime 2 ways of writting: with and without -c Do the 2 following case output the same and have equal speed ? mysqldump -u root dbname | gzip > test.sql mysqldump -u root dbname | gzip -c ...
0
votes
0answers
18 views

Restoring file after zipping, when it become binary [duplicate]

I zip my python file into file.py.gz on Linux. After that my file become something like a binary file. When I am open file with vim, on the bottom was a text " [noeol] [converted]. I want to restore ...
0
votes
0answers
30 views

How to view specific path inside tar.gz?

tar -tf file.tar.gz let's me view inside the whole archive. How do you view a specific path without viewing the whole thing? E.g., I want to view only /path/foo/ Update: This command almost works ...
0
votes
1answer
107 views

Can I decompress a .gzip file with tar?

I downloaded a .gz file with anonymized Census data and around 1 GB compressed. I am unable to inspect it with tar: $ tar -tf census.csv.gz tar: Unrecognized archive format tar: Error exit delayed ...
0
votes
1answer
49 views

MNIST Dataset - .gz files do not contain “raw” bytes

I am trying to use the MNIST dataset. However, when I download the .gz image file and then unzip it, I get a lot of "compressed" bytes. Here's a bit of it: 'Tπüó<$fi˛˛˛˛Ò∆∆∆∆∆∆∆∆™4CrHr£„˛·˛˛˛˙²˛...
0
votes
0answers
114 views

IIS10 enable pre-compressed gzip

my angular2 projects build pre-compressed gzip files for my web-app but my IIS only servers the normal ".js" files instead of the compressed ".gzip" files. My browser is willing to accept gzip. What ...
1
vote
1answer
48 views

Append to compressed log

There is a couple of z-utilities (zless, zcat), which are able to read contents of zipped file in transparent manner. Is it possible to append to compressed log file (in either format, not ...
0
votes
1answer
225 views

simple way to extract tar.gz in-place with no hard-drive overhead

I'm working with a tar.gz file (196 GB). This file needs to be extracted (240 GB) in place, and I would like the total disk usage not to go over 240 GB during the process (or close to it as possible). ...
1
vote
1answer
83 views

Looking for the best way to backup and restore a directory of sparse files

We have a directory of sparse files (du returns 240M for one of these files; ls returns 960M). When we copy one of these files over to S3, we end up uploading the entire 960M, and on downloading ...
0
votes
0answers
262 views

AWS Redshift failed to inflateinvalid or incomplete deflate data while inserting a zipped csv file

I have a zipped csv file which is a part of a huge file, and extracted from the original huge file using the following command: gunzip -c myFile.csv.gz | head -n 500000 > myFile.csv.gz_p1 after ...
1
vote
1answer
6k views

“gzip: stdin has more than one entry--rest ignored” and “gzip: tmp.gz has more than one entry — unchanged”

I have a certain file named tmp.gz. When I try to decompress it using gzip -d, I get an error-message that it has multiple entries: $ gzip -d tmp.gz gzip: tmp.gz has more than one entry -- unchanged ...
1
vote
2answers
439 views

Md5 checksum different after gunzip and gzip

I accidentally deleted a handful of gzipped files from a folder. Thankfully, I had uncompressed them in a different location, and am in the process of restoring them. I had the md5 checksums for the ...
3
votes
1answer
1k views

How to use gzip or gunzip in a pipeline with curl (For binary gz files)

I am using curl to download a file using the following command. curl -O https://s3.amazonaws.com/dl4j-distribution/GoogleNews-vectors-negative300.bin.gz I want to unpack it in a pipeline in the ...
1
vote
2answers
1k views

Fast compression in 7z format (like zip or gzip)

In short: can the Deflate compression be used only with the zip format (-tzip) in 7zip? I want to archive a big directory (hundreds GiB) from a disk to another, while keeping I/O speed the same or ...
4
votes
1answer
785 views

Is .gz the same as .gzip?

I'm decompressing a file with a .gzip extension and then re-compressing it using 7Zip. When re-compressed though it has a .gz extension. Are a .gz and .gzip extension the same thing?
0
votes
1answer
2k views

Create a tar.gz from an image file (Linux or Mac) [closed]

Hi I have an img of a custom linux distro and I would like to convert it to a tar.gz file. (I am using Mac or Linux OS) What is the most straight forward way to do it? Thank you
1
vote
1answer
59 views

Is running gzip compression on a directory tree already in the process of being gzip'd safe?

Can I simultaneously compress the same directory tree using tar -zcvf (gzip) (e.g. in two separate shells, one after the other but the second one running before the first one finished) with two ...
0
votes
1answer
80 views

Drobo FS on Fedora tar backups fail w Input/output error, Child returned status 1

We're been running tar/gzip backups for a while on Fedora 25 Linux servers and we'd like to make sure aquota.user files get backed up. From the comments in the drobo-backup.conf file here's what we ...
1
vote
1answer
152 views

Reading ZFS snapshots from tape is slow

I backed up my a zfs snapshot to tape using zfs send tank/vertex@2017-01-20 | pv -cCTrbB 1g | pigz -c | pv -cCTrbB 1g | dd of=/dev/nst0 bs=1M and then read it back using dd if=/dev/nst0 bs=1M | pv -...
0
votes
1answer
88 views

Compare compression: gzipping individual files vs. gzipping tar of same files

Consider a hypothetical archive format that does the following under the covers, given a list of files to pack: gzip each file individually Tar the gzips together Contrast this with traditional tar ...
2
votes
1answer
154 views

Gzip huge directory into separate .gz files for ssh transfer

I have a directory of ~200.000 .npy files with a total size ~100 gb. All files are stored directly below the main directory (i.e. there's no sub-directories). I need to transfer the directory and ...
0
votes
0answers
20 views

how much time takes to check the compressed file is available or not in that directory while using gzip compression in apache?

I am using static compression.(i.e.)In my application, When xml is generated, then I also creates its gzipped version and place near in it. I am having little confusion in it. When clients sends ...
4
votes
0answers
300 views

What is the difference in gzip compression levels?

Have been using gzip for a few years and usually I always gzip -9 out of habit as it is the highest level of compression. I understand that lower levels means less compression but quicker compress ...
2
votes
2answers
161 views

Optimizing gzipped files for block-level deduplication

I have about 100TiB of compressed gzip data on cloud volumes. On my way to run a block-level dedup (duperemove for btrfs) I find that it was compressed without -n, which causes block-level difference ...
1
vote
1answer
178 views

How to enable Opencl for gzip?

gzip is a widely used lossless compression program. I have installed gzip and the version is as follows gzip 1.2.4 (18 Aug 93) Compilation options: DIRENT UTIME STDC_HEADERS HAVE_UNISTD_H How to ...
1
vote
3answers
2k views

Ungzip all gz files in Windows

I have many .gz files and I want to unzip all of them keeping their name and folder nesting. How can I do this with Windows? Does 7zip have functionality that could complete this?
1
vote
1answer
85 views

Download very large files with HTTP

I'm downloading the PlaceNet compressed database of place images (~132GiB). Unluckily the downloaded file is corrupted. I have tried several times, each time the extraction is stopped at different ...
0
votes
1answer
309 views

Tar & save the output of a command

I want to tar the output of a command, say cat hello.world, to a compressed tar file. I don’t want to save a temporary file and later tar it manually. How can I do this?
-1
votes
2answers
219 views

gzip unix command with tar command

I want to zip more than one file using gzip, but when I unzip it I should get multiple files. I tried tar with zip but tar created extra folders that I don't want. The files I want to zip are cp1....
0
votes
1answer
94 views

Decompress all gz files in a tree

I am working on an Ubuntu 14 server. Trying to create a tar.gz backup of my website, I accidentally gzipped every individual file in my /var/www/ directory, recursively. Now the whole tree consists ...
0
votes
1answer
290 views

Tar Archive All Files with Extension

I'm using this command to archive all PHP files: find -name "*.php" | sudo tar -zcpvf my-archive.tar.gz -T - It works great, except that the output is like this: ./file1.php ./file2.php ./file3.php ...
0
votes
0answers
341 views

How can I restore a MySql database dump direct from S3?

I have a gzipped database backup stored on S3 and would like to restore it to MySql without having to first download it due to disk space constraints. I tried the two commands below but got gzip: ...
0
votes
1answer
171 views

Apache2 with mod_deflate serve bad css and js

Problem I am having is with css and js files served as file.css.gz and file.js.gz on one of enabled sites. The content is served as this gibberish: û—Û6’0ú»ÿ ­sæÚNZ²H½ZΉ¿yìN&9Iv¿yå5sï¡H¨Å˜5$Õïõ÷·...
1
vote
0answers
205 views

Gzip'd tar archive Spanning Multiple Disks

Very similar to (How to create tar archive split into, or spanning, multiple files?), but specifically I would like to simultaneously: tar and compress a 10 tb directory, having insufficient local ...
3
votes
1answer
2k views

Linux pv | gzip doesn't delete original file

I'm pretty new to unix so go easy. Normally gzip file replaces file with file.gz (which i'm guessing is: create file.gz then rm file). I have some rather large files I'm compressing and I like to ...
4
votes
2answers
994 views

Archive (.tar.gz) Corruption

I've got a .tar.gz archive that has definitely suffered some kind of corruption. The data inside the archive is obviously very precious to me and I'd really like to get my hands on as much as possible....
1
vote
0answers
39 views

Simultaneously enable gzip and $STR_REPLACE in CGI in apache

I have a code in my CGI script for text replacement (for example replace 'red' with 'blue') $STR_SEARCH='red' $STR_REPLACE='blue' I am using the below code in .htaccess for enable replace function: ...
0
votes
0answers
26 views

gzip archive with damaged begin

How to recover as much as possible gzip file content when begin of this file is damaged? Is it possible? I tried commands gunzip -c , zcat, openssl zlib -d etc. Unfortunately that commands doesn't ...
2
votes
1answer
348 views

Change the directory structure in tar.gz without extracting it

I have a tar.gz file that has the following structure when I extract. /dir1/dir2/dir3/many_text_files(.txt) I would like to change the structure as dir3/many_text_files(.txt) A simple solution is to ...
0
votes
2answers
2k views

How to zip an entire folder via gzip?

I am trying to zip an entire folder. There's this -r command to zip a folder recursively. Now this is good to zip all the files in a folder, but my predicament is I want to zip the folder in it's ...
0
votes
1answer
234 views

Ignore Zeros Not Working When Trying To Open Tar

I have a backup file from my system admins called backup.tar.gz. They mentioned that I need to use the --ignore-zeros/-i command when unzipping the file. However when I run the command as suggested ...
2
votes
1answer
65 views

How to Tar/GZip just the files folders in the data directory?

I have a bunch of folders and files in /usr/local/bin/data that I want to tar.gz. I have a bash script that sets the source folder to backup src='/usr/local/bin/data/* When I open up the .tar.gz ...
3
votes
1answer
678 views

Using dd to backup disk to same disk

I've tried using dd to back up my computer's hard drive, but I met with some rather confusing results. I've seen on multiple sources (e.g.: http://www.backuphowto.info/linux-backup-hard-disk-clone-dd,...
1
vote
0answers
89 views

GZIP file system code for Linux?

GZIP allows one to use file system codes. See page 7 of RFC 1952. What is (are?) the GZIP file system code(s) to use for Linux?
0
votes
1answer
124 views

using compressed (.gz) files with command line scripts expecting uncompressed files

In order to save disk space, I've gunzip-ed a lot of my files that I regularly use. What is a best-practice way to still use the .gz version of these text files with, say, python scripts? More ...
2
votes
1answer
482 views

Unzipping files downloaded from the Arxiv server

I want to download the source Tex files (not the pdf) of this document: http://arxiv.org/abs/1306.0322 After downloading here, I get a weird file with the ".0322v3" (the second part of the doc code) ...
0
votes
2answers
1k views

Can a tar.gz file contain malicious code? Is a Mac vulnerable to such a tar.gz?

Can a tar.gz file contain malicious code that is similar to ZIP file? On a Mac particularly? Edit: Oops, I meant to ask the process of opening/untar a tar file on the Mac. Not the contents of the ...