2022 Developer Survey is open! Take survey.

Questions tagged [gzip]

`gzip` (or GNU zip) is a file format and corresponding utility for compressing files using the DEFLATE algorithm. The usual extension is `.gz`.

Filter by
Sorted by
Tagged with
0 votes
2 answers
119 views

Can one extract the files in a .tar.gz and upload them individually onto cPanel?

I am in the process of migrating my website from Bluehost to a different hosting company. I downloaded the entire backup of the cPanel (61 GIG) successfully, but uploading files is incredibly much ...
user avatar
1 vote
1 answer
112 views

Error: (InvalidBSON) incorrect BSON length in element with field name 'clone_class_metrics.CE' in object with _id: ObjectId

I have windows 10 on my system with enough storage. I have a database that is 208 GB in a file with the .agz extension. When I import the database into my MongoDB, I face the following error: 2021-09-...
user avatar
0 votes
1 answer
140 views

How do I maintain integrity on zip and unzip?

I'm taking a dd of a drive and trying to share it with a friend. It's rather big after dd (~8gb). When I tar -czvf my-image.img I can get it down to ~1.5gb. However, if I try to test unzip it, I see ...
user avatar
  • 155
0 votes
0 answers
102 views

How does gzip --rsyncable work from a technical perspective?

I know that gzip --rsyncable compresses files that way that different compressed versions of the same file differ less so rsycs delta-transfer can transfer them with less traffic https://linuxcommand....
user avatar
  • 119
0 votes
0 answers
39 views

Unable to decompress file with gzip

I have a file called myfile.dat.gz that I need to decompress. I have been trying gzip -d myfile.dat.gz, but this results in the error gzip: myfile.dat.gz: invalid compressed data--format violated. ...
user avatar
1 vote
1 answer
201 views

recompressing .gz and .bz2 files to attain the same hash/checksum (mod timestamps?)

i want to duplicate the entire contents of wikimedia's dumps, monthly, and upload them to amazon glacier and/or tape backup and/or a third backup medium that can survive corporation collapse/...
user avatar
3 votes
1 answer
235 views

I have downloaded large gzipped xml files from Pubchem but my computer says they are corrupted

I have tried twice downloading the large gzipped xml files from PubChem FTP server, once through wget and one through chrome manually, but both times result in a corrupt file. For example, the first ...
user avatar
  • 289
0 votes
0 answers
371 views

How could I use logrotate and group by day a bunch of gzip files with an uncompresssed extension?

Doing a test in a production enviroment with rotation logs with 2 days just for testing purposes with gizp files. Created a test file at /tmp/. /etc/init.d/test /tmp/test/*.gz { daily ...
user avatar
  • 317
0 votes
1 answer
501 views

How to split a large gzip file into smaller gzip files without uncompressing it first?

Is there a way to split a large gzip file into smaller gzip files without using zcat? zcat large.bed.gz| split --numeric-suffixes - -b 7M --filter='gzip > $FILE.gz' large.part.
user avatar
  • 272
0 votes
1 answer
1k views

How can I count the number of files inside a tar.gz file (don't want to decompress)

I have a tar.gz file (neatly 1TB size). I want to count the number of files inside this tar.gz file. I used the following command tar -tzf file.tar.gz but it only lists the file name while I need the ...
user avatar
  • 1
1 vote
1 answer
390 views

Transfer a directory over ssh with sudo

I am trying to transfer a directory from a remote server(CentOS) to my local machine(Ubuntu) over ssh. There are two users : A and B. User A can ssh into remote server and has sudo access. User B owns ...
user avatar
-2 votes
1 answer
47 views

I want to tar gz file of the month of January

-rw-r--r--. 1 root root 4788074 Jan 1 01:50 2020-01-01-00-50-18.done.csv -rw-r--r--. 1 root root 4842864 Jan 1 02:50 2020-01-01-01-50-18.done.csv -rw-r--r--. 1 root root 4923486 Jan 1 03:50 ...
user avatar
0 votes
1 answer
126 views

Perform operations on the output of find command with -exec options

I want to perform operations on the files found by the find command which already has a -exec option. find . -type f -exec zgrep -li "4168781103" {} + Output: ./results/...
user avatar
1 vote
1 answer
610 views

How to make Dovecot maildir format emails be gziped using zlib

I activate compression plugin by set following on Dovecot: # /etc/dovecot/conf.d/20-imap.conf (...) protocol imap { mail_plugins = $mail_plugins zlib } # /etc/dovecot/conf.d/90-plugin.conf (...) ...
user avatar
1 vote
0 answers
234 views

"gzip --version" gives "Abort trap: 6" in macOS

I found that doing gzip --version in the terminal on my Mac just gives output Abort trap: 6. I came across this because it appears to cause another program to exit when it searches for the installed ...
user avatar
  • 11
0 votes
1 answer
261 views

gzip: CHARTEVENTS.csv.gz: not in gzip format

I'm trying to expand a file named CHARTEVENTS.csv.gz by using guzip CHARTEVENTS.csv.gz , but always I have this error gzip: CHARTEVENTS.csv.gz: not in gzip format . can any one tell me what is the ...
user avatar
0 votes
1 answer
81 views

how to send the decompressed output of archives to standard output?

When you decompress a gzip archive with gunzip without any arguments, the archive disappears, and you're left with the decompressed file in its place. However, if you use the -c option, the archive ...
user avatar
  • 103
0 votes
1 answer
376 views

Extracting a file in solaris

I'm try to extract a file in solaris to a folder. I have tried following combinations but no luck. gunzip -c jdk-8u211-solaris-sparcv9.tar.gz > /opt/java/jdk8.2.11 I'm getting a is directory ...
user avatar
0 votes
1 answer
159 views

Serving tar.gz file through AWS Cloudfront?

I would like to keep things tidy on the S3 bucket where my website's assets live. Currently I am uploading all assets to S3, as part of the CI/CD pipeline, this has got a bit messy since generated ...
user avatar
0 votes
0 answers
218 views

gz file corrupted while transfer

I have huge gz files generated in linux machines and everyday night there is a script running to move files to remote network storage which is also linux host with terabytes data. The problem is, I am ...
user avatar
3 votes
1 answer
5k views

MongoDB, Using mongorestore on an .agz file

I am using MongoDB 3.6 and am having trouble understanding how to use mongorestore on an .agz file. If I specify the below, then I get an error saying Failed: error connecting to db server: no ...
user avatar
  • 175
0 votes
2 answers
346 views

How to restore the original file.gz after running a gunzip -f file.gz?

The default behavior of gunzip is to delete the .gz file after it decompresses. There's a way to restore the original file from the decompressed version on Mac OS?
user avatar
  • 101
8 votes
1 answer
1k views

While trying to see the content of a zipped file, I only get information about the zipping process

In Ubuntu, installed on Windows Subsystem for Linux, I want to see the content of a zip file, using gzip --list. I expected to see a list of included files like this: FileName ratio File1 ...
user avatar
  • 1,462
2 votes
1 answer
2k views

How do modern browsers deflate .tar.gz files?

Assuming the server is set up correctly, modern browsers are able to automatically decompress .gzip files when they are downloaded. Is the same true for a .tar.gz file? For example, say you have an ...
user avatar
  • 133
0 votes
2 answers
287 views

Extract folder inside large gzip file in windows

I have a 200 gb tar.gz file I need to extract one folder inside this file. I know exact location of the folder need. Is there any way to do that, any third party tools, or any power shell commands ? ...
user avatar
0 votes
1 answer
199 views

Compress and provide single-file access to 10 million files [closed]

I have ~10 million small text files and I would like to solve the following tasks: compress all the data; put it all into 1 file to transfer over the Internet; be able to access each single file ...
user avatar
2 votes
0 answers
466 views

Why is my .tar.gz larger than the sum of the separately compressed files in it?

I observed the following situation which is somewhat unexpected to me: I have a csv file and a corresponding txt file. Uncompressed, their sizes are 375MB and 5KB. When I compress the csv file ...
user avatar
  • 121
4 votes
2 answers
6k views

Not enough disk space to unzip 50 GB file on Ubuntu 16.04: Can I extract and reduce zip file size at the same time?

I have a 50 GB zip file, which contains roughly 50.000 jpg images. The jpgs are, unzipped, around 55 GB. I am on Ubuntu 16.04. But I only have 70 GB disk size on that system. So I get a disk error in ...
user avatar
  • 140
1 vote
1 answer
2k views

DD image smaller than drive copied

I took a backup of my server's OS disk through a live USB. Using the command: dd if=/dev/sda bs=512 count=(30 gb worth of sectors) conv=noerror,sync status=progress | gzip -c > /path/to/removable/...
user avatar
  • 13
13 votes
1 answer
29k views

How do I use 7-Zip GUI for Windows to create .tar.gz files?

How can I use the 7-Zip GUI on Windows to create .tar.gz files?
user avatar
  • 550
1 vote
1 answer
389 views

Why does gzip -c give different results than gzip?

I am writing unit tests for some code and found that a simple gzip is causing a difference in my results. Upon further investigation I found that gzip gives a different .gz file than gzip -c does. Why ...
user avatar
  • 1,344
1 vote
1 answer
1k views

Gzip -c over pipe matter?

I saw sometime 2 ways of writting: with and without -c Do the 2 following case output the same and have equal speed ? mysqldump -u root dbname | gzip > test.sql mysqldump -u root dbname | gzip -c ...
user avatar
0 votes
0 answers
67 views

How to view specific path inside tar.gz?

tar -tf file.tar.gz let's me view inside the whole archive. How do you view a specific path without viewing the whole thing? E.g., I want to view only /path/foo/ Update: This command almost works ...
user avatar
  • 5,257
0 votes
1 answer
606 views

Can I decompress a .gzip file with tar?

I downloaded a .gz file with anonymized Census data and around 1 GB compressed. I am unable to inspect it with tar: $ tar -tf census.csv.gz tar: Unrecognized archive format tar: Error exit delayed ...
user avatar
  • 1,493
0 votes
1 answer
181 views

MNIST Dataset - .gz files do not contain "raw" bytes

I am trying to use the MNIST dataset. However, when I download the .gz image file and then unzip it, I get a lot of "compressed" bytes. Here's a bit of it: 'Tπüó<$fi˛˛˛˛Ò∆∆∆∆∆∆∆∆™4CrHr£„˛·˛˛˛˙²˛...
user avatar
  • 3
1 vote
1 answer
1k views

Append to compressed log

There is a couple of z-utilities (zless, zcat), which are able to read contents of zipped file in transparent manner. Is it possible to append to compressed log file (in either format, not ...
user avatar
2 votes
1 answer
1k views

simple way to extract tar.gz in-place with no hard-drive overhead

I'm working with a tar.gz file (196 GB). This file needs to be extracted (240 GB) in place, and I would like the total disk usage not to go over 240 GB during the process (or close to it as possible). ...
user avatar
  • 121
1 vote
1 answer
690 views

Looking for the best way to backup and restore a directory of sparse files

We have a directory of sparse files (du returns 240M for one of these files; ls returns 960M). When we copy one of these files over to S3, we end up uploading the entire 960M, and on downloading ...
user avatar
  • 830
0 votes
0 answers
850 views

AWS Redshift failed to inflateinvalid or incomplete deflate data while inserting a zipped csv file

I have a zipped csv file which is a part of a huge file, and extracted from the original huge file using the following command: gunzip -c myFile.csv.gz | head -n 500000 > myFile.csv.gz_p1 after ...
user avatar
  • 101
14 votes
2 answers
37k views

"gzip: stdin has more than one entry--rest ignored" and "gzip: tmp.gz has more than one entry -- unchanged"

I have a certain file named tmp.gz. When I try to decompress it using gzip -d, I get an error-message that it has multiple entries: $ gzip -d tmp.gz gzip: tmp.gz has more than one entry -- unchanged ...
user avatar
  • 596
2 votes
2 answers
3k views

Md5 checksum different after gunzip and gzip

I accidentally deleted a handful of gzipped files from a folder. Thankfully, I had uncompressed them in a different location, and am in the process of restoring them. I had the md5 checksums for the ...
user avatar
  • 123
7 votes
1 answer
7k views

How to use gzip or gunzip in a pipeline with curl (For binary gz files)

I am using curl to download a file using the following command. curl -O https://s3.amazonaws.com/dl4j-distribution/GoogleNews-vectors-negative300.bin.gz I want to unpack it in a pipeline in the ...
user avatar
  • 73
1 vote
2 answers
8k views

Fast compression in 7z format (like zip or gzip)

In short: can the Deflate compression be used only with the zip format (-tzip) in 7zip? I want to archive a big directory (hundreds GiB) from a disk to another, while keeping I/O speed the same or ...
user avatar
  • 1,114
10 votes
1 answer
7k views

Is .gz the same as .gzip?

I'm decompressing a file with a .gzip extension and then re-compressing it using 7Zip. When re-compressed though it has a .gz extension. Are a .gz and .gzip extension the same thing?
user avatar
  • 203
2 votes
1 answer
11k views

Create a tar.gz from an image file (Linux or Mac) [closed]

Hi I have an img of a custom linux distro and I would like to convert it to a tar.gz file. (I am using Mac or Linux OS) What is the most straight forward way to do it? Thank you
user avatar
  • 141
1 vote
1 answer
107 views

Is running gzip compression on a directory tree already in the process of being gzip'd safe?

Can I simultaneously compress the same directory tree using tar -zcvf (gzip) (e.g. in two separate shells, one after the other but the second one running before the first one finished) with two ...
user avatar
0 votes
1 answer
150 views

Drobo FS on Fedora tar backups fail w Input/output error, Child returned status 1

We're been running tar/gzip backups for a while on Fedora 25 Linux servers and we'd like to make sure aquota.user files get backed up. From the comments in the drobo-backup.conf file here's what we ...
user avatar
1 vote
1 answer
522 views

Reading ZFS snapshots from tape is slow

I backed up my a zfs snapshot to tape using zfs send tank/vertex@2017-01-20 | pv -cCTrbB 1g | pigz -c | pv -cCTrbB 1g | dd of=/dev/nst0 bs=1M and then read it back using dd if=/dev/nst0 bs=1M | pv -...
user avatar
1 vote
1 answer
216 views

Compare compression: gzipping individual files vs. gzipping tar of same files

Consider a hypothetical archive format that does the following under the covers, given a list of files to pack: gzip each file individually Tar the gzips together Contrast this with traditional tar ...
user avatar
2 votes
1 answer
313 views

Gzip huge directory into separate .gz files for ssh transfer

I have a directory of ~200.000 .npy files with a total size ~100 gb. All files are stored directly below the main directory (i.e. there's no sub-directories). I need to transfer the directory and ...
user avatar
  • 231

1
2 3 4 5