Questions tagged [data-integrity]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
52 views

Can LUKS2 integrity checksum initialization be made faster?

I am setting up a 2TB external USB disk with encryption using cryptsetup and LUKS2 with data integrity checksums. I am running: > cryptsetup -y -v luksFormat /dev/sda1 --integrity hmac-sha256 ...
user avatar
  • 151
0 votes
3 answers
81 views

Does a repeated download protect against file corruption?

Disclosed real issue: I use a program called youtube-dl to download and archive videos from websites like YouTube and Twitch. To verify the integrity of the downloads, I download the same video twice ...
user avatar
  • 3
0 votes
0 answers
66 views

Is downloading a media file twice and comparing their hash values enough to verify their integrity?

I often use youtube-dl to download videos. As far as I know, there is no data integrity verfication built in to youtube-dl, so what I do to verify that a video isn't corrupted in some way after ...
user avatar
  • 3
0 votes
0 answers
17 views

What's RedHat integrity test?

The binary DVD *.isos for installing the Red Hat OS, which I downloaded from https://access.redhat.com/downloads/, I checked, has the same SHA-256 reported in the webpage. But when I boot the ...
user avatar
  • 131
0 votes
1 answer
100 views

When a HDD has bad sectors, are files that don't show up any errors at reading in good state?

Well, I am dealing with an HDD with some unreallocated bad sectors for the 2nd time (the first time was a dying HDD, but now this other HDD is just one with "caution" state according to ...
user avatar
1 vote
0 answers
100 views

ffmpeg is complaining about ACT flag violation in some of our DNxHD videos. Could this be safely ignored? Why?

We've been using ffmpeg/ffprobe for checking video file integrity. If ffmpeg returns anything in its stderr, we'd know something's not right. For some videos, an error like this will show up in the ...
user avatar
1 vote
1 answer
350 views

How to cryptographically verify the authenticity and integrity of Microsoft Windows .iso releases (with gpg?)

For a given Windows release published by Microsoft, how can I cryptographically verify the authenticity and integrity of the .iso file that I downloaded before I copy it onto a USB drive and attempt ...
user avatar
0 votes
2 answers
411 views

How to checksum files from filename on Linux

I have many files tagged with a CRC checksum on their filename on a Windows machine. Example: filename_[000000].extension I know there are a lot of options for Linux based systems to check/calculate ...
user avatar
  • 123
0 votes
1 answer
425 views

How to cryptographically verify the authenticity and integrity of Mozilla releases (Firefox, Thunderbird, etc)

For a given software release published by Mozilla, how can I cryptographically verify the authenticity and integrity of the file that I downloaded before I execute it to install that program? Today I ...
user avatar
0 votes
1 answer
134 views

How does dropbox handle silent data corruption?

How does dropbox handle silent data corruption? If I have 10 computers synced through dropbox and one day on one of them just some files corrupt unnoticed, will dropbox just sync that 'change' to the ...
user avatar
1 vote
1 answer
483 views

7-Zip. t (Test integrity of archive) command. Syntax. Two variants. Difference

I use 7-Zip. I work in Windows 10 Home 64-bit. I use command line. From 7-Zip help I know there is t (Test integrity of archive) command. Do I understand right way the following? In this case 7z t ...
user avatar
  • 35
2 votes
1 answer
2k views

What's a good way to batch check media files for integrity?

I have some 15000 image, video and audio files (and also a few others) that I have been bouncing back and forth via FTP from my phone. After so many times, I found out that a few of them were ...
user avatar
1 vote
1 answer
1k views

ISO image integrity check (new try)?

When you open an .iso file with e.g. 7-zip, the tool lets you test the ISO file, just like you can test any RAR or 7Z or ZIP file that the file is still ok. If that test finishes successfully, does ...
user avatar
  • 75
4 votes
2 answers
3k views

How to turn ReFS "Enforced" file integrity off?

Short Version I have files on a ReFS volume where Integrity Stream integrity is Enforced is true. PS M:\> Get-Item Contoso.vhdx | Get-FileIntegrity FileName Enabled Enforced -------- ...
user avatar
  • 21k
1 vote
0 answers
429 views

Can Nero SecurDisc Surface Scan be rerun after the disc had been burned?

I burned a double layered BD-R disc (UDF file system), it finished successfully then in the midst of the surface scan run I had a power outage before it had the time to finish. All of the data was ...
user avatar
  • 184
4 votes
1 answer
259 views

How does sfc utility check file integrity?

We know that, in Windows OS, sfc is a well-known utility that checks for the integrity of critical system files. If changes are found, they are replaced by compressed files in Wsxs folder or the like....
user avatar
0 votes
1 answer
597 views

How to verify Integrity of ISO file with these constraints?

I have a Windows 7 Desktop PC. My secondary HDD (SATA Internal) has developed a few bad sectors. Now its state is being reported as Caution in CrystalDiskInfo tool. I have already taken backup of my ...
user avatar
  • 1,466
1 vote
0 answers
1k views

Windows 10 - Different methods to disable driver signature check and their realations

For Windows 10 I am examining different methods to monitor the disabling of "driver signature check". From a search online I found 3 main method: from administrator cmd run: bcdedit.exe -set ...
user avatar
  • 225
-1 votes
3 answers
96 views

Is it possible to see a ping from a LAN computer to an unknown destination?

rookie question... Two computers in a home network connected only by Ethernet to a router. The router is connected to internet and gives the computer ip:s like 192.168.10.xx. One of the computers ...
user avatar
0 votes
1 answer
1k views

How do you check the integrity of a VHD without using Powershell or Hyper-V Manager?

I'm running Windows 10 Home, so I cannot enable Hyper-V manager nor use Powershell cmdlets like test-vhd. I used Paragon Hard Disk Manager 16 to create a backup image of my HD in .vhd format, and I'd ...
user avatar
  • 170
1 vote
1 answer
305 views

How to be sure that readonly snapshot is not corrupted in BTRFS?

How can we sure that a readonly snapshot is not corrupted due to a disk failure? Is the only way calculating the checksums one on another and store it for further examination, or does BTRFS handle ...
user avatar
  • 495
0 votes
1 answer
93 views

How to ensure complete file integrity of key files?

A question in regards to file integrity: How can I ensure that the integrity of a file will always stay 100%? Important for example when storing key files in regards to encryption etc. on local ...
user avatar
  • 1
2 votes
1 answer
522 views

Can a device ruin an SD Card or microSD card?

I have a device that I think might be ruining microSD storage cards (SanDisk cards). The device happens to be a smartphone (an older Samsung Galaxy S), but this question applies to any device. Is it ...
user avatar
1 vote
1 answer
801 views

HPA (Host Protected Area) disabled. Bad consequences?

If an SSD's HPA is disabled, then are there any bad consequences? (In terms of data integrity, wear leveling, etc.) Do the following options make any difference to the SSD controller? HPA disabled, ...
user avatar
1 vote
1 answer
144 views

Check that files exist on remote server with different directory structure or organization

I have made a NAS project to replace an aging shared external disk drive, and before decomissioning the old shared disk drive, I'd like to verify that I have copied all important data to the new NAS. ...
user avatar
  • 11
7 votes
1 answer
3k views

How to get Btrfs verify checksum for one file?

Btrfs offers these commands to verify data integrity/checksums: btrfs scrub start <path>|<device> btrfs check --check-data-csum However, AFAIK those always verify whole filesystems; the ...
user avatar
41 votes
3 answers
8k views

Does Git prevent data degradation

I read that ZFS and Btrfs use checksums to prevent data degradation and I read that Git has integrity through hashing essentially everything with each commit. I was going to use a Git server on a ...
user avatar
6 votes
2 answers
2k views

Is there any reason to verify a download checksum over HTTPS

Assuming that both the page linking the download, and the download itself are on trusted domains over HTTPS, is there any reason to worry about checking the hash/checksum of the downloaded file (...
user avatar
  • 1,323
6 votes
1 answer
8k views

Interpreting the Spin Retry Count S.M.A.R.T. attribute value for hard drives

I'm confused about the Spin Retry Count S.M.A.R.T. attribute value. On one particular hard drive, I see a raw value of 0, which the popular CrystalDiskInfo v7.0.5 interprets as a current value of 166,...
user avatar
0 votes
1 answer
77 views

Behavior of thumb drives when disconnected from power

Less than 2 months ago, I ordered a thumb drive (cheap one). I used it the day it arrived and I think about 3 days after that. Merely checked it with badblocks and then dd-ed a Linux image into it. It ...
user avatar
  • 660
5 votes
3 answers
8k views

Can ZFS cope with sudden power loss? (What events cause a pool to be irrecoverable if the disk itself hasn't failed or become unreliable)

All the resources say ZFS doesn't have fsck, or recovery tools, use battery backed SSD for ZIL, etc. If the plug is suddenly somehow pulled (total power loss despite UPS etc, but assuming no ...
user avatar
  • 1,515
1 vote
0 answers
18 views

Disallowing a Windows 7 Pro user to modify directory contents unless he is doing so using a designated Application "A"

Noob here. I've looked around and not been able to find an answer for this on Windows 7 Platform. This pertains to Securing data files. The basic idea is that files should not be permitted to be ...
user avatar
30 votes
3 answers
4k views

Can data on a hard disk degrade without Windows warning me that this has happened when I attempt to access the data?

Is it likely that a physical degradation of a hard disk could cause bits to 'flip' in file contents without the OS 'noticing' and telling you about it when reading the file? e.g. could a 'p' in an ...
user avatar
0 votes
0 answers
286 views

How to interpret an "SFC /VERIFYONLY" CBS integrity log (win10)?

I ran an SFC on my system and it tells me that there were some "Integrity Violations" and to see the log file for more details. So I was able to open it up in Notepad, but I have no idea what I'm ...
user avatar
  • 623
0 votes
1 answer
150 views

Recompressing zip - integrity check

I have multiple large zip files and I would like to recompress them without unpacking them (I run the risk of running out of disk space). I am thinking of using advzip for that task. However, I want ...
user avatar
0 votes
1 answer
96 views

Could a CF card submerged in sea water for a few days still work?

The title pretty much sums it up: What are the chances of a Compact Flash card that has been submerged in sea water for a few days still working? The card in question has a pretty expensive licence ...
user avatar
  • 5,788
-1 votes
1 answer
41 views

Removing a USB external disk without properly ejecting it

What are the integrity-related issues I might have by simply removing a USB external hard disk from my computer, without logically disconnecting it (e.g. via Windows desktop bar icon)? Is the concern ...
user avatar
  • 141
11 votes
5 answers
5k views

Do we really need to check the integrity of downloaded files? [duplicate]

I downloaded a huge amount of files, but discovered the use of md5 and sha as integrity checkers quite recently. From then I always prefer to check it for big downloaded files, even if I never found ...
user avatar
  • 241
1 vote
0 answers
435 views

How do I check integrity of a file from DreamSpark?

I have a very unstable connection and it cut off multiple times while downloading Windows 8.1 using Microsoft's SDM, so I'm kind of concerned to how I can check to see if the file is still intact once ...
user avatar
  • 33
2 votes
1 answer
1k views

Verify rdiff backup integrity

I am using rdiff for my differential backup. Recently an issue happened where all versions of my backup failed to patch correctly and rdiff returning an error 106 which after investigation is a code ...
user avatar
  • 197
4 votes
2 answers
3k views

Comparing folders on two unconnected computers

I'd like to compare folders on two different computers. I'm using BitTorrent Sync to synchronize currently 260 GBs of data between two computers: a Windows 7 desktop PC and a Windows 8.1 laptop. All ...
user avatar
  • 1,954
1 vote
1 answer
171 views

PXE reliability

I understand that PXE is implemented by using TFTP over UDP - neither one of those protocols verifies integrity, which would seem important for something like the operating system - is there some sort ...
user avatar
  • 1,015
0 votes
1 answer
2k views

Transactions per second in a database (say PostgreSQL)

I refer to 2 documentation pages on PostgreSQL's site: #1 and #2. From these, we see the transaction log is flushed to disk 5 times per second (wal_writer_delay = 200ms), and we also see the RDBMS won'...
user avatar
  • 155
0 votes
2 answers
155 views

File integrity checking

I have a lot of PDFs and many of them may be corrupt. Rather than checking each one, how could I check them all at once and delete any that are corrupt? Using Linux. I also don't have a way to get ...
user avatar
  • 1
1 vote
0 answers
1k views

Cheaper alternative to ZFS Storage for a home NAS

I'm looking to build a NAS for home use with 8-10*(2-4TB) drives, out of which 2-3 drives would be used for parity via software RAID. In the past years and up to date, ZFS seems to have become the ...
user avatar
  • 293
3 votes
1 answer
323 views

How to make GNU/Linux more robust in case of frequent power loss

When having a system (hardware), that has no protection against sudden power loss (zero power at all), what is the best way to keep the damage that may occur to a running GNU/Linux as low as possible? ...
user avatar
  • 1,679
11 votes
1 answer
3k views

Is ECC mandatory in SSD technology?

While shopping for an SSD I have noticed that some manufacturers promote their "Pro" models as the ones sporting ECC data protection. Those manufacturers do not mention ECC in their budget models ...
user avatar
0 votes
4 answers
4k views

Check if a file has been changed

I have the following scenario: A certain process (A) creates files and I want to write a program which reads these files to generate some statistical data. The problem is simple. I want to be sure ...
user avatar
3 votes
1 answer
340 views

Does flash-memory integrity depend on system resources while reading/writing (like CDs/DVDs)?

Question I’m really concerned that flash-memory is just not reliable as a storage for irreplaceable files. Does anybody know if the integrity (corruptibility) of flash-memory (flash-drives, memory-...
user avatar
  • 67k
45 votes
1 answer
45k views

How do I fix "WARNING: message was not integrity protected" when using GPG symmetrical encryption?

I've encrypted a file using symmetric encryption like this: gpg --symmetric myfile which results in a file myfile.gpg. Alright. Now let's decrypt the file again: gpg -o myfile --decrypt myfile.gpg ...
user avatar
  • 3,378