Questions tagged [data-integrity]
The data-integrity tag has no usage guidance.
69
questions
1
vote
0
answers
112
views
How reliable is diff?
I copied a large directory from one volume to another (using rsync) and subsequently wanted to check whether the copy was indeed correct to verify the integrity of the data. To avoid the lengthy file ...
- 146
0
votes
3
answers
101
views
Does a repeated download protect against file corruption?
Disclosed real issue:
I use a program called youtube-dl to download and archive videos from websites like YouTube and Twitch. To verify the integrity of the downloads, I download the same video twice ...
- 3
0
votes
0
answers
169
views
Is downloading a media file twice and comparing their hash values enough to verify their integrity?
I often use youtube-dl to download videos. As far as I know, there is no data integrity verfication built in to youtube-dl, so what I do to verify that a video isn't corrupted in some way after ...
- 3
0
votes
0
answers
17
views
What's RedHat integrity test?
The binary DVD *.isos for installing the Red Hat OS, which I downloaded from https://access.redhat.com/downloads/, I checked, has the same SHA-256 reported in the webpage. But when I boot the ...
- 151
0
votes
1
answer
366
views
When a HDD has bad sectors, are files that don't show up any errors at reading in good state?
Well, I am dealing with an HDD with some unreallocated bad sectors for the 2nd time (the first time was a dying HDD, but now this other HDD is just one with "caution" state according to ...
- 323
1
vote
0
answers
175
views
ffmpeg is complaining about ACT flag violation in some of our DNxHD videos. Could this be safely ignored? Why?
We've been using ffmpeg/ffprobe for checking video file integrity. If ffmpeg returns anything in its stderr, we'd know something's not right.
For some videos, an error like this will show up in the ...
- 11
2
votes
1
answer
688
views
How to cryptographically verify the authenticity and integrity of Microsoft Windows .iso releases (with gpg?)
For a given Windows release published by Microsoft, how can I cryptographically verify the authenticity and integrity of the .iso file that I downloaded before I copy it onto a USB drive and attempt ...
- 1,308
0
votes
2
answers
963
views
How to checksum files from filename on Linux
I have many files tagged with a CRC checksum on their filename on a Windows machine. Example:
filename_[000000].extension
I know there are a lot of options for Linux based systems to check/calculate ...
- 123
1
vote
1
answer
634
views
How to cryptographically verify the authenticity and integrity of Mozilla releases (Firefox, Thunderbird, etc)
For a given software release published by Mozilla, how can I cryptographically verify the authenticity and integrity of the file that I downloaded before I execute it to install that program?
Today I ...
- 1,308
0
votes
1
answer
218
views
How does dropbox handle silent data corruption?
How does dropbox handle silent data corruption?
If I have 10 computers synced through dropbox and one day on one of them just some files corrupt unnoticed, will dropbox just sync that 'change' to the ...
1
vote
1
answer
1k
views
7-Zip. t (Test integrity of archive) command. Syntax. Two variants. Difference
I use 7-Zip. I work in Windows 10 Home 64-bit. I use command line. From 7-Zip help I know there is t (Test integrity of archive) command.
Do I understand right way the following?
In this case
7z t ...
- 35
2
votes
1
answer
2k
views
What's a good way to batch check media files for integrity?
I have some 15000 image, video and audio files (and also a few others) that I have been bouncing back and forth via FTP from my phone. After so many times, I found out that a few of them were ...
- 161
1
vote
1
answer
2k
views
ISO image integrity check (new try)?
When you open an .iso file with e.g. 7-zip, the tool lets you test the ISO file, just like you can test any RAR or 7Z or ZIP file that the file is still ok.
If that test finishes successfully, does ...
- 115
4
votes
2
answers
4k
views
How to turn ReFS "Enforced" file integrity off?
Short Version
I have files on a ReFS volume where Integrity Stream integrity is Enforced is true.
PS M:\> Get-Item Contoso.vhdx | Get-FileIntegrity
FileName Enabled Enforced
-------- ...
- 21.7k
1
vote
0
answers
626
views
Can Nero SecurDisc Surface Scan be rerun after the disc had been burned?
I burned a double layered BD-R disc (UDF file system), it finished successfully then in the midst of the surface scan run I had a power outage before it had the time to finish.
All of the data was ...
- 184
4
votes
1
answer
374
views
How does sfc utility check file integrity?
We know that, in Windows OS, sfc is a well-known utility that checks for the integrity of critical system files.
If changes are found, they are replaced by compressed files in Wsxs folder or the like....
user1007527
0
votes
1
answer
724
views
How to verify Integrity of ISO file with these constraints?
I have a Windows 7 Desktop PC. My secondary HDD (SATA Internal) has developed a few bad sectors. Now its state is being reported as Caution in CrystalDiskInfo tool. I have already taken backup of my ...
- 1,606
2
votes
0
answers
2k
views
Windows 10 - Different methods to disable driver signature check and their realations
For Windows 10
I am examining different methods to monitor the disabling of "driver signature check". From a search online I found 3 main method:
from administrator cmd run:
bcdedit.exe -set ...
- 245
-1
votes
3
answers
148
views
Is it possible to see a ping from a LAN computer to an unknown destination?
rookie question...
Two computers in a home network connected only by Ethernet to a router. The router is connected to internet and gives the computer ip:s like 192.168.10.xx. One of the computers ...
0
votes
1
answer
2k
views
How do you check the integrity of a VHD without using Powershell or Hyper-V Manager?
I'm running Windows 10 Home, so I cannot enable Hyper-V manager nor use Powershell cmdlets like test-vhd. I used Paragon Hard Disk Manager 16 to create a backup image of my HD in .vhd format, and I'd ...
- 317
1
vote
1
answer
408
views
How to be sure that readonly snapshot is not corrupted in BTRFS?
How can we sure that a readonly snapshot is not corrupted due to a disk failure?
Is the only way calculating the checksums one on another and store it for further examination, or does BTRFS handle ...
- 585
0
votes
1
answer
109
views
How to ensure complete file integrity of key files?
A question in regards to file integrity:
How can I ensure that the integrity of a file will always stay 100%?
Important for example when storing key files in regards to encryption etc. on local ...
- 1
2
votes
1
answer
751
views
Can a device ruin an SD Card or microSD card?
I have a device that I think might be ruining microSD storage cards (SanDisk cards).
The device happens to be a smartphone (an older Samsung Galaxy S), but this question applies to any device.
Is it ...
1
vote
1
answer
987
views
HPA (Host Protected Area) disabled. Bad consequences?
If an SSD's HPA is disabled, then are there any bad consequences? (In terms of data integrity, wear leveling, etc.)
Do the following options make any difference to the SSD controller?
HPA disabled, ...
user689423
1
vote
1
answer
235
views
Check that files exist on remote server with different directory structure or organization
I have made a NAS project to replace an aging shared external disk drive, and before decomissioning the old shared disk drive, I'd like to verify that I have copied all important data to the new NAS. ...
- 11
8
votes
1
answer
4k
views
How to get Btrfs verify checksum for one file?
Btrfs offers these commands to verify data integrity/checksums:
btrfs scrub start <path>|<device>
btrfs check --check-data-csum
However, AFAIK those always verify whole filesystems; the ...
- 801
41
votes
3
answers
8k
views
Does Git prevent data degradation
I read that ZFS and Btrfs use checksums to prevent data degradation and I read that Git has integrity through hashing essentially everything with each commit.
I was going to use a Git server on a ...
6
votes
2
answers
2k
views
Is there any reason to verify a download checksum over HTTPS
Assuming that both the page linking the download, and the download itself are on trusted domains over HTTPS, is there any reason to worry about checking the hash/checksum of the downloaded file (...
- 1,353
6
votes
1
answer
9k
views
Interpreting the Spin Retry Count S.M.A.R.T. attribute value for hard drives
I'm confused about the Spin Retry Count S.M.A.R.T. attribute value.
On one particular hard drive, I see a raw value of 0, which the popular CrystalDiskInfo v7.0.5 interprets as a current value of 166,...
0
votes
1
answer
80
views
Behavior of thumb drives when disconnected from power
Less than 2 months ago, I ordered a thumb drive (cheap one). I used it the day it arrived and I think about 3 days after that. Merely checked it with badblocks and then dd-ed a Linux image into it. It ...
- 658
5
votes
3
answers
10k
views
Can ZFS cope with sudden power loss? (What events cause a pool to be irrecoverable if the disk itself hasn't failed or become unreliable)
All the resources say ZFS doesn't have fsck, or recovery tools, use battery backed SSD for ZIL, etc.
If the plug is suddenly somehow pulled (total power loss despite UPS etc, but assuming no ...
- 1,655
1
vote
0
answers
20
views
Disallowing a Windows 7 Pro user to modify directory contents unless he is doing so using a designated Application "A"
Noob here.
I've looked around and not been able to find an answer for this on Windows 7 Platform. This pertains to Securing data files.
The basic idea is that files should not be permitted to be ...
30
votes
3
answers
4k
views
Can data on a hard disk degrade without Windows warning me that this has happened when I attempt to access the data?
Is it likely that a physical degradation of a hard disk could cause bits to 'flip' in file contents without the OS 'noticing' and telling you about it when reading the file? e.g. could a 'p' in an ...
- 403
0
votes
0
answers
297
views
How to interpret an "SFC /VERIFYONLY" CBS integrity log (win10)?
I ran an SFC on my system and it tells me that there were some "Integrity Violations" and to see the log file for more details. So I was able to open it up in Notepad, but I have no idea what I'm ...
- 653
0
votes
1
answer
174
views
Recompressing zip - integrity check
I have multiple large zip files and I would like to recompress them without unpacking them (I run the risk of running out of disk space). I am thinking of using advzip for that task.
However, I want ...
- 101
4
votes
2
answers
3k
views
Calculate checksum of every file that is being written to HDD
Is it possible to automatically calculate a checksum of every file that is being written to the HDD? My OS is Linux and I've read that btrfs stores some kind of checksums for files. So, Would it be ...
- 729
0
votes
1
answer
101
views
Could a CF card submerged in sea water for a few days still work?
The title pretty much sums it up: What are the chances of a Compact Flash card that has been submerged in sea water for a few days still working? The card in question has a pretty expensive licence ...
- 5,998
-1
votes
1
answer
41
views
Removing a USB external disk without properly ejecting it
What are the integrity-related issues I might have by simply removing a USB external hard disk from my computer, without logically disconnecting it (e.g. via Windows desktop bar icon)?
Is the concern ...
- 141
12
votes
5
answers
6k
views
Do we really need to check the integrity of downloaded files? [duplicate]
I downloaded a huge amount of files, but discovered the use of md5 and sha as integrity checkers quite recently. From then I always prefer to check it for big downloaded files, even if I never found ...
- 251
1
vote
0
answers
435
views
How do I check integrity of a file from DreamSpark?
I have a very unstable connection and it cut off multiple times while downloading Windows 8.1 using Microsoft's SDM, so I'm kind of concerned to how I can check to see if the file is still intact once ...
- 33
3
votes
1
answer
2k
views
Verify rdiff backup integrity
I am using rdiff for my differential backup. Recently an issue happened where all versions of my backup failed to patch correctly and rdiff returning an error 106 which after investigation is a code ...
- 207
5
votes
2
answers
4k
views
Comparing folders on two unconnected computers
I'd like to compare folders on two different computers.
I'm using BitTorrent Sync to synchronize currently 260 GBs of data between two computers: a Windows 7 desktop PC and a Windows 8.1 laptop. All ...
- 2,046
1
vote
1
answer
195
views
PXE reliability
I understand that PXE is implemented by using TFTP over UDP - neither one of those protocols verifies integrity, which would seem important for something like the operating system - is there some sort ...
- 1,005
1
vote
2
answers
737
views
Windows Version of ZFS
From what I've read about ZFS is that it allows and protects against FileROT. Which is why I commonly use this for all my FreeNAS Machines.
Is there an option like that but for the Windows side of ...
- 4,026
0
votes
1
answer
2k
views
Transactions per second in a database (say PostgreSQL)
I refer to 2 documentation pages on PostgreSQL's site: #1 and #2. From these, we see the transaction log is flushed to disk 5 times per second (wal_writer_delay = 200ms), and we also see the RDBMS won'...
- 155
0
votes
2
answers
168
views
File integrity checking
I have a lot of PDFs and many of them may be corrupt. Rather than checking each one, how could I check them all at once and delete any that are corrupt?
Using Linux. I also don't have a way to get ...
- 1
1
vote
0
answers
1k
views
Cheaper alternative to ZFS Storage for a home NAS
I'm looking to build a NAS for home use with 8-10*(2-4TB) drives, out of which 2-3 drives would be used for parity via software RAID.
In the past years and up to date, ZFS seems to have become the ...
- 293
3
votes
1
answer
411
views
How to make GNU/Linux more robust in case of frequent power loss
When having a system (hardware), that has no protection against sudden power loss (zero power at all), what is the best way to keep the damage that may occur to a running GNU/Linux as low as possible?
...
- 1,729
11
votes
1
answer
4k
views
Is ECC mandatory in SSD technology?
While shopping for an SSD I have noticed that some manufacturers promote their "Pro" models as the ones sporting ECC data protection. Those manufacturers do not mention ECC in their budget models ...
0
votes
4
answers
4k
views
Check if a file has been changed
I have the following scenario:
A certain process (A) creates files and I want to write a program which reads these files to generate some statistical data.
The problem is simple. I want to be sure ...
- 3