Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [data-integrity]

The tag has no usage guidance.

0
votes
1answer
24 views

How to verify Integrity of ISO file with these constraints?

I have a Windows 7 Desktop PC. My secondary HDD (SATA Internal) has developed a few bad sectors. Now its state is being reported as Caution in CrystalDiskInfo tool. I have already taken backup of my ...
0
votes
0answers
29 views

Hardware protection against bit-flips during I/O between storage and DRAM?

If a motherboard supports ECC DRAM, then it has a 72 bit bus between the DRAM slot and the memory controller. 64 data bits + 8 parity bits for SECDED. Nowadays, most CPUs have the memory controller ...
1
vote
0answers
69 views

Windows 10 - Different methods to disable driver signature check and their realations

For Windows 10 I am examining different methods to monitor the disabling of "driver signature check". From a search online I found 3 main method: from administrator cmd run: bcdedit.exe -set ...
-1
votes
3answers
25 views

Is it possible to see a ping from a LAN computer to an unknown destination?

rookie question... Two computers in a home network connected only by Ethernet to a router. The router is connected to internet and gives the computer ip:s like 192.168.10.xx. One of the computers ...
0
votes
0answers
47 views

How do you check the integrity of a VHD without using Powershell or Hyper-V Manager?

I'm running Windows 10 Home, so I cannot enable Hyper-V manager nor use Powershell cmdlets like test-vhd. I used Paragon Hard Disk Manager 16 to create a backup image of my HD in .vhd format, and I'd ...
1
vote
1answer
63 views

How to be sure that readonly snapshot is not corrupted in BTRFS?

How can we sure that a readonly snapshot is not corrupted due to a disk failure? Is the only way calculating the checksums one on another and store it for further examination, or does BTRFS handle ...
0
votes
0answers
76 views

Does Btrfs verify data while written to disk?

I sometimes have to move large files between machines and (as paranoid as I am) checksum all the data at source and destination and compare those to ensure everything is written correctly to disk ...
0
votes
1answer
78 views

How to ensure complete file integrity of key files?

A question in regards to file integrity: How can I ensure that the integrity of a file will always stay 100%? Important for example when storing key files in regards to encryption etc. on local ...
2
votes
1answer
64 views

Can a device ruin an SD Card or microSD card?

I have a device that I think might be ruining microSD storage cards (SanDisk cards). The device happens to be a smartphone (an older Samsung Galaxy S), but this question applies to any device. Is it ...
0
votes
0answers
14 views

File-level backup without “back image” or with strong EC (Windows)

What I want: Incremental: Skipping unchanged files and tracking file move/deletion/rename. Backup data stored in a way that is unlikely to meltdown: Either without "back image": Files are backup-...
1
vote
1answer
236 views

HPA (Host Protected Area) disabled. Bad consequences?

If an SSD's HPA is disabled, then are there any bad consequences? (In terms of data integrity, wear leveling, etc.) Do the following options make any difference to the SSD controller? HPA disabled, ...
1
vote
1answer
41 views

Check that files exist on remote server with different directory structure or organization

I have made a NAS project to replace an aging shared external disk drive, and before decomissioning the old shared disk drive, I'd like to verify that I have copied all important data to the new NAS. ...
2
votes
1answer
714 views

How to get Btrfs verify checksum for one file?

Btrfs offers these commands to verify data integrity/checksums: btrfs scrub start <path>|<device> btrfs check --check-data-csum However, AFAIK those always verify whole filesystems; the ...
40
votes
3answers
8k views

Does Git prevent data degradation

I read that ZFS and Btrfs use checksums to prevent data degradation and I read that Git has integrity through hashing essentially everything with each commit. I was going to use a Git server on a ...
2
votes
1answer
535 views

Is there any reason to verify a download checksum over HTTPS

Assuming that both the page linking the download, and the download itself are on trusted domains over HTTPS, is there any reason to worry about checking the hash/checksum of the downloaded file (...
4
votes
1answer
2k views

Interpreting the Spin Retry Count S.M.A.R.T. attribute value for hard drives

I'm confused about the Spin Retry Count S.M.A.R.T. attribute value. On one particular hard drive, I see a raw value of 0, which the popular CrystalDiskInfo v7.0.5 interprets as a current value of 166,...
0
votes
1answer
67 views

Behavior of thumb drives when disconnected from power

Less than 2 months ago, I ordered a thumb drive (cheap one). I used it the day it arrived and I think about 3 days after that. Merely checked it with badblocks and then dd-ed a Linux image into it. It ...
1
vote
0answers
109 views

Testing file integrity in a loop [closed]

Got few files on my hard drive which after testing file integrity in 7-zip results in increase of Read Error Rate in SMART by few each time specific sectors on the disk are read. Due to that disk is ...
2
votes
3answers
3k views

Can ZFS cope with sudden power loss? (What events cause a pool to be irrecoverable if the disk itself hasn't failed or become unreliable)

All the resources say ZFS doesn't have fsck, or recovery tools, use battery backed SSD for ZIL, etc. If the plug is suddenly somehow pulled (total power loss despite UPS etc, but assuming no ...
1
vote
0answers
11 views

Disallowing a Windows 7 Pro user to modify directory contents unless he is doing so using a designated Application “A”

Noob here. I've looked around and not been able to find an answer for this on Windows 7 Platform. This pertains to Securing data files. The basic idea is that files should not be permitted to be ...
29
votes
3answers
3k views

Can data on a hard disk degrade without Windows warning me that this has happened when I attempt to access the data?

Is it likely that a physical degradation of a hard disk could cause bits to 'flip' in file contents without the OS 'noticing' and telling you about it when reading the file? e.g. could a 'p' in an ...
0
votes
0answers
163 views

How to interpret an “SFC /VERIFYONLY” CBS integrity log (win10)?

I ran an SFC on my system and it tells me that there were some "Integrity Violations" and to see the log file for more details. So I was able to open it up in Notepad, but I have no idea what I'm ...
0
votes
1answer
77 views

Recompressing zip - integrity check

I have multiple large zip files and I would like to recompress them without unpacking them (I run the risk of running out of disk space). I am thinking of using advzip for that task. However, I want ...
0
votes
1answer
72 views

Could a CF card submerged in sea water for a few days still work?

The title pretty much sums it up: What are the chances of a Compact Flash card that has been submerged in sea water for a few days still working? The card in question has a pretty expensive licence ...
-1
votes
1answer
37 views

Removing a USB external disk without properly ejecting it

What are the integrity-related issues I might have by simply removing a USB external hard disk from my computer, without logically disconnecting it (e.g. via Windows desktop bar icon)? Is the concern ...
9
votes
5answers
3k views

Do we really need to check the integrity of downloaded files? [duplicate]

I downloaded a huge amount of files, but discovered the use of md5 and sha as integrity checkers quite recently. From then I always prefer to check it for big downloaded files, even if I never found ...
1
vote
0answers
403 views

How do I check integrity of a file from DreamSpark?

I have a very unstable connection and it cut off multiple times while downloading Windows 8.1 using Microsoft's SDM, so I'm kind of concerned to how I can check to see if the file is still intact once ...
2
votes
1answer
888 views

Verify rdiff backup integrity

I am using rdiff for my differential backup. Recently an issue happened where all versions of my backup failed to patch correctly and rdiff returning an error 106 which after investigation is a code ...
4
votes
2answers
2k views

Comparing folders on two unconnected computers

I'd like to compare folders on two different computers. I'm using BitTorrent Sync to synchronize currently 260 GBs of data between two computers: a Windows 7 desktop PC and a Windows 8.1 laptop. All ...
1
vote
1answer
104 views

PXE reliability

I understand that PXE is implemented by using TFTP over UDP - neither one of those protocols verifies integrity, which would seem important for something like the operating system - is there some sort ...
0
votes
1answer
1k views

Transactions per second in a database (say PostgreSQL)

I refer to 2 documentation pages on PostgreSQL's site: #1 and #2. From these, we see the transaction log is flushed to disk 5 times per second (wal_writer_delay = 200ms), and we also see the RDBMS won'...
0
votes
2answers
113 views

File integrity checking

I have a lot of PDFs and many of them may be corrupt. Rather than checking each one, how could I check them all at once and delete any that are corrupt? Using Linux. I also don't have a way to get ...
1
vote
0answers
1k views

Cheaper alternative to ZFS Storage for a home NAS

I'm looking to build a NAS for home use with 8-10*(2-4TB) drives, out of which 2-3 drives would be used for parity via software RAID. In the past years and up to date, ZFS seems to have become the ...
2
votes
1answer
214 views

How to make GNU/Linux more robust in case of frequent power loss

When having a system (hardware), that has no protection against sudden power loss (zero power at all), what is the best way to keep the damage that may occur to a running GNU/Linux as low as possible? ...
10
votes
1answer
2k views

Is ECC mandatory in SSD technology?

While shopping for an SSD I have noticed that some manufacturers promote their "Pro" models as the ones sporting ECC data protection. Those manufacturers do not mention ECC in their budget models ...
0
votes
4answers
2k views

Check if a file has been changed

I have the following scenario: A certain process (A) creates files and I want to write a program which reads these files to generate some statistical data. The problem is simple. I want to be sure ...
3
votes
1answer
274 views

Does flash-memory integrity depend on system resources while reading/writing (like CDs/DVDs)?

Question I’m really concerned that flash-memory is just not reliable as a storage for irreplaceable files. Does anybody know if the integrity (corruptibility) of flash-memory (flash-drives, memory-...
43
votes
1answer
26k views

How do I fix “WARNING: message was not integrity protected” when using GPG symmetrical encryption?

I've encrypted a file using symmetric encryption like this: gpg --symmetric myfile which results in a file myfile.gpg. Alright. Now let's decrypt the file again: gpg -o myfile --decrypt myfile.gpg ...
0
votes
2answers
217 views

Error proofing data

Is it possible to encode data is such a way that it can self-recover from corruptions? (corruptions - for example, hard drive or usb drive with bad sectors) I'm not looking for solutions involving ...
8
votes
1answer
4k views

Does Windows calculate CRCs to check every file operation?

When Windows encounters a file corruption on a file system, it may return the following error message: Data error (cyclic redundancy check). This suggests Windows checks every file operation (copy,...
2
votes
1answer
454 views

Used HDD/ran DiskSmartView/40,000 Power-on-hours?? should i trust it w/ my data, or take it back and complain? [closed]

I just bought a used hard drive from a University Surplus Store. Decided to run DiskSmartView to make sure it wasn't ready to fail. 40,000 power-on-hours I don't know if I feel like trusting my ...
0
votes
2answers
633 views

Is there any chance that my data will get silently corrupted with a robocopy SMB network transfer?

I'm setting up a NAS box for the first time. At the moment, I have most of my data backed up to a few local hard drives, and I intend to transfer all the data to my NAS over ethernet once the RAID ...
5
votes
1answer
2k views

How can I detect (and correct) silent data corruption?

My question is, how can I detect silent data corruption at my home PC (Windows + Linux). I do rsync like automatic backups (with version history). But how do I know in a few months/years that a long ...
22
votes
5answers
2k views

How to transfer a file over pen and paper, with error correction

I'm looking for a way to transfer a file using only a pen and paper. This is somewhat similar to paperbak, except the density I'm looking for is much, much lower, and I don't want to use a printer or ...
1
vote
1answer
567 views

How to copy files from HDD to HDD with integrity checking

I am moving data from an almost dead HDD to an external USB drive using linux , because for some reason Windows cannot see the data. I want to copy a large amount of data over from the HDD to the USB ...
1
vote
1answer
297 views

Finder Error -36 with Console I/O Error - potential causes?

I'm copying a lot of data between two hard drives. The first one (the source) was getting a lot of repetitive Finder Error -36 codes. Scanning the Console this is linked to an I/O Error coming from ...
0
votes
1answer
54 views

Verifying if two mirrored copies of disc are same or not?

I have two sets of discs which are mirrored copies of each other. Does an algorithm exist which could verify if the copy made is same as the original?
6
votes
1answer
400 views

Is it safe to edit files during the defragmentation process?

Assuming I'm on an NTFS partition, is it just as safe to edit files during defragmentation as when not? Is there any added risk, even if very small? If not, how does the operating system ensure the ...
7
votes
3answers
14k views

High “wasted” on a torrent download, with no hashfails

Recently I have downloaded a game patch from a torrent. The total patch size was ~528 MB and the torrent has shown 235 MB as "wasted", with 0 hashfails. Some other things I remember about the download:...
1
vote
1answer
351 views

How can I ensure the correctness of a .tar.gz file I recently downloaded from a server?

How can I ensure the correctness of a .tar.gz file I recently downloaded from a server?