Questions tagged [zfs]
An advanced file system that can span multiple disks, heal itself from data corruption, deduplicate data, encrypt, etc.
407
questions
0
votes
0
answers
28
views
How to get ZFS working on Alpine Linux 3.18?
According to this tutorial, all I need do is install the zfs and zfs-lts packages, issue a modprobe zfs and I'm good to go.
Not so much.
Having created a pool and a couple of datasets, I rebooted the ...
0
votes
0
answers
23
views
systemd before,after,requires all not working like expected
I have an nfs mount on a debian12 system running systemd252, i need this to be mounted at startup before zfs but after network-online.target, so i tried using /etc/fstab but that keeps loading before ...
1
vote
1
answer
4k
views
testing ZFS - how to destroy an UNAVAIL pool without reboot
I am testing ZFSonLinux and i have an experimental pool named usbcka.
There is only testing data.
I am simulating HW failure to deterimine behaviour in this scenario.
I know this setup has no ...
0
votes
0
answers
37
views
How do I import a ZFS pool from a de- and re-attached drive array?
This is not the same as importing a pool from a crashed system as the system has not crashed. The OS is fine (on a different pool/set of drives/sata bus).
I'd like to copy some key files before ...
0
votes
1
answer
75
views
What are the differences between mountpoint=legacy and mountpoint=none for ZFS datasets?
I have noted that some tutorials (ex.: Arch Linux Root on ZFS) use mountpoint=legacy while others (ex.: Install Arch Linux on ZFS) use mountpoint=none for what the datasets used as a containers for ...
0
votes
1
answer
4k
views
ZFS pool I/O is currently suspended due to disk mountpoint change (sdb to sdc). How can i fix it?
the HDD on which was mounted ZFS pool was physically reconnected and the result is that the zfs can no longer find the device at old location /dev/sdb as the drive got new name /dev/sdc.
$ zpool ...
0
votes
1
answer
215
views
How do I import ZFS pool from a crashed system?
I had one ZFS pool attached to a system that crashed. I was looking for ways to bring that pool to a new system however it looked like I need to use zfs export first, given I do not have access to the ...
0
votes
2
answers
69
views
Memory reporting discrepancy in Linux when using ZFS
I have an Ubuntu 22.04 Linux machine that runs some services and heavily uses ZFS file system. I observe some serious discrepancies in memory reporting when using various system tools.
For example, ...
0
votes
0
answers
148
views
Add new disk to an available zpool
A zpool is created with name tank. By using zfs command, a disk is added to the pool. Now the disk contains data which is not going to be lost. I buy a new disk and want to append it to the same pool ...
2
votes
1
answer
121
views
`zfs replace` keeps giving write errors with new drives & different SATA cables
I replaced a failing hard drive (increasing error counts in SMART, read/write/checksum errors in zpool status) in a ZFS raidz1 pool with a new one by running zfs offline and zfs replace. Resilvering ...
1
vote
0
answers
27
views
Listing a directory (and entering) on ZFS takes a few seconds the first time? (re: sleep/idle?)
I have a few ZFS ZPOOLs configured:
NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT
backup 1.81T 1.41M 1.81T - - 0% 0% 1.00x ...
2
votes
2
answers
4k
views
How to create a storage pool of drives (with existing data) without using RAID?
So I currently have an Ubuntu 20.04 machine that I'm running as a Plex Media Server. It has a 32gb SATA SSD used for boot, swap, /, and /home, as well as a 2TB M2 NVME SSD that I store my media on (...
0
votes
0
answers
101
views
Zpool hung while attaching a new disk, now faulted
I was attempting to expand the storage on a large ZFS pool, adding a similarly sized drive from a USB bay. The pool was in use, and the zpool attach command hung. After an hour, it still hadn't ...
0
votes
1
answer
68
views
Same UUID's for a group of ZFS drives? Are they ok?
Im trying to figure out why my two new drives which are larger than the other 6 are showing equal checksum errors. In looking into this, I noticed the UUID's are all the same. Is it normal to have ...
3
votes
2
answers
5k
views
4k hard drives freebsd gpart and zfs
I have 3 hdd, with the next camcotrol identify.
root@cirmos:/root # camcontrol identify ada1
pass2: <WDC WD10EZEX-00RKKA0 80.00A80> ATA-8 SATA 3.x device
pass2: 300.000MB/s transfers (SATA 2.x, ...
0
votes
0
answers
93
views
ZFS deduplication table not paged out to RAM
I have a pool on which there is 3.41 TB of data, deduplication is enabled on the volumes, judging by the output of the
zpool status -D <pool_name>
...
dedup: DDT entries 73665285, size 696B on ...
1
vote
0
answers
273
views
ZFS I/O Error, Kernel Panic during import
I'm running a raidz1-0 (RAID5) setup with 4 data 2TB SSDs.
During midnight, somehow 2 of my data disks experience some I/O error (from /var/log/messages).
When I investigated in the morning, the zpool ...
1
vote
2
answers
753
views
Windows Version of ZFS
From what I've read about ZFS is that it allows and protects against FileROT. Which is why I commonly use this for all my FreeNAS Machines.
Is there an option like that but for the Windows side of ...
0
votes
1
answer
187
views
Passphrase encrypted zfs dataset displays files after zpool import without being mounted
I have a zfs pool on Debian with an encrypted dataset that contains other datasets inhering encryption. Basically I have this structure
pool
passphrase encrypted dataset
dataset1 inherits encryption
...
8
votes
2
answers
2k
views
Rsync fails for files that start with underscore when destination is zfs
I'm using rsync3.1.0pre1 on Mac OS X 10.8.5, and am trying to rsync one folder to another. The destination is a ZFS volume mounted via SMB.
The problem I'm having is that files that start with ...
0
votes
0
answers
17
views
How to easily access data on ZFS drive connected directly to Windows PC in case of NAS failure? [duplicate]
I am aware of the question Access a ZFS volume in Windows?. However it is 12 years old. There are some newer answers, however, they are not really clear.
I am setting up TrueNAS on an old PC for a ...
1
vote
1
answer
690
views
recurrent zfs read and write errors while smart tests are ok
I'm using OpenZFS 2.1.5 on Ubuntu 22.04.
zpool status -v show recurrent read and write errors on one of my mechanical drives. However, SMART test doesn't show any problem with the disk. By recurrent I ...
0
votes
1
answer
2k
views
ZFS of whole disks with ashift=12 vs of aliagned partitions?
About to create zpool made of 14 hdd disks, and I see options:
can simple do zpool create -f -o ashift=12 DATA raidz2 disk1 disk2 ...
or
can use eg parted to create one partition on each drive ...
0
votes
0
answers
326
views
How to bind a folder with idmap on ZFS with systemd-nspawn
It seems that as of Ubuntu 23.10, ZFS now supports idmapping. I wanted to use this to bind mount a ZFS mount /zpool/secure to an nspawn container with root /zpool/kiba, so that the bound mount would ...
3
votes
1
answer
3k
views
How to zfs send an entire filesystem
I am trying to copy an entire filesystem between 2 machines.
Based on documentation -R on zfs send should
"Generate a replication stream package, which will replicate the specified file system, ...
5
votes
2
answers
8k
views
How does the Percent_Lifetime_Remaining SMART attribute get calculated on a Crucial MX500 disk?
I have a home lab grade server that I put 4x Crucial MX500 disks into a couple months ago. One of the disks (they're all similar) has the following SMART details:
smartctl 6.5 2016-05-07 r4318 [...
0
votes
0
answers
351
views
Proxmox : 8 SAS (Data) and 2 SSD (OS) Setup (SW/HW RAID and VMs)
I'm noob on homelab and server setup, that's why I'm calling to your support
Bellow is the main list of my server's components :
CPU : 1 x Intel Xeon Silver 4208
RAM : 5 x 16Gb DDR4 ECC
RAID Card : ...
1
vote
1
answer
422
views
SMART error on disk used with ZFS and mdadm
For some time now I've been getting emails like the following after every time I reboot my workstation (which is called 'charm').
Subject: SMART error (ErrorCount) detected on host: charm
This ...
0
votes
1
answer
314
views
Which permissions do I have to allow for zfs send
I'm trying to mirror some snapshots through zxfer as a user, on FreeBSD 13.1-RELEASE, but I get stuck with
% zxfer -dF -I com.sun:auto-snapshot -O zxfer@zfshost -R zroot/www zroot/backup
warning: ...
1
vote
0
answers
101
views
Postgres' pg_total_relation_size returning unexpected table size for a zfs-based tablespace
I have Postgres 15.1 running on Ubuntu 20.04. Basic FS is ext4, but I have mounted zfs onto a sparse file like this (for compression testing purposes):
truncate -s 100G zfspart.dat
zpool create -o ...
5
votes
0
answers
2k
views
How to deal with the "Some supported features are not enabled" warning in zfs?
I have been running zfs on root in ubuntu 18.04 and recently did a release-upgrade to 22.04. With it, zfs was upgraded from 0.8.something to 2.1.4.
Now, my zpool on the laptop prominently informs me ...
1
vote
0
answers
126
views
Autofs trying to mount ZFS filesystems and failing
I created four filesystems using zfs on my T2000 running Solaris 11.3. Two automatically mount on boot (as they should) but two fail with the error message from autofs that the mount points are not ...
4
votes
3
answers
3k
views
How to figure out whether a path is the root of a ZFS dataset mountpoint?
I'd like to figure out whether an arbitrary path is the root of a ZFS mountpoint for evaluation in a (Python) script (so return code of a command is preferred over parsing of output). The btrfs ...
2
votes
0
answers
541
views
How to copy an encrypted zfs filesystem without preserving the encryption key
I want to copy an encrypted filesystem (z/enc/a) from one computer (source) to another, and have it inherit the encryption key from the parent filesystem of the target system. I also want to compress ...
1
vote
2
answers
7k
views
How to make Windows read ext4, zfs, etc. linux drives?
In linux packages like ntfs-3g enable linux systems to read and write to NTFS drives. However when I connect a drive that was previously used in linux to a Windows system, Windows does not recognize ...
1
vote
1
answer
189
views
Confusion about NTFS compression and `du` on ZFS (was: How to *really* disable NTFS compression?)
I am using ZFS with compression+dedup on my host system and use Qemu/KVM for virtualization. I wanted to let ZFS do it's job and disable Windows 10's NTFS compression feature (both, CompactOS and NTFS ...
0
votes
1
answer
464
views
Is using ZFS L2ARC (secondarycache) cache, without ARC (primarycache) possible?
I Have a "home lab" system (Ubuntu 22.04 on i3-9300 with 32G ecc-ram, 10G of witch is dedicated to hugepages) currently holding 2 zfs raidz1 pools, one with 3x2TB WD-RED and nvme as log and ...
0
votes
0
answers
47
views
XYRATEX HB-1235 Complete Array Dropping
I have an XYRATEX HB-1235 connected to a Solaris 11.4 system via a single SAS cable to an LSI controller. The drives in the array are SATA.
Every now and then, possibly due to a slight power flicker (...
0
votes
1
answer
2k
views
ZFS Mirror + Stripe vs RaidZ
I am planning to setup a TrueNAS Scale zfs diy NAS for the first time.
Following disks exist in this NAS:
2x 3TB HDD
2x 2TB HDD
1x 1TB HDD
1x 250GB SSD
Wishes towards the system :
There is a ...
2
votes
1
answer
1k
views
How exactly do btrfs/ZFS (and related filesystems) prevent bit rot?
It seems that, since btrfs development began, various communities have touted both it and ZFS as inherently more advanced filesystems for preventing corruption, bit rot, etc.
What features of btrfs or ...
2
votes
1
answer
33
views
Inconsistent behavior from 'find' on zfs under Linux
I was checking to see if I had multiple copies of python on my system today, and I got some super strange behavior from find:
mark@neverland:~/repos/lpod-python$ ls -i /bin/python3.10
534638 /bin/...
0
votes
0
answers
27
views
zpool won't import after crash while resilvering
With triple-mirrored vdevs, I'm really not sure why I can't re-import anyway. There was also a read cache vdev, but that is no longer connected, though that doesn't seem to be the issue. I've all ...
4
votes
4
answers
5k
views
ZFS pool disappears after reboot on Debian 8
I'm getting started with ZFS and I got the basics down, but I'm having an issue with keeping it running.
Pools are created, mounts are created, I'm able to save data and see disk activity… things are ...
0
votes
1
answer
330
views
Is it possible to automatically take zfs snapshots on boot or shutdown?
I want to create a convenient solution for full system (root-on-ZFS) backups.
The idea is to create a snapshot of the whole system on startup (before any writes to FS) or as a last step of shutdown ...
0
votes
1
answer
538
views
zfs snapshot -r for a single, simple dataset?
According to the man page zfs snapshot -r "recursively create[s] snapshots of all descendent datasets". As per this document, dataset is
a generic name for the following ZFS components: ...
1
vote
0
answers
1k
views
Disable Bios memory scramble fixes ram issue
I am looking for advice on an issue.
TL:DR
Problem: ram causing screen flickering
Solution: disable memory scramble in bios fixes
Question: is the ram stick corrupted or is this a buggy vbios? Am I ...
11
votes
5
answers
11k
views
ZFS send/receive over ssh on linux without allowing root login
I wish to replicate the file system storage/photos from source to destination without enabling ssh login as root. I've tried a number of different combinations such as:
sudo zfs send -R storage/...
40
votes
11
answers
147k
views
Access a ZFS volume in Windows?
You'd think this would have been asked but I can't seem to find it so...
Let's say I have a ZFS setup in this enclosure (8 bay USB3 JBOD):
Now, I'm going to be running it on my Mac direct attached but ...
0
votes
0
answers
263
views
Getting No Data Available when using cp to copy a file (but file exists)
I am trying to copy a file with cp in Linux, and am getting an error: No Data Available
The file exists in my FS:
> ll formation_xrpu_personnalisation_27-09-2021\ 15\:33\:43.webm.mov
-rw-rw-r-- 1 ...
0
votes
0
answers
179
views
Can I read zpool with missing top level vdev?
I am new to ZFS and because of ignorance, I make terrible mistake. Delete zvol which is top level vdev of a pool. So I'm looking for a way to gather unbroken data from the pool.
Make long story short:
...