Questions tagged [btrfs]
B-tree file system, next-generation Linux file system
283
questions
0
votes
0
answers
11
views
btrfs snapshots backup with btrbk: created snapshots are empty
I want to set up a backup mechanism with btrbk package. Here are my settings:
/etc/fstab
LABEL=magnolia /btrfs rw,noatime,compress=zstd:3,discard=async,ssd,space_cache,commit=120,subvolid=256,subvol=...
- 101
0
votes
1
answer
32
views
How to recover corrupted btrfs partition that nothing can read
I was on Manjaro on a btrfs partition. I came back to my laptop and it wasn't accepting my password, which in the past I solved with a reboot. I tried to reboot from tty 2 which was logged in, and it ...
- 103
0
votes
0
answers
30
views
How to get a Btrfs filesystem fragmentation count?
The btrfs check command output doesn't mention how many files are fragmented like e4defrag -c or e2fsck with ext4 filesystems.
What command can give the number of fragmented files on a whole Btrfs ...
- 1
0
votes
1
answer
38
views
Why does btrfs scrub process more data than allocated?
Why is the "Total to scrub" a lot bigger than "Device Allocated".
29.1TiB vs 21.24TiB is a huge difference.
Setup: I have a btrfs raid array. It has a mixed data chunks of RAID1 ...
- 157
3
votes
1
answer
32
views
Odd behavior by 'du' with `dd` on a BTRFS disk showing 0 filesize.. Anyone got some clues or thoughts around it?
Been tinkering with btrfs with consideration of moving from ext4 to that.
However, when wanting to compare R/W speeds, I seem to have come across an (to me at least) unusual behavior by du on the ...
- 137
0
votes
0
answers
20
views
mounted a btrfs volume with nodatasum for performance… How to write the checksums for the files created that way?
Using a performance critical database being several Tb large, I mounted a btrfs volume using the nodatasum mount option.
As a result, more than 50% of the space is used by newly created files without ...
- 1,671
0
votes
1
answer
31
views
btrfs fails to load qgroups from disk with error -2 (out of memory)
I ran out of space in my OpenSUSE partition, which uses btrfs. I booted from a live Ubuntu USB to reallocate some of the space from my Windows partition to the Linux one. It succeeded in shrinking the ...
- 121
0
votes
0
answers
63
views
BTRFS discrepancy between df and du
the difference between disk usage reported by df and du makes 20% of capacity of my drive. It is ubuntu-type btrfs filesystem with @ and @home. Where could be the problem please?
df -h /dev/sda2
...
- 47
0
votes
0
answers
166
views
BTRFS and disk usage mystery
# df -h /
Filesystem Size Used Avail Use% Mounted on
/dev/sda2 119G 113G 5.5G 96% /
and BTRFS agrees:
# btrfs fi df /
Data, single: total=111.00GiB, used=110.53GiB
...
- 43
0
votes
1
answer
74
views
BTRFS warning (device xxx): swapfile must not be copy-on-write. Why swap is activated when disabled?
I have SSD. When I check dmesg I see warnings and fails:
$ sudo dmesg | grep swap
[ 0.085887] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization
[ 0.429424] zswap: ...
- 474
0
votes
0
answers
80
views
Exporting Snapper btrfs snapshots as Windows Previous Versions on Samba share with %U variable in path
I'm trying to use snapper to expose btrfs snapshots via samba previous versions.
Snapper is taking snapshots of each users subfolder and users can see theses snapshots and open the top level folder ...
- 1
6
votes
2
answers
895
views
LUKS on top of BTRFS raid array
How can I encrypt a partition that's btrfs RAIDed?
Running encryption on top of RAID is the best practice among a lot of sources even recommended by cryptsetup FAQ (see 2.2). The reason I want this to ...
- 163
1
vote
0
answers
15
views
Moving or Copying files from one NAS to another while maintaining Timestamps
Some of our designers want to move some of their old files from our active Synology unit to an archive Synology unit using their windows machines. But it is imperative all the timestamps (created, ...
- 11
0
votes
1
answer
34
views
ecryptfs-migrate-home on btrfs file system (Ubuntu)
I plan to encrypt home directory with ecryptfs-migrate-home. I have btrfs system and I use timeshift backup to create snapshots.
I would like to know how btrfs snapshots work on encrypted home ...
- 47
0
votes
2
answers
35
views
btrfs receive fails with incremental streams: "File exists"
For a btrfs sub-volume, I have a simple incremental backup created from two stages:
btrfs send old/@ > base.btrfs
btrfs send new/@ -p old/@ > update.btrfs
The two source sub-volumes are ...
- 162
0
votes
0
answers
94
views
Defragment BTRFS to change the compression level
I can do:
btrfs filesystem defragment -rvf -czstd ./
But not:
btrfs filesystem defragment -rvf -czstd:1 ./
I get the error:
ERROR: unknown compression type zstd:1
Is there any way to change the ...
- 123
0
votes
0
answers
99
views
How to build GRUB 2.06 to handle ubuntu on efi-luks-btrfs
I want to build GRUB 2.06 on a efi-system with ubuntu 20.04 on luks-btrfs.
I've built GRUB with:
./configure --with-platform=efi
On grub-install /dev/sda this error interrupt the execution:
...
- 11
0
votes
2
answers
67
views
solid state disk some random files corrupted; how to prevent in simple terms
Please see What happens in a raid (5) when one drive or more gets a bad sector?. I have a few .jpg files (and much more serious data). Some of the .jpg files become corrupted. I can tell because ...
1
vote
0
answers
29
views
Can ZFS and BtrFS handle files larger than physical discs?
Are ZFS and BtrFS able to handle files that are larger than one physical disk so that such a huge file spans over multiple physical discs?
I consider lifting up my file server to a VM. Currently the ...
- 284
0
votes
0
answers
39
views
How does GNU tar handle reflinks?
Does (GNU) tar handle reflink copies of files similar to hardlinks?
I.e., is just one copy of the file stored and other copies refered to?
Or are reflinks 'resolved' from the file system and each ...
- 133
0
votes
1
answer
104
views
rm -rf no longer deletes folder in cron job
I wrote a program that writes a large number of small files to a temporary directory, then, via a call from within the program, deletes the temporary directory. This program is called via a user-...
0
votes
0
answers
32
views
Why is my Linux PC coming to a complete stop on high IO?
For about 6 months or so I've been having issues with IO on Manjaro: when the system is doing some IO intensive work it comes to a complete stop. Here are some symptoms I've seen happen:
Program that ...
- 101
0
votes
1
answer
140
views
removing old BTRFS snapshots with bash
I'm trying to build my own little backup script, I want to use BTRFS snapshots and keep them for a while. Meanwhile, creating the snapshots is no longer a problem for me, but now I would like to ...
- 44
0
votes
0
answers
64
views
Is there an advantage running btrfs scrub on a desktop computer?
As far as I understand the btrfs scrub command, it checks the integrity of all files by computing their checksum and comparing it to the stored checksum. In raid modes, it can then restore a correct ...
- 850
0
votes
0
answers
45
views
Is it possible to restore a btrfs snapshot with a different partition state?
So, now i'm using Arch Linux and I already have btrfs snapshot with condition / and /home are in 1 partition (sda1).
I would separate the /home partition from / (sda2 for /home and sda1 for /).
my ...
0
votes
0
answers
32
views
How to change the location of snapshot in specifick directory in timeshift?
I'd like to locate my btrfs snaps into a specific directory, for instance, /media/.snapshots but I can't find out how.
And how to determine where my snaps are.
2
votes
2
answers
104
views
Find chunks of all 0x55 or 0xAA on hard drive image and blank them?
This is a weird request, but I had a hard drive that I initially ran badblocks on and then stopped partway through. So it started out with part of the drive covered in 0xAA and another part of the ...
- 7,225
0
votes
1
answer
140
views
How does BTRFS compression influence existing and new snapshots?
Context
I have some Synology NAS storing backups created by WBADMIN from Windows using SMB, which means VHDX image files in the end with compression disabled, as otherwise WBADMIN refuses to work on ...
0
votes
0
answers
13
views
BTRFS 56 snapshots safe?
If I understand correctly, in a multi-drive BTRFS cluster with RAID1 for metadata and RAID5 for data, a sudden loss of power may lead to a write hole, meaning that data (but not metadata) is lost.
I'm ...
- 111
0
votes
0
answers
96
views
Mac, BTRFS and docker
I got few drives containing btrfs fillesystem.They were earlier mounted on linux using compression boot args{each drive has 5 to 6 partitions and all these partitions have different level of ...
- 1,500
0
votes
1
answer
92
views
How to delete all duplicates of a file linked by CoW on BTRFS
The glory of Copy-on-Write (CoW) allows us to copy a file as many times as we like, without duplicating the used space.
I have used this functionality extensively (as well as manual deduplication of ...
- 101
0
votes
0
answers
93
views
btrfs volume in fstab fails to boot with compress-force
in my fstab, the btrfs volume boots with no problem when the option set is compress=zstd:15, however, as soon as i set it to compress-force=zstd:15, it fails to boot because of a failed dependency
...
- 23
1
vote
0
answers
87
views
How exactly do btrfs/ZFS (and related filesystems) prevent bit rot?
It seems that, since btrfs development began, various communities have touted both it and ZFS as inherently more advanced filesystems for preventing corruption, bit rot, etc.
What features of btrfs or ...
- 243
0
votes
0
answers
726
views
Btrfs write speed very slow. In Linux how do I copy files using page cache?
I have 2 filesystems consisting of the same 15Tib size with both of them using 4 nvme ssd of the same model using btrfs based raid0 with all of the them plugged to a pci port.
Both filesystem are ...
- 1,671
1
vote
1
answer
112
views
btrfs quotas: Can't delete files when quota is exceeded
I set quotas on our smb server's /home/<name> subvolumes.
These subvolumes are exposed over smb as \\server\<name>
Now whenever someone tries to delete files in his/her /home folder and is ...
- 63
0
votes
2
answers
172
views
Convert hardlinks to reflinks
I have nested folders with a bunch of files inside that are hardlinked to each other. I would like to break the hardlinks (convert them into separate files), but then immediately convert each pair ...
- 7,225
1
vote
0
answers
156
views
linux system IO hangs/freezes randomly for ~30 sec
while working on my ubuntu 20.04 desktop, I'll notice a occasional freezes where it "mostly" goes out to lunch for 10's of seconds to ~1 minute. Happens perhaps ~~once an hour. I can still ...
2
votes
2
answers
733
views
Should I format my external hard disks in EXT4 or NTFS or BTRFS? [closed]
I have four hard disks:
240GB SSD formatted as EXT4 for main OS.
3TB HDD formatted as NTFS for main files.
500GB HDD formatted as NTFS for luks containers.
4TB HDD formatted as NTFS for backuping all ...
- 21
0
votes
1
answer
152
views
btrfs and fstab with failed device
A lot of guides on how to mount a btrfs filesystem say you can use any device in the filesystem to mount.
Ex: if a filesystem has sda1, sdb1, and sdc1 in it, you can mount using any of those devices.
...
- 620
4
votes
0
answers
170
views
Why is converting from RAID1 to single in Btrfs an I/O-intensive operation?
I want to replace a device in a RAID1 and converted it temporarily to “single”:
btrfs balance start -f -mconvert=single,soft -dconvert=single,soft /
This takes very long. I don’t see why, and wonder ...
- 393
1
vote
1
answer
814
views
btrfs damaged filesystem - how to continue
My btrfs filesystem is somehow damaged (parent transid, internal errors, ...). I tried with repair options, but I think some of the filesystem is just messed up now. The btrfs volume is used for ...
- 165
0
votes
1
answer
145
views
btrfs error checking when copying files between btrfs HDDs?
If I have two separate USB HDDs with btrfs (both single-mode, no DUP nor RAID) and copy a file from one HDD to another, does btrfs ensure that the copied file is still identical to the original file, ...
- 65
1
vote
1
answer
857
views
btrfs check / scrub: what is the difference?
I am going to use (for now) btrfs on a couple of external USB HDD archives, in single-mode (no DUP, no RAID, no nothing; I will just keep it simple for now). So my idea is that I have two (manually ...
- 65
0
votes
0
answers
65
views
Can't successfully delete file on btrfs filesystem
I've got a 4 GB file in a BTRFS file system that just won't go away. I have deleted it multiple times, I've even echo'd to it, and it keeps coming back. The ls -l is:
-rw-rw-r-- 1 mark mark 4072587264 ...
1
vote
0
answers
107
views
What does "Counts for qgroup ... are different" mean and how to fix it?
I've been using btrfs for my primary file system for a Linux Mint 20 install I did a couple of months ago. Today I had reason to want to extend the partition the btrfs filesystem is on, and gparted ...
- 1,106
0
votes
3
answers
3k
views
Debian BTRFS install
Partition disks:
Shell:
https://www.reddit.com/r/debian/comments/aa3zta/install_debian_to_a_btrfs_subvolume_and_not_the/eczobqb/
Once the partitioning step is complete, select "Back" in ...
1
vote
1
answer
265
views
Is this a correct BTRFS incremental backup strategy?
Assuming /home is my BTRFS partition (to keep backups of) & /storage as my secondary disk (to store backups on), will this work?
Initial Backup (8th Sept 2020):
btrfs subvolume snapshot -r /home /...
- 43
1
vote
1
answer
1k
views
Difference between filesystem BTRFS size with df, btrfs and baobab
Today my desktop gave me a notification that my /-filesystem was 'full'. So at first i did some cleanup of files, packages and old snapshots.
However, when i removed the previous i noticed with the ...
- 11
5
votes
2
answers
4k
views
btrfs, LUKS, swapfile: How to hibernate on swapfile?
I'm using btrfs encrypted by LUKS on fedora 32 silverblue, kernel version 5.7.7 with anaconda installer default setting.
Because fedora installer automatic partition does not add swap partition or ...
0
votes
1
answer
268
views
Synology RAID 1 Recovery - Accidentally formatted a BTRFS as ZFS - next steps?
Would really appreciate someone pointing me in the right direction.
Today at work we found out our Synology box had its motherboard go. From what I can tell, it was set up with two 8TB drives in RAID ...
- 1