Questions tagged [zfs]
ZFS is a modern file system and volume manager originally developed by Sun Microsystems and licensed under the CDDL. It is a copy-on-write file system with support for large storage arrays, protection against corruption, snapshots, clones, compression, deduplication and NFSv4 ACLs. An open-source fork of ZFS can be found at http://open-zfs.org/ , which is supported by ZFSonlinux.org, illumos.org and ZFS developers in the FreeBSD & Mac OS X communities.
1,408
questions
1
vote
1
answer
28
views
zpool mismatched replication level
I have accidentally added a mismatched raidz1 to an existing pool. Yes, I specified the '-f' to do it, but I was expecting to use the '-f' for a different reason and wasn't paying attention.
Anyhoo......
- 460
0
votes
0
answers
40
views
ZFS still writes to HDDs vdev while dataset is configure to store special for Docker
I'm facing a strange behaviour when using Docker together with ZFS.
I have one pool with 2x10TB HDDs as mirror vdev and 2x250GB NVMEs as mirror for special vdev (to store metadata and datasets with ...
- 101
0
votes
0
answers
76
views
Can MegaRAID controllers use their writeback cache in JBOD mode?
Similar to this question, but for Broadcom/LSI controllers: Can MegaRAID controllers use the onboard disk cache for JBOD drives? (I would like to enable the controller's hardware cache and then use ...
- 161
0
votes
0
answers
32
views
ZFS scrubbing keeps reparing disks
I've got two SSDs in a RAID 1 (mirroring) configuration on ZFS. They are quite old (~10 years I guess) but have never been used much in these years. That's my configuration
pool: tank
state: ONLINE
...
1
vote
1
answer
65
views
Recover ZFS mirror from pool with unavailable device
I tried to expand my two-way mirror to a three-way mirror. The new drive had some filesystem issues (ext4) so I tried to force zpool add -f the drive for ZFS to handle for me. This led to a weird ...
- 11
0
votes
0
answers
18
views
/dev/zvol/pool/group/srv points to partition zd0p16 not volume zd0 - bug or feature?
I am only starting to get familiar with openzfs 2.2.0 on Linux (Ubuntu kernel 6.5) and immediately ran into something strange. A symlink I was expecting to point to a zvol block device.. was pointing ...
- 9,451
3
votes
3
answers
317
views
FreeBSD - Is it possible to create a clone of a snapshot in a different disk for improved performance?
I am a new to FreeBSD and want to make a virtual disk service via iSCSI.
I create snapshots of a dataset on the same disks, however I would like to create clones on a different disk like a NVMe drive ...
- 33
1
vote
1
answer
48
views
ZFS list - root mounted twice?
I've followed this guide to install ubuntu with root on zfs. I've skipped creating all the dedicated (sub) datasets in step 3.3. Now "zfs list" looks like:
NAME USED ...
- 115
0
votes
0
answers
37
views
Bash script error when trying to create a snapshot
I am trying to create a snapshot using Bash script as below but error occurred.
Environment: FreeBSD,
Version: 13.2,
Script: Bash
#!/usr/local/bin/bash
name="17102023_1234"
zfs snapshot data/...
- 33
1
vote
1
answer
184
views
Why are files copied over usb to be 0 bytes?
This is a recurrent topic and I have read some answers on serverfault amongst them:
Folder sizes differ within two copied NTFS file trees (using ntfs-3g)
We have a ubuntu client from which researchers ...
5
votes
2
answers
113
views
Can ZFS send/receive help me recover from partial pool loss after upgrade to Ubuntu 22?
I have a long-running ZFS pool under Ubuntu, which has been through many upgrades. After upgrade from Ubuntu 20 to 22, the encrypted filesystems refuse to mount, though the rest seem OK. zpool ...
- 161
0
votes
0
answers
51
views
Enlarged my TrueNAS boot pool instead of mirroring. How can I fix it?
In Problems trying to replace disk in truenas mirrored boot, I was trying to fix a failed drive on my mirrored TrueNAS boot pool. I flailed around and eventually got it booted with just one drive of ...
- 153
0
votes
1
answer
80
views
Problems trying to replace disk in truenas mirrored boot
I have a TrueNAS box (TrueNAS-13.0-U5.3) and my boot pool is mirrored 32GB flash drives. One of the drives, da2, is getting errors, so I want to replace it.
I already have a new drive plugged in, da1, ...
- 153
1
vote
1
answer
179
views
proxmox image import creates an 50GB disk regardless of image size
If I import a disk image for vm 101 from a raw image, it will create an 50GB disk image:
# qm importdisk 101 disk.img local-zfs
importing disk '446-jenkinsmite.img' to VM 101 ...
transferred 0.0 B of ...
- 609
0
votes
1
answer
62
views
Scheduling SMART, scrub, resilvering considerations, conflicting?
I have set up regular scrub on my ZFS pools and am beginning to look at setting up smart check every now and then, but I have a distinct memory of an entry I am unable to find that one should not ...
0
votes
0
answers
84
views
How can I make Solaris' Fault Manager forget about an improperly removed ZFS pool?
On a Solaris 11.4 system I had a ZFS pool occupying three drives. While the system was powered off, these three drives were physically removed, but neither zpool export nor zpool destroy had been ...
- 1,618
0
votes
1
answer
113
views
TrueNas Encryption method changed - Is the data safe?
just a quick question of understanding. I have a TrueNas Scale server and I just changed the Encryption method from key to passphrase. Now I wonder if I need to rewrite the whole dataset for this to ...
- 45
0
votes
1
answer
169
views
ZFS import pool by ID as name already exists
My original system won't boot (startup). There are many errors which I am not able to solve.
I have installed ubuntu on a new device and can see the old pools from the old disk.
I cannot import the ...
0
votes
1
answer
183
views
How can I speed up a zfs resilver on a 24x 16TB drive draid2 array: "117T total... 47 days 02:31:23 to go"
(My apologies for the multiple edits to clarify formatting)
As above. The drives show no SMART errors.
Is there a way to check for HBA <--> drive communication errors?
This is running under ...
- 29
2
votes
1
answer
392
views
What ZFS pool, vdev and dataset properties should most people use?
ZFS has many different configurable properties for pools, for vdevs and for datasets. Many of those can be changed at any point, but some can only be set at creation time (or only affect data written ...
- 864
9
votes
1
answer
759
views
Understanding ZFS NVMe benchmarks with FIO
I'm trying to benchmark an all-NVMe ZFS disk array. I'm familiar with extremely fast benchmark results, with very little disk activity due to efficient ZFS caching. I ran into the reverse: massive ...
- 167
0
votes
1
answer
40
views
Home directory, user database and key-based authentication
I want to share it NFS share with my users just like the home-directories (traditional way), but I don't want to create the users instead I want to get the server integrated with the github or google ...
- 13
2
votes
1
answer
330
views
Why doesn't ZFS vdev removal work when any raidz devices are in the pool?
First: I'm perfectly okay with accepting that this is the case for now and am not looking for an immediate solution, rather I'm trying to understand the technical limitation for this constraint.
I'm ...
- 864
3
votes
1
answer
129
views
Why does my SLOG slow down sequential sync writes?
I jury-rigged a TrueNAS server to run a few tests in preparation for a proper NAS build. I got hold of an older Xeon server with 256GB RAM and a 10GbE NIC, equipped it with 6 sata disks configured as ...
- 153
3
votes
2
answers
109
views
ZFS mismatched replication level
I have a RAIDZ1 running 6x 3TB drives, and I want to expand my pool by adding 5x 2TB drives to it. But when I tell it to add to the pool I get this:
$ zpool add zpool1 raidz1 /dev/sda /dev/sdb /dev/...
- 83
1
vote
0
answers
107
views
ZFS permission error 'cannot set property' when receiving snapshot from remote machine despite delegated permission
Context
I'm setting up ZFS autobackup on my home server for offsite backups. All commands printed below are run as non-root.
Problem
A 'permission denied' error arises originating from the target ...
- 11
5
votes
1
answer
233
views
How to use targetcli to disable iSCSI write cache
I have exported a single disk as an iSCSI target using targetcli on a Linux host. On a remote machine I have connected to the device, and placed a ZFS volume on it (as a replication target with zrepl)...
- 1,105
0
votes
0
answers
289
views
Samba Windows ACL not working
I want to configure Samba to manage Windows ACL and manage them from Windows via the security tab.
The Samba server is standalone and not part of an AD tree; i already followed various offical and ...
- 101
1
vote
0
answers
107
views
Does the default zabbix SNMP trueNAS template catch disk failures?
I understand this might be a very basic question, but I would like to know the answer to this question before accidentally losing all the data on the NAS due to multiple drive failures with the first ...
- 149
0
votes
1
answer
48
views
Can I mirror a 2-disk striped zpool to a single large drive?
Currently I have a 4TB pool with two striped drives:
# zpool status
pool: lxd
state: ONLINE
status: Some supported features are not enabled on the pool. The pool can
still be used, but some ...
- 65
0
votes
0
answers
42
views
How to change keyformat of existing encrypted dataset
I had an unencrytped dataset that for which I used zfs send / receive to create an encrypted dataset with the data. The destination encrypted dataset used key-based creds. I would like to change this ...
- 101
1
vote
0
answers
35
views
zfs send to NAS with PIGZ compression slowness
The following command that I use to backup used to take 5 minutes to complete and since last week it is taking around 25 minutes. This is after restarting a switch stack the server is connected to. ...
- 11
0
votes
1
answer
182
views
ZFS I/O Error, Kernel Panic during import
I'm running a raidz1-0 (RAID5) setup with 4 data 2TB SSDs.
During midnight, somehow 2 of my data disks experience some I/O error (from /var/log/messages).
When I investigated in the morning, the zpool ...
2
votes
1
answer
97
views
zfs performance: split controller across mirrors vs splitting a mirror across controllers?
Suppose I have
4 disks split into 2 zfs mirrored pairs
2 sata controllers, where each can take 2 disks
Obviously, better expected uptime will be achieved by splitting each controller across both ...
- 123
1
vote
1
answer
156
views
ZFS: restore pool with detached drive
I have a Debian system installed on zfspool of 4 HDDs (like raid10 - raid0 of two raid1). And was displayed like set of 2 mirrors mirror0 and mirror1 each with 2 HDDs.
One of the disks became Faulted.
...
- 13
0
votes
2
answers
88
views
How does zfs know which snapshots to send with the `-I` flag?
From the manual:
A group of incremental snapshots can be combined into one snapshot by
using the zfs send -I option. For example:
# zfs send -I pool/fs@snapA pool/fs@snapD > /snaps/fs@all-I
How ...
- 101
0
votes
0
answers
24
views
Can I make running `zfs receive` without "-s" to save receive_resume_token by signal?
I am running a zfs send/receive. However I forget to set zfs receive -s.
Is this possible to inform a running zfs receive to save receive_resume_token by a signal sends from kill -s ?
Or is there ...
- 105
0
votes
0
answers
99
views
Rclone to a SFTP endpoint in a local network with a bunch of disks - suggested disks setup?
I have a need to copy a complex dataset (around 4 PB total, hundreds of millions of files) via Rclone copy, for some customers (each of them own around 100TB out of the 6PB) - to a bunch of disks via ...
- 65
4
votes
1
answer
482
views
How do I troubleshoot a zfs dataset that the server when the server can't agree if it's mounted or not?
I have a ZFS dataset that exists in /proc/mounts and in /etc/mtab, but the folder doesn't exist in the filesystem, zfs umount reports the dataset doesn't exist, and zfs mount reports that the dataset ...
- 151
0
votes
0
answers
86
views
Why isn't my zpool listed for export when plugged into new host?
I have a zpool called 'temp' with some data I'm trying to move between systems. I used zpool export temp to export the zpool, then I unplugged the disks, and installed them in my new computer. But now ...
- 333
0
votes
1
answer
81
views
Samba and ZFS resulting in NT_STATUS_BAD_NETWORK_NAME
I am currently trying to share my ZFS dataset using SMB. Unfortunately I receive the error NT_STATUS_BAD_NETWORK_NAME every time I try to connect to the share. The error does not make much sense to me ...
- 1
3
votes
1
answer
86
views
Pooled storage with varying redundancy per file system
I have some files that I want stored mirrored. I have some files that I only need single copies (i.e. scratch data, easily regenerated data, etc). And I have some files that are so critical, I want it ...
- 214
1
vote
1
answer
439
views
ZFS on Hetzner Rescue fails with `checking whether inode_owner_or_capable() takes user_ns... configure: error:`
Normally, when booting into the Hetzner rescue system, using the 'zfs' command will automatically install zfs tooling inside the rescue system.
This is currently not working;
checking whether ...
- 289
1
vote
0
answers
45
views
ZFS issues with reboot
After a reboot on Debian 11, I experienced 4 drives that just disappeared for no apparent reason. 2 are 'faulted' and 2 says they are unavailable.
Question: How do I identify the disks with the ...
- 11
1
vote
1
answer
129
views
How to explain that ZFS' snapshot reports 'WRITTEN' as 4.26GB, but the transfer size is actually 31.4GB?
When I run this query on a dataset
zfs list -d 1 -t all -o name,used,refer,written,compressratio sfg-backup/mx
I see the following stats:
zfs list -d 1 -t all -o name,used,refer,written,compressratio ...
- 327
2
votes
1
answer
414
views
Extremely slow MySQL writes in Ubuntu (ext4) guest on Promox 7.3-3 (ZFS) host
I'm trying out Proxmox 7.3-3 as a hypervisor and managed to install it using ZFS on my NVMe (Samsung_SSD_970_EVO_Plus_2TB_S6S2NS0T505403V)
I also installed a Ubuntu 22.04 VM and its filesystem is ext4
...
- 154
0
votes
1
answer
268
views
Uninstall ZFS installed via Ubuntu 20.04 installer
Apologies if this has been answered somewhere, I've searched everywhere and couldn't find anything.
I'm a PhD student and I manage a small cluster for our group. When installing Ubuntu 20.04 on our ...
1
vote
1
answer
364
views
Forcefully forget / unmount ZFS pool after drives disconnected
First off, I made a mistake & I acknowledge that, but now I'm stuck with a "broken" ZFS driver and want to restore it without rebooting my machine.
How I can say ZFS on Linux to just ...
- 103
2
votes
1
answer
292
views
ZFS Pool of USB Drives causes zsf-import-cache.service to fail on boot [closed]
I setup a ZFS pool on my "home server" (Raspberry Pi 4b) that consists of various HDD and SSD drives connected over USB to the Pi. I have noticed that whenever a reboot occurs, the ZFS pool ...
- 131
0
votes
0
answers
671
views
Bindmount External Drive In Proxmox for Nextcloud
I have a Proxmox LXC container with Nextcloud. The default data directory in Nextcloud requires the owner to be www-data with the default uid and gid of 33. I am using the following
Proxmox
Mount ...
