Hello, I just wanted to post this, no one else seems to. I really don’t know why/how it’s happening, but every once in a while I loose my ZFS mirror pool. But it seems to me that somehow the ZFS packages are not updated. It is really tiresome, fighting this for 5+ years and always have to postpone some humongous kernel security update because someone “forgets” a whole filesystem. But mostly I just update and get:
PC:/home/mumu # cat /var/log/messages | grep zfs
2018-08-09T08:43:10.275368+03:00 PC systemd-udevd[932]: Process '/sbin/modprobe zfs' failed with exit code 1.
2018-08-09T08:43:10.275372+03:00 PC systemd-udevd[933]: Process '/sbin/modprobe zfs' failed with exit code 1.
2018-08-09T08:43:10.275651+03:00 PC modprobe[1488]: modprobe: FATAL: Module zfs not found in directory /lib/modules/4.12.14-lp150.12.10-default
2018-08-09T08:43:10.275659+03:00 PC zpool[1490]: Try running '/sbin/modprobe zfs' as root to load them.
2018-08-09T08:43:10.275663+03:00 PC systemd[1]: zfs-import-cache.service: Main process exited, code=exited, status=1/FAILURE
2018-08-09T08:43:10.275671+03:00 PC systemd[1]: zfs-import-cache.service: Unit entered failed state.
2018-08-09T08:43:10.275677+03:00 PC systemd[1]: zfs-import-cache.service: Failed with result 'exit-code'.
2018-08-09T08:43:10.275693+03:00 PC zfs[1493]: The ZFS modules are not loaded.
2018-08-09T08:43:10.275699+03:00 PC zfs[1493]: Try running '/sbin/modprobe zfs' as root to load them.
2018-08-09T08:43:10.275703+03:00 PC systemd[1]: zfs-mount.service: Main process exited, code=exited, status=1/FAILURE
2018-08-09T08:43:10.275710+03:00 PC systemd[1]: zfs-mount.service: Unit entered failed state.
2018-08-09T08:43:10.275716+03:00 PC systemd[1]: zfs-mount.service: Failed with result 'exit-code'.
2018-08-09T08:43:10.276032+03:00 PC zfs[1573]: The ZFS modules are not loaded.
2018-08-09T08:43:10.276036+03:00 PC zfs[1573]: Try running '/sbin/modprobe zfs' as root to load them.
2018-08-09T08:43:10.276045+03:00 PC systemd[1]: zfs-share.service: Main process exited, code=exited, status=1/FAILURE
2018-08-09T08:43:10.276061+03:00 PC systemd[1]: zfs-share.service: Unit entered failed state.
2018-08-09T08:43:10.276065+03:00 PC systemd[1]: zfs-share.service: Failed with result 'exit-code'.
2018-08-09T08:43:10.276125+03:00 PC zed[1561]: Failed to initialize libzfs
2018-08-09T08:43:10.276129+03:00 PC systemd[1]: zfs-zed.service: Main process exited, code=exited, status=1/FAILURE
2018-08-09T08:43:10.276139+03:00 PC systemd[1]: zfs-zed.service: Unit entered failed state.
2018-08-09T08:43:10.276142+03:00 PC systemd[1]: zfs-zed.service: Failed with result 'exit-code'.
2018-08-09T08:44:58.018875+03:00 PC systemd-udevd[786]: Process '/sbin/modprobe zfs' failed with exit code 1.
2018-08-09T08:44:58.018882+03:00 PC systemd-udevd[748]: Process '/sbin/modprobe zfs' failed with exit code 1.
2018-08-09T08:44:58.019097+03:00 PC modprobe[1341]: modprobe: FATAL: Module zfs not found in directory /lib/modules/4.12.14-lp150.12.10-default
2018-08-09T08:44:58.019105+03:00 PC zpool[1343]: Try running '/sbin/modprobe zfs' as root to load them.
2018-08-09T08:44:58.019109+03:00 PC systemd[1]: zfs-import-cache.service: Main process exited, code=exited, status=1/FAILURE
2018-08-09T08:44:58.019115+03:00 PC systemd[1]: zfs-import-cache.service: Unit entered failed state.
2018-08-09T08:44:58.019118+03:00 PC systemd[1]: zfs-import-cache.service: Failed with result 'exit-code'.
2018-08-09T08:44:58.019134+03:00 PC zfs[1352]: The ZFS modules are not loaded.
2018-08-09T08:44:58.019139+03:00 PC zfs[1352]: Try running '/sbin/modprobe zfs' as root to load them.
2018-08-09T08:44:58.019143+03:00 PC systemd[1]: zfs-mount.service: Main process exited, code=exited, status=1/FAILURE
2018-08-09T08:44:58.019154+03:00 PC systemd[1]: zfs-mount.service: Unit entered failed state.
2018-08-09T08:44:58.019159+03:00 PC systemd[1]: zfs-mount.service: Failed with result 'exit-code'.
2018-08-09T08:44:58.019453+03:00 PC zed[1398]: Failed to initialize libzfs
2018-08-09T08:44:58.019616+03:00 PC systemd[1]: zfs-zed.service: Main process exited, code=exited, status=1/FAILURE
2018-08-09T08:44:58.019619+03:00 PC systemd[1]: zfs-zed.service: Unit entered failed state.
2018-08-09T08:44:58.019624+03:00 PC systemd[1]: zfs-zed.service: Failed with result 'exit-code'.
2018-08-09T08:44:58.019678+03:00 PC zfs[1513]: The ZFS modules are not loaded.
2018-08-09T08:44:58.019681+03:00 PC zfs[1513]: Try running '/sbin/modprobe zfs' as root to load them.
2018-08-09T08:44:58.019688+03:00 PC systemd[1]: zfs-share.service: Main process exited, code=exited, status=1/FAILURE
2018-08-09T08:44:58.019697+03:00 PC systemd[1]: zfs-share.service: Unit entered failed state.
2018-08-09T08:44:58.019700+03:00 PC systemd[1]: zfs-share.service: Failed with result 'exit-code'.
2018-08-09T08:49:02.599885+03:00 PC systemd-udevd[955]: Process '/sbin/modprobe zfs' failed with exit code 1.
2018-08-09T08:49:02.599911+03:00 PC systemd-udevd[833]: Process '/sbin/modprobe zfs' failed with exit code 1.
2018-08-09T08:49:02.600157+03:00 PC modprobe[1438]: modprobe: FATAL: Module zfs not found in directory /lib/modules/4.12.14-lp150.12.10-default
2018-08-09T08:49:02.600167+03:00 PC zpool[1440]: Try running '/sbin/modprobe zfs' as root to load them.
2018-08-09T08:49:02.600172+03:00 PC systemd[1]: zfs-import-cache.service: Main process exited, code=exited, status=1/FAILURE
2018-08-09T08:49:02.600180+03:00 PC systemd[1]: zfs-import-cache.service: Unit entered failed state.
2018-08-09T08:49:02.600184+03:00 PC systemd[1]: zfs-import-cache.service: Failed with result 'exit-code'.
2018-08-09T08:49:02.600198+03:00 PC zfs[1443]: The ZFS modules are not loaded.
2018-08-09T08:49:02.600202+03:00 PC zfs[1443]: Try running '/sbin/modprobe zfs' as root to load them.
2018-08-09T08:49:02.600207+03:00 PC systemd[1]: zfs-mount.service: Main process exited, code=exited, status=1/FAILURE
2018-08-09T08:49:02.600215+03:00 PC systemd[1]: zfs-mount.service: Unit entered failed state.
2018-08-09T08:49:02.600221+03:00 PC systemd[1]: zfs-mount.service: Failed with result 'exit-code'.
2018-08-09T08:49:02.600547+03:00 PC zed[1493]: Failed to initialize libzfs
2018-08-09T08:49:02.600761+03:00 PC systemd[1]: zfs-zed.service: Main process exited, code=exited, status=1/FAILURE
2018-08-09T08:49:02.600767+03:00 PC systemd[1]: zfs-zed.service: Unit entered failed state.
2018-08-09T08:49:02.600771+03:00 PC systemd[1]: zfs-zed.service: Failed with result 'exit-code'.
2018-08-09T08:49:02.600793+03:00 PC zfs[1607]: The ZFS modules are not loaded.
2018-08-09T08:49:02.600797+03:00 PC zfs[1607]: Try running '/sbin/modprobe zfs' as root to load them.
2018-08-09T08:49:02.600802+03:00 PC systemd[1]: zfs-share.service: Main process exited, code=exited, status=1/FAILURE
2018-08-09T08:49:02.600809+03:00 PC systemd[1]: zfs-share.service: Unit entered failed state.
2018-08-09T08:49:02.600812+03:00 PC systemd[1]: zfs-share.service: Failed with result 'exit-code'.
PC:/home/mumu # zypper in zfs-kmp-default
Loading repository data...
Reading installed packages...
Resolving package dependencies...
The following 3 NEW packages are going to be installed:
kernel-default-4.12.14-lp150.11.4 spl-kmp-default zfs-kmp-default
3 new packages to install.
Overall download size: 65.2 MiB. Already cached: 0 B. After the operation, additional 372.9 MiB will be used.
Continue? [y/n/...? shows all options] (y): n
PC:/home/mumu # uname -a
Linux PC 4.12.14-lp150.12.10-default #1 SMP Mon Aug 6 10:07:28 UTC 2018 (da1ff4b) x86_64 x86_64 x86_64 GNU/Linux
PC:/home/mumu # zypper in zfs
Loading repository data...
Reading installed packages...
'zfs' is already installed.
No update candidate for 'zfs-0.7.9-lp150.1.3.x86_64'. The highest available version is already installed.
Resolving package dependencies...
Nothing to do.
zypper info zfs
Loading repository data...
Reading installed packages...
Information for package zfs:
----------------------------
Repository : filesystems
Name : zfs
Version : 0.7.9-lp150.1.3
Arch : x86_64
Vendor : obs://build.opensuse.org/filesystems
Installed Size : 1.3 MiB
Installed : Yes
Status : up-to-date
Source package : zfs-0.7.9-lp150.1.3.src
Summary : The ZFS filesystem and utilities
Description :
ZFS is a combined file system and logical volume manager designed by
Sun Microsystems. The features of ZFS include protection against data
corruption, support for high storage capacities, integration of the
concepts of filesystem and volume management, snapshots and
copy-on-write clones, continuous integrity checking and automatic
repair, RAID-Z and native NFSv4 ACLs.
ZFS on Linux, which is also known as ZoL, includes fully functional
and stable SPA, DMU, ZVOL, and ZPL layers.
I was pretty sure that except packman, those are our repos?
The Open Build Service hosts numerous community repositories, but they are not part of the official distribution as such. The four main official repos are: OSS, Non-OSS, Update-OSS, and Update-Non-OSS
Looking at the Linux kernel a little more closely,
I’m surprised that although most Linux filesystems are distributed within the kernel nowadays, ZFS does not make the list.
This suggests that the ZFS you use is built by an independent project, perhaps with some research might reveal that there could be more than one project out there… and as your logs suggest, ZFS is available as a kernel loadable module that has to be loaded.
I assume someone already looked at whether it might be better to dynamically compile ZFS instead of building pre-compiled modules.
The problem in my case is bigger since the latest kernel update and since I posted this: every time I start my PC I end up without my pool, the module doesn’t get loaded. Then I run:
**#** zypper in zfs-kmp-default
Loading repository data...
Reading installed packages...
Resolving package dependencies...
The following 3 NEW packages are going to be installed:
kernel-default-4.12.14-lp150.11.4 spl-kmp-default zfs-kmp-default
3 new packages to install.
Overall download size: 65.2 MiB. Already cached: 0 B. After the operation, additional 372.9 MiB will be used.
It installs, than I reboot again and voila, after the reboot everything is fine. But after that, on the next startup, again I have… no zfs. How is that even possible to keep installing the same stuff over and over again? And why it works every 2 reboots and not… forever?
Tried rebuilding with mkinitrd - no difference.
PS: I know about the state of ZFS on linux, licensing problems and such - this is not an issue for me, but I would love not to loose all my data, a mirror in fact every 2 reboots… It worked beautifully for years. Does someone else experience the same behavior?
Hi
Add your module .conf file it to /etc/modules-load.d/, the thing is after a kernel update it should move to weak-updates if it didn’t get updated in the filesystems repo, if it isn’t then it may be a zfs build bug in the filesystems repo…
Something is very wrong - is anyone using zfs here? Updated to the latest-versions-everything? Be cause I am pretty sure I had some @zfs.ko after reinstalling again and after a reboot, while my pool is OK, it is gone? In /lib/modules/<<kernel vs.>>/weak-updates/extra/zfs As some other kernel version?
What I did:
Created (it doesn’t get copied in /lib/modules/) the file /etc/modules-load.d/
# /etc/modprobe.d/zfs.conf#
# yes you really DO have to specify zfs_arc_max IN BYTES ONLY!
# 16GB=17179869184, 8GB=8589934592, 4GB=4294967296, 2GB=2147483648, 1GB=1073741824, 500MB=536870912, 250MB=268435456
#
options zfs zfs_arc_max=4294967296
Reinstalled - notice the kmp errors, what is that?
FakeMoth-PC:/lib/modules/4.12.14-lp150.12.16-default/weak-updates/extra/zfs # zypper remove zfsLoading repository data...
Reading installed packages...
Resolving package dependencies...
The following 2 packages are going to be REMOVED:
zfs zfs-sudo
2 packages to remove.
After the operation, 1.3 MiB will be freed.
Continue? [y/n/...? shows all options] (y): y
(1/2) Removing zfs-sudo-0.7.9-lp150.1.3.noarch ............................................................................................................[done]
(2/2) Removing zfs-0.7.9-lp150.1.3.x86_64 .................................................................................................................[done]
Additional rpm output:
Removed /etc/systemd/system/multi-user.target.wants/zfs.target.
Removed /etc/systemd/system/zfs-import.target.wants/zfs-import-cache.service.
Removed /etc/systemd/system/zfs-share.service.wants/zfs-mount.service.
Removed /etc/systemd/system/zfs.target.wants/zfs-mount.service.
Removed /etc/systemd/system/zfs.target.wants/zfs-share.service.
Removed /etc/systemd/system/zfs.target.wants/zfs-zed.service.
Removed /etc/systemd/system/zfs.target.wants/zfs-import.target.
Removed /etc/systemd/system/zed.service.
Removed /etc/systemd/system/zfs-mount.service.wants/zfs-import.target.
warning: /etc/zfs/zed.d/zed.rc saved as /etc/zfs/zed.d/zed.rc.rpmsave
FakeMoth-PC:/lib/modules/4.12.14-lp150.12.16-default/weak-updates/extra/zfs # zypper in zfs
Loading repository data...
Reading installed packages...
Resolving package dependencies...
The following 5 NEW packages are going to be installed:
kernel-default-4.12.14-lp150.11.4 spl-kmp-default zfs zfs-kmp-default zfs-sudo
5 new packages to install.
Overall download size: 65.7 MiB. Already cached: 0 B. After the operation, additional 374.2 MiB will be used.
Continue? [y/n/...? shows all options] (y): y
Retrieving package zfs-0.7.9-lp150.1.3.x86_64 (1/5), 479.6 KiB ( 1.3 MiB unpacked)
Retrieving: zfs-0.7.9-lp150.1.3.x86_64.rpm ....................................................................................................[done (1.1 MiB/s)]
Retrieving package zfs-sudo-0.7.9-lp150.1.3.noarch (2/5), 14.2 KiB ( 262 B unpacked)
Retrieving: zfs-sudo-0.7.9-lp150.1.3.noarch.rpm ...........................................................................................................[done]
Retrieving package kernel-default-4.12.14-lp150.11.4.x86_64 (3/5), 54.5 MiB (298.1 MiB unpacked)
Retrieving: kernel-default-4.12.14-lp150.11.4.x86_64.rpm ......................................................................................[done (3.8 MiB/s)]
Retrieving package spl-kmp-default-0.7.9_k4.12.14_lp150.11-lp150.1.5.x86_64 (4/5), 1.4 MiB ( 8.9 MiB unpacked)
Retrieving: spl-kmp-default-0.7.9_k4.12.14_lp150.11-lp150.1.5.x86_64.rpm ......................................................................[done (2.1 MiB/s)]
Retrieving package zfs-kmp-default-0.7.9_k4.12.14_lp150.11-lp150.1.3.x86_64 (5/5), 9.3 MiB ( 65.9 MiB unpacked)
Retrieving: zfs-kmp-default-0.7.9_k4.12.14_lp150.11-lp150.1.3.x86_64.rpm ......................................................................[done (2.3 MiB/s)]
Checking for file conflicts: ..............................................................................................................................[done]
(1/5) Installing: zfs-0.7.9-lp150.1.3.x86_64 ..............................................................................................................[done]
Additional rpm output:
Created symlink /etc/systemd/system/zfs-import.target.wants/zfs-import-cache.service -> /usr/lib/systemd/system/zfs-import-cache.service.
Created symlink /etc/systemd/system/zfs-share.service.wants/zfs-mount.service -> /usr/lib/systemd/system/zfs-mount.service.
Created symlink /etc/systemd/system/zfs.target.wants/zfs-mount.service -> /usr/lib/systemd/system/zfs-mount.service.
Created symlink /etc/systemd/system/zfs.target.wants/zfs-share.service -> /usr/lib/systemd/system/zfs-share.service.
Created symlink /etc/systemd/system/zed.service -> /usr/lib/systemd/system/zfs-zed.service.
Created symlink /etc/systemd/system/zfs.target.wants/zfs-zed.service -> /usr/lib/systemd/system/zfs-zed.service.
Created symlink /etc/systemd/system/multi-user.target.wants/zfs.target -> /usr/lib/systemd/system/zfs.target.
Created symlink /etc/systemd/system/zfs-mount.service.wants/zfs-import.target -> /usr/lib/systemd/system/zfs-import.target.
Created symlink /etc/systemd/system/zfs.target.wants/zfs-import.target -> /usr/lib/systemd/system/zfs-import.target.
(2/5) Installing: zfs-sudo-0.7.9-lp150.1.3.noarch .........................................................................................................[done]
(3/5) Installing: kernel-default-4.12.14-lp150.11.4.x86_64 ................................................................................................[done]
Additional rpm output:
Creating initrd: /boot/initrd-4.12.14-lp150.11-default
dracut: Executing: /usr/bin/dracut --logfile /var/log/YaST2/mkinitrd.log --force /boot/initrd-4.12.14-lp150.11-default 4.12.14-lp150.11-default
dracut: zfsexpandknowledge: host device /dev/dm-1
dracut: zfsexpandknowledge: host device /dev/mapper/cr_sda2
dracut: zfsexpandknowledge: host device /dev/sda1
dracut: zfsexpandknowledge: host device /dev/dm-0
dracut: zfsexpandknowledge: device /dev/dm-1 of type btrfs
dracut: zfsexpandknowledge: device /dev/dm-0 of type swap
dracut: zfsexpandknowledge: device /dev/sda4 of type crypto_LUKS
dracut: zfsexpandknowledge: device /dev/sda1 of type vfat
dracut: zfsexpandknowledge: device /dev/sda2 of type crypto_LUKS
dracut: zfsexpandknowledge: host device /dev/dm-1
dracut: zfsexpandknowledge: host device /dev/mapper/cr_sda2
dracut: zfsexpandknowledge: host device /dev/sda1
dracut: zfsexpandknowledge: host device /dev/dm-0
dracut: zfsexpandknowledge: device /dev/dm-1 of type btrfs
dracut: zfsexpandknowledge: device /dev/dm-0 of type swap
dracut: zfsexpandknowledge: device /dev/sda4 of type crypto_LUKS
dracut: zfsexpandknowledge: device /dev/sda1 of type vfat
dracut: zfsexpandknowledge: device /dev/sda2 of type crypto_LUKS
dracut: *** Including module: bash ***
dracut: *** Including module: systemd ***
dracut: *** Including module: warpclock ***
dracut: *** Including module: systemd-initrd ***
dracut: *** Including module: i18n ***
dracut: Could not find FONT_MAP none!
dracut: *** Including module: drm ***
dracut: *** Including module: plymouth ***
dracut: *** Including module: btrfs ***
dracut: *** Including module: crypt ***
dracut: *** Including module: dm ***
Puzzled by your problem, I wonder if the just installed **kernel-default-4.12.14-lp150.11.4 **gets wiped by purge-kernels on the next reboot with all its ZFS modules.
Please show the result of:
Please do not suggest the usage of home: repos. These are packagers’ en developers’ repos, the place where they can break things. Consider yourself lucky that this was reliable for you so far, but don’t be surprised to have a borked system one of these days.
If you insist on using zfs, rather us http://download.opensuse.org/repositories/filesystems/openSUSE_Leap_15.0/ .
to save all of you a lot of time disable purge old kernel service
i am running opensuse leap 15 whit zfs true the invis repo for +/- a year and the workaround around updates for me is disable the service. Be aware of the boot partation free size…(i use btrfs whitout a boot partitions true msdos partition table to prevent uifi boot.) i have most of the time a pretty fress system whit 2 to 5 kernels installed… i think the you also can leave the kernel whit 4.12…lp0… 11… from the instal dvd and delete all others that will work to … i am verry curias for zfs 0.8… no more spl needs…