Leap 15.3 fails to boot after upgrade to 5.3.18-59.16 Kernel

Hi,

I have fairly basic VM (VirtualBox) that I use as a base system for testing. I upgraded it to Leap 15.3 a while ago but it now fails to boot with a 5.3.18-59.16 Kernel. If I drop back to a 5.3.18-57 Kernel it boots fine.

Here’s a screen shot of how far it gets with the new kernel. Any ideas of what might have gone wrong? Should I just boot into the 5.3.18-57 kernel and reinstall 5.3.18-59.16 kernel? I do have the virtualbox extensions installed from the default repositories so it should be fine.

https://paste.opensuse.org/2142608

I have the following repositories set up:

Progress:~ # zypper lr
Repository priorities are without effect. All enabled repositories share the same priority.


#  | Alias                         | Name                                                                                        | Enabled | GPG Check | Refresh
---+-------------------------------+---------------------------------------------------------------------------------------------+---------+-----------+--------
 1 | X11:RemoteDesktop             | X11:RemoteDesktop                                                                           | Yes     | (r ) Yes  | Yes
 2 | download.opensuse.org-non-oss | Main Repository (NON-OSS)                                                                   | Yes     | (r ) Yes  | Yes
 3 | download.opensuse.org-oss     | Main Repository (OSS)                                                                       | Yes     | (r ) Yes  | Yes
 4 | packman                       | packman                                                                                     | Yes     | (r ) Yes  | Yes
 5 | repo-backports-debug-update   | Update repository with updates for openSUSE Leap debuginfo packages from openSUSE Backports | No      | ----      | ----
 6 | repo-backports-update         | Update repository of openSUSE Backports                                                     | Yes     | (r ) Yes  | Yes
 7 | repo-debug                    | openSUSE-Leap-15.3-Debug                                                                    | No      | ----      | ----
 8 | repo-debug-non-oss            | openSUSE-Leap-15.3-Debug-Non-Oss                                                            | No      | ----      | ----
 9 | repo-debug-update             | openSUSE-Leap-15.3-Update-Debug                                                             | No      | ----      | ----
10 | repo-debug-update-non-oss     | openSUSE-Leap-15.3-Update-Debug-Non-Oss                                                     | No      | ----      | ----
11 | repo-sle-debug-update         | Update repository with debuginfo for updates from SUSE Linux Enterprise 15                  | No      | ----      | ----
12 | repo-sle-update               | Update repository with updates from SUSE Linux Enterprise 15                                | Yes     | (r ) Yes  | Yes
13 | repo-source                   | openSUSE-Leap-15.3-Source                                                                   | No      | ----      | ----
14 | repo-update                   | openSUSE-Leap-15.3-Update                                                                   | Yes     | (r ) Yes  | Yes
15 | repo-update-non-oss           | openSUSE-Leap-15.3-Update-Non-Oss                                                           | Yes     | (r ) Yes  | Yes
Progress:~ # 


Anyone got any ideas?

Many thanks.

Not clear for me:
You ruin openSUSE as Hostsystem with Virtualbox?
Or run openSUSE inside an Virtaulbox as Guest?

openSUSE is the guest running on a Win10 host.

Post from the guest:

zypper se -si virtualbox kernel

Having booted with the 5.3.18-57 kernel:

Progress:~ # zypper se -si virtualbox kernelLoading repository data...
Reading installed packages...


S  | Name                        | Type    | Version                          | Arch   | Repository
---+-----------------------------+---------+----------------------------------+--------+-------------------------------------------------------------
i+ | kernel-default              | package | 5.3.18-59.16.1                   | x86_64 | Update repository with updates from SUSE Linux Enterprise 15
i+ | kernel-default              | package | 5.3.18-57.3                      | x86_64 | Main Repository (OSS)
i  | kernel-default-extra        | package | 5.3.18-59.16.1                   | x86_64 | Update repository with updates from SUSE Linux Enterprise 15
i  | kernel-default-extra        | package | 5.3.18-57.3                      | x86_64 | Main Repository (OSS)
i  | kernel-default-optional     | package | 5.3.18-59.16.1                   | x86_64 | Update repository with updates from SUSE Linux Enterprise 15
i  | kernel-default-optional     | package | 5.3.18-57.3                      | x86_64 | Main Repository (OSS)
i+ | kernel-firmware-all         | package | 20210208-2.4                     | noarch | Main Repository (OSS)
i  | kernel-firmware-amdgpu      | package | 20210208-2.4                     | noarch | Main Repository (OSS)
i  | kernel-firmware-ath10k      | package | 20210208-2.4                     | noarch | Main Repository (OSS)
i  | kernel-firmware-ath11k      | package | 20210208-2.4                     | noarch | Main Repository (OSS)
i  | kernel-firmware-atheros     | package | 20210208-2.4                     | noarch | Main Repository (OSS)
i  | kernel-firmware-bluetooth   | package | 20210208-2.4                     | noarch | Main Repository (OSS)
i  | kernel-firmware-bnx2        | package | 20210208-2.4                     | noarch | Main Repository (OSS)
i  | kernel-firmware-brcm        | package | 20210208-2.4                     | noarch | Main Repository (OSS)
i  | kernel-firmware-chelsio     | package | 20210208-2.4                     | noarch | Main Repository (OSS)
i  | kernel-firmware-dpaa2       | package | 20210208-2.4                     | noarch | Main Repository (OSS)
i  | kernel-firmware-i915        | package | 20210208-2.4                     | noarch | Main Repository (OSS)
i  | kernel-firmware-intel       | package | 20210208-2.4                     | noarch | Main Repository (OSS)
i  | kernel-firmware-iwlwifi     | package | 20210208-2.4                     | noarch | Main Repository (OSS)
i  | kernel-firmware-liquidio    | package | 20210208-2.4                     | noarch | Main Repository (OSS)
i  | kernel-firmware-marvell     | package | 20210208-2.4                     | noarch | Main Repository (OSS)
i  | kernel-firmware-media       | package | 20210208-2.4                     | noarch | Main Repository (OSS)
i  | kernel-firmware-mediatek    | package | 20210208-2.4                     | noarch | Main Repository (OSS)
i  | kernel-firmware-mellanox    | package | 20210208-2.4                     | noarch | Main Repository (OSS)
i  | kernel-firmware-mwifiex     | package | 20210208-2.4                     | noarch | Main Repository (OSS)
i  | kernel-firmware-network     | package | 20210208-2.4                     | noarch | Main Repository (OSS)
i  | kernel-firmware-nfp         | package | 20210208-2.4                     | noarch | Main Repository (OSS)
i  | kernel-firmware-nvidia      | package | 20210208-2.4                     | noarch | Main Repository (OSS)
i  | kernel-firmware-platform    | package | 20210208-2.4                     | noarch | Main Repository (OSS)
i  | kernel-firmware-prestera    | package | 20210208-2.4                     | noarch | Main Repository (OSS)
i  | kernel-firmware-qlogic      | package | 20210208-2.4                     | noarch | Main Repository (OSS)
i  | kernel-firmware-radeon      | package | 20210208-2.4                     | noarch | Main Repository (OSS)
i  | kernel-firmware-realtek     | package | 20210208-2.4                     | noarch | Main Repository (OSS)
i  | kernel-firmware-serial      | package | 20210208-2.4                     | noarch | Main Repository (OSS)
i  | kernel-firmware-sound       | package | 20210208-2.4                     | noarch | Main Repository (OSS)
i  | kernel-firmware-ti          | package | 20210208-2.4                     | noarch | Main Repository (OSS)
i  | kernel-firmware-ueagle      | package | 20210208-2.4                     | noarch | Main Repository (OSS)
i  | kernel-firmware-usb-network | package | 20210208-2.4                     | noarch | Main Repository (OSS)
i+ | kernel-macros               | package | 5.3.18-59.16.1                   | noarch | Update repository with updates from SUSE Linux Enterprise 15
i  | purge-kernels-service       | package | 0-8.3.1                          | noarch | (System Packages)
i+ | virtualbox-guest-tools      | package | 6.1.24-lp153.2.6.1               | x86_64 | openSUSE-Leap-15.3-Update
i+ | virtualbox-guest-x11        | package | 6.1.24-lp153.2.6.1               | x86_64 | openSUSE-Leap-15.3-Update
i+ | virtualbox-kmp-default      | package | 6.1.24_k5.3.18_59.16-lp153.2.6.1 | x86_64 | openSUSE-Leap-15.3-Update
i+ | virtualbox-kmp-default      | package | 6.1.20_k5.3.18_57-lp153.1.2      | x86_64 | Main Repository (OSS)




For an extended search including not yet activated remote resources you may run 'zypper
search-packages' at any time.
Do you want to run 'zypper search-packages' now? [yes/no/always/never] (no): 


Progress:~ # 



OK, so it looks like the two kernels came from different repositories :\

Not sure when “Update repository with updates from SUSE Linux Enterprise 15” got added but I suspect it was during the 5.3 update.

Probably not relevant but just in case the VirtualBox version that it is running under is 6.1.2

How long did you wait? It likely is still in initrd, so may drop you in emergency shell after timeout where you can investigate more.

Leap 15.3 kernel is from SLE so updates come from SLE.

I waited a reasonable time. On the graphical (can’t remember the correct name) the rotating swirl actually disappeared. I will set it going and leave it for an hour now as I have to go out.

After an hour the startup screen is still frozen.

Subsequently I have changed the Video controller in the VM and now get successive lines that report:

“[36.752274] watchdog: BUG soft lockup - CPU#0 stuck for 23s [plymouth:767]”

and this increments every 28 seconds or thereabouts.

What Virtualbox Version is running on the Host?

Can you boot openSUSE in Runlevel 3 (multi-user.target) with the updated kernel?

VirtualBox 6.1.2. So pretty up to date.

Can you boot openSUSE in Runlevel 3 (multi-user.target) with the updated kernel?

OK, I have just done a fresh install on a new virtual drive with a new download but still using the same virtual machine definition file (.vbox) and that also fails to boot.

Hopefully I got the run level syntax correct. I added a “3” to the edited Grub line having deleted “quiet” and “splash=silent”. It also froze during booting.

Can’t see anything special in my VM’s settings. Chipset is PIX3, storage is via a SATA controller, BIOS boot, enabled PAE/NX and enabled Nested Pages. Paravirtualization is Legacy. Very happy to provide a copy of the .vbox file if anyone would like to see/play with it.

VirtualBox 6.1.2. So pretty up to date.

Not really:

VirtualBox  --help
Oracle VM VirtualBox VM Selector v6.1.26_SUSE
(C) 2005-2021 Oracle Corporation
All rights reserved.

No special options.

If you are looking for --startvm and related options, you need to use VirtualBoxVM.

OK, an upgrade of VirtualBox fixed it.

Progress:~ # uname -a
Linux Progress 5.3.18-59.16-default #1 SMP Thu Jul 15 11:28:57 UTC 2021 (0b62bdb) x86_64 x86_64 x86_64 GNU/Linux
Progress:~ #

Many thanks for all the help on this one.

Still a bit baffled as to what was wrong but it all works now.

Enable serial console, bump log level to maximum debug, enable systemd debug output and log to kmsg, this may provide information where and why it hangs. Something like

plymouth.enable=0 debug ignore_loglevel printk.devkmsg=on systemd.log_target=kmsg console=ttyS0 console=tty0

for the first serial port. Boot output should go to ttyS0. I think I had some issues with systemd and multiple consoles, so you may try to omit console=tty0 if nothing will be output.

Record output to ttyS0 and make it available.

@arvidjaar - Many thanks for the suggestion but a VirtualBox update solved it all. Not quite sure why but possible an extension issue.

The Virtualbox on the Host was too old for the actual Virtualbox Kernel and kmps from openSUSE…
Maybe something has changed in the kernel-update…