Update:
Yesterday I had the problems twice directly after each other, just did a reboot in between.
Last week I installed Fedora 37 and used it for about a week, no problems at all. Well, not with the USB, there were other things which didn’t work like I want to so I returned to openSUSE.
Since I have these problems on a daily basis, sometimes multiple times per day, sometimes a whole day no problem, and with Fedora for one week no problems I am starting to think it might be the software instead of the hardware.
Any ideas?