I have been doing some reading, and I am starting to see the light again.

Pipewire replaces both pulse audio and jack. The programs will however "think", they are still using pulse audio or jack.

This vid made me realise I need to at least try to use to pipewire.
He is basically doing what I want to do.

https://www.youtube.com/watch?v=q7XrrBXIzfg

So I need to install something pipewire pulse and pipewire jack, and then probably just reboot.

My use case should be a bit more easy, because I am not looking for audio recording, but I do want to record midi, from my midi controller.

Pipewire here I come.