During installation when choosing LUKS encryption, it would’ve been prudent to choose LVM as well since swap, root fs, other stuff could all have been logical volumes inside a single encrypted partition. As it stands now, the system has to unlock each encrypted partition separately on boot.
But you can do so in an automated manner using key files to decrypt all others except /boot which has to be unlocked with password and where inside the initramfs you can add the key files.
The procedure is detailed in this thread.