I'm running openSUSE 12.2 (i586) (kernel:Linux 3.4.33-2.24-desktop i686) with KDE 4.8.5 (4.8.5) "release 2"

I'm trying to connect to a VPN server via OpenVPN. I followed the server's instructions for the setup but when I doubleclick on the connection in Systems Settings -> Network Settings -> VPN I get this error message
No agents were available for this request.
The settings dialog for the OpenVPN connection reopens and the password has disappeared.

After googling I figured it must have something to do with kwallet, which is running in the background (the icon is in the taskbar) but I never get a popup asking me to save the password.
I tried uninstalling, re-installing kwallet, deleting wallets etc, but nothing seems to work.

Any help is greatly appreciated.