Instructions on this matter are quite clear: if you don’t install the driver from the repos, you have to apply ‘nomodeset’.