modinfo -l shows lots of different video drivers?

modinfo -l shows a ton of different video drivers, from matrox to ATI. Are all these drivers currently loaded my kernel, and is it ok to disable all but nvidiafb (since my system if 100% nvidia)?

The ones that are actually loaded are listed with lsmod.

Ah, thank you!