No degradation because the CPU has those instructions. Only thing is you will use more memory because you cannot share those 32-bit libraries that have a 64-bit counterpart already loaded.