CUDA - can't compile .cu files because of "gcc: error trying to exec 'cc1plus': execvp" error

I'm trying to compile a simple .cu file with CUDA 5 and gcc 4.7.3 on Ubuntu 13.0 but I'm getting

gcc: error trying to exec 'cc1plus': execvp: No such file or directory

How can I fix this?