Can I change the OS or CUDA version after deploying?

Edited

Not on a running instance. Delete it and re-provision with the OS or CUDA version you want, keeping your existing block volume and attaching it to the new instance so your data comes along.