Should I use spot or on-demand for a serverless deployment?
Edited
On spot, GPUs go to on-demand users first, so a spot replica may not get capacity back after scaling to zero. For production where availability matters, use on-demand - and keep a minimum of 1 replica so it holds its GPU.