I'd rather not give money to scalper barons if I can avoid it. Fab capacity is going to that for rental rather than hardware for humans.

I thought about that, but idk if they allow me to modify the linux kernel and nvidia cuda kernel at all

In those systems you could probably leverage something like Nvidia SCADA or GDS directly.

Actually since they have direct GDS it should perform really well on professional gpus

I think you can do a bunch of that on Digitalocean's GPU droplets.