Ask HN: What is the cheapest ($/hour) H100 renting service with quick spin-up?
Something that can be programmatically spun up and turned off in seconds would be ideal.
Something that can be programmatically spun up and turned off in seconds would be ideal.
I don't know about cheapest but Modal is quite convenient code-wise
Modal is excellent for prototyping and experimentation, but I find the queueing and startup times hard to stomach. Perhaps if I had a much bigger load it would be snappier.
Runpod with its python APIs.