Ask HN: What is the cheapest ($/hour) H100 renting service with quick spin-up?
Something that can be programmatically spun up and turned off in seconds would be ideal.
Something that can be programmatically spun up and turned off in seconds would be ideal.
https://cloud.vast.ai/
Seeing H100 going for $2.138/hr
I don't know about cheapest but Modal is quite convenient code-wise
Modal is excellent for prototyping and experimentation, but I find the queueing and startup times hard to stomach. Perhaps if I had a much bigger load it would be snappier.
Runpod with its python APIs.