What's your current$/GPU/hour for H100 80GB? Trying to benchmark
Doing a sanity check on what people are actually paying right now.
We track rates across a bunch of providers and I'm seeing a pretty wide spread:
- Reserved (1yr commit): $1.90-2.40/hr
- On-demand: $2.50-3.20/hr
- Spot: $0.70-1.10/hr
But list prices are meaningless. Curious what people are actually signing contracts at.
Few things that seem to move the needle:
- Volume (8GPUs vs 64+ gets you very different conversations)
- Commitment length (monthly vs annual)
- Whether you need InfiniBand or can live with ethernet
- Paying upfront vs monthly
For those currently leasing H100s:
1. What are you paying per hour?
2. What commitment did you sign?
3. Any hidden costs that surprised you? (egress fees, storage, support tiers)
Trying to figure out if the deals I'm seeing are good or if I should push harder.
0 Comments