NVIDIA H100 GPU cloud prices
The standard data-center GPU for large-scale AI training and inference.
Compare vs other GPUs →Not enough price history yet — the trend fills in as we log more.
Provider-balanced managed-cloud median per GPU-hour (USD) · live data
Key Specifications
ArchitectureHopper
Memory80GB HBM3
Memory Bandwidth3.35 TB/s
ReleaseQ1 2023
Compare Cloud Provider Prices
We’re tracking 57 providers for the NVIDIA H100 — on-demand runs $1.55 to $23.33/hr per GPU, with interruptible spot from $0.34/hr.
| Provider | Instance | Location | VRAM | Billing | $/GPU/hr | Availability | |
|---|---|---|---|---|---|---|---|
 Vast.aiMarketplace | 1× NVIDIA H100 PCIe | California, US | 80GB | BURST · SPOT | $0.343 | Available | View ↗ |
| Vast.aiMarketplace | 4× NVIDIA H100 PCIe | South Africa, ZA | 80GB | BURST · SPOT | $0.401 | Available | View ↗ |
| Vast.aiMarketplace | 1× NVIDIA H100 NVL | The Netherlands, NL | 94GB | BURST · SPOT | $0.402 | Available | View ↗ |
| Vast.aiMarketplace | 1× NVIDIA H100 NVL | The Netherlands, NL | 94GB | BURST · SPOT | $0.402 | Available | View ↗ |
| Vast.aiMarketplace | 2× NVIDIA H100 SXM | Japan, JP | 80GB | BURST · SPOT | $0.491 | Available | View ↗ |
| Vast.aiMarketplace | 1× NVIDIA H100 SXM | Germany, DE | 80GB | BURST · SPOT | $0.936 | Available | View ↗ |
 Google CloudPublic pricing feed | 4× NVIDIA H100 | europe-north1-c | 80GB | BURST · SPOT | $1.088Modeled | Not reported | View ↗ |
| Google CloudPublic pricing feed | 2× NVIDIA H100 | europe-north1-c | 80GB | BURST · SPOT | $1.088Modeled | Not reported | View ↗ |
| Google CloudPublic pricing feed | 1× NVIDIA H100 | europe-north1-c | 80GB | BURST · SPOT | $1.088Modeled | Not reported | View ↗ |
| Google CloudPublic pricing feed | 8× NVIDIA H100 | europe-north1-c | 80GB | BURST · SPOT | $1.142Modeled | Not reported | View ↗ |
CCCompute CheapPublic pricing feed | 1× NVIDIA H100 SXM | US | 80GB | BURST · SPOT | $1.15 | Not reported | View ↗ |
CCCompute CheapPublic pricing feed | 1× NVIDIA H100 SXM | Location not disclosed | 80GB | BURST · SPOT | $1.15 | Not reported | View ↗ |
| Google CloudPublic pricing feed | 8× NVIDIA H100 | europe-west2-b | 80GB | BURST · SPOT | $1.239Modeled | Not reported | View ↗ |
| Google CloudPublic pricing feed | 4× NVIDIA H100 | europe-west2-b | 80GB | BURST · SPOT | $1.239Modeled | Not reported | View ↗ |
| Google CloudPublic pricing feed | 2× NVIDIA H100 | europe-west2-c | 80GB | BURST · SPOT | $1.239Modeled | Not reported | View ↗ |
| Google CloudPublic pricing feed | 4× NVIDIA H100 | europe-west2-c | 80GB | BURST · SPOT | $1.239Modeled | Not reported | View ↗ |
| Google CloudPublic pricing feed | 2× NVIDIA H100 | europe-west2-b | 80GB | BURST · SPOT | $1.239Modeled | Not reported | View ↗ |
| Google CloudPublic pricing feed | 1× NVIDIA H100 | europe-west2-b | 80GB | BURST · SPOT | $1.239Modeled | Not reported | View ↗ |
| Google CloudPublic pricing feed | 8× NVIDIA H100 | europe-west2-b | 80GB | BURST · SPOT | $1.239Modeled | Not reported | View ↗ |
| Google CloudPublic pricing feed | 1× NVIDIA H100 | europe-west2-c | 80GB | BURST · SPOT | $1.239Modeled | Not reported | View ↗ |
| Google CloudPublic pricing feed | 8× NVIDIA H100 | europe-west2-b | 80GB | BURST · SPOT | $1.281Modeled | Not reported | View ↗ |
| Google CloudPublic pricing feed | 8× NVIDIA H100 | europe-west2-c | 80GB | BURST · SPOT | $1.281Modeled | Not reported | View ↗ |
 AzurePublic pricing feed | 2× NVIDIA H100 | eastus | 94GB | BURST · SPOT | $1.29Modeled | Not reported | View ↗ |
| AzurePublic pricing feed | 1× NVIDIA H100 | eastus | 94GB | BURST · SPOT | $1.29Modeled | Not reported | View ↗ |
| Google CloudPublic pricing feed | 8× NVIDIA H100 | australia-southeast2-b | 80GB | BURST · SPOT | $1.295Modeled | Not reported | View ↗ |
| Google CloudPublic pricing feed | 8× NVIDIA H100 | australia-southeast2-b | 80GB | BURST · SPOT | $1.295Modeled | Not reported | View ↗ |
| Google CloudPublic pricing feed | 1× NVIDIA H100 | australia-southeast2-b | 80GB | BURST · SPOT | $1.295Modeled | Not reported | View ↗ |
| Google CloudPublic pricing feed | 2× NVIDIA H100 | australia-southeast2-b | 80GB | BURST · SPOT | $1.295Modeled | Not reported | View ↗ |
| Google CloudPublic pricing feed | 4× NVIDIA H100 | australia-southeast2-b | 80GB | BURST · SPOT | $1.295Modeled | Not reported | View ↗ |
| Google CloudPublic pricing feed | 8× NVIDIA H100 | australia-southeast2-b | 80GB | BURST · SPOT | $1.342Modeled | Not reported | View ↗ |
| Vast.aiMarketplace | 8× NVIDIA H100 PCIe | United Arab Emirates, AE | 80GB | BURST · SPOT | $1.467 | Available | View ↗ |
| Vast.aiMarketplace | 8× NVIDIA H100 PCIe | United Arab Emirates, AE | 80GB | BURST · SPOT | $1.467 | Available | View ↗ |
| AzurePublic pricing feed | 1× NVIDIA H100 | indonesiacentral | 94GB | BURST · SPOT | $1.509Modeled | Not reported | View ↗ |
| AzurePublic pricing feed | 2× NVIDIA H100 | indonesiacentral | 94GB | BURST · SPOT | $1.509Modeled | Not reported | View ↗ |
| AzurePublic pricing feed | 1× NVIDIA H100 | northeurope | 94GB | BURST · SPOT | $1.548Modeled | Not reported | View ↗ |
| AzurePublic pricing feed | 2× NVIDIA H100 | northeurope | 94GB | BURST · SPOT | $1.548Modeled | Not reported | View ↗ |
| AzurePublic pricing feed | 2× NVIDIA H100 | northcentralus | 94GB | BURST · SPOT | $1.548Modeled | Not reported | View ↗ |
| AzurePublic pricing feed | 1× NVIDIA H100 | northcentralus | 94GB | BURST · SPOT | $1.548Modeled | Not reported | View ↗ |
LILium.ioPublic pricing feed | 2× NVIDIA H100 SXM | Nizhniy Novgorod, Russia | 80GB | STANDARD | $1.55 | Not reported | View ↗ |
LILium.ioPublic pricing feed | 8× NVIDIA H100 SXM | Nizhniy Novgorod, Russia | 80GB | STANDARD | $1.55 | Not reported | View ↗ |
Frequently Asked Questions
Why choose the NVIDIA H100?
80GB HBM3 with 900 GB/s NVLink for multi-node training, and an FP8 Transformer Engine for high training throughput. The default for large-scale training.
When is the NVIDIA H100 not a good fit?
Often more than you need for single-GPU inference on sub-30B models — an L40S or A10 is more cost-effective there.
How much does the NVIDIA H100 cost per hour?
NVIDIA H100 on-demand pricing currently runs $1.55/hr to $23.33/hr per GPU, depending on the provider and instance type. Interruptible spot capacity starts around $0.34/hr.
How much does the NVIDIA H100 cost per month?
At 720 hours per month, one NVIDIA H100 runs about $1,116 to $16,795 per month on demand. Lower spot rates are currently listed.
Which cloud providers offer the NVIDIA H100?
We currently track 1043 NVIDIA H100 listings across 57 providers. Pricing and availability vary by region and billing model.
Alternatives to NVIDIA H100
NVIDIA H200
Hopper refresh with 76% more memory — for memory-bound training and inference.
From $1.40 /hr · 50 providers
NVIDIA A100
Previous-generation workhorse — more affordable, widely available.
From $1.29 /hr · 1 providers
NVIDIA Tesla P100
Pascal-era HBM2 card — budget training and inference.
From $1.27 /hr · 2 providers