Visualizations
NVIDIA H200
16,896
CUDA Cores
141GB
VRAM
4800
GB/s
Technical Specifications
16,896
CUDA Cores
1450
Base MHz
1900
Boost MHz
141GB HBM3e
5120-bit bus
Performance
75
FP32 TFLOPS
2400
FP16 TFLOPS
700W
TDP
Cloud Availability
1
Available Instances
$2.40/hr
Starting Price
Detailed Specifications
| Architecture | Hopper (Unknown) |
| Release Date | 2024-11-01 |
| Launch Price | $35,000.00 |
| Process | 4nm |
| Transistors | 90B |
AI Features
Gen 4+
Tensor Cores
Enabled
Transformer Engine
Supported
Flash Attention
Physical Specifications
Dimensions
10.5in
Length
4.4in
Width
2-slot
Height
Top GPUs for Training and Inference
| Category | Rank 1 | Rank 2 | Rank 3 |
|---|---|---|---|
| Best for Training | NVIDIA H200 | NVIDIA H100 | NVIDIA B200 |
| Best for Inference | NVIDIA A40 | NVIDIA A100 | NVIDIA A10 |
Compare GPU specifications and cloud instances to find the best GPU for your workload.