CUDA Cores
VRAM
GB/s
3,584
CUDA Cores
930
Base MHz
1440
Boost MHz
24GB HBM2
3072-bit bus
10.3
FP32 TFLOPS
165
FP16 TFLOPS
165W
TDP
0
Available Instances
$0.00/hr
Starting Price
Architecture | Ampere (Unknown) |
Release Date | 2021-04-12 |
Launch Price | $5,000.00 |
Process | 7nm |
Transistors | 54.2B |
Gen 3
Tensor Cores
Disabled
Transformer Engine
Not Supported
Flash Attention
10.5in
Length
4.4in
Width
2-slot
Height
Category | Rank 1 | Rank 2 | Rank 3 |
---|---|---|---|
Best for Training | NVIDIA H200 | NVIDIA H100 | NVIDIA B200 |
Best for Inference | NVIDIA A40 | NVIDIA A100 | NVIDIA A10 |
Compare GPU specifications and cloud instances to find the best GPU for your workload.