CUDA Cores
VRAM
GB/s
7,424
CUDA Cores
795
Base MHz
2040
Boost MHz
24GB GDDR6
192-bit bus
30
FP32 TFLOPS
120
FP16 TFLOPS
72W
TDP
2
Available Instances
$0.43/hr
Starting Price
Architecture | Ada Lovelace (Unknown) |
Release Date | 2023-03-21 |
Launch Price | $3,000.00 |
Process | 4nm |
Transistors | 35.8B |
Gen 4
Tensor Cores
Disabled
Transformer Engine
Not Supported
Flash Attention
6.1in
Length
2.7in
Width
1-slot
Height
Category | Rank 1 | Rank 2 | Rank 3 |
---|---|---|---|
Best for Training | NVIDIA H200 | NVIDIA H100 | NVIDIA B200 |
Best for Inference | NVIDIA A40 | NVIDIA A100 | NVIDIA A10 |
Compare GPU specifications and cloud instances to find the best GPU for your workload.