Visualizations
NVIDIA RTX 4090
16,384
CUDA Cores
24GB
VRAM
1008
GB/s
Technical Specifications
16,384
CUDA Cores
2235
Base MHz
2520
Boost MHz
24GB GDDR6X
384-bit bus
Performance
82.6
FP32 TFLOPS
165.2
FP16 TFLOPS
450W
TDP
Cloud Availability
4
Available Instances
$0.18/hr
Starting Price
Detailed Specifications
| Architecture | Ada Lovelace (Unknown) |
| Release Date | 2022-10-12 |
| Launch Price | $1,599.00 |
| Process | 4nm |
| Transistors | 76.3B |
AI Features
Gen 3
Tensor Cores
Disabled
Transformer Engine
Not Supported
Flash Attention
Physical Specifications
Dimensions
12in
Length
5.4in
Width
3-slot
Height
Top GPUs for Training and Inference
| Category | Rank 1 | Rank 2 | Rank 3 |
|---|---|---|---|
| Best for Training | NVIDIA H200 | NVIDIA H100 | NVIDIA B200 |
| Best for Inference | NVIDIA A40 | NVIDIA A100 | NVIDIA A10 |
Compare GPU specifications and cloud instances to find the best GPU for your workload.