Visualizations
NVIDIA A16
5,120
CUDA Cores
64GB
VRAM
888
GB/s
Technical Specifications
5,120
CUDA Cores
900
Base MHz
1400
Boost MHz
64GB GDDR6
512-bit bus
Performance
15
FP32 TFLOPS
60
FP16 TFLOPS
250W
TDP
Cloud Availability
0
Available Instances
$0.00/hr
Starting Price
Detailed Specifications
| Architecture | Ampere (Unknown) |
| Release Date | 2021-04-12 |
| Launch Price | $2,500.00 |
| Process | 8nm |
| Transistors | 34.8B |
AI Features
Gen 3
Tensor Cores
Disabled
Transformer Engine
Not Supported
Flash Attention
Physical Specifications
Dimensions
10.5in
Length
4.4in
Width
2-slot
Height
Top GPUs for Training and Inference
| Category | Rank 1 | Rank 2 | Rank 3 |
|---|---|---|---|
| Best for Training | NVIDIA H200 | NVIDIA H100 | NVIDIA B200 |
| Best for Inference | NVIDIA A40 | NVIDIA A100 | NVIDIA A10 |
Compare GPU specifications and cloud instances to find the best GPU for your workload.