NVIDIA RTX 3090

10,496

CUDA Cores

24GB

VRAM

936

GB/s

Consumer
RTX 3090 GPU Specifications

Technical Specifications

10,496

CUDA Cores

1395

Base MHz

1695

Boost MHz

24GB GDDR6X

384-bit bus

Performance

35.6

FP32 TFLOPS

71.2

FP16 TFLOPS

350W

TDP

Cloud Availability

3

Available Instances

$0.10/hr

Starting Price

Detailed Specifications

Architecture Ampere (Unknown)
Release Date 2020-09-24
Launch Price $1,499.00
Process 8nm
Transistors 28.3B

AI Features

Gen 3

Tensor Cores

Disabled

Transformer Engine

Not Supported

Flash Attention

Physical Specifications

Dimensions

12.3in

Length

5.4in

Width

3-slot

Height

Top GPUs for Training and Inference

Category Rank 1 Rank 2 Rank 3
Best for Training NVIDIA H200 NVIDIA H100 NVIDIA B200
Best for Inference NVIDIA A40 NVIDIA A100 NVIDIA A10

Compare GPU specifications and cloud instances to find the best GPU for your workload.