NVIDIA L4

7,424

CUDA Cores

24GB

VRAM

300

GB/s

Data Center
L4 GPU Specifications

Technical Specifications

7,424

CUDA Cores

795

Base MHz

2040

Boost MHz

24GB GDDR6

192-bit bus

Performance

30

FP32 TFLOPS

120

FP16 TFLOPS

72W

TDP

Cloud Availability

2

Available Instances

$0.43/hr

Starting Price

Detailed Specifications

Architecture Ada Lovelace (Unknown)
Release Date 2023-03-21
Launch Price $3,000.00
Process 4nm
Transistors 35.8B

AI Features

Gen 4

Tensor Cores

Disabled

Transformer Engine

Not Supported

Flash Attention

Physical Specifications

Dimensions

6.1in

Length

2.7in

Width

1-slot

Height

Top GPUs for Training and Inference

Category Rank 1 Rank 2 Rank 3
Best for Training NVIDIA H200 NVIDIA H100 NVIDIA B200
Best for Inference NVIDIA A40 NVIDIA A100 NVIDIA A10

Compare GPU specifications and cloud instances to find the best GPU for your workload.