NVIDIA L40S - Passive PCIe 48GB
Specifications1
GPU Architecture
|
NVIDIA Ada Lovelace Architecture |
GPU Memory
|
48GB GDDR6 with ECC |
Memory Bandwidth
|
864 GB/s |
CUDA® Cores
|
18,176 |
RT Cores
|
142 |
Tensor Cores
|
568 |
RT Core Performance
|
212 TFLOPS |
FP32
|
91.6 TFLOPS |
TF32 Tensor Core
|
366 TFLOPS |
BFLOAT16 Tensor Core
|
366 I 7332 TFLOPS |
FP16 Tensor Core
|
366 I 7332 TFLOPS |
FP8 Tensor Core
|
733 I 14662 TFLOPS |
Peak INT8 Tensor
|
733 I 14662 TOPS |
Peak INT4 Tensor
|
733 I 14662 TOPS |
Form Factor
|
4.4" (H) x 10.5" (L), dual slot |
Display Ports
|
4 x DisplayPort 1.4a |
Max Power Consumption
|
350W |
Power Connector
|
16-pin |
Thermal
|
Passive |
Virtual GPU (vGPU) Software Support
|
Yes |
NVENC I NVDEC
|
3x l 3x (Includes AV1 Encode and Decode) |
Secure Boot with Root of Trust
|
Yes |
NEBS Ready
|
Level 3 |
MIG Support
|
No |