NVIDIA 900-2G133-0080-000 Ada L40S 48GB GDDR6 PCIe Gen 4th 350W GPU Card

SKU: 900-2G133-0080-000 Category:
Get a Quote

Description

    NVIDIA L40S

    Unparalleled AI and Graphics Performance for the Data Center

    The NVIDIA L40S GPU, based on the Ada Lovelace architecture, is the most powerful universal GPU for the data center, delivering breakthrough multi-workload acceleration for large language model (LLM) inference and training, graphics, and video applications. As the premier platform for multi-modal generative AI, the L40S GPU provides end-to-end acceleration for inference, training, graphics, and video workflows to power the next generation of AI-enabled audio, speech, 2D, video, and 3D applications.

    Product Highlights

    • Tensor Performance: 1,466 TFLOPS*
    • RT Core Performance: 212 TFLOPS
    • Single-Precision Performance: 91.6 TFLOPS

    *1 Peak rates are based on GPU boost clock.

     

    Additional information

    GPU Architecture

    NVIDIA Ada Lovelace Architecture

    GPU Memory

    48GB GDDR6 with ECC

    Memory Bandwidth

    PCIe Gen4x 16: 64GB/s bidirectional

    CUDA™ Cores

    18,176

    RT Cores

    142

    Tensor Cores

    568

    RT Core Performance

    212 TFLOPS

    FP32

    91.6 TFLOPS

    TF32 Tensor Core

    366 TFLOPS

    BFLOAT16 Tensor Core

    366 I 7332 TFLOPS

    FP16 Tensor Core

    366 I 7332 TFLOPS

    FP8 Tensor Core

    733 I 14662 TFLOPS

    Peak INT8 Tensor

    733 I 14662 TOPS

    Peak INT4 Tensor

    733 I 14662 TOPS

    Form Factor

    4.4" (H) x 10.5" (L), dual slot

    Display Ports

    4 x DisplayPort 1.4a

    Max Power Consumption

    350W

    Power Connector

    16-pin

    Thermal

    Passive

    Virtual GPU (vGPU) Software Support

    Yes

    NVENC I NVDEC

    3x l 3x (Includes AV1 Encode and Decode)

    Secure Boot with Root of Trust

    Yes

    NEBS Ready

    Level 3

    MIG Support

    No

    Reviews

    There are no reviews yet

    Only logged in customers who have purchased this product may leave a review.