Product Compare

NVIDIA H100 NVL 94 GB vs NVIDIA RTX A5000 Mobile

GPU GPU
Graphics Card
Release Date Mar 2023 Apr 2021
Generation Server Hopper Quadro Ampere-M
Type AI GPU Professional
Bus Interface PCIe 5.0 x16 PCIe 4.0 x16
Clock Speeds
Base Clock 1080 MHz 900 MHz
Boost Clock 1785 MHz 1575 MHz
Memory Clock 1313 MHz 1750 MHz
Memory
Memory Size 94GB 16GB
Memory Type HBM3 GDDR6
Memory Bus 6016bit 256bit
Bandwidth 3.95TB/s 448.0GB/s
Render Config
SM Count 132 48
Shading Units 16896 6144
TMUs 528 192
ROPs 24 96
Tensor Cores 528 192
L1 Cache 256 KB (per SM) 128 KB (per SM)
L2 Cache 50 MB 4 MB
RT Cores 48
Theoretical Performance
Pixel Rate 42.84 GPixel/s 151.2 GPixel/s
Texture Rate 942.5 GTexel/s 302.4 GTexel/s
FP16 (half) 241.3 TFLOPS 19.35 TFLOPS
FP32 (float) 60.32 TFLOPS 19.35 TFLOPS
FP64 (double) 30.16 TFLOPS 302.4 GFLOPS
Graphics Processor
GPU Name GH100 GA104
Architecture Hopper Ampere
Foundry TSMC Samsung
Process Size 5 nm 8 nm
Transistors 80 billion 17.4 billion
Die Size 814 mm² 392 mm²
Board Design
TDP 400W 150W
Suggested PSU 800 W
Outputs No outputs Portable Device Dependent
Power Connectors 8-pin EPS None
Graphics Features
DirectX N/A 12 Ultimate (12_2)
OpenGL N/A 4.6
OpenCL 3.0 3.0
Vulkan N/A 1.3
CUDA 9.0 8.6
Shader Model N/A 6.7