Product Compare

NVIDIA RTX A5000 Mobile vs NVIDIA H100 NVL 94 GB

GPU GPU
Graphics Card
Release Date Apr 2021 Mar 2023
Generation Quadro Ampere-M Server Hopper
Type Professional AI GPU
Bus Interface PCIe 4.0 x16 PCIe 5.0 x16
Clock Speeds
Base Clock 900 MHz 1080 MHz
Boost Clock 1575 MHz 1785 MHz
Memory Clock 1750 MHz 1313 MHz
Memory
Memory Size 16GB 94GB
Memory Type GDDR6 HBM3
Memory Bus 256bit 6016bit
Bandwidth 448.0GB/s 3.95TB/s
Render Config
SM Count 48 132
Shading Units 6144 16896
TMUs 192 528
ROPs 96 24
Tensor Cores 192 528
RT Cores 48
L1 Cache 128 KB (per SM) 256 KB (per SM)
L2 Cache 4 MB 50 MB
Theoretical Performance
Pixel Rate 151.2 GPixel/s 42.84 GPixel/s
Texture Rate 302.4 GTexel/s 942.5 GTexel/s
FP16 (half) 19.35 TFLOPS 241.3 TFLOPS
FP32 (float) 19.35 TFLOPS 60.32 TFLOPS
FP64 (double) 302.4 GFLOPS 30.16 TFLOPS
Graphics Processor
GPU Name GA104 GH100
Architecture Ampere Hopper
Foundry Samsung TSMC
Process Size 8 nm 5 nm
Transistors 17.4 billion 80 billion
Die Size 392 mm² 814 mm²
Board Design
TDP 150W 400W
Outputs Portable Device Dependent No outputs
Power Connectors None 8-pin EPS
Suggested PSU 800 W
Graphics Features
DirectX 12 Ultimate (12_2) N/A
OpenGL 4.6 N/A
OpenCL 3.0 3.0
Vulkan 1.3 N/A
CUDA 8.6 9.0
Shader Model 6.7 N/A