Product Compare

NVIDIA RTX 3000 Mobile Ada Generation vs NVIDIA H100 SXM5 96 GB

GPU GPU
Graphics Card
Release Date Mar 2023 Mar 2023
Generation Quadro Ada-M Server Hopper
Type Mobile AI GPU
Bus Interface PCIe 4.0 x16 PCIe 5.0 x16
Clock Speeds
Base Clock 1395 MHz 1350 MHz
Boost Clock 1695 MHz 1980 MHz
Memory Clock 2000 MHz 1313 MHz
Memory
Memory Size 8GB 96GB
Memory Type GDDR6 HBM3
Memory Bus 128bit 5120bit
Bandwidth 256.0GB/s 3.36TB/s
Render Config
SM Count 36 132
Shading Units 4608 16896
TMUs 144 528
ROPs 48 24
Tensor Cores 144 528
RT Cores 36
L1 Cache 128 KB (per SM) 256 KB (per SM)
L2 Cache 32 MB 50 MB
Theoretical Performance
Pixel Rate 81.36 GPixel/s 47.52 GPixel/s
Texture Rate 244.1 GTexel/s 1045 GTexel/s
FP16 (half) 15.62 TFLOPS 267.6 TFLOPS
FP32 (float) 15.62 TFLOPS 66.91 TFLOPS
FP64 (double) 244.1 GFLOPS 33.45 TFLOPS
Graphics Processor
GPU Name AD106 GH100
Architecture Ada Lovelace Hopper
Foundry TSMC TSMC
Process Size 5 nm 5 nm
Transistors 22.9 billion 80 billion
Die Size 188 mm² 814 mm²
Board Design
TDP 115W 700W
Outputs Portable Device Dependent No outputs
Power Connectors None 8-pin EPS
Suggested PSU 1100 W
Graphics Features
DirectX 12 Ultimate (12_2) N/A
OpenGL 4.6 N/A
OpenCL 3.0 3.0
Vulkan 1.3 N/A
CUDA 8.9 9.0
Shader Model 6.7 N/A