Product Compare

NVIDIA GeForce RTX 4090 D vs NVIDIA H100 SXM5 80 GB

GPU GPU
Graphics Card
Release Date Dec 2023 Oct 2022
Generation GeForce 40 Server Hopper
Type Desktop AI GPU
Bus Interface PCIe 4.0 x16 PCIe 5.0 x16
Clock Speeds
Base Clock 2280 MHz 1590 MHz
Boost Clock 2520 MHz 1980 MHz
Memory Clock 1313 MHz 1313 MHz
Memory
Memory Size 24GB 80GB
Memory Type GDDR6X HBM3
Memory Bus 384bit 5120bit
Bandwidth 1008GB/s 3.36TB/s
Render Config
SM Count 114 132
Shading Units 14592 16896
TMUs 456 528
ROPs 176 24
Tensor Cores 456 528
RT Cores 114
L1 Cache 128 KB (per SM) 256 KB (per SM)
L2 Cache 72 MB 50 MB
Theoretical Performance
Pixel Rate 443.5 GPixel/s 47.52 GPixel/s
Texture Rate 1149 GTexel/s 1045 GTexel/s
FP16 (half) 73.54 TFLOPS 267.6 TFLOPS
FP32 (float) 73.54 TFLOPS 66.91 TFLOPS
FP64 (double) 1149 GFLOPS 33.45 TFLOPS
Graphics Processor
GPU Name AD102 GH100
GPU Variant AD102-250-A1
Architecture Ada Lovelace Hopper
Foundry TSMC TSMC
Process Size 5 nm 5 nm
Transistors 76.3 billion 80 billion
Die Size 609 mm² 814 mm²
Board Design
TDP 425W 700W
Suggested PSU 800 W 1100 W
Outputs 1x HDMI 2.13x DisplayPort 1.4a No outputs
Power Connectors 1x 16-pin None
Graphics Features
DirectX 12 Ultimate (12_2) N/A
OpenGL 4.6 N/A
OpenCL 3.0 3.0
Vulkan 1.3 N/A
CUDA 8.9 9.0
Shader Model 6.7 N/A