Product Compare

NVIDIA H100 PCIe 96 GB vs NVIDIA Rubin Ultra GPU

GPU GPU
Graphics Card
Release Date Mar 2023 Jan 2027
Generation Tesla Hopper Server Rubin
Type AI GPU Desktop
Bus Interface PCIe 5.0 x16 PCIe 6.0 x16
Clock Speeds
Base Clock 1665 MHz 700 MHz
Boost Clock 1837 MHz 2267 MHz
Memory Clock 1313 MHz 1900 MHz
Memory
Memory Size 96GB 1024GB
Memory Type HBM3 HBM4e
Memory Bus 5120bit 32768bit
Bandwidth 1681GB/s 31.1TB/s
Render Config
SM Count 132 448
Shading Units 16896 57344
TMUs 528 1792
ROPs 24 24
Tensor Cores 528 1792
L1 Cache 256 KB (per SM) 256 KB (per SM)
L2 Cache 50 MB 128 MB
Theoretical Performance
Pixel Rate 44.09 GPixel/s 54.41 GPixel/s
Texture Rate 969.9 GTexel/s 4062.5 GTexel/s
FP16 (half) 248.3 TFLOPS 520.0 TFLOPS
FP32 (float) 62.08 TFLOPS 260.0 TFLOPS
FP64 (double) 31.04 TFLOPS 65.00 TFLOPS
Graphics Processor
GPU Name GH100 GR110
Architecture Hopper Rubin Ultra
Foundry TSMC TSMC
Process Size 4 nm 3 nm
Transistors 80 billion 670 billion
Die Size 814 mm² 2912 mm²
Board Design
TDP 700W 3600W
Suggested PSU 1100 W 4000 W
Outputs No outputs No outputs
Power Connectors 8-pin EPS
Graphics Features
DirectX N/A N/A
OpenGL N/A N/A
OpenCL 3.0 3.0
Vulkan N/A N/A
CUDA 9.0 10.7
Shader Model N/A N/A