Product Compare

H200 SXM vs NVIDIA GeForce RTX 2080 Ti

GPU GPU
Graphics Card
Release Date Nov 2023 Sep 2018
Generation Hopper GeForce 20
Type AI GPU Desktop
Bus Interface PCIe 5.0 x16 PCIe 3.0 x16
Clock Speeds
Base Clock 1590 MHz 1350 MHz
Boost Clock 1980 MHz 1545 MHz
Memory Clock 1313 MHz 1750 MHz
Memory
Memory Size 141GB 11GB
Memory Type HBM3e GDDR6
Memory Bus 5120bit 352bit
Bandwidth 4800GB/s 616.0GB/s
Render Config
SM Count 132 68
Shading Units 16896 4352
TMUs 528 272
ROPs 24 88
Tensor Cores 528 544
L1 Cache 256 KB (per SM) 64 KB (per SM)
L2 Cache 50 MB 0 MB
RT Cores 68
Theoretical Performance
Pixel Rate 47.52 GPixel/s 136.0 GPixel/s
Texture Rate 1045 GTexel/s 420.2 GTexel/s
FP16 (half) 1979 TFLOPS 26.90 TFLOPS
FP32 (float) 67 TFLOPS 13.45 TFLOPS
FP64 (double) 34 TFLOPS 420.2 GFLOPS
Graphics Processor
GPU Name GH200 TU102
Architecture Hopper Turing
Foundry TSMC TSMC
Process Size 4 nm 12 nm
Transistors 80 billion 18.6 billion
Die Size 814 mm² 754 mm²
GPU Variant TU102-300A-K1-A1
Board Design
TDP 700W 250W
Suggested PSU 1100 W 600 W
Outputs No outputs 1x HDMI 2.03x DisplayPort 1.4a1x USB Type-C
Power Connectors 8-pin EPS 2x 8-pin
Graphics Features
DirectX N/A 12 Ultimate (12_2)
OpenGL N/A 4.6
OpenCL 3.0 3.0
Vulkan N/A 1.4
CUDA 9.0 7.5
Shader Model N/A 6.8