Product Compare

NVIDIA GeForce RTX 2060 12 GB vs NVIDIA H100 PCIe 96 GB

GPU GPU
Graphics Card
Release Date Dec 2021 Mar 2023
Generation GeForce 20 Tesla Hopper
Type Desktop AI GPU
Bus Interface PCIe 3.0 x16 PCIe 5.0 x16
Clock Speeds
Base Clock 1470 MHz 1665 MHz
Boost Clock 1650 MHz 1837 MHz
Memory Clock 1750 MHz 1313 MHz
Memory
Memory Size 12GB 96GB
Memory Type GDDR6 HBM3
Memory Bus 192bit 5120bit
Bandwidth 336.0GB/s 1681GB/s
Render Config
SM Count 34 132
Shading Units 2176 16896
TMUs 136 528
ROPs 48 24
Tensor Cores 272 528
RT Cores 34
L1 Cache 64 KB (per SM) 256 KB (per SM)
L2 Cache 3 MB 50 MB
Theoretical Performance
Pixel Rate 79.20 GPixel/s 44.09 GPixel/s
Texture Rate 224.4 GTexel/s 969.9 GTexel/s
FP16 (half) 14.36 TFLOPS 248.3 TFLOPS
FP32 (float) 7.181 TFLOPS 62.08 TFLOPS
FP64 (double) 224.4 GFLOPS 31.04 TFLOPS
Graphics Processor
GPU Name TU106 GH100
GPU Variant TU106-300-KA-A1
Architecture Turing Hopper
Foundry TSMC TSMC
Process Size 12 nm 4 nm
Transistors 10.8 billion 80 billion
Die Size 445 mm² 814 mm²
Board Design
TDP 184W 700W
Suggested PSU 450 W 1100 W
Outputs 1x DVI1x HDMI 2.02x DisplayPort 1.4a1x USB Type-C No outputs
Power Connectors 1x 8-pin 8-pin EPS
Graphics Features
DirectX 12 Ultimate (12_2) N/A
OpenGL 4.6 N/A
OpenCL 3.0 3.0
Vulkan 1.3 N/A
CUDA 7.5 9.0
Shader Model 6.6 N/A