Product Compare

NVIDIA GeForce RTX 3080 12 GB vs NVIDIA H100 CNX

GPU GPU
Graphics Card
Release Date Jan 2022 Mar 2023
Generation GeForce 30 Tesla Hopper
Type Desktop AI GPU
Bus Interface PCIe 4.0 x16 PCIe 5.0 x16
Clock Speeds
Base Clock 1260 MHz 690 MHz
Boost Clock 1710 MHz 1845 MHz
Memory Clock 1188 MHz 1593 MHz
Memory
Memory Size 12GB 80GB
Memory Type GDDR6X HBM2e
Memory Bus 384bit 5120bit
Bandwidth 912.4GB/s 2039GB/s
Render Config
SM Count 70 114
Shading Units 8960 14592
TMUs 280 456
ROPs 96 24
Tensor Cores 280 456
RT Cores 70
L1 Cache 128 KB (per SM) 256 KB (per SM)
L2 Cache 6 MB 50 MB
Theoretical Performance
Pixel Rate 164.2 GPixel/s 44.28 GPixel/s
Texture Rate 478.8 GTexel/s 841.3 GTexel/s
FP16 (half) 30.64 TFLOPS 215.4 TFLOPS
FP32 (float) 30.64 TFLOPS 53.84 TFLOPS
FP64 (double) 478.8 GFLOPS 26.92 TFLOPS
Graphics Processor
GPU Name GA102 GH100
GPU Variant GA102-220-A1
Architecture Ampere Hopper
Foundry Samsung TSMC
Process Size 8 nm 4 nm
Transistors 28.3 billion 80 billion
Die Size 628 mm² 814 mm²
Board Design
TDP 350W 350W
Suggested PSU 750 W 750 W
Outputs 1x HDMI 2.13x DisplayPort 1.4a No outputs
Power Connectors 1x 12-pin 8-pin EPS
Graphics Features
DirectX 12 Ultimate (12_2) N/A
OpenGL 4.6 N/A
OpenCL 3.0 3.0
Vulkan 1.3 N/A
CUDA 8.6 9.0
Shader Model 6.8 N/A