NVIDIA H100 PCIe 96 GB vs AMD Radeon PRO W7800

GPU Specs Compare

Graphics Card

Release Date
Mar 2023
Apr 2023
Generation
Tesla Hopper
Radeon Pro Navi(Navi III Series)
Type
AI GPU
Professional
Bus Interface
PCIe 5.0 x16
PCIe 4.0 x16

Clock Speeds

Base Clock
1665 MHz
1895 MHz
Boost Clock
1837 MHz
2525 MHz
Memory Clock
1313 MHz
2250 MHz

Memory

Memory Size
96GB
32GB
Memory Type
HBM3
GDDR6
Memory Bus
5120bit
256bit
Bandwidth
1681GB/s
576.0GB/s

Render Config

SM Count
132
-
Shading Units
16896
4480
TMUs
528
280
ROPs
24
128
Tensor Cores
528
-
L1 Cache
256 KB (per SM)
256 KB per Array
L2 Cache
50 MB
6 MB
Compute Units
-
70
RT Cores
-
70
L3 Cache
-
64 MB

Theoretical Performance

Pixel Rate
44.09 GPixel/s
323.2 GPixel/s
Texture Rate
969.9 GTexel/s
707.0 GTexel/s
FP16 (half)
248.3 TFLOPS
90.50 TFLOPS
FP32 (float)
62.08 TFLOPS
45.25 TFLOPS
FP64 (double)
31.04 TFLOPS
1414 GFLOPS

Graphics Processor

GPU Name
GH100
Navi 31
Architecture
Hopper
RDNA 3.0
Foundry
TSMC
TSMC
Process Size
4 nm
5 nm
Transistors
80 billion
57.7 billion
Die Size
814 mm²
529 mm²
GPU Variant
-
Navi 31

Board Design

TDP
700W
260W
Suggested PSU
1100 W
600 W
Outputs
No outputs
3x DisplayPort 2.11x mini-DisplayPort 2.1
Power Connectors
8-pin EPS
2x 8-pin

Graphics Features

DirectX
N/A
12 Ultimate (12_2)
OpenGL
N/A
4.6
OpenCL
3.0
2.2
Vulkan
N/A
1.3
CUDA
9.0
-
Shader Model
N/A
6.8