NVIDIA Jetson AGX Orin 64 GB vs NVIDIA H100 SXM5 64 GB

GPU Specs Compare

Graphics Card

Release Date
Mar 2023
Mar 2023
Generation
Tegra
Tesla Hopper
Type
Professional
AI GPU
Bus Interface
PCIe 4.0 x4
PCIe 5.0 x16

Clock Speeds

Memory Clock
800 MHz
1313 MHz
Base Clock
-
1665 MHz
Boost Clock
-
1980 MHz

Memory

Memory Size
64GB
64GB
Memory Type
LPDDR5
HBM3
Memory Bus
256bit
3072bit
Bandwidth
204.8GB/s
2.02TB/s

Render Config

SM Count
16
132
Shading Units
2048
16896
TMUs
64
528
ROPs
32
24
Tensor Cores
64
528
L1 Cache
128 KB (per SM)
256 KB (per SM)
L2 Cache
6 MB
30 MB

Theoretical Performance

Pixel Rate
41.60 GPixel/s
47.52 GPixel/s
Texture Rate
83.20 GTexel/s
1045 GTexel/s
FP16 (half)
10.65 TFLOPS
267.6 TFLOPS
FP32 (float)
5.325 TFLOPS
66.91 TFLOPS
FP64 (double)
2.662 TFLOPS
33.45 TFLOPS

Graphics Processor

GPU Name
GA10B
GH100
Architecture
Ampere
Hopper
Foundry
Samsung
TSMC
Process Size
8 nm
5 nm
Transistors
Unknown
80 billion
Die Size
200 mm²
814 mm²

Board Design

TDP
60W
700W
Outputs
Portable Device Dependent
No outputs
Suggested PSU
-
1100 W
Power Connectors
-
8-pin EPS

Graphics Features

DirectX
12 Ultimate (12_2)
N/A
OpenGL
4.6
N/A
OpenCL
3.0
3.0
Vulkan
1.4
N/A
CUDA
8.7
9.0
Shader Model
6.8
N/A