Product Compare

NVIDIA H200 NVL vs NVIDIA RTX A3000 Mobile 12 GB

GPU GPU
Graphics Card
Release Date Nov 2024 Mar 2022
Generation Server Hopper Ampere-MW
Type AI GPU Professional
Bus Interface PCIe 5.0 x16 PCIe 4.0 x16
Clock Speeds
Base Clock 1365 MHz 855 MHz
Boost Clock 1785 MHz 1440 MHz
Memory Clock 1593 MHz 1750 MHz
Memory
Memory Size 141GB 12GB
Memory Type HBM3e GDDR6
Memory Bus 6144bit 192bit
Bandwidth 4.89TB/s 336.0GB/s
Render Config
SM Count 132 32
Shading Units 16896 4096
TMUs 528 128
ROPs 24 64
Tensor Cores 528 128
L1 Cache 256 KB (per SM) 128 KB (per SM)
L2 Cache 50 MB 4 MB
RT Cores 32
Theoretical Performance
Pixel Rate 42.84 GPixel/s 92.16 GPixel/s
Texture Rate 942.5 GTexel/s 184.3 GTexel/s
FP16 (half) 241.3 TFLOPS 11.80 TFLOPS
FP32 (float) 60.32 TFLOPS 11.80 TFLOPS
FP64 (double) 30.16 TFLOPS 184.3 GFLOPS
Graphics Processor
GPU Name GH100 GA104
Architecture Hopper Ampere
Foundry TSMC Samsung
Process Size 5 nm 8 nm
Transistors 80 billion 17.4 billion
Die Size 814 mm² 392 mm²
Board Design
TDP 600W 115W
Suggested PSU 1000 W
Outputs No outputs Portable Device Dependent
Power Connectors 8-pin EPS None
Graphics Features
DirectX N/A 12 Ultimate (12_2)
OpenGL N/A 4.6
OpenCL 3.0 3.0
Vulkan N/A 1.3
CUDA 9.0 8.6
Shader Model N/A 6.8