AMDVendor documented
Instinct MI210
CDNA 2 · CDNA 2 · PCIe · 2022
PCIe CDNA 2 card for standard servers. A practical entry to Instinct/ROCm for HPC and mid-size inference.
HPCLLM inferenceVision
Precision fingerprint
6432t3216BF168i8
Memory
64 GB
HBM2e
Bandwidth
1.6 TB/s
peak
TDP
300 W
air
Max model
~25B
FP16, planning est.
Compute throughput
| FP64 | 45.3 TFLOPS |
| FP32 | 45.3 TFLOPS |
| TF32 | — |
| FP16 | 181 TFLOPS |
| BF16 | 181 TFLOPS |
| FP8 | — |
| INT8 | 181 TFLOPS |
Platform & software
InterconnectInfinity Fabric bridge
PCIePCIe 4.0 x16
Coolingair
MIGNot supported
VirtualizationSR-IOV
FrameworksROCm, RCCL, MIOpen
Availabilitybare-metal
Known limitations
- ·Single-GCD PCIe part — lower throughput than MI250 line
- ·No FP8