-
- Name
- AMD Instinct™ MI350X
- Family
- Instinct
- Series
- Instinct MI350 Series
- Form Factor
- Servers
- Launch Date
- 6/12/2025
-
- GPU Architecture
- CDNA4
- Lithography
- TSMC 3nm | 6nm FinFET
- Stream Processors
- 16,384
- Matrix Cores
- 1024
- Compute Units
- 256
- Peak Engine Clock
- 2200 MHz
- Peak Microscaling Four-bit Precision Matrix (MXFP4) Performance
- 9.2 PFLOPs
- Peak Microscaling Six-bit Precision Matrix (MXFP6) Performance
- 9.2 PFLOPs
- Peak Microscaling Eight-bit Precision Matrix (MXFP8) Performance
- 4.6 PFLOPs
- Peak Open Compute Project Eight-bit Precision Matrix (OCP-FP8) Performance (E5M2, E4M3)
- 4.6 PFLOPs
- Peak Open Compute Project Eight-bit Precision Matrix (OCP-FP8) Performance with Structured Sparsity (E5M2, E4M3)
- 9.2 PFLOPs
- Peak Half Precision Matrix (FP16) Performance
- 2.3 PFLOPs
- Peak Half Precision Matrix (FP16) Performance with Structured Sparsity
- 4.6 PFLOPs
- Peak Half Precision (FP16) Performance
- 144.2 TFLOPs
- Peak Single Precision Matrix (FP32) Performance
- 144.2 TFLOPs
- Peak Single Precision (FP32) Performance
- 144.2 TFLOPs
- Peak Double Precision Matrix (FP64) Performance
- 72.1 TFLOPs
- Peak Double Precision (FP64) Performance
- 72.1 TFLOPs
- Peak INT8 Matrix Performance
- 4.6 POPs
- Peak INT8 Matrix Performance with Structured Sparsity
- 9.2 POPs
- Peak bfloat16 Matrix performance
- 2.3 PFLOPs
- Peak bfloat16 Matrix Performance with Structured Sparsity
- 4.6 PFLOPs
- Transistor Count
- 185 Billion
-
- External Power Connectors
- 54V UBB
- Typical Board Power (TBP)
- 1000W (TBP)
-
- Last Level Cache (LLC)
- 256 MB
- Dedicated Memory Size
- 288 GB
- Dedicated Memory Type
- HBM3E
- Infinity Cache
- Yes
- Memory Interface
- 8192-bit
- Memory Clock
- 8 GHz
- Peak Memory Bandwidth
- 8 TB/s
- Memory ECC Support
- Yes (Full-Chip)
-
- GPU Form Factor
- OAM Module
- Bus Type
- PCIe® 5.0 x16
- Infinity Fabric™ Links
- 7
- Peak Infinity Fabric™ Link Bandwidth
- 153 GB/s
- Scale-out AMD Infinity Fabric™ Links (Per GPU)
- 1
- Scale-up (Peak) AMD Infinity Fabric™ Link Bandwidth
- 153 GB/s
- Scale-out (Peak) AMD Infinity Fabric™ Link Bandwidth
- 128 GB/s
- Cooling
- Passive OAM
-
- Supported Technologies
- 4th Gen AMD Infinity Architecture , AMD ROCm™ - Ecosystem without Borders , AMD CDNA™ 4 Architecture
- RAS Support
- Yes
- Page Retirement
- Yes
- Page Avoidance
- Yes
- SR-IOV
- Yes
-
Image Zoom
AMD Instinct™ MI350X GPUs
Built on the 4th Gen AMD CDNA™ architecture, AMD Instinct™ MI350X GPUs deliver leadership AI and HPC performance for data center infrastructures with 288GB HBM3E memory, 8TB/s bandwidth, and expanded MXFP6 and MXFP4 datatype support.
