-
- Name
- AMD Instinct™ MI350P
- Family
- Instinct
- Series
- Instinct MI350 Series
- Form Factor
- Servers
-
- GPU Architecture
- CDNA4
- Lithography
- TSMC 3nm | 6nm FinFET
- Stream Processors
- 8,192
- Matrix Cores
- 512
- Compute Units
- 128
- Peak Engine Clock
- 2200 MHz
- Peak Microscaling Four-bit Precision Matrix (MXFP4) Performance
- 4.6 PFLOPs
- Peak Microscaling Six-bit Precision Matrix (MXFP6) Performance
- 4.6 PFLOPs
- Peak Microscaling Eight-bit Precision Matrix (MXFP8) Performance
- 2.3 PFLOPs
- Peak Open Compute Project Eight-bit Precision Matrix (OCP-FP8) Performance (E5M2, E4M3)
- 2.3 PFLOPs
- Peak Open Compute Project Eight-bit Precision Matrix (OCP-FP8) Performance with Structured Sparsity (E5M2, E4M3)
- 4.6 PFLOPs
- Peak Half Precision Matrix (FP16) Performance
- 1.15 PFLOPs
- Peak Half Precision Matrix (FP16) Performance with Structured Sparsity
- 2.3 PFLOPs
- Peak Half Precision (FP16) Performance
- 72 TFLOPs
- Peak Single Precision Matrix (FP32) Performance
- 72 TFLOPs
- Peak Single Precision (FP32) Performance
- 72 TFLOPs
- Peak Double Precision Matrix (FP64) Performance
- 36 TFLOPs
- Peak Double Precision (FP64) Performance
- 36 TFLOPs
- Peak INT8 Matrix Performance
- 2.3 POPs
- Peak INT8 Matrix Performance with Structured Sparsity
- 4.6 POPs
- Peak bfloat16 Matrix performance
- 1.15 PFLOPs
- Peak bfloat16 Matrix Performance with Structured Sparsity
- 2.3 PFLOPs
- Transistor Count
- 73 Billion
- OS Support
- Linux x86 64-Bit
-
- External Power Connectors
- 12V-2x6
- Typical Board Power (TBP)
- 600W TBP (Max); 450W TBP configurable
-
- Last Level Cache (LLC)
- 128 MB
- Dedicated Memory Size
- 144 GB
- Dedicated Memory Type
- HBM3E
- Infinity Cache
- Yes
- Memory Interface
- 4096-bit
- Peak Memory Bandwidth
- 4 TB/s
- Memory ECC Support
- Yes (Full-Chip)
-
- GPU Form Factor
- PCIe® Add-in Card
- Bus Type
- PCIe® 5.0 x16
- Cooling
- Passive
-
- Board Height
- Full Height
- Board Length
- 10.5" (267 mm)
- Board Width
- Double Slot
-
- Supported Technologies
- AMD CDNA™ 4 Architecture , 4th Gen AMD Infinity Architecture , AMD ROCm™ - Ecosystem without Borders
- RAS Support
- Yes
- Page Retirement
- Yes
- Page Avoidance
- Yes
- SR-IOV
- Yes
-
- OpenMP®
- Yes
- OpenCL™
- Yes
- HIP
- Yes
- ROCm™ Open Ecosystem
-
Yes
-
- TensorFlow
- Yes
- PyTorch
- Yes
- ONYX-RT
- Yes
- SGLang
- Yes
- JAX
- Yes
- Triton
- Yes
- Kokkos
- Yes
- RAJA
- Yes
-
Image Zoom
-
Image Zoom
AMD Instinct™ MI350P PCIe® Cards
Deploy and scale generative and agentic AI within your existing infrastructure using AMD Instinct™ MI350P PCIe® cards – designed for high performance, leadership cost, an open, enterprise-ready AI stack, and simple deployment.
