AMD Instinct™ MI325X Accelerators

AMD Instinct™ MI325X GPU accelerators set new AI performance standards, delivering incredible performance and efficiency for training and inference.

Name

AMD Instinct™ MI325X

Family

Instinct

Series

Instinct MI300 Series

Form Factor

Servers

Launch Date

10/10/2024
GPU Architecture

CDNA3

Lithography

TSMC 5nm | 6nm FinFET

Stream Processors

19,456

Matrix Cores

1216

Compute Units

304

Peak Engine Clock

2100 MHz

Peak Eight-bit Precision (FP8) Performance (E5M2, E4M3)

2.61 PFLOPs

Peak Eight-bit Precision (FP8) Performance with Structured Sparsity (E5M2, E4M3)

5.22 PFLOPs

Peak Half Precision (FP16) Performance

1.3 PFLOPs

Peak Half Precision (FP16) Performance with Structured Sparsity

2.61 PFLOPs

Peak Single Precision (TF32 Matrix) Performance

653.7 TFLOPs

Peak Single Precision (TF32) Performance with Structured Sparsity

1.3 PFLOPs

Peak Single Precision Matrix (FP32) Performance

163.4 TFLOPs

Peak Single Precision (FP32) Performance

163.4 TFLOPs

Peak Double Precision Matrix (FP64) Performance

163.4 TFLOPs

Peak Double Precision (FP64) Performance

81.7 TFLOPs

Peak INT8 Performance

2.6 POPs

Peak INT8 Performance with Structured Sparsity

5.22 POPs

Peak bfloat16

1.3 PFLOPs

Peak bfloat16 with Strutured Sparsity

2.61 PFLOPs

Transistor Count

153 Billion
External Power Connectors

54V UBB

Typical Board Power (TBP)

1000W Peak
Last Level Cache (LLC)

256 MB

Dedicated Memory Size

256 GB

Dedicated Memory Type

HBM3E

Infinity Cache

Yes

Memory Interface

8192-bit

Memory Clock

6 GHz

Peak Memory Bandwidth

6 TB/s

Memory ECC Support

Yes (Full-Chip)
GPU Form Factor

OAM Module

Bus Type

PCIe® 5.0 x16

Infinity Fabric™ Links

8

Peak Infinity Fabric™ Link Bandwidth

128 GB/s

Cooling

Passive OAM
Supported Technologies

AMD CDNA™ 3 Architecture , AMD ROCm™ - Ecosystem without Borders , AMD Infinity Architecture

RAS Support

Yes

Page Retirement

Yes

Page Avoidance

Yes

SR-IOV

Yes

Footnotes

MI325-002 - Calculations conducted by AMD Performance Labs as of May 28th, 2024 for the AMD Instinct™ MI325X GPU resulted in 1307.4 TFLOPS peak theoretical half precision (FP16), 1307.4 TFLOPS peak theoretical Bfloat16 format precision (BF16), 2614.9 TFLOPS peak theoretical 8-bit precision (FP8), 2614.9 TOPs INT8 floating-point performance. Actual performance will vary based on final specifications and system configuration.
Published results on Nvidia H200 SXM (141GB) GPU: 989.4 TFLOPS peak theoretical half precision tensor (FP16 Tensor), 989.4 TFLOPS peak theoretical Bfloat16 tensor format precision (BF16 Tensor), 1,978.9 TFLOPS peak theoretical 8-bit precision (FP8), 1,978.9 TOPs peak theoretical INT8 floating-point performance. BFLOAT16 Tensor Core, FP16 Tensor Core, FP8 Tensor Core and INT8 Tensor Core performance were published by Nvidia using sparsity; for the purposes of comparison, AMD converted these numbers to non-sparsity/dense by dividing by 2, and these numbers appear above
Nvidia H200 source: https://nvdam.widen.net/s/nb5zzzsjdf/hpc-datasheet-sc23-h200-datasheet-3002446 and https://www.anandtech.com/show/21136/nvidia-at-sc23-h200-accelerator-with-hbm3e-and-jupiter-supercomputer-for-2024
Note: Nvidia H200 GPUs have the same published FLOPs performance as H100 products https://resources.nvidia.com/en-us-tensor-core/. MI325-02
MI325-008 - Calculations conducted by AMD Performance Labs as of October 2nd, 2024 for the AMD Instinct™ MI325X (1000W) GPU designed with AMD CDNA™ 3 5nm | 6nm FinFET process technology at 2,100 MHz peak boost engine clock resulted in 163.4 TFLOPs peak theoretical double precision Matrix (FP64 Matrix), 81.7 TFLOPs peak theoretical double precision (FP64), 163.4 TFLOPs peak theoretical single precision Matrix (FP32 Matrix), 163.4 TFLOPs peak theoretical single precision (FP32), 653.7 TFLOPS peak theoretical TensorFloat-32 (TF32), 1307.4 TFLOPS peak theoretical half precision (FP16), Actual performance may vary based on final specifications and system configuration.
Published results on Nvidia H200 SXM (141GB) GPU: 66.9 TFLOPs peak theoretical double precision tensor (FP64 Tensor), 33.5 TFLOPs peak theoretical double precision (FP64), 66.9 TFLOPs peak theoretical single precision (FP32), 494.7 TFLOPs peak TensorFloat-32 (TF32), 989.5 TFLOPS peak theoretical half precision tensor (FP16 Tensor). TF32 Tensor Core performance were published by Nvidia using sparsity; for the purposes of comparison, AMD converted these numbers to non-sparsity/dense by dividing by 2, and this number appears above.
Nvidia H200 source: https://nvdam.widen.net/s/nb5zzzsjdf/hpc-datasheet-sc23-h200-datasheet-3002446 and https://www.anandtech.com/show/21136/nvidia-at-sc23-h200-accelerator-with-hbm3e-and-jupiter-supercomputer-for-2024
Note: Nvidia H200 GPUs have the same published FLOPs performance as H100 products https://resources.nvidia.com/en-us-tensor-core/.
*Nvidia H200 GPUs don’t support FP32 Tensor.
MI325-001A - Calculations conducted by AMD Performance Labs as of September 26th, 2024, based on current specifications and /or estimation. The AMD Instinct™ MI325X OAM accelerator will have 256GB HBM3E memory capacity and 6 TB/s GPU peak theoretical memory bandwidth performance. Actual results based on production silicon may vary.
The highest published results on the NVidia Hopper H200 (141GB) SXM GPU accelerator resulted in 141GB HBM3E memory capacity and 4.8 TB/s GPU memory bandwidth performance. https://nvdam.widen.net/s/nb5zzzsjdf/hpc-datasheet-sc23-h200-datasheet-3002446
The highest published results on the NVidia Blackwell HGX B100 (192GB) 700W GPU accelerator resulted in 192GB HBM3E memory capacity and 8 TB/s GPU memory bandwidth performance.
The highest published results on the NVidia Blackwell HGX B200 (192GB) GPU accelerator resulted in 192GB HBM3E memory capacity and 8 TB/s GPU memory bandwidth performance.
Nvidia Blackwell specifications at https://resources.nvidia.com/en-us-blackwell-architecture?_gl=1*1r4pme7*_gcl_aw*R0NMLjE3MTM5NjQ3NTAuQ2p3S0NBancyNkt4QmhCREVpd0F1NktYdDlweXY1dlUtaHNKNmhPdHM4UVdPSlM3dFdQaE40WkI4THZBaWFVajFy

Data Center

Business Systems

Personal & Gaming

Embedded

Resources

GPU Accelerators

Adaptive Accelerators

DPU Accelerators

Ethernet Adapters

Workstations

Desktops

Laptops

Resources

Adaptive SoCs & FPGAs

System-on-Modules (SOMs)

Technologies

Resources

Evaluation Boards & Kits

Processor Tools

Graphics Tools & Apps

Adaptive SoC & FPGA Tools

Intellectual Property & Apps

GPU Accelerator Tools & Apps

Ethernet Adapter Tools

Overview

For Data Center & Cloud

For Edge & Endpoints

For Developers

Industries

Industries

Industries

Industries

Industries

Workloads

Gaming

Systems

Technologies

Resources

EPYC Processors

Radeon Graphics & AMD Chipsets

Adaptive SoCs & FPGAs

Alveo Accelerators & Kria SOMs

Ryzen Processors

Ethernet Adapters

Overview

Processors

Accelerators

Embedded Products

Graphics

Overview

Resources by Product

Resources by Type

About Our Partners

AMD Global Support

Processors & Graphics

Accelerators

Adaptive SoCs & FPGAs

Gaming & Personal Computing

Adaptive & Embedded Computing

Get AMD Fan Gear

Shop Our Retail Partners

AMD Instinct™ MI325X Accelerators

Product Basics

GPU Specifications

Requirements

GPU Memory

Board Specifications

Additional Features

Specs Comparisons

AI Performance (Peak TFLOPs)

HPC Performance (Peak TFLOPs)

Memory Capacity & Bandwidth

Support & Resources

AMD ROCm™ Software

AMD CDNA™ Architecture

AMD Instinct Documentation

Company

News & Events

Resources

Partners