Managing the Server Memory Market Challenge of 2026

Jul 06, 2026

Introduction

This is the first in a short series of blogs meant to share insights from AMD experts to help customers address the challenges of the server memory market. The series will share insights on ways to reduce the need for and expense of memory, while retaining server performance. Subsequent blogs on this topic will drill down a bit further into memory optimization options and discuss how AMD and other enterprise management tools can help assess savings opportunities and modelling financial impact of IT procurement options.

Since late 2025 price increases and supply constraints have made planning and executing server acquisitions more challenging. While it is far from the only component with supply and price concerns, server memory has been an oft-cited example of a technology that is disrupting customer plans. The three leading memory vendors (Samsung, SK hynix and Micron) have acknowledged that rapidly growing demand for AI data centers has led to significant supply shortages, extended lead times and rising prices for standard DDR5 memory despite intense efforts to shift manufacturing capacity towards building the DDR5 and HBM used in AI servers.

In 2024 and early 2025, the practice of overprovisioning memory was relatively common in many businesses, the incremental costs were nominal, the memory was readily available and having robustly configured servers gave IT great flexibility in where they could deploy workloads. In today’s market, memory has transitioned from a secondary component cost to one of the primary drivers of overall server BOM cost. Pricing increases, constrained supply and extended lead times are directly impacting procurement decisions.

The combination of scarcity and cost may lead some IT managers to re-think the viability of new IT deployments. It is not unheard of for a system configuration that cost approximately $25,000 nine months ago to now be quoted in the $35-40,000 range, largely without corresponding performance gains. After all, increased cost while keeping performance and other aspects the same seems like a deal-breaker. Perhaps waiting until the supply/demand scenario improves is the smarter choice?

Worth Waiting?

What may seem like a prudent stand in isolation becomes less compelling in the dynamic business environment, and particularly so when the memory market constraints are expected to persist for several quarters (not weeks or even months). Companies invest in IT to provide robust, reliable infrastructure needed to support the innovation and growth. Companies have found tremendous economic value through IT—with modernization and consolidation projects that can pay for themselves and deliver compelling return on investment in months. While higher cost systems would make the economics seem less compelling, it is important to recognize that not investing also carries a cost. Deferred infrastructure investment can result in lost productivity, diminished competitiveness, reduced uptime and missed opportunities for consolidation and efficiency gains.

At the same time, organizations may want to avoid over-investing in a challenging market. As a result, defining deployment strategies that mitigate the current memory-related headwinds is essential. Given past tendencies toward over-provisioning and the wide variability in how memory affects workload performance, right-sizing configurations and selecting appropriate systems offer a practical path forward which still delivers business value. After all, system decisions extend beyond upfront cost: they can impact utilization, performance, and energy efficiency over the lifetime of the infrastructure.

One Size Does Not Fit All: How Do You Compare?

AMD analysis as well as some of the leading independent testing sites such as Phoronix and Serve the Home (STH) indicate that there is wide variability in how memory impacts workload performance. This variability reinforces that memory sizing should be workload-specific, not procurement-policy driven. And the high component costs and limited availability mean that overprovisioning of memory can be wasteful. To demonstrate how diverse memory needs are, consider Figure 1 showing some general recommendations from the AMD performance engineering experts that develop tuning and optimization guides with some of the world’s leading software vendors.

[Figure 1 — insert chart image, 1200px wide. Data table below for reference.]

Figure 1: AMD Rule of Thumb Guidance on Mainstream Enterprise Server Configurations. Memory per core represents the recommended GB of RAM per CPU core. Total system memory is calculated as cores × memory per core.

Application Category

# Processor Ideal

Optimal Cores/Processor

Optimal Memory / Core (GB)

Optimal Memory Capacity / System (Total GB)

AI Inference

2

96

12

2304

CRM

2

64

16

2048

ERM

2

64

16

2048

SCM

2

64

16

2048

General Virtualization and HCI

2

32

32

2048

HPC - Open Source

2

64

12

1536

VDI (Core)

2

64

12

1536

Collaborative applications

2

64

8

1024

HPC - Commercial ISV

2

32

12

768

Media streaming

2

64

6

768

Application development and testing

2

64

4

512

Structured data analytics

1

64

24

1536

Structured data management (Lg)

1

64

24

1536

Content applications

1

64

16

1024

Structured data management (Med)

1

32

24

768

Unstructured data analytics

1

32

16

512

Web serving

1

32

12

384

File and print

1

16

8

128

Networking

1

16

8

128

Security

1

16

8

128

Systems management

1

16

8

128

VDI (Edge)

1

16

8

128

As you can see, application memory needs can vary from the very modest to the quite large. On the other hand, nearly all applications and workloads have some baseline need for memory capacity to deliver acceptable performance and stability. Certainly, these figures should be considered as general guidance points and not as final guidance on equipping your data center. This data is intended to provide a quick reference and estimate to help identify workload configurations where your organization may be over-investing in memory configurations. If application tuning experts often identify these as “sweet spot” configuration points, they are worthy of some consideration in many customer environments.

Moving IT Forward

This is just the first rock to turn over to look for opportunities to move IT forward despite current memory market headwinds. Our next blog will share additional methods and tools to evaluate memory provisioning decisions and “right size” IT infrastructure.

Share:

Article By


Director, AMD EPYC Technology Marketing

Related Blogs