Skip to main content

Idle Capacity to Agentic AI: Scaling Inference on AMD EPYC

abstract background

Learn how AMD EPYC turns underutilized CPU infrastructure into cost-effective, high-performance AI inference for the enterprise. This session covers deployment strategies, ZenDNN acceleration, Venice quantization support, kernel optimizations, and EPYC’s role in powering Agentic AI workloads.

July 22, 2026 3:30 PM - 3:50 PM PDT

Siddharth Rele
Siddharth Rele

Senior Director, Software Engineering | AMD

Priya Vasudevan
Priya Vasudevan

Senior AI Product Manager | AMD

Milind Damle
Milind Damle

Senior Director, Systems Design Engineering | AMD

Topic

Enterprise AI

Agentic & Generative AI

Session Type

Tech Talk

Related Product

EPYC

Related Sessions

View All Sessions
  • ElMerFold: Exascale AI for Protein Structure Prediction with El Capitan

    DProtein structure prediction is foundational to modern biology, enabling breakthroughs in drug discovery, enzyme engineering, and AI-driven science. We present ElMerFold, a production-scale synthetic data generation workflow running on the El Capitan system at 11,000 nodes and 44,000 APUs. ElMerFold processes ~41 million proteins at 2,378 structures/s, achieving a 16.3× improvement over prior approaches and reaching 969 PFLOP/s FP32 inference performance.;DProtein structure prediction is foundational to modern biology, enabling breakthroughs in drug discovery, enzyme engineering, and AI-driven science. We present ElMerFold, a production-scale synthetic data generation workflow running on the El Capitan system at 11,000 nodes and 44,000 APUs. ElMerFold processes ~41 million proteins at 2,378 structures/s, achieving a 16.3× improvement over prior approaches and reaching 969 PFLOP/s FP32 inference performance.

    July 23, 2026

  • Inside AMD IT: Our Enterprise AI Journey

    How is AMD using AI to transform its own enterprise IT? Go inside AMD IT's AI journey – from early experimentation to scaled deployment. Learn about AMD IT’s multi-year AI strategy and its strategic investment in Data platform to enable AI to automate mega process workflows, accelerate delivery, and drive measurable business outcomes. Whether you are starting your AI journey or scaling existing initiatives, this insider view offers practical lessons on strategy, adoption, and change.;How is AMD using AI to transform its own enterprise IT? Go inside AMD IT's AI journey – from early experimentation to scaled deployment. Learn about AMD IT’s multi-year AI strategy and its strategic investment in Data platform to enable AI to automate mega process workflows, accelerate delivery, and drive measurable business outcomes. Whether you are starting your AI journey or scaling existing initiatives, this insider view offers practical lessons on strategy, adoption, and change.

    July 23, 2026

  • Build an MRI Analysis Agent with AMD Blueprints

    Build and deploy an AI-powered MRI analysis agent in minutes using the AMD mri-doc Solution Blueprint. Run a Gradio-based pipeline that accepts DICOM, NIfTI, and standard image formats, applies tissue segmentation and anomaly detection, and generates LLM-drafted clinical reports on AMD Instinct GPUs. Then customize: swap the LLM AIM, reuse an existing model endpoint, or extend the pipeline for your specific clinical workflow.;Build and deploy an AI-powered MRI analysis agent in minutes using the AMD mri-doc Solution Blueprint. Run a Gradio-based pipeline that accepts DICOM, NIfTI, and standard image formats, applies tissue segmentation and anomaly detection, and generates LLM-drafted clinical reports on AMD Instinct GPUs. Then customize: swap the LLM AIM, reuse an existing model endpoint, or extend the pipeline for your specific clinical workflow.

    July 23, 2026

  • How to Right-size Your Memory

    Memory has rarely been in such short supply and is impeding customer data center refresh plans. In this interactive conversation, we’ll discuss tips and tools for right-sizing memory configurations to help move your data center efficiency initiatives forward and preserve ROI. Bring your questions and our experts will provide answers!;Memory has rarely been in such short supply and is impeding customer data center refresh plans. In this interactive conversation, we’ll discuss tips and tools for right-sizing memory configurations to help move your data center efficiency initiatives forward and preserve ROI. Bring your questions and our experts will provide answers!

    July 23, 2026

  • Creating CPU Inference and Agentic Performance Transparency

    Your finance team doesn't care about tokens per second. They care about predictable costs, compliance risk, and vendor lock-in. With agentic AI, the metrics for tracking success are even more complex. But benchmarks don't answer the question that actually matters: Should you undertake this effort and is it viable for your business? In this interactive technical discussion, we’ll break down the tradeoffs, work through the math, and pressure-test the strategy together.;Your finance team doesn't care about tokens per second. They care about predictable costs, compliance risk, and vendor lock-in. With agentic AI, the metrics for tracking success are even more complex. But benchmarks don't answer the question that actually matters: Should you undertake this effort and is it viable for your business? In this interactive technical discussion, we’ll break down the tradeoffs, work through the math, and pressure-test the strategy together.

    July 23, 2026

  • Benchmarking AI Systems: from Model Metrics to Real-World Performance

    AI benchmarking is evolving rapidly as enterprises scale from experimentation to deployment. This interactive session explores measuring real world performance across inference and training workloads. We will discuss metrics that matter, throughput vs. latency tradeoffs, memory bandwidth, and open software ecosystems. Gain practical insights into evaluating AI infrastructure for performance, scalability, efficiency, and TCO in modern enterprise and developer environments.;AI benchmarking is evolving rapidly as enterprises scale from experimentation to deployment. This interactive session explores measuring real world performance across inference and training workloads. We will discuss metrics that matter, throughput vs. latency tradeoffs, memory bandwidth, and open software ecosystems. Gain practical insights into evaluating AI infrastructure for performance, scalability, efficiency, and TCO in modern enterprise and developer environments.

    July 23, 2026

  • Building Scalable Enterprise AI on AMD MI350P

    Most AI value is unlocked during inference. Enterprises need flexible compute platforms to optimize cost, power, and performance while expanding workloads and meeting ROI goals. AMD Instinct MI350P PCIe cards provide flexible inference performance within existing data center infrastructure. Learn how AMD Instinct MI350P, the AMD enterprise AI reference stack, and a robust ecosystem combine with standard AMD EPYC and Pensando enterprise platforms to scale AI for changing enterprise needs.;Most AI value is unlocked during inference. Enterprises need flexible compute platforms to optimize cost, power, and performance while expanding workloads and meeting ROI goals. AMD Instinct MI350P PCIe cards provide flexible inference performance within existing data center infrastructure. Learn how AMD Instinct MI350P, the AMD enterprise AI reference stack, and a robust ecosystem combine with standard AMD EPYC and Pensando enterprise platforms to scale AI for changing enterprise needs.

    July 23, 2026

  • Advantages of Deploying Agentic AI at Work with Agent Computers

    Agentic AI is redefining the future of work by moving computing beyond user-driven interactions to intelligent agents that can reason, plan, and execute ta;Agentic AI is redefining the future of work by moving computing beyond user-driven interactions to intelligent agents that can reason, plan, and execute tasks autonomously. Discover how agent computers powered by AMD Ryzen™ AI PRO processors are unlocking a new era of enterprise productivity through faster, more responsive, and more secure local AI workflows.

    July 23, 2026