Skip to main content

Enterprise AI Inference at Scale with AMD

abstract background

Enterprise AI is scaling quickly in production, requiring infrastructure that optimizes performance, governance, simplicity, and cost. In this session we show how the AMD Enterprise AI reference stack enables heterogenous inference across on-premises and hosted environments using a vLLM-based Semantic Router to intelligently direct workloads across AMD Instinct™ MI350P, MI350X, and hosted models. Learn how enterprises can streamline deployment, strengthen AI governance, and scale AI responsibly.

July 22, 2026 2:00 PM - 2:45 PM PDT

Kumaran Siva
Kumaran Siva

Corporate Vice President, Enterprise AI | AMD

Topic

Enterprise AI

AI Infrastructure

Session Type

Breakout Session

Related Product

Instinct, EPYC

Related Sessions

View All Sessions
  • Supercomputing for All: Bringing Exascale Innovation to Enterprise AI

    HPE and AMD have built some of the world's most advanced supercomputers, including Frontier and El Capitan. Join HPE leaders who helped deploy these systems and learn how the technologies, expertise, and operational practices developed for exascale computing are enabling enterprise AI. Discover how organizations can accelerate AI adoption, scale workloads, and reduce deployment risk.;HPE and AMD have built some of the world's most advanced supercomputers, including Frontier and El Capitan. Join HPE leaders who helped deploy these systems and learn how the technologies, expertise, and operational practices developed for exascale computing are enabling enterprise AI. Discover how organizations can accelerate AI adoption, scale workloads, and reduce deployment risk.

    July 23, 2026

  • Domain-Specific AI at Scale: Open Models, Post-Training, and AI Infrastructure

    Learn how domain-specific AI moves beyond generic models using post-training, domain evals, and scalable open infrastructure. Using Open Telco Models as a case study, this session covers curated data, reward loops, unified training and serving, and AMD Instinct/ROCm-based stacks for building specialized AI systems at enterprise scale.;Learn how domain-specific AI moves beyond generic models using post-training, domain evals, and scalable open infrastructure. Using Open Telco Models as a case study, this session covers curated data, reward loops, unified training and serving, and AMD Instinct/ROCm-based stacks for building specialized AI systems at enterprise scale.

    July 23, 2026

  • Unlocking Secure Enterprise Intelligence at Scale with Cisco

    As organizations transition from AI experimentation to production-scale infrastructure, demand for high-performance compute must be matched by security and reliability. This session explores Cisco's vision for secure, high-performance AI environments and a framework for accelerating AI deployment while mitigating risks associated with large-scale data processing. Learn how the Cisco UCS C845A M8 and AMD are enabling the next generation of enterprise AI.;As organizations transition from AI experimentation to production-scale infrastructure, demand for high-performance compute must be matched by security and reliability. This session explores Cisco's vision for secure, high-performance AI environments and a framework for accelerating AI deployment while mitigating risks associated with large-scale data processing. Learn how the Cisco UCS C845A M8 and AMD are enabling the next generation of enterprise AI.

    July 23, 2026

  • From Models to Production—A Blueprint for AI at Scale

    Moving AI from training to production takes more than GPUs. Hear how Microsoft and Chai AI built scalable AI infrastructure on Vultr using AMD Instinct GPUs and ROCm. Learn best practices for data locality, secure networking, Kubernetes orchestration, benchmarking, cost optimization, and scale-out operations. Leave with a practical blueprint for deploying fast, portable, production-ready AI workloads.;Moving AI from training to production takes more than GPUs. Hear how Microsoft and Chai AI built scalable AI infrastructure on Vultr using AMD Instinct GPUs and ROCm. Learn best practices for data locality, secure networking, Kubernetes orchestration, benchmarking, cost optimization, and scale-out operations. Leave with a practical blueprint for deploying fast, portable, production-ready AI workloads.

    July 23, 2026

  • Right Size Your Memory Footprint to Move IT Refresh Forward

    Memory has rarely been in such short supply and is impeding customer data center refresh plans. In this interactive conversation, we’ll discuss tips and tools for right-sizing memory configurations to help move your data center efficiency initiatives forward and preserve ROI. Bring your questions and our experts will provide answers!;Memory has rarely been in such short supply and is impeding customer data center refresh plans. In this interactive conversation, we’ll discuss tips and tools for right-sizing memory configurations to help move your data center efficiency initiatives forward and preserve ROI. Bring your questions and our experts will provide answers!

    July 23, 2026

  • Build an MRI Analysis Agent with AMD Blueprints

    Build and deploy an AI-powered MRI analysis agent in minutes using the AMD mri-doc Solution Blueprint. Run a Gradio-based pipeline that accepts DICOM, NIfTI, and standard image formats, applies tissue segmentation and anomaly detection, and generates LLM-drafted clinical reports on AMD Instinct GPUs. Then customize: swap the LLM AIM, reuse an existing model endpoint, or extend the pipeline for your specific clinical workflow.;Build and deploy an AI-powered MRI analysis agent in minutes using the AMD mri-doc Solution Blueprint. Run a Gradio-based pipeline that accepts DICOM, NIfTI, and standard image formats, applies tissue segmentation and anomaly detection, and generates LLM-drafted clinical reports on AMD Instinct GPUs. Then customize: swap the LLM AIM, reuse an existing model endpoint, or extend the pipeline for your specific clinical workflow.

    July 23, 2026

  • From Tokens to Outcomes: Driving AI ROI with Lenovo Hybrid Infrastructure

    AI success is increasingly measured by business outcomes, not model size. As agentic AI accelerates inference demand, organizations must improve token efficiency, infrastructure utilization, and energy consumption to maximize ROI. Learn how Lenovo Hybrid AI Factories, powered by AMD, help enterprises deploy AI from personal systems to rack-scale environments while reducing token costs, increasing control and utilization, and supporting more sustainable AI growth.;AI success is increasingly measured by business outcomes, not model size. As agentic AI accelerates inference demand, organizations must improve token efficiency, infrastructure utilization, and energy consumption to maximize ROI. Learn how Lenovo Hybrid AI Factories, powered by AMD, help enterprises deploy AI from personal systems to rack-scale environments while reducing token costs, increasing control and utilization, and supporting more sustainable AI growth.

    July 23, 2026

  • HP & AMD Co-engineering Local Compute for Agentic AI

    As AI workloads explode, a cloud-only approach creates friction in data movement, latency, cost, and security. This session explores how keeping compute close to data unlocks measurable advantages for AI workflows. Learn how HP and AMD are co-engineering AI workstations with high-performance local compute and the memory capacity to support larger models and datasets. The future is hybrid—running AI in the right place, at the right time, across environments.;As AI workloads explode, a cloud-only approach creates friction in data movement, latency, cost, and security. This session explores how keeping compute close to data unlocks measurable advantages for AI workflows. Learn how HP and AMD are co-engineering AI workstations with high-performance local compute and the memory capacity to support larger models and datasets. The future is hybrid—running AI in the right place, at the right time, across environments.

    July 23, 2026