Skip to main content

Lessons Learned Training ZAYA1-74B End-to-End on AMD

abstract background

ZAYA1-74B is a 74B-parameter MoE (4B active) pretrained and post-trained end-to-end on AMD MI300X. We share what it took: a co-designed stack with CCA attention, expert-context-parallel folding, and sliding-window layers that halve KV cache, plus an RL pipeline that sharpens math and code and hardens multi-turn agentic tool use. The result is a competitive long-context, Apache 2.0 model, proving the full train-to-RL loop runs effectively on AMD.

July 23, 2026 4:00 PM - 4:15 PM PDT

Topic

Agentic & Generative AI

AI Training & Inference

Session Type

Theater Session

Related Product

Instinct

Related Sessions

View All Sessions
  • Training at Scale with AMD Primus

    Primus makes large-scale training on Instinct reliable, debuggable and highly performant. It supports the latest OSS training frameworks, models, and is expanding support to new, cutting-edge model architectures, training techniques, and datatypes. SOTA pre and post training performance with Primus, proven at scales of thousands of GPUs, positions an AMD Instinct GPU as a competitive solution for model development at frontier labs, enterprises, and AI startups.;Primus makes large-scale training on Instinct reliable, debuggable and highly performant. It supports the latest OSS training frameworks, models, and is expanding support to new, cutting-edge model architectures, training techniques, and datatypes. SOTA pre and post training performance with Primus, proven at scales of thousands of GPUs, positions an AMD Instinct GPU as a competitive solution for model development at frontier labs, enterprises, and AI startups.

    July 23, 2026

  • Scaling AI in Production with Vultr

    Explore how enterprises can scale AI from training to inference using AMD-powered infrastructure on Vultr. Through a deep dive into the University of Cambridge's Tessera model, learn how organizations can accelerate AI deployment, improve operational efficiency, and scale globally. The session also highlights real-world AI initiatives across healthcare, retail, finance, manufacturing, and hospitality.;Explore how enterprises can scale AI from training to inference using AMD-powered infrastructure on Vultr. Through a deep dive into the University of Cambridge's Tessera model, learn how organizations can accelerate AI deployment, improve operational efficiency, and scale globally. The session also highlights real-world AI initiatives across healthcare, retail, finance, manufacturing, and hospitality.

    July 23, 2026

  • From Tokens to Outcomes: Driving AI ROI with Lenovo Hybrid Infrastructure

    AI success is increasingly measured by business outcomes, not model size. As agentic AI accelerates inference demand, organizations must improve token efficiency, infrastructure utilization, and energy consumption to maximize ROI. Learn how Lenovo Hybrid AI Factories, powered by AMD, help enterprises deploy AI from personal systems to rack-scale environments while reducing token costs, increasing control and utilization, and supporting more sustainable AI growth.;AI success is increasingly measured by business outcomes, not model size. As agentic AI accelerates inference demand, organizations must improve token efficiency, infrastructure utilization, and energy consumption to maximize ROI. Learn how Lenovo Hybrid AI Factories, powered by AMD, help enterprises deploy AI from personal systems to rack-scale environments while reducing token costs, increasing control and utilization, and supporting more sustainable AI growth.

    July 23, 2026

  • Production-Ready AI Training and Inference with Vultr

    AI teams need more than GPUs to move models into production. Hear how organizations build training pipelines and deliver production inference on Vultr using AMD Instinct GPUs and ROCm, with attention to data locality, secure networking, Kubernetes orchestration, benchmarking, cost controls, and scale-out operations. Attendees will leave with a blueprint for running AI workloads that are fast, portable, and ready for production use.;AI teams need more than GPUs to move models into production. Hear how organizations build training pipelines and deliver production inference on Vultr using AMD Instinct GPUs and ROCm, with attention to data locality, secure networking, Kubernetes orchestration, benchmarking, cost controls, and scale-out operations. Attendees will leave with a blueprint for running AI workloads that are fast, portable, and ready for production use.

    July 23, 2026

  • Creating CPU Inference and Agentic Performance Transparency

    Your finance team doesn't care about tokens per second. They care about predictable costs, compliance risk, and vendor lock-in. With agentic AI, the metrics for tracking success are even more complex. But benchmarks don't answer the question that actually matters: Should you undertake this effort and is it viable for your business? In this interactive technical discussion, we’ll break down the tradeoffs, work through the math, and pressure-test the strategy together.;Your finance team doesn't care about tokens per second. They care about predictable costs, compliance risk, and vendor lock-in. With agentic AI, the metrics for tracking success are even more complex. But benchmarks don't answer the question that actually matters: Should you undertake this effort and is it viable for your business? In this interactive technical discussion, we’ll break down the tradeoffs, work through the math, and pressure-test the strategy together.

    July 23, 2026

  • Agentic Kernel Performance Tuning with AMD ROCm

    This session introduces an agentic kernel development workflow for optimizing AI and HPC workloads on AMD ROCm. Learn how a self-directing optimization loop can profile, analyze, optimize, validate, and generate production-ready kernel improvements with minimal manual tuning. The talk highlights how AMD is accelerating kernel engineering by reducing weeks of performance optimization effort into an automated, scalable workflow for developers and performance engineers.;This session introduces an agentic kernel development workflow for optimizing AI and HPC workloads on AMD ROCm. Learn how a self-directing optimization loop can profile, analyze, optimize, validate, and generate production-ready kernel improvements with minimal manual tuning. The talk highlights how AMD is accelerating kernel engineering by reducing weeks of performance optimization effort into an automated, scalable workflow for developers and performance engineers.

    July 23, 2026

  • Advantages of Deploying Agentic AI at Work with Agent Computers

    Agentic AI is redefining the future of work by moving computing beyond user-driven interactions to intelligent agents that can reason, plan, and execute ta;Agentic AI is redefining the future of work by moving computing beyond user-driven interactions to intelligent agents that can reason, plan, and execute tasks autonomously. Discover how agent computers powered by AMD Ryzen™ AI PRO processors are unlocking a new era of enterprise productivity through faster, more responsive, and more secure local AI workflows.

    July 23, 2026

  • Redefining Scalable AI Performance: OCI Supercomputing in the Cloud

    Organizations building frontier AI models need infrastructure designed for performance at scale. This session shows how OCI combines AMD Instinct, AMD EPYC, and Pensando in Oracle Acceleron to enable ultra-low-latency networking for high-throughput distributed workloads, with practical guidance for designing infrastructure for large language, multimodal, and scientific AI models.;Organizations building frontier AI models need infrastructure designed for performance at scale. This session shows how OCI combines AMD Instinct, AMD EPYC, and Pensando in Oracle Acceleron to enable ultra-low-latency networking for high-throughput distributed workloads, with practical guidance for designing infrastructure for large language, multimodal, and scientific AI models.

    July 23, 2026