Evolving Comms Libraries in ROCm for Future AI Workloads
Abstract
This talk covers advances in AMD ROCm communication libraries for large-scale AI. RCCL innovations include copy-engine offloading, symmetric memory, GPU-initiated collectives, congestion-aware load balancing, and port failover. rocSHMEM extends an OpenSHMEM-like model with Python and Triton support, while NIXL contributions enable efficient inference. Together, they support diverse NICs like AMD Pensando AINICs and Broadcom Thor.
July 22, 2026 4:30 PM - 4:50 PM PDT