Optimizing MI300X Inter-Chiplet Communication via the RCCL Tuner API

The AMD Instinct MI300X’s chiplet architecture introduces non-uniform communication paths when running in CPX/NPS4 mode — and RCCL default algorithms don’t account for this topology.

In this blog, you will learn how the MI300X’s XCD, IOD, and HBM hierarchy creates cross-IOD latency and bandwidth bottlenecks, how to use the RCCL Tuner Plugin API to build a rule-based, topology-aware tuner that selects the optimal algorithm and protocol per collective operation, and how to validate the results with rccl-tests.

By the end, you will have a working CSV-driven tuner plugin that automatically detects CPX/SPX mode and adapts its strategy accordingly.

Read more: Optimizing MI300X Inter-Chiplet Communication via the RCCL Tuner API — ROCm Blogs