Attention Decode on AMD MI450 GPUs: A Gluon Kernel Optimization Guide
↗AMD's MI450 Gluon-based attention decode kernel achieves up to ~85% of peak HBM bandwidth (about 16–17 TB/s of a 20 TB/s peak) using a four-stage pipeline, TDM data paths, and Split-k across KV partitions, backed by detailed hardware features and open-source references.
Aug 1, 20261%