•SiTech AI Team
NVIDIA and Dao AI Lab Present ReplaySSM for Faster Hybrid Model Decoding
NVIDIA and Princeton's Dao AI Lab present ReplaySSM, which represents SSM state as a checkpoint plus a buffer of recent inputs, cutting state memory traffic roughly in half and speeding up hybrid model decoding on Blackwell GPUs.