ReplaySSM: Rethinking State Storage for Faster Hybrid-Model Decoding
ReplaySSM optimizes State-Space Models (SSMs) by decoupling output computation from state updates to reduce memory traffic, simplify speculative decoding, and mitigate quantization errors.