Articles tagged: decoding optimization

ReplaySSM: Rethinking State Storage for Faster Hybrid-Model Decoding

ReplaySSM proposes a different approach to storing recurrent state in hybrid models, aiming to speed up decoding without sacrificing quali...