How MiniMax M3 Was Built: Sparse Attention and Native Multimodality — Olive Song
MiniMax researcher Olive Song explains how M3 combines a GQA-aware sparse attention design with native text-and-vision pretraining, and why block retrieval and early multimodal integration matter for long context and visual understanding.