How We Shrank an AI Model by 85% and Kept 90% of Its Smarts
This article introduces Pingala-8, a 2-bit quantization format that compresses the Qwen3-4B model from 8.05 GB to 1.24 GB while maintaining high accuracy, achieved through a combination of rotation, error-feedback rounding, and trellis coding.