Pruning LLMs Like a Physicist: Block Removal as an Ising Optimization Problem
The article introduces a method for LLM block removal by reformulating it as a constrained binary optimization problem mapped to an Ising glass, allowing for efficient, high-performance depth pruning that accounts for block interactions.