Wire
Apple's IDEA Prune shrinks a 2.8B model to 1.3B
Apple researchers describe IDEA Prune as a training pipeline that compresses a 2.8-billion-parameter language model to 1.3 billion—removing 53.6% of the parameters—after pretraining with up to 2 trillion tokens. The catch is that the larger model is never deployed: builders trade extra training compute for a smaller inference footprint, a pattern that complements Unsloth’s finding that aggressive model compression can fit agent models on consumer GPUs.