Caltech spinout PrismML released Bonsai 2 27B, using novel ternary compression to shrink a high-performing language model tenfold to 5.9 GB. The breakthrough retains 98 percent of original benchmark capabilities, enabling complex reasoning models to run locally on consumer PCs and smartphones.
FireBrief
FireBrief