Optimization
What is Ternary Quantization?
Storing each weight as −1, 0 or +1 with a shared scale, instead of 4 to 16 bits. PrismML's Ternary Bonsai 2 27B fits a 27B model in a 7.2 GB file and runs at 47 tok/s published on an M5 Max. Ternary decoding is compute-bound, so the LLMCheck index does not extrapolate it to other chips.
Where Ternary Quantization comes up on LLMCheck
Browse all 111 models in the index →