Home/Glossary/Ternary Quantization

Optimization

What is Ternary Quantization?

Storing each weight as −1, 0 or +1 with a shared scale, instead of 4 to 16 bits. PrismML's Ternary Bonsai 2 27B fits a 27B model in a 7.2 GB file and runs at 47 tok/s published on an M5 Max. Ternary decoding is compute-bound, so the LLMCheck index does not extrapolate it to other chips.

Where Ternary Quantization comes up on LLMCheck

Browse all 111 models in the index →

Related terms

All 39 terms in the LLMCheck glossary →