gg2
Breaking the 1.58-bit Barrier for Ternary LLMs
The gist
An arXiv paper proposes BITCOS, a ternary-weight format needing 2−z bits per weight.
It challenges the assumed 1.58-bit floor, which matters for cheaper LLM storage and decoding.
How it unfolded
- Sep 14, 2026The arXiv paper "Breaking the 1.58-bit Barrier for Ternary LLMs" (arXiv:2609.16338) is submitted.
- Sep 16, 2026YouTube channel AI Paper Slop posts a video summarizing the paper, and Pradeep Dubey posts on LinkedIn about reaching "a new industry milestone in the average number of bits required per weight for deep neural networks."
- Sep 16, 2026The paper is submitted to Hacker News by user matt_d with 6 points, and threads appear on Reddit r/hypeurls and r/hackernews.