The largest open model ever runs on 3.7 percent of itself
Kimi K3 just went public: 2.8 trillion parameters, 896 experts with only 16 awake per token, and a million token context made possible by deleting most of its attention. The size makes the headline. The accounting is the story.