Why Inkling is the pragmatic AI engineer’s new secret weapon

Thinking Machines’ 975B open-weights MoE activates 41B parameters, ships Apache 2.0, and dials thinking effort without closed-API lock-in.

Thinking Machines Lab launched its first in-house model called Inkling this week. The company openly acknowledges that Inkling is not the strongest overall model available today. Yet, it debuted as the leading American open-weights contender.

The release comes as the developer community is shifting its focus from hunting down the smartest frontier model to securing reliable return on investment with cost-effective LLMs that avoid rigid ecosystem lock-in.

For developers, the raw benchmark rankings are secondary to the model's unparalleled deployment readiness. Released under an enterprise-friendly Apache 2.0 license, Inkling arrives with massive Day-0 implementation support across inference engines.

It also tightly integrates with Thinking Machines' dedicated fine-tuning platform, making it a suitable choice for custom enterprise deployment.

Under the hood: Architecture, efficiency, and benchmarks

Inkling is a 975-billion parameter model that supports a one-million token context window. It relies on a sparse Mixture-of-Experts (MoE) architecture that only activates 41 billion parameters per token during inference.

MoEs use a routing system that sends each token to a few specialized sub-networks as opposed to the entire network of model parameters. This grants the reasoning power of a one-trillion parameter model at the inference cost of a much smaller system.

To affordably support its massive context window, Inkling introduces a highly efficient attention mechanism. It interleaves local sliding-window attention and global attention that reduces the memory and compute bottleneck typically associated with long-context reasoning.