Mistral's Le Chonk Beats GPT-6-Astra at Pinpointing Objects in Images
Mistral's trillion-parameter Le Chonk model hits 42% on Dense 200 visual grounding, edging past frontier closed models and targeting industrial inspection work.
- Mistral is highlighting Le Chonk's visual grounding, pinpointing objects in images rather than captioning them
- Reports 42% on Dense 200 benchmark, edging GPT-6 Astra's 41%, though not independently verified
- Mistral Large 4 is a 1T-parameter mixture-of-experts model with 49B active, natively multimodal
- API live via Mistral Studio at $1.36 per million input tokens, $4.18 per million output
- Targeted at engineering drawings, PDF evidence extraction, and gigapixel satellite imagery search
- Full open weights expected by end of month, following cybersecurity partner red-teaming
Mistral makes visual grounding Le Chonk’s headline feature
Mistral is promoting visual grounding as a core capability of its flagship Mistral Large 4 model, nicknamed Le Chonk. Visual grounding maps a text request to a precise image region. A prompt such as “find the cracked weld” can yield bounding-box coordinates for the suspected defect.
Machine-readable coordinates can feed inspection systems, agent workflows, document-retrieval tools, and geospatial pipelines. Mistral supports that pitch with a benchmark result and demonstrations involving engineering drawings, PDFs, and satellite imagery.
One point ahead, replication pending
On Dense 200, a visual-grounding benchmark, Mistral reports a score of 42% for Le Chonk and 41% for the closed GPT-6-Astra model. The one-percentage-point lead comes from a single benchmark, and Mistral’s vision results have yet to be independently reproduced. The claim remains evidence from one dataset, pending replication and application-specific testing.
The company pairs the score with demonstrations of dense-scene analysis, mechanical-part verification, PDF evidence retrieval, and satellite-image search. These examples show the intended workflows, while production accuracy, latency, and failure rates will depend on each dataset and integration.
A trillion weights behind text coordinates
| Specification | Details |
|---|---|
| Architecture | Natively multimodal mixture of experts |
| Model size | 1 trillion total parameters, with 49 billion active |
| Inputs | Text and images |
| Outputs | Text, including structured coordinates |
| Availability | Mistral Studio API at launch; full weights promised by month-end |
Mixture-of-experts routing sends each token through a subset of the model’s experts, reducing computation relative to a dense trillion-parameter model. The complete expert set must remain loaded or distributed across memory so the router can call it, making self-hosting a substantial infrastructure project even with 49 billion parameters active at a time.
Applications must parse the model’s text response and turn its coordinates into boxes, highlights, or crop regions. Stable coordinate conventions therefore matter as much as model accuracy for developers building reusable grounding tools.
Factory floors, PDFs, and orbit
Mistral targets industrial workflows that pass locations into downstream software. A returned coordinate can trigger part verification, cite source evidence, or direct another inspection pass. The showcased workloads include:
- Engineering inspection: verifying mechanical parts and possible defects against technical drawings.
- Document retrieval: locating supporting evidence in scanned and image-heavy PDFs.
- Geospatial search: finding targets in gigapixel satellite imagery for disaster response and Earth observation.
- Chart analysis: answering questions over visual data, with Mistral also claiming strong ChartQA Pro results.
Mistral attributes these capabilities to native multimodal pretraining. Its launch video shows the model zooming into an engineering drawing, inspecting details, and refining its answer. Gigapixel imagery will require applications to manage tiling or iterative zooming so the model can inspect selected regions at usable resolution.
API access comes first
Developers can call Le Chonk through the Mistral Studio API. Mistral says the full weights will follow by the end of the month, enabling self-hosted deployments for teams with sufficient memory, compute capacity, and a compatible use case.
Published API pricing is $1.36 per million input tokens and $4.18 per million output tokens. Those rates place the service above many Chinese open-weight competitors, while actual workload costs will vary with image tokenization, prompt size, and response length.
A community Bun grounding demo already renders bounding-box overlays from the model’s responses. Mistral’s launch materials and model card do not specify an official box schema, so the demo requests coordinates normalized to a 0-to-1000 range. Production integrations should validate coordinate order, origin, scaling, and behavior near image boundaries.
Vision leads an uneven scorecard
Independent evaluations reported alongside the launch support the model’s cybersecurity and legal performance claims, place its finance results near the middle of the field, and rank it 32nd among 44 models on one broad aggregate index. The spread indicates concentrated strengths across selected domains. Visual grounding appears among those strengths, subject to outside replication.
Coordinates meet data control
Chinese labs including DeepSeek, Moonshot AI’s Kimi, and Alibaba’s Qwen have dominated recent open-weight rankings. Mistral’s result adds a European model with a competitive grounding claim and a planned path to local deployment.
Local deployment can matter when proprietary CAD files, internal PDFs, or high-resolution satellite images face confidentiality, data-residency, or bandwidth constraints. If the 42% Dense 200 result holds under independent testing, industrial-inspection, document-analysis, and geospatial teams will gain another model that can run on controlled infrastructure and return coordinates for downstream software. Application-specific evaluations will determine whether that benchmark lead survives real drawings, scans, and imagery.