---
title: "MGSD Closes the Visual Planning Gap by 19% Without Symbolic Inputs"
subtitle: "MGSD teaches vision-language models to plan spatially by distilling symbolic knowledge into visual reasoning, closing an 18-19% performance gap at inference time without any symbolic inputs."
url: "https://alphasignal.ai/news/mgsd-closes-the-visual-planning-gap-by-19-without-symbolic-inputs"
author: "AlphaSignal Newsroom"
author_url: "https://alphasignal.ai/editorial-team"
company: "AlphaSignal"
company_url: "https://alphasignal.ai/company/alphasignal"
published: "2026-06-04T00:00:00.000Z"
updated: "2026-06-12T01:34:18.226Z"
type: "Paper"
topics:
  - "Reasoning"
  - "Robotics"
subtopics:
  - "Test Time Compute"
  - "Vla Models"
upvotes: 2014
source_url: "https://arxiv.org/abs/2606.06076"
comments: 0
truncated: true
---

# MGSD Closes the Visual Planning Gap by 19% Without Symbolic Inputs

> MGSD teaches vision-language models to plan spatially by distilling symbolic knowledge into visual reasoning, closing an 18-19% performance gap at inference time without any symbolic inputs.

Ask a state-of-the-art vision-language model to navigate a maze from a screenshot, or rearrange blocks to match a target configuration, and it will likely fail -- not because it lacks raw intelligence, but because it is facing two compounding problems at once. It has to figure out the scene structure from raw pixels, and then reason over that inferred structure to produce a valid multi-step plan. A new paper introduces [MGSD (Modality-Gap-Aware Self-Distillation)](https://arxiv.org/abs/2606.06076), a training framework that tackles both bottlenecks simultaneously, delivering gains of roughly 19% on visual planning benchmarks while keeping inference purely visual.

## The gap that nobody talks about

There is a well-known divide between how models handle text versus images. But in the planning domain, this gap has a very specific shape. One understudied capability in VLMs is visual spatial planning -- the ability to comprehend the spatial arrangements of objects and devise action plans to achieve desired outcomes in visual scenes. The trouble is that spatial planning is not one hard problem, it is two hard problems stacked on top of each other.

The MGSD paper calls this the **perception-reasoning modality gap**: visual planning requires a model to first recover latent state structure from pixels (where are the walls, the blocks, the obstacles?) and then reason over that recovered structure to produce valid actions. Symbolic planning, by contrast, hands the model an explicit list of objects and constraints. Both open-source and private VLMs fail to generate effective plans for even simple spatial planning tasks, with evaluations revealing fundamental deficiencies in visual perception and bottlenecks in reasoning abilities.

![Diagram showing perception and reasoning gaps between base model, SFT, and MGSD with accuracy metrics](https://arxiv.org/html/2606.06076v2/x1.png) 

The result is a frustrating ceiling: give a model the same planning problem as text (symbolic state) and it performs dramatically better than when given an image. The gap between these two modes is the target MGSD is designed to close.

_Preview only. Full text requires an AlphaSignal Pro account._

## Sources

- [MGSD: Learning Visual Spatial Planning from Symbolic State via Modality-Gap-Aware Self-Distillation](https://arxiv.org/abs/2606.06076)
- [VSP: Assessing the dual challenges of perception and reasoning in spatial planning tasks for VLMs](https://arxiv.org/abs/2407.01863)
- [On-Policy Context Distillation (OPCD) -- Emergent Mind](https://www.emergentmind.com/topics/on-policy-context-distillation-opcd)
- [MGSD GitHub Repository](https://github.com/Oranger-l/MGSD)
- [Visual-Advantage On-Policy Distillation for Vision-Language Models](https://arxiv.org/html/2605.21924v1)
