---
title: "MMG2Skill Turns Raw Internet Guides Into Self-Improving AI Agent Skills"
subtitle: "MMG2Skill turns messy web tutorials into self-improving agent skills, beating vanilla VLM baselines by up to 25 percentage points across GUI, Minecraft, and card games"
url: "https://alphasignal.ai/news/mmg2skill-turns-raw-internet-guides-into-self-improving-ai-agent-skills"
author: "AlphaSignal Newsroom"
author_url: "https://alphasignal.ai/editorial-team"
company: "AlphaSignal"
company_url: "https://alphasignal.ai/company/alphasignal"
published: "2026-06-01T00:00:00.000Z"
updated: "2026-06-09T11:38:24.678Z"
type: "Paper"
topics:
  - "Agents"
  - "Development"
subtopics:
  - "Agent Frameworks"
  - "Tool Use"
  - "Code Agents"
  - "Code Agents"
upvotes: 1894
source_url: "https://arxiv.org/abs/2606.01993"
comments: 0
truncated: true
---

# MMG2Skill Turns Raw Internet Guides Into Self-Improving AI Agent Skills

> MMG2Skill turns messy web tutorials into self-improving agent skills, beating vanilla VLM baselines by up to 25 percentage points across GUI, Minecraft, and card games

The internet is full of how-to guides: YouTube walkthroughs, wiki pages, community tutorials. Humans use them all the time to learn new software or pick up a game. But hand one of those guides directly to an AI agent and it often performs **worse** than if you had given it nothing at all. A new paper from a team of researchers introduces [MMG2Skill](https://arxiv.org/abs/2606.01993), a framework that bridges this gap by converting raw, human-oriented guides into structured, self-improving agent skills.

## The gap nobody was measuring

The web holds abundant procedural knowledge for long-horizon tasks, but such knowledge is often multimodal, heterogeneous, noisy, and implicitly assumes human executors, making it difficult to use directly as the skills required by agents. Think about a Minecraft wiki page: it assumes you know what a crafting table looks like, that you have hands, and that you understand spatial metaphors like "place in the top-left slot." An agent operating through an API has none of that implicit context.

Recent agent systems augment LLMs with reusable behavior stored as language memories, executable programs, or skill libraries. But the skills in these systems are typically expert-provided, model-generated, or discovered through the agent's own experience. As a result, there is no systematic evidence about whether public guide material can become agent-executable skills, and no framework that can make this conversion without relying on benchmark scores during revision.

To bridge the gap between human-oriented guides and agent-executable skills, the authors formalize this problem as **guide-to-skill learning**: converting in-the-wild guides into executable skills and continuously improving them from trajectories observable to the agent. The key constraint: the system must improve itself using only what the agent can actually see during execution, not privileged benchmark labels.

## A benchmark built for the real world

To address these gaps, the team introduces MMG2Skill-Bench, the first benchmark for guide-to-skill learning from in-the-wild multimodal guides. The benchmark spans desktop GUI control, open-ended game play, and strategy tasks, enabling evaluation beyond a single environment or action interface.

_Preview only. Full text requires an AlphaSignal Pro account._

## Sources

- [MMG2Skill: Can Agents Distill In-the-Wild Guides into Self-Evolving Skills? (arXiv abstract)](https://arxiv.org/abs/2606.01993)
- [MMG2Skill full paper (arXiv HTML)](https://arxiv.org/html/2606.01993)
- [Autonomous Agents research paper tracker (GitHub)](https://github.com/tmgthb/Autonomous-Agents)
- [XSkill: Continual Learning from Experience and Skills in Multimodal Agents (ICML 2026)](https://github.com/XSkill-Agent/XSkill)
- [A Survey of Agent Skills: Toward Procedural Infrastructure for LLM Agents](https://www.researchgate.net/publication/404720630_A_Survey_of_Agent_Skills_Toward_Procedural_Infrastructure_for_LLM_Agents)