---
title: "LY Corporation's sim-use Gives AI Agents Eyes and Hands on Mobile Apps"
subtitle: "A Swift CLI from LY Corporation gives AI coding agents a token-efficient observe-act loop across iOS Simulator and Android devices."
url: "https://alphasignal.ai/news/ly-corporation-s-sim-use-gives-ai-agents-eyes-and-hands-on-mobile-apps"
author: "AlphaSignal Newsroom"
author_url: "https://alphasignal.ai/editorial-team"
company: "AlphaSignal"
company_url: "https://alphasignal.ai/company/alphasignal"
published: "2026-08-21T07:05:04.000Z"
updated: "2026-08-22T02:52:53.905Z"
type: "Repo"
topics:
  - "Agents"
  - "Development"
subtopics:
  - "Computer Use"
  - "Code Agents"
  - "Tool Use"
  - "Code Agents"
upvotes: 10
source_url: "https://github.com/lycorp-jp/sim-use"
comments: 0
truncated: true
---

# LY Corporation's sim-use Gives AI Agents Eyes and Hands on Mobile Apps

> A Swift CLI from LY Corporation gives AI coding agents a token-efficient observe-act loop across iOS Simulator and Android devices.

Mobile development has been the awkward stepchild of the agentic coding boom. Web agents can click through Playwright, backend agents can hit shells and APIs, but coding assistants building iOS or Android apps have mostly been flying blind after `xcodebuild` succeeds. [sim-use](https://github.com/lycorp-jp/sim-use), a new open source CLI from LY Corporation (the LINE/Yahoo Japan parent), is a focused attempt to close that gap with a single command surface that drives both iOS Simulators and Android emulators or physical devices.

The pitch is right in the tagline: give your agent eyes and hands on the simulator. sim-use is a cross-platform CLI that drives Apple's Accessibility APIs, the iOS Simulator HID pipeline, and Android's AccessibilityService through one command surface. It is Apache-2.0 licensed, written in Swift, and installs via Homebrew with `brew install lycorp-jp/tap/sim-use`.

## The observe-act loop, in two commands

The core interaction pattern is deliberately minimal. You call `sim-use ui` to get a compact screen description, then `sim-use tap @N` to act on any element by its numeric alias. No coordinates, no XPath, no brittle screen scraping. A typical loop looks like this:

```
sim-use ui                  # 1. read the screen
sim-use tap @9              # 2. act on what you see
sim-use ui                  # 3. verify the result
```

The

_Preview only. Full text requires an AlphaSignal Pro account._

## Sources

- [lycorp-jp/sim-use](https://github.com/lycorp-jp/sim-use)
- [cameroncooke/AXe](https://github.com/cameroncooke/AXe)
- [facebook/idb](https://github.com/facebook/idb)