claude-in-mobile CLI

Fast CLI for mobile device automation across Android (via ADB), iOS (via simctl), Aurora OS (via audb), and Desktop (via companion JSON-RPC app).

Binary: claude-in-mobile (ensure it's in PATH or use full path to the built binary).

Common Flags

Most commands accept platform-specific device selectors:

Flag	Description	Platforms
--device <serial>	Android/Aurora device serial (default: first connected)	Android, Aurora
--simulator <name>	iOS Simulator name (default: booted)	iOS
--companion-path <path>	Path to Desktop companion app (or set MOBILE_TOOLS_COMPANION env)	Desktop

---

Commands Reference

devices

List connected devices across platforms.

claude-in-mobile devices              # All platforms
claude-in-mobile devices android      # Android only
claude-in-mobile devices ios          # iOS simulators only
claude-in-mobile devices aurora       # Aurora devices only

Platforms: Android, iOS, Aurora

---

screenshot

Capture a screenshot. Outputs base64 to stdout by default, or save to file with -o.

claude-in-mobile screenshot android
claude-in-mobile screenshot ios
claude-in-mobile screenshot aurora
claude-in-mobile screenshot desktop --companion-path /path/to/companion

# Save to file
claude-in-mobile screenshot android -o screen.png

# Compress for LLM (resize + JPEG quality reduction)
claude-in-mobile screenshot android --compress --max-width 800 --quality 60

Flag	Description	Default
-o, --output <path>	Save to file instead of base64 stdout	stdout
-c, --compress	Enable compression (resize + quality)	false
--max-width <px>	Max width when compressing	1024
--max-height <px>	Max height when compressing	unlimited
--quality <1-100>	JPEG quality when compressing	80
--monitor-index <n>	Monitor index (Desktop)	primary

Platforms: Android, iOS, Aurora, Desktop

---

annotate

Capture screenshot with UI element bounding boxes drawn over it. Useful for visual debugging and identifying tap targets.

claude-in-mobile annotate android -o annotated.png
claude-in-mobile annotate ios -o annotated.png

Flag	Description
-o, --output <path>	Save to file instead of base64 stdout

Platforms: Android, iOS

---

analyze-screen

Parse current screen and return categorized interactive elements as structured JSON. Groups elements into buttons, inputs, texts, etc. Useful for automated test flows.

claude-in-mobile analyze-screen
claude-in-mobile analyze-screen --device emulator-5554

Platforms: Android only

---

screen-size

Get screen resolution in pixels.

claude-in-mobile screen-size android
claude-in-mobile screen-size ios

Platforms: Android, iOS

---

tap

Tap at exact coordinates, or by text/resource-id/index.

# By coordinates
claude-in-mobile tap android 500 800
claude-in-mobile tap ios 200 400
claude-in-mobile tap aurora 300 600
claude-in-mobile tap desktop 100 200 --companion-path /path/to/companion

# By text (searches UI tree, finds element, taps center)
claude-in-mobile tap android 0 0 --text "Login"
claude-in-mobile tap desktop 0 0 --text "Submit" --companion-path /path/to/companion

# By resource-id (Android)
claude-in-mobile tap android 0 0 --resource-id "btn_login"

# By element index from ui-dump (Android)
claude-in-mobile tap android 0 0 --index 5

Flag	Description	Platforms
--text <text>	Tap element matching text	Android, Desktop
--resource-id <id>	Tap element by resource-id	Android
--index <n>	Tap element by ui-dump index	Android

Platforms: Android, iOS, Aurora, Desktop

---

tap-text

Find an element by text, resource-id, or content-desc in the UI hierarchy and tap it. Shortcut for find + tap.

claude-in-mobile tap-text android "Submit"
claude-in-mobile tap-text ios "Login"

Platforms: Android, iOS

---

find

Search UI hierarchy for an element by text, resource-id, or content-desc. Returns element coordinates and bounds.

claude-in-mobile find android "Login"
claude-in-mobile find ios "Submit"

Platforms: Android, iOS

---

find-and-tap

Fuzzy-match an element by description and tap it. Uses confidence scoring for inexact matches.

claude-in-mobile find-and-tap "Submit Order" --min-confidence 50
claude-in-mobile find-and-tap "Cancel" --min-confidence 30

Flag	Description	Default
--min-confidence <0-100>	Minimum match confidence threshold	30

Platforms: Android only

---

long-press

Long press at coordinates or by text. Duration configurable in milliseconds.

# By coordinates
claude-in-mobile long-press android 500 800 -d 2000
claude-in-mobile long-press ios 300 600
claude-in-mobile long-press aurora 400 700

# By text (Android: finds element, long presses at center)
claude-in-mobile long-press android 0 0 --text "Delete"

Flag	Description	Default
-d, --duration <ms>	Press duration in milliseconds	1000
--text <text>	Find by text and long press	—

Platforms: Android, iOS, Aurora

---

swipe

Swipe gesture between coordinates, or by named direction (up/down/left/right).

# By coordinates (x1 y1 x2 y2)
claude-in-mobile swipe android 500 1500 500 500 -d 300

# By direction (uses screen center, swipes 400px)
claude-in-mobile swipe android 0 0 0 0 --direction up
claude-in-mobile swipe ios 0 0 0 0 --direction left
claude-in-mobile swipe aurora 0 0 0 0 --direction down

Flag	Description	Default
-d, --duration <ms>	Swipe duration in milliseconds	300
--direction <dir>	Swipe direction: up, down, left, right (overrides coordinates)	—

Platforms: Android, iOS, Aurora

---

input

Type text into the currently focused field.

claude-in-mobile input android "Hello world"
claude-in-mobile input ios "Search query"
claude-in-mobile input aurora "user@example.com"
claude-in-mobile input desktop "text" --companion-path /path/to/companion

Platforms: Android, iOS, Aurora, Desktop

---

key

Press a hardware/software key or button.

claude-in-mobile key android back
claude-in-mobile key android home
claude-in-mobile key android enter
claude-in-mobile key android power
claude-in-mobile key ios home
claude-in-mobile key aurora back
claude-in-mobile key desktop enter --companion-path /path/to/companion

Common keys: home, back, enter, power, volume_up, volume_down, tab, delete.

Platforms: Android, iOS, Aurora, Desktop

---

ui-dump

Dump the current UI hierarchy. Default format is JSON; also supports XML for Android.

claude-in-mobile ui-dump android
claude-in-mobile ui-dump android -f xml
claude-in-mobile ui-dump ios
claude-in-mobile ui-dump desktop --companion-path /path/to/companion

Flag	Description	Default
-f, --format <fmt>	Output format: json or xml	json
--show-all	Include non-interactive elements (Android)	false

Platforms: Android, iOS, Desktop

---

apps

List installed applications, optionally filtered by name.

claude-in-mobile apps android
claude-in-mobile apps android -f "myapp"
claude-in-mobile apps ios
claude-in-mobile apps aurora

Flag	Description
-f, --filter <text>	Filter by package/bundle name

Platforms: Android, iOS, Aurora

---

launch

Launch an application by package name, bundle ID, or path.

claude-in-mobile launch android com.example.app
claude-in-mobile launch ios com.example.app
claude-in-mobile launch aurora harbour-myapp
claude-in-mobile launch desktop /path/to/app --companion-path /path/to/companion

Platforms: Android, iOS, Aurora, Desktop

---

stop

Force-stop/kill an application.

claude-in-mobile stop android com.example.app
claude-in-mobile stop ios com.example.app
claude-in-mobile stop aurora harbour-myapp
claude-in-mobile stop desktop "AppName" --companion-path /path/to/companion

Platforms: Android, iOS, Aurora, Desktop

---

install

Install an application package onto the device.

claude-in-mobile install android /path/to/app.apk
claude-in-mobile install ios /path/to/app.app
claude-in-mobile install aurora /path/to/app.rpm

Platforms: Android, iOS, Aurora

---

uninstall

Remove an installed application from the device.

claude-in-mobile uninstall android com.example.app
claude-in-mobile uninstall ios com.example.app
claude-in-mobile uninstall aurora harbour-myapp

Platforms: Android, iOS, Aurora

---

push-file

Copy a local file to the device filesystem.

claude-in-mobile push-file android /local/path /sdcard/remote/path
claude-in-mobile push-file aurora /local/file /home/user/file

Platforms: Android, Aurora

---

pull-file

Copy a file from device filesystem to local machine.

claude-in-mobile pull-file android /sdcard/remote/file /local/path
claude-in-mobile pull-file aurora /home/user/file /local/file

Platforms: Android, Aurora

---

get-clipboard

Read current clipboard content from the device.

claude-in-mobile get-clipboard android
claude-in-mobile get-clipboard ios
claude-in-mobile get-clipboard desktop --companion-path /path/to/companion

Platforms: Android, iOS, Desktop

---

set-clipboard

Set clipboard content on the device.

claude-in-mobile set-clipboard android "copied text"
claude-in-mobile set-clipboard ios "copied text"
claude-in-mobile set-clipboard desktop "text" --companion-path /path/to/companion

Platforms: Android, iOS, Desktop

---

logs

Retrieve device logs. Supports line limit and filtering.

claude-in-mobile logs android -l 50
claude-in-mobile logs android -f "MyTag"
claude-in-mobile logs ios -l 200
claude-in-mobile logs aurora -l 100

Flag	Description	Default
-l, --lines <n>	Number of log lines to retrieve	100
-f, --filter <text>	Filter by tag/process/text	—
--level <V/D/I/W/E/F>	Log level filter (Android)	—
--tag <tag>	Filter by tag (Android)	—
--package <pkg>	Filter by package name (Android)	—

Platforms: Android, iOS, Aurora

---

clear-logs

Clear all device logs.

claude-in-mobile clear-logs android
claude-in-mobile clear-logs ios
claude-in-mobile clear-logs aurora

Platforms: Android, iOS, Aurora

---

system-info

Get device system information (battery, memory, OS version, etc.).

claude-in-mobile system-info android
claude-in-mobile system-info ios
claude-in-mobile system-info aurora

Platforms: Android, iOS, Aurora

---

current-activity

Get the currently displayed activity or foreground app.

claude-in-mobile current-activity android
claude-in-mobile current-activity ios

Platforms: Android, iOS

---

reboot

Reboot the device or restart the simulator.

claude-in-mobile reboot android
claude-in-mobile reboot ios

Platforms: Android, iOS

---

screen

Control screen power state (turn display on/off).

claude-in-mobile screen on
claude-in-mobile screen off

Platforms: Android only

---

open-url

Open a URL in the device's default browser.

claude-in-mobile open-url android "https://example.com"
claude-in-mobile open-url ios "https://example.com"
claude-in-mobile open-url aurora "https://example.com"

Platforms: Android, iOS, Aurora

---

shell

Execute an arbitrary shell command on the device.

claude-in-mobile shell android "ls /sdcard"
claude-in-mobile shell ios "ls ~/Documents"
claude-in-mobile shell aurora "uname -a"

Platforms: Android, iOS, Aurora

---

wait

Pause execution for a specified duration. Useful in automation scripts between actions.

claude-in-mobile wait 2000    # wait 2 seconds
claude-in-mobile wait 500     # wait 500ms

Platforms: cross-platform (no device interaction)

---

get-window-info

List all open desktop windows with their IDs, titles, positions, and sizes.

claude-in-mobile get-window-info --companion-path /path/to/companion

Platforms: Desktop only

---

focus-window

Bring a desktop window to front by its ID (from get-window-info).

claude-in-mobile focus-window "window-id" --companion-path /path/to/companion

Platforms: Desktop only

---

resize-window

Resize a desktop window to specified width and height.

claude-in-mobile resize-window "window-id" 800 600 --companion-path /path/to/companion

Platforms: Desktop only

---

launch-desktop-app

Launch a desktop application by path.

claude-in-mobile launch-desktop-app /path/to/app --companion-path /path/to/companion

Platforms: Desktop only

---

stop-desktop-app

Stop a running desktop application by name.

claude-in-mobile stop-desktop-app "AppName" --companion-path /path/to/companion

Platforms: Desktop only

---

get-performance-metrics

Get CPU/memory usage metrics for running desktop applications.

claude-in-mobile get-performance-metrics --companion-path /path/to/companion

Platforms: Desktop only

---

get-monitors

List connected monitors with resolutions and positions.

claude-in-mobile get-monitors --companion-path /path/to/companion

Platforms: Desktop only

---

Additional Resources

For full platform support matrix and per-platform details (backends, supported/unsupported commands), see references/platform-support.md.

Tips

• Use --compress on screenshots when sending to LLM — reduces token usage significantly
• analyze-screen gives structured JSON of buttons/inputs/texts — useful for automated testing
• find-and-tap uses fuzzy matching with confidence scoring — good for flaky element names
• Aurora commands use audb (Aurora Debug Bridge) — similar to ADB
• Desktop commands communicate via JSON-RPC with a companion app over stdin/stdout
• Combine ui-dump + tap --index N for reliable element interaction by index
• Use wait between actions in automation scripts to allow UI transitions