Agent Android for Openclaw

A local-first automation skill for controlling Android devices over a network without requiring USB connections, ADB, or root access.

crazytigerman
v0.1.6
Apr 16, 2026
1
1.1k
0

Install & Download

1. ClawHub CLI

The fastest way to install a skill directly from the registry.

npx clawhub@latest install agent-android

2. Manual Installation

Copy the skill folder to one of these locations

Global
~/.openclaw/skills/
Workspace
<project>/skills/

Priority: Workspace > Local > Bundled

3. Prompt Installation

Copy this prompt to OpenClaw to install it automatically.

Help me install agent-android using Clawhub. If Clawhub is not installed, install it first (npm i -g clawhub).

Prefer to download?

Get the raw skill files in a ZIP archive.

What is Agent Android?

Agent Android is a powerful addition to the library of Openclaw Skills designed for remote device interaction and robotic process automation (RPA). It allows an AI agent to drive an Android device through a lightweight HTTP service hosted directly on the phone. This skill operates on a local-first principle, ensuring that UI reads, taps, inputs, and screenshots remain within your local area network (LAN) for maximum privacy and performance. By bypassing the need for traditional developer tools like ADB, it simplifies the workflow for non-technical setups while providing deep technical access to the device UI tree.

Agent Android Use Cases

  • Automating repetitive tasks within Android applications
  • Performing remote mobile app testing and UI verification
  • Navigating Android interfaces via AI voice or text commands
  • Extracting data from mobile apps that do not offer public APIs
  • Managing Android devices across a local network without physical tethering

How Agent Android Works

  1. Confirm network connectivity by hitting the device's health endpoint to ensure the service is active.
  2. Discover available applications using the apps discovery command to identify the target package.
  3. Launch the desired application to bring it to the foreground of the Android device.
  4. Inspect the current UI tree to map out resource IDs, text labels, and element bounds.
  5. Perform a specific action such as a tap, swipe, or text input based on the mapped UI elements.
  6. Refresh the UI tree inspection to verify the result of the action and prepare for the next step in the loop.

Agent Android Setup

To get started with this skill from the Openclaw Skills collection, ensure the CLI is available on your path. Install it using the uv package manager:

uv tool install aivane-agent-android
uv tool update-shell

You must also have the AIVane app running on your Android device to host the local API service at a URL like http://<device-ip>:8080.

Agent Android Data Schema & Taxonomy

The skill organizes data primarily through the Android UI hierarchy and metadata. Information is structured as follows:

Data Type Description
UI Tree A hierarchical representation of all visible screen elements and their attributes.
RefID A temporary session-based integer assigned to elements for quick REPL interaction.
Resource ID The native Android developer-defined ID for specific UI components.
XPath Dynamically generated path strings used to uniquely identify elements in complex layouts.
Attributes Metadata for elements including text, class, bounds, and clickable status.

Agent Android Advanced Features

  • Interactive REPL mode for exploratory device control and real-time debugging.
  • Advanced XPath support to generate and validate unique element selectors on the fly.
  • Screen capture capabilities to save snapshots for visual verification or AI analysis.
  • Comprehensive input handling including clearing fields and specialized system key presses like Home and Back.
  • Waiting mechanisms that allow the agent to pause until specific text or elements appear on the screen.

SKILL.md


Loading

Related Openclaw Skills

METADATA

Requires
Bins agent-android
Github Stars: 0
forks: 0

Featured*