A natural language to Midscene script generator supporting Web, Mobile, and Desktop platforms.
Install & Download
1. ClawHub CLI
The fastest way to install a skill directly from the registry.
npx clawhub@latest install nl2ms-ui
2. Manual Installation
Copy the skill folder to one of these locations
~/.openclaw/skills/ <project>/skills/ Priority: Workspace > Local > Bundled
3. Prompt Installation
Copy this prompt to OpenClaw to install it automatically.
Help me install nl2ms-ui using Clawhub. If Clawhub is not installed, install it first (npm i -g clawhub).
Prefer to download?
Get the raw skill files in a ZIP archive.
What is nl2ms-ui?
nl2ms-ui is a specialized automation bridge designed to convert natural language descriptions into executable Midscene scripts. By utilizing the Midscene API, this skill empowers developers to describe UI interactions in plain English and receive fully functional automation code for Web, Android, iOS, and PC environments. As a key component of the Openclaw Skills ecosystem, it significantly reduces the barrier to entry for cross-platform UI testing and robotic process automation.
This skill is particularly effective for teams looking to standardize their automation workflows across different operating systems. It supports both YAML and TypeScript outputs, allowing it to fit into modern CI/CD pipelines and developer local environments with minimal friction.
nl2ms-ui Use Cases
- Creating Android mobile application automation scripts from plain text descriptions.
- Generating iOS UI testing workflows for native mobile apps.
- Developing Web browser automation scripts for rapid end-to-end testing.
- Building PC desktop application automation routines for legacy or modern software.
- Accelerating the development of test suites within Openclaw Skills based projects.
How nl2ms-ui Works
- The user inputs a natural language prompt describing a sequence of UI actions.
- The skill analyzes the request to determine the target platform (Web, Android, iOS, or PC).
- It references optimized platform-specific logic and examples (YAML or TypeScript) from the internal library.
- Using the Midscene API, the skill generates a structured script that includes descriptive step names and logical flow.
- The skill applies best practices such as dynamic waiting and error handling before delivering the final code.
nl2ms-ui Setup
To get started with this skill, ensure your environment is configured to interact with the Midscene API.
# Install the necessary Midscene dependencies
npm install -g @midscene/cli
# Configure your environment variables
echo "MIDSCENE_API_KEY=your_api_key_here" >> .env
Ensure that your target device (emulator, real device, or browser) is accessible to the Midscene driver.
nl2ms-ui Data Schema & Taxonomy
The skill organizes its output based on the platform and format requested. It utilizes a structured reference system to ensure high-quality script generation.
| Data Type | Description | File Extension |
|---|---|---|
| Web Scripts | Automation for browsers | .yaml / .ts |
| Mobile Scripts | Android and iOS logic | .yaml / .ts |
| Desktop Scripts | PC application routines | .yaml / .ts |
| Configuration | Environment and API settings | .env |
| References | Platform-specific examples | .md |
nl2ms-ui Advanced Features
- Support for aiWaitFor mechanisms to ensure reliable execution without hard-coded sleep timers.
- Robust error handling using continueOnError or try-catch patterns for optional steps.
- Integration with .env management for secure API key handling and aiActionContext configuration.
- Flexible output options allowing users to choose between YAML for simplicity or TypeScript for complex logic.
- High compatibility with the Openclaw Skills framework for multi-agent automation orchestration.
SKILL.md
Loading
Related Openclaw Skills
Solana Sniper Architect
A specialized coding assistant that generates high-frequency Solana trading bots using Jupiter v6 and DexScreener.
Skill Security Guide
A technical manual for developers to ensure their AI coding agent skills meet security standards and receive benign ratings on ClawHub.
Hunyuan 3D Generator
A professional AI tool for generating high-quality 3D assets from text descriptions or images via the Tencent Hunyuan model.
Story Music Assistant
A comprehensive AI skill for generating multi-genre stories integrated with dynamic background music and professional voice-over narration.
Skillagi
A lightweight persistent memory skill for AI agents to log and recall project-specific mistakes and best practices.
2026 Milan Winter Olympics Data Fetcher
A comprehensive data retrieval skill for the 2026 Milan Winter Olympics providing real-time medal standings, news reports, and competition schedules.
Featured*
