Desktop Mouse Control for Openclaw

A specialized Linux utility for programmatic mouse control via the host gateway using a ydotool wrapper.

oguzhaslak
v1.0.0
Jan 31, 2026
3
3.5k
0

Install & Download

1. ClawHub CLI

The fastest way to install a skill directly from the registry.

npx clawhub@latest install molt-mouse

2. Manual Installation

Copy the skill folder to one of these locations

Global
~/.openclaw/skills/
Workspace
<project>/skills/

Priority: Workspace > Local > Bundled

3. Prompt Installation

Copy this prompt to OpenClaw to install it automatically.

Help me install molt-mouse using Clawhub. If Clawhub is not installed, install it first (npm i -g clawhub).

Prefer to download?

Get the raw skill files in a ZIP archive.

What is Desktop Mouse Control?

The Desktop Mouse Control skill provides AI agents with the ability to physically interact with a Linux desktop environment. By serving as a high-level wrapper for ydotool, it enables the execution of precise mouse movements and click events through the host gateway. This tool is essential for expanding the capabilities of Openclaw Skills beyond text-based interactions, allowing for full GUI automation and desktop navigation.

Built specifically for Linux systems, this skill leverages the molt-mouse binary to translate agent intentions into hardware-level events. It serves as a bridge for agents to click buttons, move windows, and navigate interfaces that do not offer native API access.

Desktop Mouse Control Use Cases

  • Automating interactions with legacy desktop applications that lack APIs
  • Performing automated GUI testing and quality assurance on Linux environments
  • Assisting with accessibility workflows by translating text commands to mouse actions
  • Navigating complex desktop layouts within broader Openclaw Skills workflows

How Desktop Mouse Control Works

  1. The AI agent determines that a physical mouse action is required to fulfill a user request.
  2. The agent formats a command using the molt-mouse syntax for relative or absolute movement.
  3. The command is dispatched using the exec tool directed at the host gateway.
  4. The molt-mouse binary processes the input and communicates with ydotool.
  5. The system executes the mouse move or click event on the local desktop session.

Desktop Mouse Control Setup

To use this skill, ensure that your Linux environment has ydotool and the molt-mouse binary installed and accessible in your system path. This skill is part of the internal Openclaw Skills library and is triggered through the gateway host.

# Verify molt-mouse installation
molt-mouse --version

# Ensure the ydotool daemon is running
ydotoolrd

Desktop Mouse Control Data Schema & Taxonomy

The skill utilizes a command-based schema for interaction. No persistent data is stored, as it operates as a real-time execution wrapper. Supported commands include:

Command Arguments Description
move <dx> <dy> Moves the cursor relative to current position
abs <x> <y> Moves the cursor to absolute screen coordinates
click left, right, middle Executes a standard button click
click 0x40, 0x80 Advanced hold (0x40) or release (0x80) actions

Commands must always be prefixed with molt-mouse and executed via the gateway.

Desktop Mouse Control Advanced Features

  • Hexadecimal button support for complex drag-and-drop or hold actions
  • Absolute coordinate mapping for multi-monitor or high-resolution setups
  • Gateway-level execution for secure agent-to-host interaction within the Openclaw Skills framework
  • Minimal latency wrapper designed for rapid-fire automation sequences

SKILL.md


Loading

Related Openclaw Skills

METADATA

Github Stars: 0
forks: 0

Featured*