A specialized Linux automation tool that translates AI-perceived screen coordinates into precise HiDPI hardware clicks.
Install & Download
1. ClawHub CLI
The fastest way to install a skill directly from the registry.
npx clawhub@latest install hidpi-mouse
2. Manual Installation
Copy the skill folder to one of these locations
~/.openclaw/skills/ <project>/skills/ Priority: Workspace > Local > Bundled
3. Prompt Installation
Copy this prompt to OpenClaw to install it automatically.
Help me install hidpi-mouse using Clawhub. If Clawhub is not installed, install it first (npm i -g clawhub).
Prefer to download?
Get the raw skill files in a ZIP archive.
What is HiDPI Mouse Click Handler?
HiDPI Mouse is a robust utility designed to solve the common issue of coordinate misalignment in AI-driven desktop automation. When using Openclaw Skills for Linux tasks, AI agents often view downscaled screenshots, leading to missed clicks on high-resolution or Retina displays. This skill provides a seamless translation layer between the display viewport and actual system screen coordinates.
By automating the calculation of scale factors across various resolutions and DPI settings, it ensures that every interaction—whether a single click, double click, or drag-and-drop—lands exactly where intended. This is an essential component for developers building reliable agents that need to navigate complex Linux GUIs without manual coordinate hardcoding.
HiDPI Mouse Click Handler Use Cases
- Automating GUI interactions on 4K or HiDPI Linux displays where standard coordinates fail.
- Ensuring AI agent precision when interacting with applications through downscaled screenshots.
- Scaling desktop automation scripts across different hardware configurations from 1080p to 4K+.
- Handling complex mouse operations like dragging and relative clicking in headless or remote desktop environments.
How HiDPI Mouse Click Handler Works
- The AI agent captures a screenshot of the Linux desktop environment.
- Target UI elements are identified based on the coordinates seen in the downscaled display view.
- The skill detects the current system screen resolution and DPI settings to determine the necessary scale factor.
- Mathematical translation maps the display-relative points to the absolute hardware screen coordinates.
- The skill executes the interaction via xdotool to perform the precise mouse action on the host system.
HiDPI Mouse Click Handler Setup
Ensure the necessary system dependencies are installed on your Linux environment:
sudo apt-get install xdotool scrot python3
To ensure perfect accuracy for your specific monitor setup, run the interactive calibration script included in the Openclaw Skills package:
./scripts/calibrate.sh
You can verify your current configuration at any time using:
./scripts/calibrate.sh info
HiDPI Mouse Click Handler Data Schema & Taxonomy
The skill manages its configuration and state through specific file paths and metadata structures:
| Path | Type | Purpose |
|---|---|---|
~/.config/hidpi-mouse/scale.conf |
Configuration | Persistent user-defined scale overrides (highest priority). |
/tmp/hidpi_scale_cache |
Cache | Temporary storage for auto-detected scale factors with a 1-hour TTL. |
scripts/ |
Executables | Collection of bash utilities for coordinate conversion and mouse control. |
HiDPI Mouse Click Handler Advanced Features
- Interactive calibration wizard that uses visual markers to achieve pixel-perfect input accuracy.
- Support for raw coordinate overrides using the --raw flag for scripts that do not require scaling.
- Reliable click functionality that supports window-specific targeting and relative offsets.
- Automated scale factor detection supporting a wide range of DPI settings (96 to 192+).
- Seamless integration with existing Openclaw Skills to enhance multi-agent desktop workflows.
SKILL.md
Loading
Related Openclaw Skills
hume-x
A comprehensive X/Twitter CLI and SDK leveraging GraphQL and cookie-based authentication for full platform engagement and automation.
Raindrop Bookmark Sync
Sync and automate the ingestion of Raindrop.io bookmarks into your AI-driven knowledge base using Openclaw Skills.
PR Triage
An AI-powered pull request assistant that identifies duplicate submissions, scores contribution quality, and generates prioritized triage reports.
Interesting Finding Link Digest
An automated workflow that transforms shared Discord links into analyzed summaries and structured local knowledge base entries.
SearXNG Search
A privacy-focused web search skill that connects AI agents to SearXNG instances using the Model Context Protocol.
Nova App Builder
An end-to-end automation skill for building, deploying, and verifying Trusted Execution Environment (TEE) applications on the Nova Platform.
Featured*
