A sophisticated Playwright-based scraping engine for Openclaw Skills that bypasses Cloudflare and anti-bot security.
Install & Download
1. ClawHub CLI
The fastest way to install a skill directly from the registry.
npx clawhub@latest install coco-playwright-stealth
2. Manual Installation
Copy the skill folder to one of these locations
~/.openclaw/skills/ <project>/skills/ Priority: Workspace > Local > Bundled
3. Prompt Installation
Copy this prompt to OpenClaw to install it automatically.
Help me install coco-playwright-stealth using Clawhub. If Clawhub is not installed, install it first (npm i -g clawhub).
Prefer to download?
Get the raw skill files in a ZIP archive.
What is Playwright Scraper Skill?
The Playwright Scraper Skill is a high-performance web extraction tool built to handle the complexities of the modern web. As a key component of the Openclaw Skills library, it allows users to navigate beyond simple static HTML, providing the capability to render JavaScript and interact with dynamic elements. Its primary value lies in its tiered approach to scraping, offering specialized methods for different security environments.
Whether you are dealing with basic sites or websites protected by advanced systems like Cloudflare, this skill provides the necessary stealth and automation hooks to ensure successful data retrieval. It is designed to be framework-independent, focusing on browser-level manipulation to avoid detection by common bot-detection algorithms.
Playwright Scraper Skill Use Cases
- Scraping dynamic, JavaScript-heavy single-page applications (SPAs).
- Bypassing Cloudflare or 403 Forbidden errors on high-security websites.
- Extracting content from community forums like Discuss.com.hk which employ strict anti-bot measures.
- Automating data collection tasks that require realistic human-like browsing behavior.
How Playwright Scraper Skill Works
- The user selects a scraping method based on the target site security (Simple vs. Stealth).
- For protected sites, the skill initializes a Playwright instance with custom stealth configurations to hide automation signatures.
- The skill injects initialization scripts to set navigator.webdriver to false and mimics realistic mobile or desktop User-Agents.
- It executes the navigation, implementing random delays and scroll behaviors to simulate human interaction.
- Upon completion, the skill extracts the desired content, captures screenshots for verification, and returns a structured JSON object to the Openclaw Skills environment.
Playwright Scraper Skill Setup
To install the Playwright Scraper Skill, run the following commands in your terminal:
cd playwright-scraper-skill
npm install
npx playwright install chromium
Playwright Scraper Skill Data Schema & Taxonomy
The skill returns structured data in JSON format and can save supplementary files. The standard output schema includes:
| Key | Type | Description |
|---|---|---|
| url | String | The final URL processed by the scraper |
| title | String | The metadata title of the page |
| content | String | The extracted text or HTML content |
| elapsedSeconds | String | Total execution time for the request |
| screenshot | File (Optional) | A PNG file of the rendered page for debugging |
| html_path | File (Optional) | The raw HTML source saved to disk |
Playwright Scraper Skill Advanced Features
- Stealth Mode: Advanced anti-bot measures including automation marker hiding and realistic User-Agent rotation.
- Environment Variable Support: Fully configurable through variables like WAIT_TIME, HEADLESS, and SAVE_HTML.
- Human Mimicry: Built-in support for random delays and custom initialization scripts via addInitScript.
- Headful Debugging: Capability to run in non-headless mode to observe browser interactions in real-time.
- Special Site Handlers: Easy integration with other Openclaw Skills like deep-scraper for specialized YouTube and Reddit extraction.
SKILL.md
Loading
Related Openclaw Skills
Clawrma
Clawrma is a versatile utility for web fetching, search, and inference that serves as a reliable fallback for agentic workflows.
Permission Guard
A layered security and permission management system designed to intercept dangerous AI agent commands and protect local environments.
Approval and Workflow Management Agent
An AI-powered assistant for managing corporate approvals, leave requests, and pending enterprise tasks.
MOV to MP4 Converter
A powerful cloud-based tool to instantly convert Apple MOV files into universally compatible MP4 videos without quality loss.
Fund Buying Decision
A sophisticated framework for parameterizing and executing Chinese mutual fund strategies based on price drawdown, DCA, and cash-pool management.
Nightly Dream - Memory Consolidation System
A biologically-inspired memory consolidation system that distills daily fragments of AI interactions into structured long-term knowledge.
Featured*
