A high-performance web scraping tool powered by Playwright, specifically engineered to bypass Cloudflare and sophisticated anti-bot protections.
Install & Download
1. ClawHub CLI
The fastest way to install a skill directly from the registry.
npx clawhub@latest install playwright-scraper-skill-1-2-0
2. Manual Installation
Copy the skill folder to one of these locations
~/.openclaw/skills/ <project>/skills/ Priority: Workspace > Local > Bundled
3. Prompt Installation
Copy this prompt to OpenClaw to install it automatically.
Help me install playwright-scraper-skill-1-2-0 using Clawhub. If Clawhub is not installed, install it first (npm i -g clawhub).
Prefer to download?
Get the raw skill files in a ZIP archive.
What is Playwright Scraper Skill?
The Playwright Scraper Skill is a professional-grade web extraction framework designed for the Openclaw Skills ecosystem. It provides developers with a tiered approach to web scraping, ranging from simple JavaScript-enabled fetches to highly sophisticated stealth operations that mimic human behavior. By leveraging the Playwright library, this skill can navigate complex, dynamic websites that traditional scrapers fail to access.
At its core, the skill focuses on reliability and framework independence. It has been rigorously tested against high-security targets like Discuss.com.hk, achieving a 100% success rate where other tools were blocked. Whether you need a quick data pull or a stealthy operation to bypass advanced bot detection, this skill provides the necessary scripts and configurations to get the job done efficiently within Openclaw Skills.
Playwright Scraper Skill Use Cases
- Scraping dynamic, JavaScript-heavy websites that require full browser rendering.
- Bypassing Cloudflare, 403 Forbidden errors, and other high-level anti-bot challenges.
- Automating the capture of website screenshots and HTML snapshots for visual regression or archival.
- Extracting structured data from specialized platforms like YouTube and Reddit via integrated sub-skills.
- Implementing automated research workflows that require data from protected community forums.
How Playwright Scraper Skill Works
- The user identifies the target website's protection level and selects the corresponding script (Simple or Stealth).
- The skill initializes a Chromium instance via Playwright, applying specific anti-fingerprinting techniques.
- For protected sites, the script injects initialization scripts to hide automation markers like navigator.webdriver.
- Realistic User-Agents and human-like interaction patterns, such as random delays, are applied to the session.
- The browser navigates to the URL, waits for the specified load state or timeout, and extracts the required data.
- The skill outputs a structured JSON object containing the URL, page title, content, and execution timing.
Playwright Scraper Skill Setup
To get started with this skill in your environment, follow these installation steps:
# Navigate to the skill directory
cd playwright-scraper-skill
# Install NPM dependencies
npm install
# Install the necessary Chromium browser binaries
npx playwright install chromium
Playwright Scraper Skill Data Schema & Taxonomy
The skill returns data in a clean, structured JSON format. Below is the primary schema for the scraper output:
| Property | Type | Description |
|---|---|---|
url |
String | The final destination URL of the scrape |
title |
String | The meta title of the web page |
content |
String | The extracted text or HTML content |
elapsedSeconds |
String | Total time taken for the scraping operation |
screenshot |
Path | (Optional) Path to the generated PNG file in stealth mode |
Playwright Scraper Skill Advanced Features
- Stealth Injection: Uses addInitScript to neutralize bot detection before the page even loads.
- Environmental Control: Fine-tune scraping via environment variables like
HEADLESS=false,WAIT_TIME, andUSER_AGENT. - Multi-Method Support: Seamlessly switch between built-in web_fetch and dedicated Playwright scripts based on site response.
- Human Mimicry: Implements random delay logic and scrolling behavior to bypass behavioral analysis bots.
- Extension Ready: Designed to work alongside other Openclaw Skills such as deep-scraper for specialized media extraction.
SKILL.md
Loading
Related Openclaw Skills
Playwright MCP
A high-performance browser automation skill that enables AI agents to control web browsers, navigate sites, and interact with elements via the Model Context Protocol.
n8n Workflow Automation
A specialized skill for designing production-grade n8n workflows featuring built-in error handling, idempotency, and comprehensive audit logging.
Elite Longterm Memory
A robust multi-layer memory architecture for AI agents that ensures persistent context across sessions using vector search, git-notes, and a Write-Ahead Log protocol.
Backtest Expert
A professional framework for the rigorous validation and stress-testing of systematic trading strategies to ensure real-world robustness.
Polymarket
A comprehensive CLI toolkit for querying Polymarket prediction data, tracking market momentum, and simulated paper trading.
Tandoor Recipes
A powerful integration for Openclaw Skills that enables AI agents to manage recipes, meal plans, and shopping lists within a Tandoor Recipe Manager instance.
Featured*
