An advanced scraping engine designed to bypass anti-bot protections through multi-layer evasion techniques and residential proxy rotation.
Install & Download
1. ClawHub CLI
The fastest way to install a skill directly from the registry.
npx clawhub@latest install stealth-scraper
2. Manual Installation
Copy the skill folder to one of these locations
~/.openclaw/skills/ <project>/skills/ Priority: Workspace > Local > Bundled
3. Prompt Installation
Copy this prompt to OpenClaw to install it automatically.
Help me install stealth-scraper using Clawhub. If Clawhub is not installed, install it first (npm i -g clawhub).
Prefer to download?
Get the raw skill files in a ZIP archive.
What is Stealth Web Scraper?
The Stealth Web Scraper is a sophisticated toolset designed for developers who need to extract data from websites protected by aggressive anti-bot systems. By leveraging Openclaw Skills, this tool implements a multi-layer detection stack that addresses IP reputation, TLS fingerprints, and behavioral analysis. It ensures that automated requests are indistinguishable from real human browsing, allowing for seamless data collection at scale.
This skill is particularly effective against major security providers like Cloudflare, DataDome, and Akamai. It moves beyond simple HTTP requests by managing browser fingerprinting and implementing human-like navigation patterns. By integrating this into your workflow, you can maintain high success rates and avoid the common pitfalls of IP bans and CAPTCHA challenges that plague traditional scraping methods.
Stealth Web Scraper Use Cases
- Extracting data from sites protected by Cloudflare, DataDome, PerimeterX, or Akamai.
- Scaling web scraping operations without triggering IP-based rate limits or bans.
- Accessing geo-locked content via residential proxy rotation across 195+ countries.
- Automating browser-based tasks that require human-like interaction and timing.
- Bypassing 403 Forbidden and 429 Too Many Requests errors on sensitive domains.
How Stealth Web Scraper Works
- The skill identifies the target site's protection level and selects the appropriate residential proxy endpoint.
- It configures the browser tool or HTTP client with a specific TLS fingerprint (e.g., Chrome 131) to pass handshake validation.
- The automation engine spoofs navigator properties and removes the WebDriver flag to hide bot signatures.
- It executes human-like behavioral patterns, including randomized Gaussian delays and incremental scrolling.
- The system maintains session persistence using sticky proxies to handle multi-page navigation or login flows.
- Data is extracted once the anti-bot challenges have been successfully resolved by the stealth browser environment.
Stealth Web Scraper Setup
To initialize the stealth environment for Openclaw Skills, configure your proxy credentials and environment variables as follows:
# Set residential proxy environment variables
export HTTP_PROXY=http://USER:[email protected]:7777
export HTTPS_PROXY=http://USER:[email protected]:7777
For browser-based automation, apply the proxy configuration within your tool settings:
{
"browser": {
"proxy": {
"server": "http://gate.birdproxies.com:7777",
"username": "USER",
"password": "PASS"
}
}
}
Stealth Web Scraper Data Schema & Taxonomy
The skill utilizes a structured approach to proxy and session management to ensure anonymity. The following table describes the configuration parameters:
| Component | Configuration Format | Function |
|---|---|---|
| Proxy Server | gate.birdproxies.com:7777 |
Primary residential gateway. |
| Rotation Strategy | USER-session-randomID |
Maintains IP persistence for specific tasks. |
| Geo-Targeting | USER-country-us |
Routes traffic through real household IPs in specific regions. |
| TLS Impersonation | impersonate="chrome131" |
Matches the JA3/JA4 fingerprint of a real browser. |
| Viewport | 1920x1080 |
Sets a standard desktop resolution to avoid detection. |
Stealth Web Scraper Advanced Features
- Multi-layer evasion covering IP reputation, TLS, and browser fingerprints.
- Integration with curl_cffi for high-performance TLS impersonation without a full browser overhead.
- Automatic navigator property spoofing including WebGL, canvas, and permissions overrides.
- Dynamic behavioral simulation with randomized mouse movements and scroll patterns.
- Sticky session management to bypass Cloudflare Turnstile and JS challenges.
- Specialized bypass logic tailored for DataDome and Akamai Bot Manager.
SKILL.md
Loading
Related Openclaw Skills
Social Media Scraper
A high-performance data extraction tool designed to scrape profiles, posts, and engagement metrics from major social media platforms using residential proxies.
SMMA Agency Proxy
A professional framework for managing multiple social media clients using dedicated proxy isolation to prevent account bans and scale agency operations.
SERP Scraper (Google Search Results)
A comprehensive tool for extracting Google Search Engine Results Page data to power SEO analysis and competitive market research.
Scraping Recipes
A collection of pre-configured scraping strategies for major websites with built-in proxy rotation and anti-detection logic.
TikTok Account Farming
Automate the entire lifecycle of high-volume TikTok account management using mobile-grade residential proxies to bypass detection.
Tinder Dating Automation
A comprehensive automation suite for managing multiple dating app profiles, performing A/B testing, and bypassing ban detection with residential proxies.
Featured*
