A powerful tool for discovering and executing Apify Actors to scrape structured data from social media and websites.
Install & Download
1. ClawHub CLI
The fastest way to install a skill directly from the registry.
npx clawhub@latest install apify-runner
2. Manual Installation
Copy the skill folder to one of these locations
~/.openclaw/skills/ <project>/skills/ Priority: Workspace > Local > Bundled
3. Prompt Installation
Copy this prompt to OpenClaw to install it automatically.
Help me install apify-runner using Clawhub. If Clawhub is not installed, install it first (npm i -g clawhub).
Prefer to download?
Get the raw skill files in a ZIP archive.
What is Apify Web Scraping & Data Extraction?
The Apify skill provides a standardized framework for executing complex web scraping tasks through the Apify platform. It automates the entire lifecycle of data extraction—from identifying the best-performing scraper for a specific platform to validating input schemas and managing batched execution. By integrating this capability into Openclaw Skills, developers can programmatically access structured data from Instagram, TikTok, Reddit, and thousands of other sites without manual configuration.
This skill is designed to handle the technical nuances of web crawling, including Actor discovery, quality filtering, and probe testing to ensure reliability. It effectively turns natural language scraping requests into precise, executable workflows that deliver clean JSON data for further analysis or integration.
Apify Web Scraping & Data Extraction Use Cases
- Automated scraping of social media profiles and posts for market research and sentiment analysis.
- Monitoring Reddit communities or specific hashtags for real-time trend tracking.
- High-volume data collection through automated, batched execution of Apify Actors.
- Programmatic discovery of high-quality, high-rated scrapers for specific web targets to ensure data accuracy.
How Apify Web Scraping & Data Extraction Works
- Intent Parsing: The skill extracts the platform, specific targets (URLs or keywords), and filters from the user's natural language request.
- Actor Discovery: It utilizes a specialized search script to find top-rated Actors based on success rates, user ratings, and pricing models.
- Schema Validation: The skill fetches the specific Actor's documentation to construct a valid JSON input schema automatically, ensuring all required fields are met.
- Probe Testing: Before committing to a full run, a minimal test run is performed to verify the Actor is functional and permissions are valid.
- Execution & Collection: The full scraping task is executed with built-in support for batching and rate-limit management, saving the final results to a local JSON file.
Apify Web Scraping & Data Extraction Setup
To get started with this skill within the Openclaw Skills ecosystem, ensure you have your credentials and environment ready:
# Set your Apify API Token as an environment variable
export APIFY_TOKEN='your_api_token_here'
# Alternatively, configure tokens in config.json
cp config.json.example config.json
# Ensure Python dependencies are installed
pip install requests
Apify Web Scraping & Data Extraction Data Schema & Taxonomy
The skill manages data through structured JSON outputs and configuration mappings to maintain high data integrity.
| Component | Description |
|---|---|
config.json |
Stores API tokens and account mappings for multi-account support. |
run_input |
The dynamically generated JSON payload required by the specific Apify Actor. |
results.json |
The final structured output containing the extracted web data. |
search_results |
Metadata for ranked Actors, including success rates and 30-day run counts. |
Apify Web Scraping & Data Extraction Advanced Features
- Automated Quality Filters: Only selects Actors with a 95%+ success rate and a 4.0+ user rating.
- Intelligent Batching: Automatically splits large requests into manageable batches with configurable pauses to avoid timeouts.
- Multi-Token Management: Support for multiple Apify accounts through a central configuration file.
- Robust Fallback Logic: If a top-ranked Actor fails a probe test, the skill automatically attempts the next best candidate.
- Probe-Only Mode: Validates scraper logic and permissions before initiating billing-intensive runs.
SKILL.md
Loading
Related Openclaw Skills
DrawThings Image Generation
A high-performance local image generation skill that interfaces with DrawThings to provide Stable Diffusion capabilities via an API on macOS.
ProtonMail Skill
A specialized toolset for reading, searching, and scanning ProtonMail accounts via secure IMAP bridges like Proton Bridge or hydroxide.
Duola Lobster Agent
An institutional-grade execution playbook for the Duola Polymarket copy-trading CLI within agent workflows.
med-info
A specialized tool for fetching authoritative, label-backed medication answers with traceable identifiers and regulatory safety context.
Intercom Conversations Read
A specialized tool for listing, finding, and searching Intercom customer conversations via a structured JSON interface.
AI Image Generation (gen-image)
A high-performance skill for generating AI images using industry-leading models like FLUX and Kolors through the SiliconFlow API.
Featured*
