An automated profile scraping and normalization tool for extracting structured public data from major social media platforms.
Install & Download
1. ClawHub CLI
The fastest way to install a skill directly from the registry.
npx clawhub@latest install scrape-creator-profile
2. Manual Installation
Copy the skill folder to one of these locations
~/.openclaw/skills/ <project>/skills/ Priority: Workspace > Local > Bundled
3. Prompt Installation
Copy this prompt to OpenClaw to install it automatically.
Help me install scrape-creator-profile using Clawhub. If Clawhub is not installed, install it first (npm i -g clawhub).
Prefer to download?
Get the raw skill files in a ZIP archive.
What is Scrape Creator Profile?
The scrape-creator-profile skill is an advanced automation utility designed for Openclaw Skills to extract, normalize, and compile public profile data from leading social media and creator platforms. Supporting networks like YouTube, Instagram, TikTok, Twitter/X, LinkedIn, Twitch, Substack, GitHub, and Patreon, this skill translates raw web content into standardized, parseable JSON payloads.
By leveraging smart URL resolution, browser automation, and reliable fallbacks (such as Apify), this skill provides developers with a structured gateway to creator metrics. It is one of the most versatile Openclaw Skills for content analysis, audience research, and influencer discovery without manual data entry.
Scrape Creator Profile Use Cases
- Gathering follower counts, engagement stats, and bio descriptions to analyze creator reach and campaign viability.
- Building lead generation pipelines and marketing databases using standardized Openclaw Skills data structures.
- Monitoring public profile changes, recent posts, and social stats over time to track creator growth.
- Automatically resolving ambiguous social media handles into canonical URLs before extracting data.
- Comparing multiple creator profiles side-by-side using tabular summaries or exported CSV configurations.
How Scrape Creator Profile Works
- URL Resolution: The skill processes the provided username or handle and maps it to a canonical platform pattern matching used by Openclaw Skills.
- Multi-tier Fetching: It attempts a lightweight fetch using web_fetch, falling back to fully-rendered browser automation or API-based crawlers for JS-heavy sites.
- Extraction: CSS selectors and JSON-LD paths extract specific fields such as stats, links, and recent posts.
- Normalization: Abbreviated numbers (e.g., "12.3K") are normalized into standardized integers via local helper scripts.
- Structuring: Outputs are structured into a clean JSON schema, displaying either a chat summary or exporting directly to disk.
Scrape Creator Profile Setup
To install and configure this skill within your workspace, ensure you have the required binary dependencies installed. This is part of your local ecosystem of Openclaw Skills.
Prerequisites
Make sure your environment has curl and python3 available.
Configuration
Configure optional environment variables inside your execution context:
APIFY_API_TOKEN: Your Apify API token (optional, used as a high-reliability fallback for heavy JS/login walls).CREATOR_SCRAPE_DELAY_MS: Delay between multi-profile requests (defaults to1500).
Run Scripts
Normalize counts using Python:
python3 ~/.openclaw/workspace/skills/scrape-creator-profile/scripts/normalize_count.py "4.5M"
Save a profile directly to JSON:
python3 ~/.openclaw/workspace/skills/scrape-creator-profile/scripts/save_profile.py \
--data '{"platform": "youtube", "handle": "@example"}' \
--output ~/creator-profiles/example_youtube.json
Scrape Creator Profile Data Schema & Taxonomy
This utility produces a normalized schema across all source platforms to guarantee seamless integration with other Openclaw Skills.
| Field | Type | Description |
|---|---|---|
platform |
string | Normalized platform name (e.g., youtube, tiktok, twitter, instagram) |
handle |
string | Canonical handle prefixed with @ |
display_name |
string | Full name displayed on profile |
verified |
boolean | Verification status |
bio |
string | Public biography text |
profile_url |
string | Scraped canonical URL |
stats |
object | Nested numerical stats: followers, following, views, posts |
recent_content |
array | Up to 5 recent posts, containing titles, URLs, and engagement metrics |
contact_info |
object | Extracted public email or website |
scraped_at |
string | ISO 8601 UTC timestamp of execution |
All missing or unavailable public metrics will be set strictly to null to avoid false assumptions.
Scrape Creator Profile Advanced Features
- Multi-Profile Batch Mode: Sequentially crawls a batch of handles, respecting rate-limiting pauses, and compiles them into a unified dataset.
- Automatic Browser Fallbacks: Smart execution detects JS-heavy pages (like Instagram and TikTok) and automatically switches from web_fetch to headless browser rendering.
- Data Comparative Analytics: Generates comparison tables and formats large datasets into CSV outputs for reporting using helper scripts in Openclaw Skills.
- Apify Integration: Seamless fallback routing to platform-specific Apify Actors when encountering persistent login walls or Cloudflare blocks.
- Ethical Safeguards: Hardcoded privacy logic filters private profiles, prevents scraping private data, and ignores non-public sensitive fields.
SKILL.md
Loading
Related Openclaw Skills
F1 Session Summary
A smart AI-driven automation skill to quickly retrieve, summarize, and translate Formula 1 practice, qualifying, and race results.
COMB Credential Exposure Checker
A defensive security skill that checks emails and usernames against the 3.2 billion leaked credentials in the COMB dataset.
FWQuant Skills
An advanced quantitative analysis and strategy simulation engine designed to deliver real-time trading signals and historical backtesting insights directly to AI agents.
Token Cockpit
An essential utility among Openclaw Skills that analyzes local usage logs to monitor, project, and optimize your LLM API token spend without sharing your data.
VBTI (Vibe-coding Type Indicator)
An interactive profile analyzer that parses your AI terminal transcripts to diagnose your vibe coding personality type and output a visual diagnostic card.
GitHub Trending
A CLI-based utility from the Openclaw Skills collection that queries the GitHub API to fetch, filter, and summarize top-performing repositories.
Featured*
