A high-performance API skill for extracting public data, profiles, and transcripts from over 20 social media platforms using simple curl commands.
Install & Download
1. ClawHub CLI
The fastest way to install a skill directly from the registry.
npx clawhub@latest install scrapping
2. Manual Installation
Copy the skill folder to one of these locations
~/.openclaw/skills/ <project>/skills/ Priority: Workspace > Local > Bundled
3. Prompt Installation
Copy this prompt to OpenClaw to install it automatically.
Help me install scrapping using Clawhub. If Clawhub is not installed, install it first (npm i -g clawhub).
Prefer to download?
Get the raw skill files in a ZIP archive.
What is ScrapeCreators Social Media Data Scraper?
ScrapeCreators is a comprehensive API integration designed for Openclaw Skills that provides access to over 100 REST endpoints for gathering public social media intelligence. It eliminates the need for platform-specific SDKs or complex authentication flows, allowing developers to fetch profiles, engagement stats, and trending content from platforms like TikTok, Instagram, and LinkedIn using a single unified API key. This tool is essential for those who need to monitor social trends or analyze creator performance without the overhead of maintaining individual scrapers.
By leveraging this skill within the Openclaw Skills ecosystem, users can automate the collection of large-scale social datasets through a consistent interface. The skill is built to handle the complexities of modern web scraping, including automated pagination, data trimming for context window management, and cross-platform data consistency.
ScrapeCreators Social Media Data Scraper Use Cases
- Extracting creator profiles and follower growth metrics from TikTok or Instagram.
- Monitoring trending hashtags and content performance across multiple social networks simultaneously.
- Fetching video transcripts from YouTube and TikTok for automated sentiment analysis.
- Auditing competitor ad campaigns through Facebook, LinkedIn, and Reddit ad libraries.
- Scraping TikTok Shop product data and pricing for e-commerce market research.
How ScrapeCreators Social Media Data Scraper Works
- The skill is triggered when a user requests social media data retrieval, such as fetching a specific profile or searching for trending posts.
- The system authenticates the request using the SCRAPECREATORS_API_KEY stored in your environment variables.
- A structured GET request is generated using curl, targeting the appropriate platform-specific endpoint with necessary query parameters.
- If the requested data spans multiple pages, the skill automatically manages pagination via cursors returned in the API responses.
- The raw JSON output is typically piped through jq to filter for specific fields, ensuring the resulting data is clean and actionable.
- The final structured data is presented to the user or saved to a local file (JSON/CSV) for integration into larger workflows within Openclaw Skills.
ScrapeCreators Social Media Data Scraper Setup
To get started, obtain an API key from the ScrapeCreators dashboard. Once you have your key, configure your environment to work with Openclaw Skills by setting the following variable:
export SCRAPECREATORS_API_KEY="your_api_key_here"
Ensure that your system has curl and jq installed. You can verify the setup by running a simple profile lookup:
curl -s -G "https://api.scrapecreators.com/v1/tiktok/profile" \
--data-urlencode "handle=khaby.lame" \
-H "x-api-key: $SCRAPECREATORS_API_KEY" | jq .
ScrapeCreators Social Media Data Scraper Data Schema & Taxonomy
The skill returns structured JSON responses. Users can leverage specific parameters to modify the data structure returned by Openclaw Skills.
| Parameter | Type | Description |
|---|---|---|
trim |
Boolean | When set to true, returns a smaller, high-signal response to save tokens. |
cursor |
String | Used for navigating through paginated results (e.g., long lists of comments). |
credits_remaining |
Integer | Included in most responses to help monitor usage and API balance. |
includeExtras |
Boolean | Returns additional metadata like channel descriptions for YouTube endpoints. |
ScrapeCreators Social Media Data Scraper Advanced Features
- Response Trimming: Use the trim parameter to keep your context window clean by only returning essential data fields.
- Integrated Transcripts: Directly fetch AI-generated transcripts for TikTok, YouTube, and Facebook videos for content analysis.
- Ad Library Access: Programmatically search ad libraries across Facebook, Google, LinkedIn, and Reddit to track marketing trends.
- Multi-Agent Chaining: Pass IDs retrieved from a profile lookup into subsequent content or comment extraction requests for deep-dive analysis.
- Flexible Pagination: Seamlessly handle large datasets with built-in support for cursor-based and max_cursor pagination logic.
SKILL.md
Loading
Related Openclaw Skills
Kazakh-Convert
A professional-grade conversion tool for bidirectional Kazakh text translation between Cyrillic and Arabic scripts.
Video Generator Free
A cloud-based AI agent skill that transforms text descriptions and image files into professional 1080p videos without requiring local editing software.
HeyGen Stack
An advanced AI video production framework for creating high-fidelity avatar videos via the HeyGen v3 API.
SBTI Personality Test
A chaotic, meme-driven parody of personality tests that generates hilarious and unscientific character profiles.
Domain Checker
A precision domain validation tool that cross-references WHOIS data and DNS records to confirm if a domain name is truly available for registration.
Taipei Bus and Highway Transport Tracker
A specialized skill for tracking real-time public transportation dynamics and arrival times across Greater Taipei and nationwide highway bus networks.
METADATA
Featured*
