An elite multi-platform scraper to capture social media metrics and automatically sync them to Feishu Bitables.
Install & Download
1. ClawHub CLI
The fastest way to install a skill directly from the registry.
npx clawhub@latest install media-data-scraper
2. Manual Installation
Copy the skill folder to one of these locations
~/.openclaw/skills/ <project>/skills/ Priority: Workspace > Local > Bundled
3. Prompt Installation
Copy this prompt to OpenClaw to install it automatically.
Help me install media-data-scraper using Clawhub. If Clawhub is not installed, install it first (npm i -g clawhub).
Prefer to download?
Get the raw skill files in a ZIP archive.
What is Multi-Platform Social Media Data Scraper?
This Multi-Platform Social Media Scraper is a robust data extraction utility designed for digital marketers, growth hackers, and data analysts. Operating as a premier tool within the Openclaw Skills library, this skill allows users to extract complete public engagement metrics—including views, likes, comments, shares, and collections—from five major Chinese social media networks: Douyin, Xiaohongshu (RED), Bilibili, Kuaishou, and WeChat Video Channels. It is completely free to use and runs without requiring user logins, API keys, or premium subscriptions.
By leveraging advanced crawler techniques such as Chrome TLS fingerprint emulation and dynamic browser-based rendering fallbacks, it guarantees high-fidelity extraction even against strict bot protection systems. The skill also features out-of-the-box integration with Feishu (Lark) Bitables, enabling teams to build automated growth dashboards instantly from raw scraped URLs.
Multi-Platform Social Media Data Scraper Use Cases
- Competitive Intelligence Gathering: Monitor competitor post metrics, content reach, and viral velocity on Xiaohongshu and Douyin.
- Automated KPI Dashboarding: Collect daily performance metrics across multiple distributed channels and aggregate them automatically.
- Seamless Database Synchronization: Streamline marketing workflows by immediately writing extracted social metrics to localized databases or live cloud spreadsheets.
- Anti-Bot Defense Bypass: Extract data continuously without triggering security IP blocks or JA3 fingerprint bans on protected channels.
How Multi-Platform Social Media Data Scraper Works
- Trigger Phase: The user feeds one or more social media post links to the AI agent, or initiates action using natural language keywords.
- Fast-Fetch Scripting: The tool initiates a high-speed script-level fetch utilizing public APIs or Server-Side Rendered (SSR) HTML state extractions.
- TLS Fingerprint Emulation: When scraping Xiaohongshu, it implements a Chrome TLS fingerprint bypass via special network requests to prevent interception.
- Browser Fallback Engine: If a platform utilizes closed single-page architectures (like WeChat Video Channels) or if an access token expires, the system downgrades to a headless Chromium environment (via native tools or DrissionPage) to dynamically extract raw DOM elements.
- Sync & Format: The finalized payload is cleaned of illegal formatting, validated, and directly pushed to a configured Feishu Bitable.
Multi-Platform Social Media Data Scraper Setup
To deploy this skill on your runner, install the required dependencies using pip:
pip install curl_cffi requests beautifulsoup4 lxml brotli DrissionPage
Key Components:
- curl_cffi: Required for simulating Chrome browser fingerprints to bypass Xiaohongshu's security gates.
- DrissionPage: Used as the ultimate anti-detection browser fallback wrapper when strict SPA rendering is active.
- lark-cli (Optional): Install via
pip install lark-clito handle Feishu authentication via standard developer credentials.
Multi-Platform Social Media Data Scraper Data Schema & Taxonomy
The skill generates structured data conforming to the following metadata taxomony:
| Field Name | Description | Platform Coverage |
|---|---|---|
platform |
The source platform (e.g., douyin, bilibili, xiaohongshu) | All |
title |
Title of the post or video (falls back to description crop) | All |
author |
Nickname of the content creator | All |
description |
Full text caption of the post | All |
views |
Total views / plays | Bilibili, Kuaishou, Douyin |
likes |
Total likes / upvotes | All |
comments |
Total comment count | All |
shares |
Total share count | All |
collects |
Total bookmarks / collections | All |
publish_time |
Original publish date and time | All |
status |
Processing status (success, partial, or error) |
All |
strategy_used |
Extraction strategy used (e.g., API, SSR, Browser) | All |
Multi-Platform Social Media Data Scraper Advanced Features
- Feishu / Lark Bitable Synchronization: Automate data workflows by mapping scraped social data fields directly to online tables without writing sync code.
- Anti-Detection Browser Fallbacks: Integrates DrissionPage, a driverless automation tool superior to standard Selenium, to bypass headless browser blockers.
- Interactive Lark CLI integration: Simplifies enterprise app authentication with standard CLI commands like
lark-cli auth login. - Dynamic Token Validation: Autodetects expired Xiaohongshu
xsec_tokenparameters, returning clear warnings and instructions to refresh short-lived sharing tokens.
SKILL.md
Loading
Related Openclaw Skills
Deeptechnic Deep-Tech Due Diligence Framework
A structured system for conducting independent physics-based technology due diligence and risk assessment on hard-tech startup investments.
Deckly Deck Redesign
An interactive AI coding agent skill to automatically redesign, beautify, and polish PowerPoint (.pptx) and PDF slides using the Deckly API.
Literature Work Page Generator
An AI coding agent skill designed to automatically generate feature-rich, standalone HTML presentation and analysis pages for literary and creative works.
FastAPI Web Framework
A high-performance Python Web API framework skill that enables AI agents to design, generate, and deploy modern, production-ready RESTful APIs with native async support.
Domain Payload Generator
Domain Payload Generator is a specialized meta-skill designed to analyze new technical fields and independently manufacture fully UTOS-compatible domain payload skills from scratch.
Prevent WPS Image Hijack
A utility skill to permanently block WPS Office from hijacking default image associations and restore user control on Windows systems.
Featured*
