A comprehensive data extraction and sentiment analysis tool designed to scrape notes, comments, and engagement metrics from the Xiaohongshu (XHS) platform.
Install & Download
1. ClawHub CLI
The fastest way to install a skill directly from the registry.
npx clawhub@latest install xhs-crawler
2. Manual Installation
Copy the skill folder to one of these locations
~/.openclaw/skills/ <project>/skills/ Priority: Workspace > Local > Bundled
3. Prompt Installation
Copy this prompt to OpenClaw to install it automatically.
Help me install xhs-crawler using Clawhub. If Clawhub is not installed, install it first (npm i -g clawhub).
Prefer to download?
Get the raw skill files in a ZIP archive.
What is Xiaohongshu Sentiment & Data Scraper?
This skill provides a robust framework for gathering high-fidelity data from Xiaohongshu, one of the most influential social and lifestyle platforms. By integrating multiple open-source projects and API SDKs, it enables users to perform keyword-based searches, collect detailed note content, and scrape user comments for deep sentiment analysis. This tool is essential for developers and marketers looking to leverage Openclaw Skills to understand consumer trends, monitor brand health, and perform competitive research in the Chinese social media ecosystem.
Xiaohongshu Sentiment & Data Scraper Use Cases
- Tracking brand sentiment and public opinion trends on Xiaohongshu.
- Automating competitor research by monitoring specific product keywords.
- Collecting large-scale datasets for academic or market research.
- Bulk downloading high-quality image and video content for creative analysis.
- Analyzing user engagement metrics such as likes, collections, and comment counts.
How Xiaohongshu Sentiment & Data Scraper Works
- Environment Initialization: Sets up the Python environment and installs necessary drivers like DrissionPage for browser automation.
- Authentication: Launches a browser instance for the user to log into their Xiaohongshu account, ensuring access to restricted data.
- Task Configuration: Users input target keywords and select scraping parameters such as the number of notes and whether to include comments.
- Data Extraction: The scraper traverses XHS search results, extracting text, metadata, and media files.
- Data Structuring: The raw scraped data is cleaned, processed, and saved into organized formats like Excel or SQLite for further analysis.
Xiaohongshu Sentiment & Data Scraper Setup
To get started with this skill, ensure you have Python 3.8+ installed on a system with a GUI (preferably Windows for full feature support).
# Clone the repository
git clone https://github.com/xiaofuqing13/redbooks.git
cd redbooks
# Create and activate a virtual environment
python -m venv venv
# On Windows:
venv\\Scripts\\activate
# On Linux/Mac:
source venv/bin/activate
# Install required dependencies
pip install -r requirements.txt
# Launch the scraping utility
python crawler_ultimate.py
Xiaohongshu Sentiment & Data Scraper Data Schema & Taxonomy
The skill organizes extracted data into structured formats to facilitate seamless integration with other Openclaw Skills.
| Attribute | Description |
|---|---|
| title | The headline of the XHS note |
| author | The creator's profile name |
| content | Full text description and body |
| tags | List of hashtags used in the post |
| publish_time | Date and time of publication |
| ip_region | User location information |
| metrics | Like_count, collect_count, and comment_count |
| comments | A list of user comments associated with the note |
Xiaohongshu Sentiment & Data Scraper Advanced Features
- Support for both browser automation (DrissionPage) and high-speed API access via TikHub.
- Built-in GUI interface for simplified task management and keyword input.
- AI-powered sentiment analysis capabilities for automated qualitative feedback processing.
- Multi-format exports including Excel (.xlsx) and SQLite (.db) for local database management.
- Automatic media harvesting for high-resolution image and video downloads.
SKILL.md
Loading
Related Openclaw Skills
OpenClaw Starter
A comprehensive onboarding assistant that guides new users through skill recommendations, channel configurations, and environment setup.
A-Stock Analyst
A professional AI-powered investment research assistant specializing in A-share market analysis, fundamental evaluation, and automated stock monitoring.
Google Search Console
A comprehensive analysis tool for Google Search Console data to optimize search visibility, indexing coverage, and technical SEO health.
AI Writing Agent
An intelligent writing assistant that transforms simple prompts into structured, professional articles and marketing copy.
Session Summary Skill
An automated utility for capturing coding progress, decisions, and file changes directly into Obsidian at the end of every session.
PDF Processing Toolkit
A comprehensive toolkit for AI agents to programmatically manipulate, extract data from, and generate high-quality PDF documents.
Featured*
