An automated trend-monitoring agent that scrapes social platforms and RSS feeds to generate data-driven content reports.
Install & Download
1. ClawHub CLI
The fastest way to install a skill directly from the registry.
npx clawhub@latest install sovereign-content-scraper
2. Manual Installation
Copy the skill folder to one of these locations
~/.openclaw/skills/ <project>/skills/ Priority: Workspace > Local > Bundled
3. Prompt Installation
Copy this prompt to OpenClaw to install it automatically.
Help me install sovereign-content-scraper using Clawhub. If Clawhub is not installed, install it first (npm i -g clawhub).
Prefer to download?
Get the raw skill files in a ZIP archive.
What is Content Scraper Skill?
The Content Scraper Skill is a powerful research agent designed to act as a dedicated trend-monitoring assistant. It systematically scans the web to find viral topics, fresh ideas, and high-engagement content within any specified niche. By integrating this into your Openclaw Skills library, you can automate the tedious process of manual research across diverse platforms like social media, forums, and video repositories.
This skill doesn't just collect data; it synthesizes it into actionable intelligence. It identifies content gaps, analyzes why specific formats are going viral, and suggests unique angles for your next article, video, or social thread. It is an essential tool for creators and marketers looking to maintain a competitive edge through consistent, data-backed insight.
Content Scraper Skill Use Cases
- Identifying viral tweet formats and recurring debates in a specific niche.
- Tracking Reddit comments to uncover audience pain points and unanswered questions.
- Monitoring RSS feeds for industry news and identifying overlooked story angles.
- Analyzing YouTube video titles and descriptions to find trending video topics and formats.
How Content Scraper Skill Works
- The agent parses the local
sources.jsonconfiguration to identify which keywords, subreddits, and feeds to monitor. - It connects to X, Reddit, and YouTube to fetch high-engagement data points based on specific metrics like like counts and recency.
- The skill processes the raw data to extract trends, hooks, and suggested CTAs.
- It generates a structured JSON report including trending topics and content ideas.
- The report is saved to the data directory, and the user is notified via the configured channel.
Content Scraper Skill Setup
To get started with this skill, ensure your environment is ready for Openclaw Skills integration:
- Create a
sources.jsonfile in your project root containing your target keywords and feeds. - (Optional) Add your Twitter API credentials to the config for enhanced data retrieval.
- Install the skill using the CLI:
openclaw install content-scraper
- The skill is pre-configured to run daily at 6 AM. Ensure your system scheduler is active to receive the daily reports.
Content Scraper Skill Data Schema & Taxonomy
The skill organizes research into a structured JSON report located at data/trend-report-{date}.json. The schema includes:
| Section | Description |
|---|---|
trending_topics |
Includes the topic name, source platform, engagement level, and suggested angle. |
content_ideas |
Provides titles, formats (thread/article), hooks, and key points for new content. |
viral_formats |
Analyzes successful content structures with examples and success factors. |
Content Scraper Skill Advanced Features
- Custom engagement filtering (e.g., only tracking posts with > 100 likes).
- Cross-platform gap analysis to find topics trending on one platform but missing on others.
- Automated notification hooks for real-time alerts on high-velocity trends.
- Support for multi-agent workflows where data feeds into automated content generation Openclaw Skills.
SKILL.md
Loading
Related Openclaw Skills
Sovereign Content Machine
An autonomous content strategy engine designed to plan, create, and automate high-performance content across multiple platforms.
Sovereign Commit Craft
Sovereign Commit Craft automates the generation of perfect conventional commit messages, changelogs, and pull request descriptions by analyzing code diffs.
Sovereign Codebase Onboarding
An autonomous onboarding specialist that transforms complex, undocumented repositories into comprehensive architecture maps and actionable developer guides.
Code Review Helper
An automated code review assistant that generates file-specific checklists for security, performance, and style within your git workflow.
Daily Digest
A personal intelligence briefing system that compiles your tasks, calendar, news, and weather into a single, structured daily report.
Sovereign Docker Wizard
A specialized AI agent skill designed to analyze, score, and optimize Docker configurations for production-grade security and performance.
Featured*
