A specialized scraper that converts GitHub's trending repository pages into clean, actionable JSON data without requiring an API key.
Install & Download
1. ClawHub CLI
The fastest way to install a skill directly from the registry.
npx clawhub@latest install github-trending-scraper
2. Manual Installation
Copy the skill folder to one of these locations
~/.openclaw/skills/ <project>/skills/ Priority: Workspace > Local > Bundled
3. Prompt Installation
Copy this prompt to OpenClaw to install it automatically.
Help me install github-trending-scraper using Clawhub. If Clawhub is not installed, install it first (npm i -g clawhub).
Prefer to download?
Get the raw skill files in a ZIP archive.
What is GitHub Trending Scraper?
The GitHub Trending Scraper is a robust tool designed to extract real-time data from GitHub's trending section. As part of the ecosystem of Openclaw Skills, it allows developers and automated agents to track the hottest repositories, identify rising stars in specific programming languages, and monitor industry shifts across daily, weekly, or monthly intervals.
By bypassing the need for an official GitHub API key, this skill provides a low-friction way to gather competitive intelligence or discover new libraries for your projects. It focuses on delivering structured data that can be immediately consumed by other automation tools or visualization engines within the Openclaw Skills framework.
GitHub Trending Scraper Use Cases
- Tracking daily, weekly, or monthly popularity shifts in specific ecosystems like Python, Rust, or Go.
- Generating automated reports or newsletters featuring the top 10 trending repositories in a target niche.
- Powering visual trending cards or dashboards by feeding the scraped JSON into UI generation scripts.
- Automating market research to see which development tools are gaining traction in the open-source community.
How GitHub Trending Scraper Works
- The skill accepts parameters for language, time range (since), and the number of results (top).
- It sends a request to the public GitHub Trending URL based on the provided filters.
- The scraper parses the HTML structure of the page to identify repository names, owners, descriptions, stars, and forks.
- Extracted data is sanitized and organized into a standardized JSON schema.
- The results are either printed to the console (stdout) or saved to a specified file for downstream processing.
GitHub Trending Scraper Setup
To integrate this into your environment, ensure you have Python 3 installed. Use the following commands to get started:
# Clone the Openclaw Skills repository if you haven't already
# Navigate to your workspace and run the script
python3 scripts/github_trending.py --language python --since weekly --top 10
No additional authentication or GitHub tokens are required to use this specific skill.
GitHub Trending Scraper Data Schema & Taxonomy
The skill outputs a structured JSON object containing metadata about the scrape event and an array of repository objects.
| Field | Type | Description |
|---|---|---|
source |
string | Identifies the data origin as github-trending. |
scraped_at |
string | ISO-8601 timestamp of the operation. |
language |
string | The language filter applied (e.g., all, rust, go). |
since |
string | The time period: daily, weekly, or monthly. |
repos |
array | List containing rank, owner, name, url, description, language, stars, and forks. |
stars_period |
number | Stars gained specifically during the requested time range. |
GitHub Trending Scraper Advanced Features
- Multi-language filtering allowing users to pivot between specific stacks or the entire GitHub ecosystem.
- Seamless pipe integration with existing trending card generators for rapid HTML visualization.
- Flexible output formatting with a
--compactflag for minified JSON, ideal for machine-to-machine communication. - Configurable depth through the
--topflag, allowing users to pull anywhere from a single repo to a full list of 25.
SKILL.md
Loading
Related Openclaw Skills
Agent Builder
An expert framework for designing, generating, and iterating on complete OpenClaw agent workspaces with high-fidelity personas and operating rules.
TikTok User Profile API
A specialized API skill for fetching comprehensive TikTok user profile metadata including handles, avatars, and verification status.
Verified Agent Identity
Empower AI agents to create and manage decentralized identities on the Billions Network while linking them securely to human owners.
TikTok Post Search API
A high-performance AI agent skill for programmatic TikTok post discovery and trend analysis via keyword-based searching.
TikTok Comment Replies API
A specialized tool for extracting nested comment replies and threaded discussions from TikTok posts.
Verified Agent Identity
A decentralized identity framework that enables AI agents to create self-sovereign identities and link them to human owners via the Billions Network.
Featured*
