A comprehensive data collection assistant for retrieving real-time stock quotes, market sector analysis, and keyword-based news search.
Install & Download
1. ClawHub CLI
The fastest way to install a skill directly from the registry.
npx clawhub@latest install webscraper-v2
2. Manual Installation
Copy the skill folder to one of these locations
~/.openclaw/skills/ <project>/skills/ Priority: Workspace > Local > Bundled
3. Prompt Installation
Copy this prompt to OpenClaw to install it automatically.
Help me install webscraper-v2 using Clawhub. If Clawhub is not installed, install it first (npm i -g clawhub).
Prefer to download?
Get the raw skill files in a ZIP archive.
What is Web Scraper V2?
Web Scraper V2 is a versatile data retrieval tool specifically designed to provide AI agents with real-time access to financial markets and web content. As a core component of the Openclaw Skills ecosystem, it bridges the gap between static LLM knowledge and the fast-paced world of live stock data, fund flows, and breaking news.
By leveraging high-performance Python libraries, this skill allows users to extract precise data points from financial portals like Sina Finance and East Money. Whether you are building an automated trading assistant or a market research bot, this tool provides the necessary infrastructure to pull clean, actionable data directly into your workflow.
Web Scraper V2 Use Cases
- Monitoring real-time stock prices and volume for specific ticker codes.
- Identifying high-performing market sectors and industry trends through block analysis.
- Conducting automated news research based on specific company or technology keywords.
- Tracking institutional fund flows to understand market liquidity.
- Scraping specific URL content to provide the AI agent with external context for research tasks.
How Web Scraper V2 Works
- The user triggers a command via the AI interface using the /webscraper prefix.
- The command and arguments are dispatched to the local Python-based tool execution environment.
- The skill utilizes the requests library to query established financial APIs or custom web addresses.
- BeautifulSoup4 parses the HTML or JSON response to extract relevant data points like stock price or news headlines.
- The processed data is returned to the agent in a structured format for immediate analysis or display.
Web Scraper V2 Setup
This skill is typically pre-installed but requires a functioning Python 3 environment. To ensure all dependencies for these Openclaw Skills are met, run the following commands:
# Ensure Python 3 is installed
python3 --version
# Install required scraping libraries
pip install requests beautifulsoup4
Web Scraper V2 Data Schema & Taxonomy
The skill organizes market and web data into structured outputs to ensure compatibility with other Openclaw Skills.
| Data Category | Primary Fields | Output Format |
|---|---|---|
| Stock Query | Price, Change %, Volume, Code | Structured Text |
| Sector Block | Sector Name, Trend, Top Gainers | List |
| News Search | Article Title, Source, Summary | List |
| URL Scraping | Extracted Body Content | Markdown/Text |
Web Scraper V2 Advanced Features
- Real-time API integration with Sina Finance and East Money for zero-latency market updates.
- Multi-mode command dispatching allowing for specific stock, news, or general URL scraping.
- Integrated rate-limiting logic to maintain compliance with data source terms of service.
- Raw argument mode support for complex query handling within the Openclaw Skills framework.
- Automated data cleaning to remove HTML noise from URL extraction tasks.
SKILL.md
Loading
Related Openclaw Skills
Meeting Notes Generator
An AI-powered assistant that transforms meeting recordings and transcripts into professional, actionable meeting minutes instantly.
Data Harvester v2
A professional-grade batch web scraping and market intelligence tool for automated data collection and competitor monitoring.
AI Smart Customer Service
A sophisticated LLM-powered customer support agent capable of automated FAQ resolution, intent recognition, and multi-turn dialogue management.
FlowClaw
FlowClaw is a high-availability LLM load balancer and usage monitor designed to keep AI agents running by rotating provider accounts based on real-time credit availability.
Weekly Reporter Skill
A Python-powered automation tool for generating structured weekly work reports using customizable templates.
UI Designer
A sophisticated design agent skill that generates, serves, and iterates on React-based web interfaces using natural language prompts.
METADATA
Featured*
