An advanced web scraping skill that enables AI agents to extract structured data from any website through a Chrome extension and MCP interface.
Install & Download
1. ClawHub CLI
The fastest way to install a skill directly from the registry.
npx clawhub@latest install datalens-web-scraper
2. Manual Installation
Copy the skill folder to one of these locations
~/.openclaw/skills/ <project>/skills/ Priority: Workspace > Local > Bundled
3. Prompt Installation
Copy this prompt to OpenClaw to install it automatically.
Help me install datalens-web-scraper using Clawhub. If Clawhub is not installed, install it first (npm i -g clawhub).
Prefer to download?
Get the raw skill files in a ZIP archive.
What is DataLens Scraping Skill?
DataLens is a specialized data extraction skill designed for Openclaw Skills that allows AI agents to interact with the Chrome browser to scrape structured information. By bridging the gap between the browser and terminal-based agents, it facilitates the extraction of lists, tables, comments, products, and reviews. This skill uses the Model Context Protocol (MCP) to provide a seamless workflow for turning unstructured web content into actionable data, making it a cornerstone for developers building sophisticated automation workflows with Openclaw Skills.
The skill operates by spawning a proxy that communicates via WebSockets to a dedicated Chrome extension. This allows the AI agent to see what is on the page, identify repeating patterns, and execute complex scraping jobs that can handle dynamic content, pagination, and nested data structures.
DataLens Scraping Skill Use Cases
- Extracting product catalogs and pricing from e-commerce platforms.
- Collecting user reviews and social media comments for sentiment analysis.
- Harvesting news headlines and article metadata for research and aggregation.
- Monitoring data changes on dashboards and tables that require user authentication.
- Automating the collection of structured datasets from legacy websites without APIs.
How DataLens Scraping Skill Works
- The AI agent uses a detection tool to identify table structures and item selectors on the target webpage.
- Optional steps allow the agent to inspect the DOM tree to find and click expand buttons or "load more" triggers.
- The agent performs an AI-driven analysis of the columns to generate a robust scraper configuration and job draft.
- A scraping job is initiated using the job draft, which can include limits on the number of records to be fetched.
- The agent polls the job status periodically until the extraction is complete or stopped.
- Final data is exported in the user's preferred format (JSON, CSV, or XLSX) for use within Openclaw Skills.
DataLens Scraping Skill Setup
To integrate DataLens into your environment for Openclaw Skills, follow these preparation steps:
- Install the required npm package globally:
npm install -g datalens-mcp-server
- Install the DataLens Chrome extension from the web store and ensure it is active.
- Ensure Node.js version 18 or higher is available in your terminal.
- Open Chrome with the target page loaded, or let the tool open it automatically via the URL argument.
- Verify that
datalens-mcp-callis in your PATH, or usenpx datalens-mcp-callfor command execution.
DataLens Scraping Skill Data Schema & Taxonomy
The DataLens skill organizes extraction tasks using a structured configuration and job management system. Data is categorized as follows:
| Component | Details |
|---|---|
| Job Metadata | Includes jobId, current status (QUEUED, RUNNING, COMPLETED), and scrapedCount. |
| Selectors | Uses rootSelector, itemSelector, and documentInfoPath to pinpoint data within the DOM. |
| Scraper Config | A backend-generated AI configuration that maps web elements to specific data fields. |
| Export Formats | Supports standard output as JSON, with additional support for CSV and XLSX spreadsheets. |
| Logs | Error and debug logs are maintained for troubleshooting complex scraping workflows. |
DataLens Scraping Skill Advanced Features
- Intelligent detection of nested replies and hidden content using UID-annotated tree inspection.
- Full browser tab management, including opening, switching, and closing tabs programmatically.
- Real-time job control allowing users to pause, resume, or stop active scraping tasks.
- Support for custom timeout settings via environment variables for processing heavy webpages.
- In-memory base64 export capabilities for direct integration into other automated workflows within Openclaw Skills.
SKILL.md
Loading
Related Openclaw Skills
Video Maker Free Animation
A high-performance AI video generation skill that converts static images and text scripts into professional 1080p animated MP4 videos in minutes.
Text to Video Long
Convert long-form text scripts into fully narrated, visual-rich 1080p videos without manual editing using cloud-based GPU rendering.
paper-polisher
An expert academic editing tool designed to polish language, optimize logic, and standardize formatting for Chinese and English research papers.
Musecard
Musecard is an AI visual assistant that converts emotional text and quotes into stunning 9:16 vertical illustration cards for social media platforms.
Making Video HD Free Online
An AI-powered video editing skill that automates the transformation of raw media into polished 1080p HD videos using cloud GPU rendering.
Image to Video Demo
A high-performance skill that converts static images into professional 1080p video clips using cloud-based GPU rendering.
Featured*
