Firecrawl Scrape for Openclaw

A powerful tool for extracting clean, LLM-optimized Markdown content from any URL, including JavaScript-heavy single-page applications.

yang1002378395-cmyk
v1.0.0
Mar 24, 2026
0
2.2k
0

Install & Download

1. ClawHub CLI

The fastest way to install a skill directly from the registry.

npx clawhub@latest install firecrawl-scrape-cn

2. Manual Installation

Copy the skill folder to one of these locations

Global
~/.openclaw/skills/
Workspace
<project>/skills/

Priority: Workspace > Local > Bundled

3. Prompt Installation

Copy this prompt to OpenClaw to install it automatically.

Help me install firecrawl-scrape-cn using Clawhub. If Clawhub is not installed, install it first (npm i -g clawhub).

Prefer to download?

Get the raw skill files in a ZIP archive.

What is Firecrawl Scrape?

Firecrawl Scrape is an essential utility within the Openclaw Skills ecosystem designed to convert raw web pages into structured, readable Markdown. It handles the complexities of modern web development, such as JavaScript rendering and Single Page Applications (SPAs), ensuring that AI agents receive high-quality data without the noise of headers, footers, or sidebars.

By prioritizing clean content extraction, this skill enables more accurate reasoning and data processing for AI models. It supports concurrent scraping of multiple URLs and provides various output formats, making it a versatile choice for developers building data-driven AI workflows.

Firecrawl Scrape Use Cases

  • Extracting specific content from a known URL for LLM analysis.
  • Scraping modern, JavaScript-rendered websites or SPAs that traditional scrapers fail to read.
  • Automating the second step of research workflows: Search → Scrape → Map → Crawl.
  • Comparing content across multiple pages by scraping URLs concurrently.

How Firecrawl Scrape Works

  1. The user provides one or more target URLs to the firecrawl scrape command.
  2. The tool accesses the web pages, optionally waiting for JavaScript execution to ensure full content rendering.
  3. Firecrawl processes the HTML to remove clutter like navigation menus, ads, and footers using the only-main-content flag.
  4. The processed content is converted into LLM-optimized Markdown or the requested format (HTML, JSON, etc.).
  5. The final output is saved to a specified local directory, typically following the .firecrawl/{filename} convention for easy retrieval.

Firecrawl Scrape Setup

To use this skill within your Openclaw Skills environment, ensure you have the Firecrawl CLI installed. You can run it directly or via npx:

# Basic installation check
firecrawl --version

# Or use via npx without local installation
npx firecrawl scrape "https://example.com"

Firecrawl Scrape Data Schema & Taxonomy

The skill organizes extracted data into a structured local directory. By default, it uses the following taxonomy:

Feature Specification
Default Directory .firecrawl/
Naming Convention {site}-{path}.md
Supported Formats markdown, html, rawHtml, links, screenshot, json
Metadata Optional inclusion of HTTP headers using the -H flag

Firecrawl Scrape Advanced Features

  • Concurrent scraping: Fetch data from multiple URLs simultaneously to increase throughput.
  • JS Rendering Control: Use --wait-for to specify millisecond delays for complex page loads.
  • Targeted Extraction: Use --include-tags or --exclude-tags to fine-tune exactly which HTML elements are processed.
  • Intelligent Querying: Ask questions directly against a page's content using the --query parameter for targeted answers without manual reading.

SKILL.md


Loading

Related Openclaw Skills

METADATA

Github Stars: 0
forks: 0

Featured*