A utility skill that maps and identifies all URLs on a given website with advanced search filtering capabilities.
Install & Download
1. ClawHub CLI
The fastest way to install a skill directly from the registry.
npx clawhub@latest install firecrawl-map
2. Manual Installation
Copy the skill folder to one of these locations
~/.openclaw/skills/ <project>/skills/ Priority: Workspace > Local > Bundled
3. Prompt Installation
Copy this prompt to OpenClaw to install it automatically.
Help me install firecrawl-map using Clawhub. If Clawhub is not installed, install it first (npm i -g clawhub).
Prefer to download?
Get the raw skill files in a ZIP archive.
What is firecrawl-map?
The firecrawl-map skill enables AI agents to systematically discover, list, and index all URLs belonging to a target domain. It serves as an essential architectural reconnaissance tool, allowing developers and autonomous agents to visualize site structure or isolate exact page locations without guessing paths.
By leveraging deep domain discovery, this skill bridges the gap between high-level domain knowledge and granular page execution. It plays an integral role within broader Openclaw Skills ecosystems where automated data ingestion, site indexing, or multi-page analysis workflows require highly precise URL inputs.
firecrawl-map Use Cases
- The AI agent needs to discover a specific, deeply nested subpage on a massive enterprise website.
- Gathering a comprehensive list of all valid URLs across a domain prior to launching a massive scraping or crawling initiative.
- Implementing step 3 of the workflow escalation pattern: moving logically from a generic search to scraping, into mapping, before proceeding to full crawl and interactive behaviors.
How firecrawl-map Works
- The AI agent executes the firecrawl map tool targeting a specific base URL configuration.
- Optional parameters are evaluated to determine whether subdomains, sitemaps, or specific limit restrictions should apply.
- The mapping engine scans the domain structure, filtering endpoints by search queries if provided.
- Output files are compiled and saved locally, providing a clean data payload ready for downstream consumption like localized scraping.
firecrawl-map Setup
Ensure you have the core CLI architecture configured. Run the following commands to map your target sites:
# Find a specific page on a large site matching a search query
firecrawl map "<url>" --search "authentication" -o .firecrawl/filtered.txt
# Map and discover up to 500 URLs, exporting directly to raw JSON format
firecrawl map "<url>" --limit 500 --json -o .firecrawl/urls.json
firecrawl-map Data Schema & Taxonomy
The skill saves data structural schemas locally based on flags passed during runtime execution:
| File Type | Default Path | Format Details |
|---|---|---|
| Filtered Out | .firecrawl/filtered.txt |
Plaintext list of line-separated URLs matching query parameters. |
| Structured Out | .firecrawl/urls.json |
Array of discovered URL objects containing metadata structure. |
firecrawl-map Advanced Features
- Smart sequential escalation: natively couples with adjacent Openclaw Skills to trigger automated pipelines like mapping a URL, filtering out the correct match, and running automated scraping right after.
- Flexible sitemap strategy configurations handling
include,skip, oronlymodes to optimize speed and balance bandwidth requirements. - Extended subdomain discovery mode using the
--include-subdomainsflag to surface multi-tenant or multi-app structures hosted under the main domain root.
SKILL.md
Loading
Related Openclaw Skills
The Lords of Easy Money
An executable Openclaw Skills extension based on Christopher Leonard's book to help users understand the Fed, quantitative easing, and modern monetary policy.
The Great Displacement Climate Migration Toolkit
An executable AI agent toolkit inspired by Jake Bittle's book to help users understand climate-driven displacement, assess geographic risks, and build resilient adaptation strategies.
Firecrawl Download
A convenient skill that combines site mapping and scraping to easily download entire websites and documentation locally in markdown, images, or raw text formats.
firecrawl-interact
An interactive command-line utility to control browser sessions, perform page actions with natural language, and scrape dynamic, JavaScript-heavy sites.
Firecrawl Build Search
An AI agent skill designed to integrate Firecrawl search capabilities directly into product code and agent workflows for query-first discovery and web research.
The Miracle of Mindfulness AI Skill
An executable AI coding agent skill that delivers structured mindfulness teachings and practical meditation frameworks inspired by Thich Nhat Hanh.
Featured*
