A powerful web scraping utility that converts any URL into clean, LLM-ready markdown using Firecrawl via the SkillBoss API.
Install & Download
1. ClawHub CLI
The fastest way to install a skill directly from the registry.
npx clawhub@latest install skillboss-scraper
2. Manual Installation
Copy the skill folder to one of these locations
~/.openclaw/skills/ <project>/skills/ Priority: Workspace > Local > Bundled
3. Prompt Installation
Copy this prompt to OpenClaw to install it automatically.
Help me install skillboss-scraper using Clawhub. If Clawhub is not installed, install it first (npm i -g clawhub).
Prefer to download?
Get the raw skill files in a ZIP archive.
What is Firecrawl Scraper (SkillBoss)?
The Firecrawl Scraper is a specialized tool within the Openclaw Skills ecosystem designed to streamline the process of harvesting web content for AI applications. By leveraging the Firecrawl engine, it bypasses complex scraping logic and delivers high-quality markdown directly to your agent. This skill eliminates the need for managing multiple individual vendor accounts by routing requests through SkillBoss, providing a unified billing experience and instant access to top-tier scraping technology without long-term subscriptions.
Built for developers and AI researchers, this skill ensures that web content is presented in a format that LLMs can easily parse and understand. Whether you are building a knowledge base or performing real-time research, incorporating this into your Openclaw Skills workflow provides a significant advantage in data accessibility.
Firecrawl Scraper (SkillBoss) Use Cases
- Scrape technical documentation sites to provide context for AI coding tasks.
- Extract structured data from websites for market research or competitive analysis.
- Convert blog posts or news articles into clean markdown for RAG pipelines.
- Monitor web updates and feed changes into automated data processing workflows.
How Firecrawl Scraper (SkillBoss) Works
- The user provides a target URL and optional extraction parameters to the skill interface.
- The skill authenticates the request using the provided SKILLBOSS_API_KEY.
- A request is sent to the SkillBoss gateway, which invokes the Firecrawl engine to process the URL.
- Firecrawl handles JavaScript rendering and noise removal (ads, navbars, footers) to isolate core content.
- The cleaned markdown or structured JSON response is returned to the Openclaw Skills environment for immediate consumption by the agent.
Firecrawl Scraper (SkillBoss) Setup
To integrate this tool with Openclaw Skills, follow these steps:
- Visit skillboss.co/console to create an account and obtain your API key.
- Set the environment variable in your local environment or CI/CD pipeline:
export SKILLBOSS_API_KEY='your_api_key_here'
- Use the following curl command to test the integration:
curl https://api.heybossai.com/v1/run \
-H "Authorization: Bearer $SKILLBOSS_API_KEY" \
-d '{"model": "firecrawl", "input": {"url": "https://example.com"}}'
Firecrawl Scraper (SkillBoss) Data Schema & Taxonomy
The skill primarily deals with text-based data extraction and organizes its output to be highly compatible with LLMs:
| Field | Description |
|---|---|
| markdown | The primary content of the page stripped of HTML bloat and converted to standard markdown. |
| metadata | Metadata including page title, description, and source URL information. |
| json_data | Structured extraction results if a specific JSON schema was provided during the request. |
| status | Confirmation of the scrape success or error logs. |
Firecrawl Scraper (SkillBoss) Advanced Features
- AI-driven structured data extraction that maps raw HTML to specific JSON schemas.
- Pay-as-you-go pricing model with $2 initial free credits to test your Openclaw Skills.
- Unified billing through SkillBoss for access to 100+ AI services with one key.
- Seamless integration with autonomous agents for browser-based research and content summarization.
SKILL.md
Loading
Related Openclaw Skills
SkillBoss Unified AI Gateway
A unified AI gateway providing access to over 100 top-tier AI models through a single OpenAI-compatible API key.
SkillBoss
SkillBoss provides a single API gateway for over 100 AI services, including top-tier LLMs, video generation, and web scraping with zero markup.
Send Email API
A high-performance email delivery skill for Openclaw Skills that enables transactional and marketing communications via AWS SES without complex SMTP configuration.
Perplexity Search API
A powerful AI-driven web search engine integration providing real-time information with verifiable citations.
AI Video Generation API for OpenClaw
An AI-powered video creation skill that allows agents to generate high-fidelity videos from text prompts using industry-leading models.
Web Scraping API
A unified web scraping solution for extracting structured data from over 30 major platforms including LinkedIn, Amazon, and Twitter.
Featured*
