Sponsored by
APIMart
A high-performance utility to scrape any webpage and transform it into clean, well-formatted Markdown while preserving all image links.
shijianwen
v1.1.0
Feb 15, 2026
0
2.2k
0
Install & Download
1. ClawHub CLI
The fastest way to install a skill directly from the registry.
npx clawhub@latest install webfetch-md
2. Manual Installation
Copy the skill folder to one of these locations
Global
~/.openclaw/skills/ Workspace
<project>/skills/ Priority: Workspace > Local > Bundled
3. Prompt Installation
Copy this prompt to OpenClaw to install it automatically.
Help me install webfetch-md using Clawhub. If Clawhub is not installed, install it first (npm i -g clawhub).
Prefer to download?
Get the raw skill files in a ZIP archive.
What is WebFetch MD?
WebFetch MD is a specialized tool designed for the Openclaw Skills framework that streamlines the process of extracting meaningful content from the web. It intelligently identifies the main body of a webpage, stripping away distracting elements like advertisements, sidebars, and navigation menus to deliver a pure Markdown output.
By leveraging industry-standard libraries like Turndown and Cheerio, it ensures high-fidelity conversion that is perfect for AI ingestion or personal knowledge management. Whether you are building an automated research pipeline or simply archiving articles, this skill provides a robust bridge between HTML and Markdown, making it a vital addition to the Openclaw Skills library.
WebFetch MD Use Cases
- Scraping articles for AI model training or RAG (Retrieval-Augmented Generation) pipelines.
- Archiving blog posts and news articles into personal notes or PKM systems.
- Automating web research and data collection within Openclaw Skills workflows.
- Converting online documentation pages into offline-readable Markdown files for developers.
How WebFetch MD Works
- The tool initiates a fetch request to the target URL, simulating a real browser via User-Agent headers to ensure access.
- It parses the raw HTML using Cheerio to build a searchable DOM structure for analysis.
- A smart extraction algorithm prioritizes content containers like
, , or specific CSS classes (e.g., .post-content) to find the core text. - It converts relative image and link paths into absolute URLs to maintain data integrity across different environments.
- The Turndown library converts the cleaned HTML into standard Markdown format while preserving formatting like headers and lists.
- It returns a structured JSON response containing the Markdown content, page title, and image metadata for use in other Openclaw Skills.
WebFetch MD Setup
To get started with this skill in your environment, ensure you have Node.js installed. You can run it directly via npx or integrate it into your Openclaw Skills configuration.
# Basic usage via npx
npx webfetch-md --url https://example.com
# Save content directly to a file using jq
npx webfetch-md https://example.com | jq -r '.markdown' > article.md
WebFetch MD Data Schema & Taxonomy
The skill returns a unified JSON object to ensure compatibility across different Openclaw Skills integrations and CLI pipes.
| Field | Type | Description |
|---|---|---|
| success | Boolean | Indicates if the fetch and conversion were successful |
| title | String | The extracted title of the webpage |
| markdown | String | The full content converted into clean Markdown |
| images | Array | A list of all absolute image URLs found in the content |
| imageCount | Number | Total number of images processed |
| contentLength | Number | The character count of the resulting Markdown |
WebFetch MD Advanced Features
- Intelligent content prioritization using a fallback ladder starting from semantic tags down to the document body.
- Automatic filtering of non-essential elements including scripts, styles, headers, footers, and comment sections.
- Direct integration as a module for custom JavaScript and Node.js applications.
- Seamless CLI support with JSON output for easy automation within Openclaw Skills scripts.
- Robust error handling with descriptive feedback to debug failed scrapers or restricted URLs.
SKILL.md
Loading
Related Openclaw Skills
Vibe Coding Workflow
A systematic 5-phase framework designed to transform vague ideas into production-ready software through structured AI collaboration.
2
1.2k
Vibe Coding Workflow
A structured 5-phase development framework designed to guide AI agents from vague requirements to production-ready code and iteration.
0
984
Gemini Reader
A specialized tool for understanding and summarizing local PDF, video, and audio files using the Google Gemini API.
0
0
Web Search
A powerful, API-free internet search tool for AI agents to retrieve real-time data from Baidu and Bing.
0
1.1k
Simple Email
A powerful IMAP and SMTP interface for AI agents to manage email workflows across providers like Gmail, Outlook, and more.
0
1.3k
AWS Health Monitor
A real-time AWS incident monitoring tool that pushes service health alerts and root cause analysis to your favorite communication channels.
0
866
METADATA
Categories
Source&History
v1.0.5（latest）
Feb 15, 2026
Github Stars: 0
forks: 0
Featured*
iMean AI Trip Planner
AI trip planner that creates personalized itineraries, finds cheap flights and hotels, and helps you plan an entire trip in one chat.
Free
PoYo.AI
High concurrency. Stable AI API. Better pricing.
PostMcpAi
AI-powered social media publishing across seven networks
Agentkit
AI agents trained on business content for support, lead capture, and automation
Tripo AI
AI-powered 3D model generator from images and text.
Skild Art
一站式 AI 视觉创作平台，为商业营销而生
Happy Shrimp Music
AI platform for generating complete songs from text prompts
Anathema AI
▎ Anathema is an AI chat platform built around Lexi, an assistant with personality. She is bubbly, a little aloof, gives you a straight answer, and does not hedge everything into uselessness. Alongside chat, Anathema includes a full generation Studio for images, video, music and voice, running state of the art models. An API is available for Lexi and Ana.
Oakleaf 3D
AI tool for converting images into 3D-printable STL models
Mailmodo AI
Complete Email Marketing Automation With AI Agents
Runable
Runable is a general AI agent that can execute any task, from building web apps, slides, reports, and documents to generating images, videos, and podcasts, all in one place. It doesn’t just create it connects. Runable integrates with thousands of your favorite apps so you can simply ask it to do the work for you.
Sup AI
Sup AI is the world's most accurate AI orchestration platform, combining 9 frontier LLMs with proprietary synthesis technology to deliver hallucination-free, verifiable responses for mission-critical decisions.
Elser AI
All-in-one AI Studio for Character-consistent Anime Videos
ace.me
Your new website, email address & cloud storage. Simple. Fast. Secure.
Gobii
Hire AI employees that automate your web workflows — built on a production-grade platform that runs 24/7 without the maintenance headaches.
Diagrimo
AI-powered tool to turn ideas/text into clear diagrams & infographics.
KiloClaw
Managed hosting for OpenClaw. Set up OpenClaw in seconds.
Articos
Articos is a fast, recruitment free user research platform that helps you validate product ideas, test UX flows, and understand customer needs without waiting weeks to find real participants. Instead of booking calls and chasing no shows, you run AI moderated interviews with realistic synthetic users that match your target personas. In a short time, you get clear feedback on what people understand, what confuses them, what they would pay for, and what would stop them from using your product. It is built for founders, product managers, designers, and agencies who need quick direction before they commit time and budget to building the wrong thing.
APIDot
Unified AI API platform for low-cost, production-ready image and video model integration.
NewsBang
AI-powered news platform providing summaries, insights, and interactive podcasts.
