A high-performance CLI tool for fetching web content and converting it into structured Markdown, plain text, or raw HTML.
Install & Download
1. ClawHub CLI
The fastest way to install a skill directly from the registry.
npx clawhub@latest install webfetch
2. Manual Installation
Copy the skill folder to one of these locations
~/.openclaw/skills/ <project>/skills/ Priority: Workspace > Local > Bundled
3. Prompt Installation
Copy this prompt to OpenClaw to install it automatically.
Help me install webfetch using Clawhub. If Clawhub is not installed, install it first (npm i -g clawhub).
Prefer to download?
Get the raw skill files in a ZIP archive.
What is Webfetch?
Webfetch is a specialized command-line utility designed to bridge the gap between complex web pages and clean, readable formats. It enables users to scrape static web content seamlessly, making it an essential choice for developers and AI agents needing to digest online information quickly. As part of the Openclaw Skills ecosystem, Webfetch prioritizes format flexibility, allowing for easy integration into research workflows or documentation pipelines.
By default, it converts web content to Markdown, preserving the structural integrity of the original page while removing unnecessary noise. This makes it particularly valuable for feeding clean data into LLMs or personal knowledge management systems.
Webfetch Use Cases
- Converting lengthy web articles into clean Markdown for personal knowledge management.
- Fetching raw HTML or text data for automated research and analysis tasks.
- Downloading web content for offline reading through shell scripts or AI agents.
- Scraping specific online resources while operating behind a corporate proxy or restricted network.
How Webfetch Works
- The tool receives a target URL and optional parameters for format, timeout, or proxy settings.
- It initiates a network request, automatically respecting environment variables like HTTPS_PROXY if configured.
- The tool fetches the static HTML content of the page, supporting responses up to 5MB.
- It processes the fetched content based on the requested format (Markdown, Text, or HTML).
- The output is either printed directly to the console or saved to a specified local file.
Webfetch Setup
To get started with this entry in the Openclaw Skills library, install the package globally using npm:
npm install -g @lyhue1991/webfetch
Verify that the installation was successful by checking the version:
webfetch --version
Webfetch Data Schema & Taxonomy
The skill manages data through direct command-line arguments and environment variables. Key parameters and their functions are detailed below:
| Argument | Description |
|---|---|
<url> |
The required target web address. |
-f, --format |
Output format: markdown (default), text, or html. |
-o, --output |
The destination file path for the fetched content. |
--proxy |
Custom proxy server URL for network requests. |
--timeout |
Request timeout in seconds (default 30s, max 120s). |
--insecure |
Bypass TLS certificate validation for self-signed certificates. |
Additionally, the tool utilizes system environment variables such as HTTP_PROXY, HTTPS_PROXY, and NO_PROXY to handle network routing.
Webfetch Advanced Features
- Full proxy support with automatic environment variable detection for secure enterprise environments.
- Insecure mode using the --insecure flag to bypass TLS/SSL certificate validation errors.
- Quiet mode (-q) for silent execution, perfect for pipe redirection in automation scripts.
- Custom timeout settings to handle slow-loading websites or high-latency connections.
- Structured exit codes (0-3) to facilitate error handling within multi-agent Openclaw Skills workflows.
SKILL.md
Loading
Related Openclaw Skills
Pesticide Management Reference
A comprehensive reference skill for managing chemical classes, application protocols, and regulatory compliance in modern agriculture.
robots-ai
An AI-powered utility for auditing, analyzing, and generating robots.txt files with specialized support for over 20 AI crawlers and bots.
Dify Workflow DSL Expert
A specialized skill for authoring, editing, and validating Dify Workflow DSL files for self-hosted instances using an export-first approach.
Git Hooks Toolkit
A comprehensive toolkit for generating, installing, and managing production-ready Git hooks using pre-built templates for linting, testing, and branch protection.
SecLists Passwords (Curated)
A streamlined collection of the most effective password wordlists for security researchers and penetration testers.
MGO — Multi-chain Gas Optimizer
MGO is a specialized multi-chain gas optimization tool designed to help AI agents find the most cost-effective EVM chains for transactions and contract deployments.
LiteParse
A privacy-first, local document parser that extracts text and generates screenshots from PDFs and Office files without cloud dependencies.
Featured*
