url2md for Openclaw

A lightweight Python utility designed to extract high-quality Markdown content from web pages for documentation, archiving, and note-taking.

rwonly
v2.1.2
May 11, 2026
2
783
0

Install & Download

1. ClawHub CLI

The fastest way to install a skill directly from the registry.

npx clawhub@latest install url2md

2. Manual Installation

Copy the skill folder to one of these locations

Global
~/.openclaw/skills/
Workspace
<project>/skills/

Priority: Workspace > Local > Bundled

3. Prompt Installation

Copy this prompt to OpenClaw to install it automatically.

Help me install url2md using Clawhub. If Clawhub is not installed, install it first (npm i -g clawhub).

Prefer to download?

Get the raw skill files in a ZIP archive.

What is url2md?

url2md is a robust tool within the Openclaw Skills library that converts web pages into clean, readable Markdown format. It is specifically engineered to strip away web clutter like scripts, styles, and navigation menus, focusing instead on the primary content found in article or main tags. This ensures that users receive high-fidelity text perfect for technical documentation or personal knowledge bases.

Built with portability in mind, this Openclaw Skills utility relies solely on the Python standard library, requiring no external dependencies. It excels at preserving structural integrity—including headings, tables, and code blocks—while offering advanced metadata extraction to support sophisticated digital gardening and archiving workflows.

url2md Use Cases

  • Converting online documentation into local Markdown files for offline reference and search.
  • Archiving web articles and blog posts as permanent text-based records.
  • Creating a structured knowledge base using YAML frontmatter for tools like Obsidian or Notion.
  • Batch processing large lists of URLs to generate static content from dynamic web sources.
  • Bypassing complex browser-based extraction when a lightweight, scriptable CLI approach is required.

How url2md Works

  1. The script fetches the HTML content of the provided URL or list of URLs using standard HTTP requests.
  2. It identifies the most relevant content area by prioritizing
    or
    tags to avoid capturing headers and footers.
  3. Extracted metadata (author, date, title) is gathered from Open Graph tags, Twitter cards, and Schema.org JSON-LD.
  4. The HTML fragment is parsed and converted into GitHub Flavored Markdown (GFM), including tables and fenced code blocks.
  5. If configured, the tool downloads remote images locally and updates the Markdown links to point to the local assets.
  6. The final output is generated based on a custom template or default layout, optionally including YAML frontmatter.

url2md Setup

To start using this Openclaw Skills utility, ensure you have Python 3 installed. No additional pip installations are required.

# Clone your Openclaw repository and navigate to the scripts directory
cd scripts/

# Run a test conversion on a single URL
python3 url2md.py https://example.com/article -o output.md

url2md Data Schema & Taxonomy

The url2md tool organizes data using a flexible metadata taxonomy and structured file outputs.

Feature Description
Frontmatter Supports YAML keys: title, author, published, description, category, and source.
Filenames Configurable via templates, e.g., {{date}}-{{title}}.md.
Asset Management Localizes images into a specified folder (e.g., /assets) to ensure link persistence.
Template Vars Accessible variables include {{content}}, {{site_name}}, and {{datetime}}.

url2md Advanced Features

  • Custom Template System: Full control over the Markdown output structure using variables like {{title}} and {{url}}.
  • Batch Processing: Use the -f flag to process hundreds of URLs from a text file in a single command.
  • Image Localization: Automatically download and host remote images locally using the --download-images flag.
  • Intelligent Noise Removal: Automatically skips sidebars, forms, and footers to ensure only the core article content is saved.
  • YAML Frontmatter Integration: Generate files ready for Obsidian, Jekyll, or Hugo with pre-populated metadata headers.

SKILL.md


Loading

Related Openclaw Skills

METADATA

Github Stars: 0
forks: 0

Featured*