Web Crawling Rendered Html API for Openclaw

A high-performance web crawling tool that retrieves fully rendered HTML for static page scraping, metadata extraction, and page structure analysis.

justserpapi
v1.0.0
Jun 10, 2026
0
495
0

Install & Download

1. ClawHub CLI

The fastest way to install a skill directly from the registry.

npx clawhub@latest install justserpapi-web-rendered-html

2. Manual Installation

Copy the skill folder to one of these locations

Global
~/.openclaw/skills/
Workspace
<project>/skills/

Priority: Workspace > Local > Bundled

3. Prompt Installation

Copy this prompt to OpenClaw to install it automatically.

Help me install justserpapi-web-rendered-html using Clawhub. If Clawhub is not installed, install it first (npm i -g clawhub).

Prefer to download?

Get the raw skill files in a ZIP archive.

What is Web Crawling Rendered Html API?

The Web Crawling Rendered Html API is a highly focused tool designed for developers and AI agents searching for precise scraping capabilities. By leveraging this tool within the Openclaw Skills catalog, agents can effortlessly access the GET /api/v1/web/rendered-html endpoint provided by Just Serp API. This skill is optimized specifically for static page crawling, metadata extraction, and page structure analysis, making it an essential utility for modern data pipelines.

Rather than managing resource-intensive browser engines, developers can integrate this skill to retrieve full raw rendered HTML directly. The skill operates cleanly, providing the lightweight scaffolding necessary to inject web content directly into larger applications, LLMs, or local search scripts.

Web Crawling Rendered Html API Use Cases

  • Web Scraping and Parsing: Extract precise page content, articles, or structural details from targeted web pages.
  • SEO and Metadata Auditing: Retrieve headers, schema markup, and metadata from fully rendered HTML layouts.
  • Page Structure Analysis: Analyze HTML hierarchies and DOM nodes to build scraping patterns or selectors.
  • AI Agent Research Context: Feed high-fidelity rendered web pages directly to LLMs to enhance search and document retrieval tasks.

How Web Crawling Rendered Html API Works

  1. Initiate Request: The developer or AI workflow specifies a target URL through the Openclaw Skills interface.
  2. Parameter Evaluation: The skill parses the input to confirm the required url parameter is active and properly structured.
  3. Request Dispatch: The tool executes a GET request against the /api/v1/web/rendered-html endpoint using the credentials configured in the environment.
  4. HTML Rendering: Just Serp API processes the web crawl, extracts the raw rendered HTML, and passes it back to the client.
  5. Summary and Delivery: The output yields an immediate status summary followed by the raw JSON containing the target HTML structure.

Web Crawling Rendered Html API Setup

To set up this skill, ensure that Node.js is configured on your machine. You will need a valid API key from Just Serp API to authenticate requests.

First, set your environment variables:

export JUST_SERP_API_KEY="your_just_serp_api_key_here"

Execute the skill locally using the command-line interface helper provided in Openclaw Skills:

node {baseDir}/bin/run.mjs --operation "renderedHtml" --api-key "$JUST_SERP_API_KEY" --params-json '{"url":"<target_url_here>"}'

Keep your API key secure and avoid posting credential strings in application logs or screenshots.

Web Crawling Rendered Html API Data Schema & Taxonomy

This skill uses a single primary input and structures responses around the standard web crawl results.

Inputs Schema

Parameter In Required Type Notes
url query Yes string The full URL of the webpage to crawl (e.g., 'https://www.example.com')

Output Schema

The output features the following elements:

  • Operation Identification: Echoes the operation renderedHtml on /api/v1/web/rendered-html.
  • Scope Definition: Confirms the lookup scope parameters (the target url).
  • Target Content: Returns the full, raw rendered HTML content optimized for static structures.
  • Error State Reporting: In the event of a failure, the return payload exposes the exact backend payload error and operation ID.

Web Crawling Rendered Html API Advanced Features

  • Direct Rendered HTML Retrieval: Avoids bloated browser simulation by fetching rendered content directly from Just Serp API.
  • Standard CLI Integration: Runs with minimal dependencies via node scripts, perfect for automated DevOps cron jobs.
  • Secure Token Passing: Relies on system env variables for API keys to maintain standard compliance with Openclaw Skills security profiles.
  • Granular Error Handling: Provides developers and agents with explicit error logs mapping the exact failed operation and query scope.

SKILL.md


Loading

Related Openclaw Skills

METADATA

Requires
Bins node
Github Stars: 0
forks: 0

Featured*