A specialized diagnostic tool designed to uncover hollow or fake validation tests that falsely signal AI agent skill reliability.
Install & Download
1. ClawHub CLI
The fastest way to install a skill directly from the registry.
npx clawhub@latest install hollow-validation-checker
2. Manual Installation
Copy the skill folder to one of these locations
~/.openclaw/skills/ <project>/skills/ Priority: Workspace > Local > Bundled
3. Prompt Installation
Copy this prompt to OpenClaw to install it automatically.
Help me install hollow-validation-checker using Clawhub. If Clawhub is not installed, install it first (npm i -g clawhub).
Prefer to download?
Get the raw skill files in a ZIP archive.
What is Hollow Validation Checker?
The Hollow Validation Checker is a critical utility for maintaining the integrity of Openclaw Skills by identifying validation commands that create an illusion of testing. In AI agent marketplaces, a validation field often serves as a proxy for trust; however, developers may inadvertently or intentionally use echo commands or tautological assertions that always pass without verifying actual behavior. This tool helps developers and users verify that the testing layer of an agent is substantive and provides real assurance of functionality.
By analyzing validation fields in Capsule or Gene JSON files, this tool protects the ecosystem from the false floor of quality created by exit code gaming and empty test functions. It ensures that every skill registered under Openclaw Skills meets a baseline of technical truth rather than just superficial passing marks.
Hollow Validation Checker Use Cases
- Auditing third-party AI agents for reliability before deployment into production environments.
- Improving local development workflows for Openclaw Skills by ensuring assertions are meaningful and effective.
- Batch processing a library of skills to identify weak or unvalidated components across a marketplace.
- Preventing exit code gaming where failures are suppressed by shell operators like || true.
How Hollow Validation Checker Works
- The user provides a Capsule JSON, a raw validation command, or a batch of scripts for analysis.
- The checker scans the input for known patterns of hollow validation, such as static echo strings or hardcoded success messages.
- It performs a substantive assertion inventory, looking for actual verification logic versus superficial outputs.
- The tool evaluates suppressed failure patterns, such as the use of || true or catch-all exit codes in shell environments.
- It generates a comprehensive quality report categorizing the skill as SUBSTANTIVE, WEAK, or HOLLOW based on findings.
Hollow Validation Checker Setup
To begin using this tool with Openclaw Skills, ensure you have the necessary dependencies installed on your system.
# Verify required binaries are installed
python3 --version
curl --version
# Run the checker against a specific skill capsule
# python3 checker.py --file skill_capsule.json
Hollow Validation Checker Data Schema & Taxonomy
The checker produces a structured quality report that breaks down the technical validity of the target skill. This data is organized as follows:
| Field | Description |
|---|---|
| Validation Breakdown | Detailed analysis of individual command strings and their intent. |
| Assertion Inventory | A tally of real functional assertions versus hollow or echo-only outputs. |
| Quality Rating | Final classification: SUBSTANTIVE, WEAK, or HOLLOW. |
| Specific Findings | Itemized evidence of test theater or tautological checks. |
| Recommendations | Actionable advice for the publisher to improve test coverage. |
Hollow Validation Checker Advanced Features
- Batch analysis for comparing validation quality across multiple Openclaw Skills simultaneously.
- Detection of commented-out real tests that leave only a passing shell behind.
- Identification of tautological logic such as assert True or equivalent always-true comparisons.
- Recognition of exit code gaming that prevents validation failures from being reported to the agent host.
SKILL.md
Loading
Related Openclaw Skills
GEP Immune Auditor
A sophisticated security agent that serves as an immune system for AI ecosystems by scanning assets for malicious patterns and intent.
Evolution Drift Detector
A specialized security utility that identifies how AI agent skills silently mutate and accumulate risks across multiple inheritance generations.
Economic Incentive Misalignment Detector
A strategic diagnostic tool that identifies structural marketplace pressures favoring publication volume over security and safety quality.
Delta Disclosure Auditor
A security-focused auditor that identifies transparency gaps in skill updates by verifying machine-readable deltas and chain-of-custody records.
Install-Then-Update Trap Detector
Detects malicious updates in AI agent skills that pass initial security audits but introduce backdoors through subsequent automatic updates.
Observer Effect Probe
A sophisticated security analysis tool that detects AI agent skills designed to hide malicious behavior when they sense they are being monitored in a sandbox.
Featured*
