A statistical analysis engine for text that evaluates linguistic complexity, predictability, and authenticity through advanced NLP metrics.
Install & Download
1. ClawHub CLI
The fastest way to install a skill directly from the registry.
npx clawhub@latest install nlp-toolkit
2. Manual Installation
Copy the skill folder to one of these locations
~/.openclaw/skills/ <project>/skills/ Priority: Workspace > Local > Bundled
3. Prompt Installation
Copy this prompt to OpenClaw to install it automatically.
Help me install nlp-toolkit using Clawhub. If Clawhub is not installed, install it first (npm i -g clawhub).
Prefer to download?
Get the raw skill files in a ZIP archive.
What is NLP Toolkit?
The NLP Toolkit is a powerful utility designed for Openclaw Skills to perform deep linguistic forensics. It employs mathematical models to calculate perplexity, burstiness, and Shannon entropy, providing developers with the tools needed to distinguish between human-written and AI-generated content. By analyzing token distribution and sentence variance, it offers a quantitative measure of text naturalness and complexity.
This skill is particularly valuable for developers building content moderation systems, academic integrity tools, or linguistic research workflows. As part of the Openclaw Skills ecosystem, it provides a standardized way to extract statistical metadata from any text string, enabling more intelligent decision-making for AI agents.
NLP Toolkit Use Cases
- Identifying AI-generated text by analyzing low-perplexity and uniform burstiness patterns.
- Performing linguistic research to calculate the vocabulary richness and information density of documents.
- Content moderation and quality assurance by filtering for low-entropy or repetitive text.
- Benchmarking the output of other Openclaw Skills to ensure generated text maintains a human-like variation.
How NLP Toolkit Works
- The skill receives a text string and verifies it meets the minimum length requirement for statistical significance.
- It calculates a perplexity score based on the ratio of unique tokens to the total word count to measure predictability.
- Burstiness is determined by calculating the coefficient of variation in sentence lengths, identifying robotic uniformity.
- Shannon entropy is computed to measure character-level randomness and information density.
- The system aggregates these metrics to produce an AI-detection confidence score based on predefined or custom thresholds.
NLP Toolkit Setup
To deploy this skill within your environment, ensure the script is located in your agent's skills directory. You can configure the sensitivity thresholds in your configuration file.
# Move the toolkit to your skills directory
mv nlp-toolkit.js ./path/to/your/skills/
Define the following parameters in your configuration to tune the detection engine:
{
"perplexityThreshold": 45.0,
"burstinessThreshold": 0.35,
"minTextLength": 50
}
NLP Toolkit Data Schema & Taxonomy
The NLP Toolkit returns a structured object containing detailed statistical metrics and a final determination.
| Property | Type | Description |
|---|---|---|
| isAI | Boolean | True if metrics fall below the specified thresholds. |
| confidence | Number | A percentage (0-100) representing the certainty of the analysis. |
| metrics.perplexity | Float | The predictability score of the text; lower values suggest AI. |
| metrics.burstiness | Float | The variation in sentence structure; lower values suggest AI. |
| metrics.entropy | Float | The information density based on character distribution. |
| tokenStats | Object | Contains totalWords, uniqueWords, and vocabularyRichness. |
NLP Toolkit Advanced Features
- Multi-metric analysis combining perplexity and burstiness for higher accuracy in AI detection.
- Configurable thresholds allowing for domain-specific tuning (e.g., technical docs vs. creative writing).
- Detailed token distribution stats to identify vocabulary exhaustion in generated content.
- Modular architecture allowing other Openclaw Skills to import individual statistical functions like calculateEntropy.
SKILL.md
Loading
Related Openclaw Skills
Image Detection Skills
A comprehensive suite of tools for identifying AI-generated imagery and analyzing visual metadata through local and cloud-based models.
Hash Toolkit
A versatile utility for generating multi-algorithm hashes and perceptual signatures to manage content integrity and deduplication.
GPT Analyzer
A sophisticated detection engine for identifying GPT-generated content through model fingerprinting and linguistic pattern analysis.
Geo Shield
A powerful tool for country-based content filtering, VPN detection, and regional law compliance.
NSFW Detection Skills
A comprehensive suite of safety tools for detecting and filtering explicit content using Openclaw Skills.
NSFW Detector Pro
An advanced AI-powered content moderation system for real-time detection of explicit images, videos, and text.
Featured*
