A high-performance tool for detecting and managing duplicate or visually similar images using perceptual hashing.
Install & Download
1. ClawHub CLI
The fastest way to install a skill directly from the registry.
npx clawhub@latest install image-deduplicator
2. Manual Installation
Copy the skill folder to one of these locations
~/.openclaw/skills/ <project>/skills/ Priority: Workspace > Local > Bundled
3. Prompt Installation
Copy this prompt to OpenClaw to install it automatically.
Help me install image-deduplicator using Clawhub. If Clawhub is not installed, install it first (npm i -g clawhub).
Prefer to download?
Get the raw skill files in a ZIP archive.
What is Image Deduplicator?
The Image Deduplicator is a robust utility designed to streamline image management by identifying redundant files. By leveraging both MD5 hashing for byte-for-byte matches and perceptual hashing (pHash) for visual similarity, this Openclaw Skills contribution allows developers and content creators to clean up large datasets efficiently. It handles various formats like JPG, PNG, and BMP, ensuring your storage remains optimized without requiring manual inspection of every file.
Image Deduplicator Use Cases
- Cleaning up duplicate photo backups in local or cloud storage.
- Deduplicating large-scale image datasets before training machine learning models.
- Identifying near-identical screenshots or resized versions of the same marketing assets.
- Organizing messy media folders by automatically moving duplicates to a designated quarantine directory.
How Image Deduplicator Works
- The skill scans a target directory for image files based on user-defined extensions.
- It generates cryptographic MD5 hashes for exact matches and pHash values for visual similarity detection.
- Files are grouped based on their hash signatures according to the specified similarity threshold.
- The skill executes a chosen action—list, delete, or move—to handle duplicate files while preserving the original instance.
Image Deduplicator Setup
To use this tool within the Openclaw Skills ecosystem, install the necessary Python dependencies:
pip install pillow imagehash
Ensure the script is executable within your environment to begin scanning your directories.
Image Deduplicator Data Schema & Taxonomy
| Property | Description |
|---|---|
| Threshold | Integer (0-100) determining similarity sensitivity (default 100 for exact) |
| Actions | Supported operations: list, delete, move |
| Extensions | Default scanned formats: jpg, jpeg, png, bmp |
| Hash Types | Employs MD5 for exact bits and pHash for perceptual similarity |
Image Deduplicator Advanced Features
- Adjustable similarity threshold for fine-tuned near-duplicate detection.
- Batch processing capabilities designed for handling high-volume image folders.
- Flexible output management allowing users to move duplicates to a specific folder instead of immediate deletion.
- Custom extension filtering to target specific media types within complex directory structures.
SKILL.md
Loading
Related Openclaw Skills
Image Cropper
A high-performance utility for extracting specific objects from image datasets based on standard bounding box annotation formats.
Image Annotation QC
An automated quality control tool for validating, scoring, and visualizing image annotation accuracy in computer vision datasets.
Dataset Splitter
A robust utility for automatically partitioning image datasets and annotations into training, validation, and testing subsets.
Daily Horoscope & Almanac
A specialized agent for querying traditional Chinese Almanac data, providing daily auspicious and inauspicious guidance.
Image Quality Filter
An automated computer vision tool designed to detect and filter out blurry, poorly lit, or low-resolution images from datasets.
Jiugong Feixing (Flying Star Feng Shui)
An AI-powered calculation tool for Nine Palace Flying Star Feng Shui to determine auspicious and inauspicious directions based on time cycles.
Featured*
