An intelligent file management utility for identifying and removing duplicate files through content hashing and customizable safety protocols.
Install & Download
1. ClawHub CLI
The fastest way to install a skill directly from the registry.
npx clawhub@latest install file-deduplicator
2. Manual Installation
Copy the skill folder to one of these locations
~/.openclaw/skills/ <project>/skills/ Priority: Workspace > Local > Bundled
3. Prompt Installation
Copy this prompt to OpenClaw to install it automatically.
Help me install file-deduplicator using Clawhub. If Clawhub is not installed, install it first (npm i -g clawhub).
Prefer to download?
Get the raw skill files in a ZIP archive.
What is File-Deduplicator?
File-Deduplicator is a robust utility designed for developers and power users who need to reclaim disk space and maintain a clean digital environment. By leveraging advanced Openclaw Skills, this tool goes beyond simple filename matching to perform deep content hashing (MD5), ensuring that identical files are identified even if they have been renamed or moved across different directories.
Whether you are managing massive media libraries, document archives, or complex development projects, this skill provides a programmatic way to scan directories recursively, exclude specific patterns like node_modules, and handle duplicates safely. It is an essential addition to any automated system maintenance workflow using Openclaw Skills.
File-Deduplicator Use Cases
- Digital Hoarder Cleanup: Scan large photo or video libraries to reclaim gigabytes of wasted storage space by identifying bit-for-bit duplicates.
- Document Version Control: Clean up redundant PDFs and reports while keeping only the latest versions based on file metadata.
- Development Project Maintenance: Remove duplicate build artifacts or redundant source files across multiple project folders to keep your workspace lean.
- Backup Optimization: Identify and prune redundant files within backup drives to reduce cloud storage costs and sync times.
How File-Deduplicator Works
- Initialize a scan by defining target directories and selecting a detection method such as content, size, or name-based comparison.
- The skill performs a recursive traversal of the filesystem, applying exclusion patterns and calculating unique file hashes.
- A comprehensive analysis report is generated, displaying potential space savings and categorized duplicate groups.
- Users can execute removal actions—including delete, move, or archive—based on specific logic like keeping the newest or smallest file.
- All actions are recorded in a recovery log, and safety thresholds are applied to prevent the accidental deletion of critical large-scale assets.
File-Deduplicator Setup
To integrate this capability into your environment, install it via the CLI using the following command:
clawhub install file-deduplicator
After installation, you can refine your detection logic and exclusion rules within the config.json file to customize how these Openclaw Skills interact with your local or networked storage.
File-Deduplicator Data Schema & Taxonomy
The skill organizes its findings and metadata using a structured format to ensure transparency and recoverability:
| Component | Description |
|---|---|
duplicates |
An array of objects grouping identical files by their MD5 hash or size metadata. |
spaceWasted |
A calculated metric representing the total byte count of redundant data found during the scan. |
actionLog |
A persistent log file containing a history of all moved or deleted files, enabling undo functionality. |
config.json |
Global settings for detection methods, name similarity thresholds, and directory whitelists. |
File-Deduplicator Advanced Features
- Dry-Run Preview: Generate a complete report of planned actions to see exactly which files would be affected before any deletions occur.
- Archive Workflow: Instead of permanent deletion, move duplicates to a designated archive directory to ensure zero data loss.
- Size Thresholding: Configure the skill to automatically skip files larger than a specific limit to avoid accidental loss of massive datasets.
- Content-Based Hashing: Utilize high-accuracy MD5 comparison that identifies duplicates regardless of filename or directory location.
- Flexible Comparison Logic: Toggle between content-based, size-based, or name-based detection to balance speed and accuracy within your Openclaw Skills workflow.
SKILL.md
Loading
Related Openclaw Skills
Content Recycler
A powerful automation tool for transforming long-form articles into platform-optimized social media posts and multi-day content calendars.
AffiliateMaster
AffiliateMaster is a comprehensive automation suite for Openclaw Skills designed to handle link generation, revenue tracking, and FTC-compliant content integration.
ClawDog Backup
A robust automated backup and restoration utility for OpenClaw core configuration files and memory layers via OneDrive.
DoNotify Voice Reminders
A powerful skill to send immediate or scheduled voice call reminders directly to your phone via the DoNotify API.
Landing Page Generator
An automated engine for generating high-converting, SEO-optimized landing pages using proven copywriting frameworks and responsive design.
Markdown-Formatter
A comprehensive tool for formatting and linting markdown documents to ensure professional consistency across various style guides.
Featured*
