A specialized CLI tool for automating AWS S3 bulk uploads with intelligent, character-based file organization.
Install & Download
1. ClawHub CLI
The fastest way to install a skill directly from the registry.
npx clawhub@latest install s3-sort
2. Manual Installation
Copy the skill folder to one of these locations
~/.openclaw/skills/ <project>/skills/ Priority: Workspace > Local > Bundled
3. Prompt Installation
Copy this prompt to OpenClaw to install it automatically.
Help me install s3-sort using Clawhub. If Clawhub is not installed, install it first (npm i -g clawhub).
Prefer to download?
Get the raw skill files in a ZIP archive.
What is S3 Bulk Upload?
S3 Bulk Upload is a robust utility designed to simplify large-scale data migration to Amazon S3. By leveraging Openclaw Skills, developers can automate the process of sorting files into logical subdirectories based on their starting characters (e.g., a/, b/, 0-9/). This prevents bucket clutter and optimizes object retrieval performance.
This skill bridges the gap between raw AWS CLI commands and organized storage management. It provides a structured approach to cloud uploads, ensuring that every file—whether an asset, log, or document—is placed in a predictable location according to a predefined organizational logic.
S3 Bulk Upload Use Cases
- Managing massive asset libraries by automatically sorting files alphabetically in S3 buckets.
- Automating cloud backups where structured organization is required for easier manual auditing.
- Optimizing S3 bucket performance by distributing files across multiple prefixes to avoid request throttling.
- Transitioning local data to the cloud while applying specific storage classes via Openclaw Skills for cost management.
How S3 Bulk Upload Works
- The skill scans a designated local source directory for files.
- For each file, it identifies the first character of the filename and normalizes it to lowercase.
- It maps the character to a specific prefix: letters a-z go to their respective folders, numbers go to 0-9, and others go to _other.
- It leverages the AWS CLI to perform the upload, either through individual copy commands or an efficient sync operation.
- Users can verify the upload success by generating manifests or counting files per prefix using Openclaw Skills integrated scripts.
S3 Bulk Upload Setup
To use this skill, ensure you have the AWS CLI installed and your credentials configured.
# Install AWS CLI
brew install awscli
# Configure credentials
export AWS_ACCESS_KEY_ID="your_key"
export AWS_SECRET_ACCESS_KEY="your_secret"
# Verify access
aws sts get-caller-identity
S3 Bulk Upload Data Schema & Taxonomy
The skill organizes files within the S3 bucket using a strict prefix-based taxonomy:
| Character Type | Prefix | Example Destination |
|---|---|---|
| Alphabetical (A-Z, a-z) | lowercase character | s3://bucket/a/apple.txt |
| Numeric (0-9) | 0-9/ | s3://bucket/0-9/100.dat |
| Special/Other | _other/ | s3://bucket/_other/!file.zip |
This schema ensures that Openclaw Skills can consistently locate and manage objects regardless of the total file volume.
S3 Bulk Upload Advanced Features
- Efficient Staging: Supports creating a symlink-based staging directory to enable high-speed sync operations without duplicating local disk usage.
- Multi-Storage Class Support: Easily switch between Standard, Infrequent Access (IA), and Glacier Instant Retrieval to optimize AWS costs.
- Dry Run Mode: Preview the entire organization structure and upload path before committing any changes to S3.
- Automated Verification: Built-in manifest generation and per-prefix file counting to ensure data integrity after bulk operations.
SKILL.md
Loading
Related Openclaw Skills
M2M Ads
A machine-to-machine classified marketplace where AI agents autonomously buy, sell, and exchange goods using cryptographic identities.
Find Profitable Stocks
A financial analysis tool that identifies high-quality companies by calculating Free Cash Flow and aggregate health scores.
Singapore Property Scraper
An advanced property search tool that scrapes Singapore rental and sale listings with support for MRT proximity and commute time filtering.
Arbiter
A decision-brokering skill that allows AI agents to push complex plans and architectural choices for asynchronous human review and approval.
Meerkat Governance
A dual-endpoint governance API that protects agents from malicious inputs and verifies AI outputs for factual accuracy and safety.
Memory Curator
A high-performance utility designed to transform verbose agent logs into compact, indexed memory digests.
Featured*
