Pget enables high-throughput parallel file downloads and in-memory tar extraction for rapid data retrieval.
Install & Download
1. ClawHub CLI
The fastest way to install a skill directly from the registry.
npx clawhub@latest install pget
2. Manual Installation
Copy the skill folder to one of these locations
~/.openclaw/skills/ <project>/skills/ Priority: Workspace > Local > Bundled
3. Prompt Installation
Copy this prompt to OpenClaw to install it automatically.
Help me install pget using Clawhub. If Clawhub is not installed, install it first (npm i -g clawhub).
Prefer to download?
Get the raw skill files in a ZIP archive.
What is Pget Parallel Downloader?
Pget is a high-performance utility designed for developers using Openclaw Skills who need to move large volumes of data quickly. Unlike traditional tools like curl or wget, pget utilizes parallel chunking to maximize bandwidth when fetching files from HTTP(S), Amazon S3, or Google Cloud Storage. It is an essential tool for AI workflows that involve large model weights, datasets, or complex environment setups.
This skill significantly reduces the time spent waiting for assets by splitting large files into multiple chunks and downloading them simultaneously. Its ability to extract tar archives in-memory further optimizes performance by eliminating the need to write compressed files to disk before unpacking, making it a cornerstone for efficient automation within Openclaw Skills.
Pget Parallel Downloader Use Cases
- Downloading massive machine learning model weights or training datasets.
- Automated deployment of application environments using compressed tarballs.
- Batch processing hundreds of file downloads using a single manifest file.
- Enhancing CI/CD pipelines with high-speed asset retrieval in Openclaw Skills.
How Pget Parallel Downloader Works
- The user provides a source URL (HTTP, S3, or GCS) and a destination path.
- The utility initiates multiple parallel TCP connections based on the defined concurrency level.
- The file is requested in chunks, allowing for simultaneous data transfer across all available threads.
- For compressed archives, the skill processes the stream in-memory to extract files directly to the target directory.
- Upon completion, the tool verifies the file structure and provides logs for troubleshooting within the Openclaw Skills environment.
Pget Parallel Downloader Setup
To use this tool, ensure the pget binary is installed and accessible in your system path. For cloud storage access, ensure your environment variables (like AWS_ACCESS_KEY_ID or GOOGLE_APPLICATION_CREDENTIALS) are correctly configured.
# Basic file download
pget <url> <dest>
# Download and extract in one step
pget <url> <dest> -x
Pget Parallel Downloader Data Schema & Taxonomy
| Feature | Implementation Details |
|---|---|
| Supported Protocols | HTTP, HTTPS, S3, GCS |
| Archive Extraction | Supports .tar and .tar.gz via in-memory streaming |
| Manifest Format | Plain text file with URL DEST mapping per line |
| Parallelism | Configurable via --concurrency and --max-concurrent-files |
Pget Parallel Downloader Advanced Features
- In-memory extraction to optimize I/O performance and save disk space.
- Granular control over chunk sizes and connection retries for unstable network conditions.
- Manifest mode for orchestrating complex multi-file downloads in a single command.
- Native support for cloud-native storage buckets (S3/GCS) within Openclaw Skills.
- Verbose logging and debug modes for deep inspection of network throughput.
SKILL.md
Loading
Related Openclaw Skills
Reddit CLI
A lightweight command-line interface that enables Reddit interaction and content retrieval using session cookies instead of standard API keys.
Portfolio Risk & Optimization Analyzer
An AI-powered crypto portfolio analyzer that delivers deep risk metrics, stress testing, and automated optimization strategies while supporting a token buyback ecosystem.
OpenClaw Deck
A powerful multi-column web interface for side-by-side management and interaction with multiple OpenClaw agents.
Memory System v2.0
A lightweight, file-based memory system that allows AI agents to persist learnings and decisions with sub-20ms search performance.
Throwly MCP
An autonomous commerce protocol that enables AI agents to list items, negotiate deals, and execute point-based transactions.
Enterprise Budget Intelligence (budget-intel)
A sophisticated intelligence tool that synthesizes multi-source data to generate actionable enterprise budget estimates and sales strategies.
Featured*
