Audio Processing for Openclaw

A comprehensive toolset for audio ingestion, analysis, transformation, and generation using Whisper and Librosa.

iyeque
v1.1.0
Feb 17, 2026
0
0
0

Install & Download

1. ClawHub CLI

The fastest way to install a skill directly from the registry.

npx clawhub@latest install audio-processing

2. Manual Installation

Copy the skill folder to one of these locations

Global
~/.openclaw/skills/
Workspace
<project>/skills/

Priority: Workspace > Local > Bundled

3. Prompt Installation

Copy this prompt to OpenClaw to install it automatically.

Help me install audio-processing using Clawhub. If Clawhub is not installed, install it first (npm i -g clawhub).

Prefer to download?

Get the raw skill files in a ZIP archive.

What is Audio Processing?

The Audio Processing skill is a versatile suite designed to empower AI agents with the ability to handle complex sound-based tasks. By integrating this capability through Openclaw Skills, developers can bridge the gap between raw audio data and actionable text or insights. It supports high-fidelity transcription via OpenAI Whisper, text-to-speech synthesis via Google TTS, and deep audio feature extraction for analytical purposes.

Security and reliability are at the forefront of this skill's design. It includes rigorous path validation to prevent unauthorized file system access and implements strict character limits for synthesis tasks. Whether you are building an automated transcription service or a voice-responsive AI assistant, these Openclaw Skills provide the necessary infrastructure to manage audio workflows efficiently and securely.

Audio Processing Use Cases

  • Automating the transcription of recorded meetings or voice notes into structured text.
  • Creating text-to-speech (TTS) pipelines for generating dynamic audio notifications.
  • Performing voice activity detection (VAD) to identify and extract speech segments from long recordings.
  • Extracting audio features like duration and MFCC for machine learning classification tasks.
  • Normalizing or trimming audio files as a preprocessing step for media production.

How Audio Processing Works

  1. The AI agent initiates an action such as transcribe or transform by providing the required parameters like file paths or text strings.
  2. The skill performs a security audit, resolving absolute paths and ensuring the requested files are not in protected system directories.
  3. Based on the selected action, the skill invokes the relevant backend tool, such as Whisper for speech-to-text or Pydub for audio transformation.
  4. Processing is handled locally using high-performance libraries like FFmpeg and Librosa to ensure data privacy and speed.
  5. The processed results, such as transcription segments or the path to a newly generated MP3, are returned as a structured JSON object for the agent to use in subsequent steps.

Audio Processing Setup

To deploy this skill, you must have FFmpeg and Python 3.8+ installed on your system. Follow these steps to install the necessary dependencies:

# Install FFmpeg (macOS example)
brew install ffmpeg

# Install required Python libraries
pip install openai-whisper gTTS librosa pydub soundfile numpy webrtcvad-wheels

Audio Processing Data Schema & Taxonomy

The Audio Processing skill utilizes a standardized JSON schema for all inputs and outputs to ensure compatibility across Openclaw Skills workflows.

Action Input Parameters Key Output Fields
transcribe file_path, model text, segments
tts text, output_path file_path, status
extract_features file_path duration, sample_rate, mfcc_mean
vad_segments file_path segments (start/end timestamps)
transform file_path, ops file_path

Audio Processing Advanced Features

  • Support for multiple Whisper model sizes (tiny to large) to optimize for either speed or transcription accuracy.
  • Complex audio transformation chaining, allowing for simultaneous trimming, resampling, and normalization.
  • Built-in Voice Activity Detection (VAD) using silencedetect filters for efficient audio segmenting.
  • Comprehensive security layer that blocks access to root and system directories during file operations.
  • Seamless integration with other Openclaw Skills for multi-modal AI agent development.

SKILL.md


Loading

Related Openclaw Skills

METADATA

Github Stars: 0
forks: 0

Featured*