An AI-powered audio pipeline that transforms voice memos and humming into professional, quantized MIDI files.
Install & Download
1. ClawHub CLI
The fastest way to install a skill directly from the registry.
npx clawhub@latest install voice-note-to-midi
2. Manual Installation
Copy the skill folder to one of these locations
~/.openclaw/skills/ <project>/skills/ Priority: Workspace > Local > Bundled
3. Prompt Installation
Copy this prompt to OpenClaw to install it automatically.
Help me install voice-note-to-midi using Clawhub. If Clawhub is not installed, install it first (npm i -g clawhub).
Prefer to download?
Get the raw skill files in a ZIP archive.
What is Voice Note to MIDI?
The voice-note-to-midi skill provides a sophisticated audio-to-MIDI conversion pipeline directly within the Openclaw Skills framework. It is engineered to handle the nuances of human vocal recordings, such as pitch drift and background noise, by utilizing a multi-stage processing approach. This includes stem separation to isolate melodic content and Spotify's Basic Pitch model for polyphonic pitch extraction.
By integrating this tool into your musical workflow, you can bridge the gap between a spontaneous vocal idea and a structured digital composition. The skill goes beyond simple pitch detection by offering intelligent quantization and key-aware correction, ensuring that the generated MIDI files are musically accurate and ready for immediate use in any Digital Audio Workstation (DAW). It is a perfect example of how Openclaw Skills can streamline creative technical tasks.
Voice Note to MIDI Use Cases
- Capturing melodic ideas on the go using voice memos for later production.
- Converting hummed melodies into MIDI tracks for non-instrumentalist songwriters.
- Extracting lead lines from legacy audio recordings to create new arrangements.
- Rapid prototyping of synth lines using vocal guides during studio sessions.
How Voice Note to MIDI Works
- The pipeline performs Stem Separation using HPSS to isolate the melodic harmonic content from noise or percussive elements.
- It runs the processed audio through Spotify's Basic Pitch ML model to extract raw fundamental frequencies and note onsets.
- The system performs a detailed Pitch Analysis to detect the musical key and identify dominant note distributions.
- It applies Intelligent Quantization, snapping notes to a timing grid and performing optional key-aware pitch correction.
- Final post-processing removes harmonic overlaps (octave pruning) and merges legato notes for a clean, professional MIDI output.
Voice Note to MIDI Setup
To get started with this component from Openclaw Skills, ensure you have Python 3.11+ and FFmpeg installed. Use the automated setup script for a quick installation:
cd /path/to/voice-note-to-midi
./setup.sh
For manual installation and dependency management, you can set up a virtual environment and install the required libraries via pip:
mkdir -p ~/melody-pipeline
cd ~/melody-pipeline
python3 -m venv venv-bp
source venv-bp/bin/activate
pip install basic-pitch librosa soundfile mido music21
Voice Note to MIDI Data Schema & Taxonomy
The skill processes various audio inputs and generates structured MIDI data. The following table outlines the data handling:
| Data Type | Format | Description |
|---|---|---|
| Input | WAV, MP3, M4A, FLAC | High-quality uncompressed audio is recommended for best results. |
| Output | Standard MIDI (.mid) | Quantized MIDI file compatible with all modern DAWs. |
| Analysis | Metadata | Includes detected key (e.g., G Major), pitch range, and note count. |
The tool maintains a 120 BPM reference for the output file, while preserving the relative timing of the original performance.
Voice Note to MIDI Advanced Features
- Key-aware pitch correction to force detected notes into a specific musical scale automatically.
- Octave pruning and harmonic removal to eliminate ghost notes common in pitch detection.
- Configurable quantization grids (1/4, 1/8, 1/16, 1/32) to match the rhythm of your recording.
- Legacy MIDI processing mode that allows you to quantize and clean up existing MIDI files using the same intelligent pipeline.
- Integration with music21 for high-fidelity musical analysis and Krumhansl-Kessler key detection.
SKILL.md
Loading
Related Openclaw Skills
PostProxy Social Media Manager
A comprehensive integration for managing and automating social media content across all major platforms via the PostProxy API.
Paper Digest
An AI-driven research tool that fetches arXiv papers, analyzes their core citations via sub-agents, and compiles a cohesive executive summary.
MarkItDown Skill
A powerful Microsoft utility for converting complex document formats into clean Markdown for AI consumption.
Leetify CS2 Analytics
Automate CS2 player statistics retrieval and tactical demo analysis using the Leetify API.
Office Comic Relief
An AI-powered creative tool that generates warm, humorous Chinese-language vertical comics designed to help office workers decompress through relatable character dialogues.
GitHub Helper
A specialized tool for managing local GitHub repositories, indexing project knowledge, and streamlining Issue/PR tracking.
Featured*
