From Music — AI Video Generation Skill for Openclaw

From Music is a high-performance AI video creation skill that converts audio tracks into music-driven 1080p videos using cloud GPU rendering.

peand-rover
v1.0.0
Apr 30, 2026
0
292
0

Install & Download

1. ClawHub CLI

The fastest way to install a skill directly from the registry.

npx clawhub@latest install from-music

2. Manual Installation

Copy the skill folder to one of these locations

Global
~/.openclaw/skills/
Workspace
<project>/skills/

Priority: Workspace > Local > Bundled

3. Prompt Installation

Copy this prompt to OpenClaw to install it automatically.

Help me install from-music using Clawhub. If Clawhub is not installed, install it first (npm i -g clawhub).

Prefer to download?

Get the raw skill files in a ZIP archive.

What is From Music — AI Video Generation Skill?

From Music is an advanced integration for Openclaw Skills designed to bridge the gap between audio production and visual content creation. By leveraging remote GPU nodes, this skill allows developers and creators to transform a standard MP3 or WAV track into a fully realized 1080p MP4 video with minimal manual intervention. The system eliminates the need for complex video editing software by handling timeline management and export settings through simple natural language commands.

The skill excels at generating videos from music tracks that are perfectly synchronized to the rhythm. Whether you are creating Spotify Canvas loops, YouTube lyric videos, or social media promos, it uses a sophisticated Server-Sent Events (SSE) stream to communicate with a cloud-based rendering engine, ensuring high-fidelity results in under two minutes.

From Music — AI Video Generation Skill Use Cases

  • Creating social-ready 1080p videos from music tracks with automatic beat-synced transitions.
  • Generating visualizers for musicians and content creators directly from audio files.
  • Batch processing multiple audio tracks into video formats for rapid content scaling.
  • Iterative video editing through natural language prompts to refine visual layers and text overlays.

How From Music — AI Video Generation Skill Works

  1. Authentication: The skill checks for a NEMO_TOKEN or automatically provisions an anonymous token via a UUID client identifier.
  2. Session Initialization: A project session is established with the cloud backend to maintain state across multiple edits.
  3. Media Upload: Audio files (MP3, WAV, AAC) are uploaded to a remote staging area and assigned to the current session.
  4. Intent Processing: Natural language prompts are parsed to trigger specific actions like adding visualizers, text tracks, or video layers.
  5. Cloud Rendering: The backend composites the video layers on GPU nodes, applying H.264 compression for high-quality output.
  6. Export & Polling: The skill initiates a render job and polls the cloud proxy until a download URL for the final MP4 is ready.

From Music — AI Video Generation Skill Setup

To get started with this skill in your Openclaw Skills environment, ensure your API token is configured.

# Set your environment variable
export NEMO_TOKEN="your_token_here"

# The skill will automatically connect to:
# https://mega-api-prod.nemovideo.ai

If no token is provided, the skill will attempt to generate an anonymous session token with 100 free credits upon first use.

From Music — AI Video Generation Skill Data Schema & Taxonomy

The skill utilizes a structured mapping for its cloud-based timeline and metadata:

Field Description Mapping
t Tracks Array of timeline layers
tt Track Type 0: Video, 1: Audio, 7: Text
sg Segments Defined timing for each clip
d Duration Length in milliseconds
m Metadata File properties and render settings

From Music — AI Video Generation Skill Advanced Features

  • Multi-Track Compositing: Support for simultaneous video, audio, and text tracks within a single session.
  • Beat-Sync Automation: Intelligent mapping of audio transients to visual cuts and transitions.
  • State Persistence: The session-based architecture allows for iterative refinements without re-uploading source assets.
  • Platform-Specific Optimization: Automatically applies optimal compression and aspect ratios for modern social platforms via Openclaw Skills.

SKILL.md


Loading

Related Openclaw Skills

METADATA

Requires
Github Stars: 0
forks: 0

Featured*