SenseAudio Video Gen for Openclaw

A developer tool that compiles HTML templates, website captures, and AI narration into frame-accurate, production-grade MP4 video files.

fridaylifan
v1.0.0
May 25, 2026
0
609
0

Install & Download

1. ClawHub CLI

The fastest way to install a skill directly from the registry.

npx clawhub@latest install senseaudio-video-gen

2. Manual Installation

Copy the skill folder to one of these locations

Global
~/.openclaw/skills/
Workspace
<project>/skills/

Priority: Workspace > Local > Bundled

3. Prompt Installation

Copy this prompt to OpenClaw to install it automatically.

Help me install senseaudio-video-gen using Clawhub. If Clawhub is not installed, install it first (npm i -g clawhub).

Prefer to download?

Get the raw skill files in a ZIP archive.

What is SenseAudio Video Gen?

SenseAudio Video Gen is a production-grade tool designed to orchestrate complex programmatic video creation workflows. By treating HTML and CSS as the definitive source of truth for visual designs, developers can leverage headless Chrome and FFmpeg to render perfectly synchronized, frame-accurate MP4 animations. The skill integrates AudioClaw LLM routing for intelligent scriptwriting and storyboard layout planning alongside SenseAudio's powerful media generation APIs for speech synthesis, voice modeling, and automated soundtrack generation.

As a core asset among Openclaw Skills, this pipeline replaces manual video editing suites with a flexible code-first approach. It programmatically transforms website assets, documentation directories, or text summaries into beautiful product explainers, features videos, or social campaigns.

SenseAudio Video Gen Use Cases

  • Automated Explainer Videos: Convert website interfaces, screenshots, and custom briefs into styled presentation and feature walkthrough videos.
  • Documentation to Video Conversion: Convert Markdown READMEs or code files into video walkthroughs featuring synchronized audio narration and styled visuals.
  • Audio-Reactive Interfaces: Dynamically pulse UI components, waveform designs, and text callouts in perfect sync with vocal patterns and background audio beds.
  • Scale-Ready Ad Campaigns: Generate dozens of video localized variants simply by tweaking CSS variables, asset arrays, and voice properties.

How SenseAudio Video Gen Works

  1. Source Parsing: Extracts website structural zones, styling guidelines, and page content using site-ingest or local markdown files via source-ingest.
  2. AI Storyboarding: Deploys an AudioClaw LLM agent to plan visual sequences, storyboard frames, and narrative scripts matching target video durations.
  3. Audio & Media Synthesis: Generates studio-quality TTS voiceovers and soundtracks using SenseAudio APIs while automatically aligning timed scripts.
  4. Telemetry Extraction: Parses the narration files to extract frame-by-frame audio intensity, creating telemetry files that drive browser-based movement.
  5. Rendering & Compilation: Launches a headless browser running local timelines, captures frames deterministically on step updates (renderFrame), and compiles them with audio into highly optimized MP4 media via FFmpeg.

SenseAudio Video Gen Setup

Configure your credentials separately to secure your media generation and LLM pipelines:

# Configure media creation endpoints
export SENSEAUDIO_API_KEY="your_sense_audio_api_key"

# Configure LLM orchestration settings (if customizing outside default local profiles)
export AUDIOCLAW_CONFIG_PATH="config/audioclaw.json"
export AUDIOCLAW_LLM_MODEL="doubao-seed-2-0-pro-260215"
export AUDIOCLAW_LLM_BASE_URL="https://platform.senseaudio.cn/v1"
export AUDIOCLAW_LLM_API_KEY="your_audioclaw_llm_key"

SenseAudio Video Gen Data Schema & Taxonomy

File Path Role Key Properties
senseframe.json Orchestration Manifest Stores global timing, frames configs, visual preset parameters, and file relationships.
assets/asset-manifest.json Asset Directory Lists active files, tracking generated images, video b-rolls, audio cues, and status logs.
assets/timeline.json Transition Spec Declares keyframe steps, GSAP-compatible motion tracks, and camera paths.
assets/audio-data.json Audio Telemetry Contains precise frequency band readings to enable reactive HTML styling patterns.
assets/captions.json Subtitle Data Tracks timed word blocks supporting highlight structures for karaoke layouts.
assets/site-profile.json Structured Scrapes Documents crawled headings, brand keywords, logo metadata, and semantic site parts.

SenseAudio Video Gen Advanced Features

  • Deterministic Animation Tracking: Syncs programmatic timelines directly to capturing updates using window.renderFrame(time), eliminating lag and browser rendering drift.
  • HyperFrames-Style Scrapes: Dismisses popups, interacts with cookie warnings, and pans through website layouts using custom scroll positions.
  • Audio-Responsive Elements: Emits frequency energy metrics to DOM interfaces, powering dynamic glows, scaling visualizers, and timing effects.
  • Self-Healing Error Correction: Evaluates completed video frames with built-in visual checks, correcting cropped elements or misaligned designs automatically.

SKILL.md


Loading

Related Openclaw Skills

METADATA

Github Stars: 0
forks: 0

Featured*