ACE-Step / acestep-captioner

huggingface.co
Total runs: 1.8K
24-hour runs: 27
7-day runs: -3
30-day runs: -427
Model's Last Updated: February 03 2026
text-to-audio

Introduction of acestep-captioner

Model Details of acestep-captioner

Tech Report

ACE-Step Captioner

Description

ACE-Step Captioner is the annotation model used by ACE-Step v1.5 for training data labeling. It is a professional-grade music captioning model that generates detailed, structured descriptions of audio content.

Performance

🏆 Accuracy surpasses Gemini Pro 2.5 in music description tasks

Key Features
  • 🎼 Musical Style Analysis - Identifies genres, sub-genres, and stylistic influences
  • 🎸 Instrument Recognition - Detects and describes 1000+ instrument types and combinations
  • 🎭 Structure & Progression - Analyzes musical arrangement including intro, verse, chorus, bridge, climax, and outro
  • 🔊 Timbre Description - Captures tonal qualities, textures, and sonic characteristics
  • 📝 Rich Vocabulary - Supports 1000+ descriptive terms for comprehensive music annotation
Usage

The usage is the same as Qwen2.5 Omni-7B .

Prompt Format

Use the following prompt to caption audio:

*Task* Describe this audio in detail
<audio>
Output Format

The model generates natural language descriptions covering multiple aspects of the music.

Example Output
A melancholic indie folk track featuring fingerpicked acoustic guitar 
as the primary instrument. The song opens with a sparse, contemplative 
intro before the vocals enter with a breathy, intimate delivery. 
The arrangement gradually builds through the verse, adding subtle 
string pads and a gentle kick drum. The chorus lifts with layered 
harmonies and a warmer, fuller texture. The bridge introduces a 
key change and emotional climax before returning to the stripped-down 
acoustic arrangement for the outro.
Descriptive Capabilities
Musical Styles (Examples)
Category Styles
Electronic Ambient, Techno, House, Drum & Bass, Synthwave, IDM, Downtempo
Rock Alternative, Indie, Post-Rock, Progressive, Psychedelic, Grunge
Pop Synth-pop, Electropop, Dream Pop, Art Pop, Indie Pop
Classical Orchestral, Chamber, Minimalist, Neo-Classical, Cinematic
World Latin, African, Middle Eastern, Asian Traditional, Celtic
Jazz Fusion, Smooth, Bebop, Modal, Free Jazz
Hip-Hop Trap, Boom Bap, Lo-fi, Instrumental, Cloud Rap
Instruments (1000+ Supported)
Category Examples
Strings Acoustic Guitar, Electric Guitar, Violin, Cello, Bass, Harp, Mandolin
Keys Piano, Synthesizer, Organ, Rhodes, Wurlitzer, Mellotron
Percussion Drums, Electronic Drums, Congas, Bongos, Timpani, Vibraphone
Wind Saxophone, Trumpet, Flute, Clarinet, Oboe, French Horn
Electronic Synth Bass, Pad, Lead, Arpeggiator, Sampler, 808, 303
Structure Analysis
  • Intro / Outro - Opening and closing sections
  • Verse / Pre-Chorus / Chorus - Main song structure
  • Bridge / Break - Transitional sections
  • Build-up / Drop / Climax - Dynamic progression
  • Interlude / Solo - Instrumental passages
Timbre Descriptions
Dimension Descriptors
Texture Warm, Bright, Dark, Crisp, Muddy, Clean, Distorted, Saturated
Space Reverberant, Dry, Spacious, Intimate, Cavernous, Tight
Dynamics Punchy, Soft, Aggressive, Gentle, Compressed, Dynamic
Character Ethereal, Gritty, Smooth, Raw, Polished, Organic, Synthetic
Use Cases
  • Music AI Training - Generate high-quality captions for music generation models
  • Music Information Retrieval - Create searchable metadata for audio databases
  • Content Moderation - Analyze and categorize music content
  • Music Education - Provide detailed analysis for learning purposes
  • Audio Production - Document and describe sound design elements

Runs of ACE-Step acestep-captioner on huggingface.co

1.8K
Total runs
27
24-hour runs
-67
3-day runs
-3
7-day runs
-427
30-day runs

More Information About acestep-captioner huggingface.co Model

More acestep-captioner license Visit here:

https://choosealicense.com/licenses/mit

acestep-captioner huggingface.co

acestep-captioner huggingface.co is an AI model on huggingface.co that provides acestep-captioner's model effect (), which can be used instantly with this ACE-Step acestep-captioner model. huggingface.co supports a free trial of the acestep-captioner model, and also provides paid use of the acestep-captioner. Support call acestep-captioner model through api, including Node.js, Python, http.

acestep-captioner huggingface.co Url

https://huggingface.co/ACE-Step/acestep-captioner

ACE-Step acestep-captioner online free

acestep-captioner huggingface.co is an online trial and call api platform, which integrates acestep-captioner's modeling effects, including api services, and provides a free online trial of acestep-captioner, you can try acestep-captioner online for free by clicking the link below.

ACE-Step acestep-captioner online free url in huggingface.co:

https://huggingface.co/ACE-Step/acestep-captioner

acestep-captioner install

acestep-captioner is an open source model from GitHub that offers a free installation service, and any user can find acestep-captioner on GitHub to install. At the same time, huggingface.co provides the effect of acestep-captioner install, users can directly use acestep-captioner installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

acestep-captioner install url in huggingface.co:

https://huggingface.co/ACE-Step/acestep-captioner

Url of acestep-captioner

acestep-captioner huggingface.co Url

Provider of acestep-captioner huggingface.co

ACE-Step
ORGANIZATIONS

Other API from ACE-Step

huggingface.co

Total runs: 59.5K
Run Growth: 8.5K
Growth Rate: 14.38%
Updated:February 03 2026