LongCat-Audio-Codec: An Audio Tokenizer and Detokenizer Solution Designed for Speech Large Language Models
We are excited to introduce
LongCat-Audio-Codec
, an audio tokenizer and detokenizer solution designed for speech large language models. It works by generating semantic and acoustic tokens in parallel, enabling high-fidelity audio reconstruction at extremely low bitrates with excellent backend support for Speech LLM.
This repository hosts the resources for
LongCat-Audio-Codec
. For complete documentation, installation guides, and usage examples, please visit our
GitHub Repository
.
🗺️ Framework
✨ Key Features
High Fidelity at Ultra-Low Bitrates:
As a codec, it achieves high-intelligibility audio reconstruction at extremely low bitrates.
Low-Frame-Rate Tokenizer:
As a tokenizer, it extracts semantic and acoustic tokens in parallel at a low frame rate of 16.6Hz, with flexible acoustic codebook configurations to adapt to different downstream tasks.
Low-Latency Streaming Detokenizer:
Equipped with a specially designed streaming detokenizer that requires minimal future information to deliver high-quality audio output with low latency.
Super-Resolution Capability:
Integrates audio super-resolution processing into the detokenizer, enabling the generation of high-quality audio with a higher sample rate if the sample rate of original input is lower than 24khz.
📦Resources
Resourcess
Notes
LongCatAudioCodec_encoder
encoder weights of LongCat-Audio-Codec with semantic encoder and acoustic encoder
LongCatAudioCodec_encoder_cmvn
coefficients of Cepstral Mean and Variance Normalization, used by encoder
LongCatAudioCodec_decoder16k_4codebooks
native 16k decoder, supply 1 semantic codebook and at most 3 acoustic codebooks
super-resolution 24k decoder, supply 1 semantic codebook and at most 3 acoustic codebooks
📚 Citation
If you find our work useful in your research, please consider citing:
@article{longcataudiocodec,
title={LongCat-Audio-Codec: An Audio Tokenizer and Detokenizer Solution Designed for Speech Large Language Models},
author={Xiaohan Zhao, Hongyu Xiang, Shengze Ye, Song Li, Zhengkun Tian, Guanyu Chen, Ke Ding, Guanglu Wan},
organization={LongCat Team, Meituan},
year={2025}
}
📜 License
The code and models in this repository are released under the
MIT License
. This grants you broad permissions to use, copy, modify, and distribute the software, provided you include the original copyright notice. We claim no ownership over any content you generate using these models.
The software is provided "AS IS", without any warranty. You are fully accountable for your use of the models. Your usage must not involve creating or sharing any content that violates applicable laws, causes harm to individuals, disseminates personal information with harmful intent, spreads misinformation, or targets vulnerable groups.
📩 Contact
Please contact us at
[email protected]
or open an issue if you have any questions.
Runs of meituan-longcat LongCat-Audio-Codec on huggingface.co
0
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs
More Information About LongCat-Audio-Codec huggingface.co Model
LongCat-Audio-Codec huggingface.co is an AI model on huggingface.co that provides LongCat-Audio-Codec's model effect (), which can be used instantly with this meituan-longcat LongCat-Audio-Codec model. huggingface.co supports a free trial of the LongCat-Audio-Codec model, and also provides paid use of the LongCat-Audio-Codec. Support call LongCat-Audio-Codec model through api, including Node.js, Python, http.
LongCat-Audio-Codec huggingface.co is an online trial and call api platform, which integrates LongCat-Audio-Codec's modeling effects, including api services, and provides a free online trial of LongCat-Audio-Codec, you can try LongCat-Audio-Codec online for free by clicking the link below.
meituan-longcat LongCat-Audio-Codec online free url in huggingface.co:
LongCat-Audio-Codec is an open source model from GitHub that offers a free installation service, and any user can find LongCat-Audio-Codec on GitHub to install. At the same time, huggingface.co provides the effect of LongCat-Audio-Codec install, users can directly use LongCat-Audio-Codec installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
LongCat-Audio-Codec install url in huggingface.co: