Readme
CosyVoice 2.0
Compared to version 1.0, the new version offers more accurate, more stable, faster, and better speech generation capabilities.
Multilingual
- Support Language : Chinese, English, Japanese, Korean, Chinese dialects (Cantonese, Sichuanese, Shanghainese, Tianjinese, Wuhanese, etc.)
- Crosslingual & Mixlingual ：Support zero-shot voice cloning for cross-lingual and code-switching scenarios.
Ultra-Low Latency
- Bidirectional Streaming Support : CosyVoice 2.0 integrates offline and streaming modeling technologies.
- Rapid First Packet Synthesis : Achieves latency as low as 150ms while maintaining high-quality audio output.
High Accuracy
- Improved Pronunciation : Reduces pronunciation errors by 30% to 50% compared to CosyVoice 1.0.
- Benchmark Achievements : Attains the lowest character error rate on the hard test set of the Seed-TTS evaluation set.
Strong Stability
- Consistency in Timbre : Ensures reliable voice consistency for zero-shot and cross-language speech synthesis.
- Cross-language Synthesis : Marked improvements compared to version 1.0.
Natural Experience
- Enhanced Prosody and Sound Quality : Improved alignment of synthesized audio, raising MOS evaluation scores from 5.4 to 5.53.
- Emotional and Dialectal Flexibility : Now supports more granular emotional controls and accent adjustments.
