Sponsored by
APIMart
budecosystem / Tansen
Model's Last Updated: September 07 2023
Introduction of Tansen
Model Details of Tansen
Democratizing access to LLMs, Multi-Modal Gen AI models for the open-source community.
Let's advance AI, together.
Tansen is a text-to-speech program built with the following priorities:
- Strong multi-voice capabilities.
- Highly realistic prosody and intonation.
- Speaking rate control
🎧 Demos
Demos
💻 Getting Started on GitHub
Ready to dive in? Here's how you can get started with our repo on GitHub.
1️⃣ : Clone our GitHub repository
First things first, you'll need to clone our repository. Open up your terminal, navigate to the directory where you want the repository to be cloned, and run the following command:
conda create --name Tansen python=3.9 numba inflect
conda activate Tansen
conda install pytorch torchvision torchaudio pytorch-cuda=11.7 -c pytorch -c nvidia
conda install transformers=4.29.2
git clone https://github.com/BudEcosystem/Tansen.git
cd Tansen
2️⃣ : Install dependencies
python setup.py install
3️⃣ : Generate Audio
do_tts.py
This script allows you to speak a single phrase with one or more voices.
python do_tts.py --text "I'm going to speak this" --voice random --preset fast
read.py
This script provides tools for reading large amounts of text.
python Tansen/read.py --textfile <your text to be read> --voice random
This will break up the textfile into sentences, and then convert them to speech one at a time. It will output a series of spoken clips as they are generated. Once all the clips are generated, it will combine them into a single file and output that as well.
Sometimes Tansen screws up an output. You can re-generate any bad clips by re-running
read.py
with the --regenerate
argument.
Intrested in running as as API ?
🐍 Usage in Python
Tansen can be used programmatically :
reference_clips = [utils.audio.load_audio(p, 22050) for p in clips_paths]
tts = api.TextToSpeech(use_deepspeed=True, kv_cache=True, half=True)
pcm_audio = tts.tts_with_preset("your text here", voice_samples=reference_clips, preset='fast')
Loss Curves
loss_mel_ce
loss_text_ce
Training Information
Device : A Single A100
Dataset : 876 hours
Runs of budecosystem Tansen on huggingface.co
0
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs
More Information About Tansen huggingface.co Model
Url of Tansen
Tansen huggingface.co Url
Provider of Tansen huggingface.co
Other API from budecosystem
Total runs:
83
Run Growth:
40
Growth Rate:
48.19%
Total runs:
81
Run Growth:
25
Growth Rate:
30.86%
Total runs:
77
Run Growth:
37
Growth Rate:
48.05%
Total runs:
71
Run Growth:
30
Growth Rate:
42.25%
Total runs:
57
Run Growth:
11
Growth Rate:
19.30%
Total runs:
56
Run Growth:
45
Growth Rate:
80.36%
Total runs:
28
Run Growth:
4
Growth Rate:
14.29%
Total runs:
27
Run Growth:
19
Growth Rate:
70.37%
Total runs:
19
Run Growth:
10
Growth Rate:
52.63%
Total runs:
19
Run Growth:
8
Growth Rate:
42.11%
Total runs:
16
Run Growth:
8
Growth Rate:
57.14%
Total runs:
12
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%