This is an on-going project. it is a modified version of Higgs-Boson audio tokenizer, you can fully train it. all scripts have been tested.
a Few notes however:
this is not backward compatible with the original checkpoint (I think you can tweak it to be, but you have to adhere to Boson community license if you do.)
I highly recommend you to pretrain the model without the mel and adversarial setup first. it saves you a significant amount of compute, time and speed-up your convergence. raise the batch size as much as you can before the adversarial phase.
for the semantic teacher, I am using
utter-project/mHuBERT-147
which has a good multilingual support. if you want the original setup you can change it in the config.
The loss weights and hyperparameters may not be ideal, feel free to play around with different values.
I will train a checkpoint on a larger enough dataset one of these days after figuring out a few things first. but the setup is solid.
Training
python train_boson_mixed_precision.py --data_csv "yourdata.csv" \ # full path to your audio files, the format can be anything .mp3 .wav .ogg etc.
--config config.json --batch_size 42 \
--use_mixed_precision \
--use_discriminator
Simple Inference
take a look at the notebook
Batch inference
take a look at boson_codeit.py
Happy using / training (
inshallah
).
Runs of Respair Higgs_Codec_Extended on huggingface.co
14
Total runs
0
24-hour runs
-2
3-day runs
1
7-day runs
10
30-day runs
More Information About Higgs_Codec_Extended huggingface.co Model
Higgs_Codec_Extended huggingface.co is an AI model on huggingface.co that provides Higgs_Codec_Extended's model effect (), which can be used instantly with this Respair Higgs_Codec_Extended model. huggingface.co supports a free trial of the Higgs_Codec_Extended model, and also provides paid use of the Higgs_Codec_Extended. Support call Higgs_Codec_Extended model through api, including Node.js, Python, http.
Higgs_Codec_Extended huggingface.co is an online trial and call api platform, which integrates Higgs_Codec_Extended's modeling effects, including api services, and provides a free online trial of Higgs_Codec_Extended, you can try Higgs_Codec_Extended online for free by clicking the link below.
Respair Higgs_Codec_Extended online free url in huggingface.co:
Higgs_Codec_Extended is an open source model from GitHub that offers a free installation service, and any user can find Higgs_Codec_Extended on GitHub to install. At the same time, huggingface.co provides the effect of Higgs_Codec_Extended install, users can directly use Higgs_Codec_Extended installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
Higgs_Codec_Extended install url in huggingface.co: