AudioGen is an autoregressive transformer LM that synthesizes general audio conditioned on text (Text-to-Audio).
Internally, AudioGen operates over discrete representations learnt from the raw waveform, using an EnCodec tokenizer.
AudioGen was presented at
AudioGen: Textually Guided Audio Generation
by
Felix Kreuk, Gabriel Synnaeve, Adam Polyak, Uriel Singer, Alexandre Défossez, Jade Copet, Devi Parikh, Yaniv Taigman, Yossi Adi
.
AudioGen 1.5B is a variant of the original AudioGen model that follows
MusicGen
architecture.
More specifically, it is trained over a 16kHz EnCodec tokenizer with 4 codebooks sampled at 50 Hz with a delay pattern between the codebooks.
Having only 50 auto-regressive steps per second of audio, this AudioGen model allows faster generation while reaching similar performances to the original AudioGen model introduced in the paper.
import torchaudio
from audiocraft.models import AudioGen
from audiocraft.data.audio import audio_write
model = AudioGen.get_pretrained('facebook/audiogen-medium')
model.set_generation_params(duration=5) # generate 5 seconds.
descriptions = ['dog barking', 'sirenes of an emergency vehicule', 'footsteps in a corridor']
wav = model.generate(descriptions) # generates 3 samples.for idx, one_wav inenumerate(wav):
# Will save under {idx}.wav, with loudness normalization at -14 db LUFS.
audio_write(f'{idx}', one_wav.cpu(), model.sample_rate, strategy="loudness", loudness_compressor=True)
audiogen-medium huggingface.co is an AI model on huggingface.co that provides audiogen-medium's model effect (), which can be used instantly with this facebook audiogen-medium model. huggingface.co supports a free trial of the audiogen-medium model, and also provides paid use of the audiogen-medium. Support call audiogen-medium model through api, including Node.js, Python, http.
audiogen-medium huggingface.co is an online trial and call api platform, which integrates audiogen-medium's modeling effects, including api services, and provides a free online trial of audiogen-medium, you can try audiogen-medium online for free by clicking the link below.
facebook audiogen-medium online free url in huggingface.co:
audiogen-medium is an open source model from GitHub that offers a free installation service, and any user can find audiogen-medium on GitHub to install. At the same time, huggingface.co provides the effect of audiogen-medium install, users can directly use audiogen-medium installed effect in huggingface.co for debugging and trial. It also supports api for free installation.