Edge0 / GPA-v1.5

GPA v1.5: One Model for Speech Recognition, Text-to-Speech, and Voice Conversion

TL;DR This is the main Hugging Face checkpoint repo for GPA v1.5 . Use it for native PyTorch / Hugging Face inference and fine-tuning. Runtime-optimized ONNX assets are published separately at AutoArk-AI/GPA-v1.5-onnx-runtime .

What Is GPA v1.5?

GPA stands for General Purpose Audio .

GPA v1.5 is a unified autoregressive audio-language model for speech understanding and generation. It currently supports:

• ASR : automatic speech recognition.
• TTS : text-to-speech with reference voice conditioning.
• Training / fine-tuning : native Hugging Face Trainer workflow.
• Deployment path : ONNX runtime assets and service code for local CLI, FastAPI, and browser UI testing.

Voice conversion support in the native v1.5 path is on the roadmap.

_{GPA unifies speech understanding and generation in a single autoregressive audio-language model.}

Hugging Face and GitHub Mapping

This Hugging Face repo stores the large checkpoint assets. The code, examples, and docs live in the GitHub repo:

Recommended Local Layout

For the least configuration, keep the checkpoint repos side by side:

GPA-v1.5/
GPA-v1.5-HF/
  GPA-v1.5/
    spark_tokenizer_model/
  GPA-v1.5-onnx-runtime/

What each path is used for:

• GPA-v1.5-HF/GPA-v1.5 : native PyTorch train / inference checkpoint.
• GPA-v1.5-HF/GPA-v1.5/spark_tokenizer_model : Spark tokenizer assets used by native TTS.
• GPA-v1.5-HF/GPA-v1.5-onnx-runtime : ONNX CLI / service / browser UI asset bundle.

With this layout, the native inference, training, and ONNX smoke tests can run without editing source paths.

Download

git clone https://github.com/AutoArk/GPA.git GPA-v1.5
mkdir -p GPA-v1.5-HF

huggingface-cli download AutoArk-AI/GPA-v1.5 \
  --local-dir GPA-v1.5-HF/GPA-v1.5

huggingface-cli download AutoArk-AI/GPA-v1.5-onnx-runtime \
  --local-dir GPA-v1.5-HF/GPA-v1.5-onnx-runtime

Where To Start

• Fine-tuning / continued training : GPA_1.5/docs/train.md
• Native PyTorch inference : GPA_1.5/docs/infer.md
• ONNX runtime deployment : GPA_1.5/onnx_runtime/README.md

GPA v1.5 Release Overview

Evaluation Metric Results

TTS Evaluation

ASR Evaluation

WER (%) is reported for LibriSpeech. CER (%) is reported for AISHELL-1.

License

This model is released under the Apache 2.0 license.

Citation

If you find GPA useful for your research or projects, please cite us:

@misc{cai2026unifyingspeechrecognitionsynthesis,
      title={Unifying Speech Recognition, Synthesis and Conversion with Autoregressive Transformers},
      author={Runyuan Cai and Yu Lin and Yiming Wang and Chunlin Fu and Xiaodong Zeng},
      year={2026},
      eprint={2601.10770},
      archivePrefix={arXiv},
      primaryClass={cs.SD},
      url={https://arxiv.org/abs/2601.10770},
}