aufklarer / Parakeet-EOU-120M-CoreML-INT8

Parakeet-EOU-120M CoreML INT8

Streaming speech recognition with end-of-utterance detection, converted to CoreML for Apple Neural Engine inference. Part of speech-swift — on-device speech AI for Apple Silicon.

Based on nvidia/parakeet_realtime_eou_120m-v1 (FastConformer-RNNT, cache-aware streaming).

Quick Start

// Add to Package.swift:
// .package(url: "https://github.com/soniqo/speech-swift.git", branch: "main")

import ParakeetStreamingASR

let model = try await ParakeetStreamingASRModel.fromPretrained()

// Streaming transcription from microphone
for await partial in model.transcribeStream(audioChunks: micStream) {
    print(partial.text, partial.isFinal ? "[FINAL]" : "")
}

Or via CLI:

git clone https://github.com/soniqo/speech-swift && cd speech-swift && make build
.build/release/audio transcribe --engine parakeet-eou --stream recording.wav

Model

Files

Performance

Benchmarked on Apple M2 Max, 320ms chunks, CoreML CPU+NE compute units.

Streaming Cache Shapes

cache_last_channel:     [17, 1, 70, 512]   float32   2.4 MB
cache_last_time:        [17, 1, 512, 8]    float32   0.3 MB
cache_last_channel_len: [1]                int32
LSTM h:                 [1, 1, 640]        float16
LSTM c:                 [1, 1, 640]        float16

Usage

import ParakeetStreamingASR

let model = try await ParakeetStreamingASRModel.fromPretrained()

for await partial in model.transcribeStream(audioChunks: micStream) {
    print(partial.text, partial.isFinal ? "[FINAL]" : "")
}

EOU Detection

End-of-utterance is detected via a special <EOU> token (ID 1024) emitted by the joint network. No external VAD required for utterance segmentation.

Source

Converted from nvidia/parakeet_realtime_eou_120m-v1 using coremltools 8.3 with INT8 palettization.

Links

• speech-swift - Apple SDK
• soniqo.audio - Website
• blog.ivan.digital - Blog