, News summary

New Swift packages bring swappable speech and decision models to Apple apps

A Hugging Face blog post introduces two packages that let Apple developers choose their speech recognition engine and get probability-based answers from models running on the device.

At a glance

for Parakeet to transcribe an hour from file
20–40s
speakers the diarizer can track
4
AnyDecisionModel backends
6
What’s new
AnySpeechRecognizer mirrors Apple’s speech-to-text API but lets apps use other engines, such as Nvidia’s Parakeet and Alibaba’s Qwen3-ASR, and adds speaker labels. AnyDecisionModel answers yes-or-no, multiple-choice and rating questions with probabilities instead of generated text.
Who it affects
Developers building Apple apps that transcribe audio or classify text without relying on cloud services.

The details

For code that uses Apple’s shared API, switching engines can be as simple as changing one import line. Converted models download from the Hugging Face Hub only when an app asks, from about 250 MB to 2.4 GB. In the author’s tests on an M4 Max Mac Studio, Parakeet models transcribing files had lower word error rates than Apple’s own transcriber on the LibriSpeech test set, but every engine topped 23% on meeting recordings with overlapping speech. Testing so far covers macOS 27 only, not iPhones.

Why it matters

Apps often ask a chatbot-style model to make a choice and then parse its text, which hides how confident it is. Returning probabilities lets developers set thresholds and send uncertain cases to people, though the post warns raw probabilities are often overconfident and need calibration. Swappable engines also reduce dependence on Apple’s own models. The figures come from one machine, so results on phones are unknown.

Original source

Introducing AnySpeechRecognizer and AnyDecisionModel: Open Models for Speech and Decisions on Apple Platforms

Hugging Face · huggingface.co

About this summary. Written by the nplusoneai newsroom from the original report. Full reporting is at the source. Spotted a mistake? Tell us.