Request a new model

Tell us which model you want measured. We review every request.

Speech-to-Text

Benchmarks

X
Y

WER

AzureAzureMAI-Transcribe-2 Streaming6.2%
InworldInworldRealtime STT-17.0%
AssemblyAIAssemblyAIUniversal-3.5 ProTry →7.2%
AssemblyAIAssemblyAIUniversal-3.6 ProTry →7.2%
Fish AudioFish Audiotranscribe-stream-17.4%
NariNariQwen3-ASRTry →7.6%
NariNariQwen3-ASR FastTry →7.6%
OmiOmimedical-17.9%
ElevenLabsScribe v2 RealtimeTry →8.2%
ModulateModulateVelma 2Try →8.4%
MetaMetaMuse Voice TranscribeTry →8.5%
Sonioxstt-rt-v68.6%
OpenAIGPT Live TranscribeTry →8.8%
SpeechmaticsSpeechmaticsEnhanced9.0%
SpeechmaticsSpeechmaticsLinden 19.5%
Sonioxstt-rt-v5Try →9.5%
MistralMistralVoxtral Mini Transcribe Realtime 39.6%
xAIGrok Voice Transcribe 1.0Try →9.7%
Smallest AISmallest AIPulseTry →10.0%
xAIGrok Voice Transcribe 2.010.2%
OpenAIGPT TranscribeTry →10.3%
OpenAIGPT Realtime Whisper10.4%
DeepgramNova-3Try →11.0%
SpeechmaticsSpeechmaticsStandard11.3%
OpenAIGPT-4o mini TranscribeTry →11.4%
DeepgramNova-3 Medical12.3%
GladiaSolaria-1Try →12.3%
CartesiaInk-2Try →12.6%
DeepgramFluxTry →12.8%
DeepgramFlux MultilingualTry →14.1%
AssemblyAIAssemblyAIUniversal-Streaming EnglishTry →14.3%
HopperHoppernemotron-asrTry →14.4%
GradiumASRTry →18.4%
OpenAIGPT-4o TranscribeTry →19.3%
AssemblyAIAssemblyAIUniversal-Streaming MultilingualTry →21.6%
DeepgramBase Phonecall23.5%
0.0%10.0%20.0%30.0%40.0%

End of turn

lower is better

Time from the last spoken word to the final transcript, decided by the model itself.

MetaMetaMuse Voice TranscribeTry →301ms · 584ms
Sonioxstt-rt-v5Try →489ms · 2.40s
Sonioxstt-rt-v6555ms · 2.48s
AssemblyAIAssemblyAIUniversal-3.6 ProTry →589ms · 1.58s
AssemblyAIAssemblyAIUniversal-3.5 ProTry →606ms · 1.62s
DeepgramFlux MultilingualTry →654ms · 1.36s
NariNariQwen3-ASRTry →681ms · 960ms
NariNariQwen3-ASR FastTry →684ms · 965ms
OmiOmimedical-1768ms · 1.04s
DeepgramNova-3Try →771ms · 1.21s
DeepgramFluxTry →773ms · 1.48s
ElevenLabsScribe v2 RealtimeTry →793ms · 1.06s
HopperHoppernemotron-asrTry →809ms · 1.08s
OpenAIGPT-4o mini TranscribeTry →926ms · 1.35s
Smallest AISmallest AIPulseTry →958ms · 1.45s
GladiaSolaria-1Try →1.09s · 1.59s
Fish AudioFish Audiotranscribe-stream-11.12s · 2.27s
GradiumASRTry →1.22s · 1.35s
ModulateModulateVelma 2Try →1.25s · 1.54s
OpenAIGPT-4o TranscribeTry →1.28s · 1.70s
MistralMistralVoxtral Mini Transcribe Realtime 31.28s · 3.34s
xAIGrok Voice Transcribe 2.01.35s · 1.75s
xAIGrok Voice Transcribe 1.0Try →1.40s · 1.95s
SpeechmaticsSpeechmaticsStandard1.45s · 1.81s
InworldInworldRealtime STT-11.90s · 2.71s
0ms500ms1.00s1.50s2.00s2.50s

p50 p90

Time to first token

lower is better

Time from the caller starting to speak to the first word of the live transcript.

AzureAzureMAI-Transcribe-2 Streaming241ms · 342ms
OmiOmimedical-1309ms · 550ms
Fish AudioFish Audiotranscribe-stream-1414ms · 480ms
DeepgramFlux MultilingualTry →506ms · 1.65s
DeepgramFluxTry →641ms · 1.19s
GladiaSolaria-1Try →671ms · 1.20s
SpeechmaticsSpeechmaticsStandard690ms · 1.05s
MetaMetaMuse Voice TranscribeTry →728ms · 1.16s
AssemblyAIAssemblyAIUniversal-3.6 ProTry →775ms · 974ms
AssemblyAIAssemblyAIUniversal-3.5 ProTry →775ms · 973ms
Sonioxstt-rt-v5Try →786ms · 1.27s
HopperHoppernemotron-asrTry →825ms · 1.67s
DeepgramNova-3Try →885ms · 1.45s
InworldInworldRealtime STT-1942ms · 1.02s
MistralMistralVoxtral Mini Transcribe Realtime 3978ms · 1.61s
OpenAIGPT Realtime Whisper987ms · 1.27s
OpenAIGPT Live TranscribeTry →988ms · 1.13s
xAIGrok Voice Transcribe 1.0Try →989ms · 1.10s
xAIGrok Voice Transcribe 2.0995ms · 1.18s
Smallest AISmallest AIPulseTry →1.04s · 2.01s
Sonioxstt-rt-v61.11s · 1.60s
CartesiaInk-2Try →1.19s · 1.61s
ModulateModulateVelma 2Try →1.38s · 1.47s
NariNariQwen3-ASR FastTry →1.65s · 1.74s
GradiumASRTry →1.65s · 2.43s
NariNariQwen3-ASRTry →1.68s · 1.77s
ElevenLabsScribe v2 RealtimeTry →2.02s · 2.19s
OpenAIGPT-4o mini TranscribeTry →2.91s · 6.12s
OpenAIGPT-4o TranscribeTry →4.72s · 8.46s
0ms1.00s2.00s3.00s4.00s5.00s

p50 p90

Live words

lower is better

Time from a word being spoken to it appearing in the live transcript for good.

AzureAzureMAI-Transcribe-2 Streaming114ms · 515ms
DeepgramFlux MultilingualTry →180ms · 715ms
DeepgramFluxTry →190ms · 586ms
Fish AudioFish Audiotranscribe-stream-1249ms · 1.57s
OmiOmimedical-1343ms · 2.76s
SpeechmaticsSpeechmaticsStandard403ms · 1.07s
HopperHoppernemotron-asrTry →425ms · 717ms
MetaMetaMuse Voice TranscribeTry →486ms · 716ms
Sonioxstt-rt-v5Try →496ms · 739ms
InworldInworldRealtime STT-1583ms · 1.86s
DeepgramNova-3Try →583ms · 1.72s
AssemblyAIAssemblyAIUniversal-3.5 ProTry →803ms · 2.52s
MistralMistralVoxtral Mini Transcribe Realtime 3804ms · 947ms
AssemblyAIAssemblyAIUniversal-3.6 ProTry →815ms · 2.71s
Sonioxstt-rt-v6857ms · 1.11s
ModulateModulateVelma 2Try →896ms · 2.35s
NariNariQwen3-ASR FastTry →901ms · 2.04s
ElevenLabsScribe v2 RealtimeTry →945ms · 1.97s
NariNariQwen3-ASRTry →973ms · 2.18s
Smallest AISmallest AIPulseTry →1.17s · 1.98s
CartesiaInk-2Try →1.22s · 1.71s
GradiumASRTry →1.48s · 1.66s
GladiaSolaria-1Try →1.50s · 3.98s
xAIGrok Voice Transcribe 2.01.89s · 10.22s
xAIGrok Voice Transcribe 1.0Try →2.08s · 8.91s
OpenAIGPT-4o mini TranscribeTry →2.47s · 5.29s
OpenAIGPT-4o TranscribeTry →3.43s · 7.18s
OpenAIGPT Realtime Whisper3.96s · 11.28s
OpenAIGPT Live TranscribeTry →4.02s · 11.34s
0ms1.00s2.00s3.00s4.00s5.00s

p50 p90

Rewrites

lower is better

Words the live transcript takes back, per word in the final transcript.

GradiumASRTry →0%
CartesiaInk-2Try →0%
MetaMetaMuse Voice TranscribeTry →0%
MistralMistralVoxtral Mini Transcribe Realtime 30%
Smallest AISmallest AIPulseTry →0%
OpenAIGPT-4o TranscribeTry →3%
OpenAIGPT-4o mini TranscribeTry →5%
OpenAIGPT Realtime Whisper6%
HopperHoppernemotron-asrTry →8%
OpenAIGPT Live TranscribeTry →10%
Sonioxstt-rt-v610%
Sonioxstt-rt-v5Try →13%
NariNariQwen3-ASRTry →21%
NariNariQwen3-ASR FastTry →22%
ElevenLabsScribe v2 RealtimeTry →29%
InworldInworldRealtime STT-130%
DeepgramNova-3Try →33%
ModulateModulateVelma 2Try →33%
SpeechmaticsSpeechmaticsStandard35%
AssemblyAIAssemblyAIUniversal-3.6 ProTry →35%
AssemblyAIAssemblyAIUniversal-3.5 ProTry →36%
AzureAzureMAI-Transcribe-2 Streaming37%
DeepgramFluxTry →40%
DeepgramFlux MultilingualTry →41%
Fish AudioFish Audiotranscribe-stream-156%
xAIGrok Voice Transcribe 2.064%
xAIGrok Voice Transcribe 1.0Try →83%
OmiOmimedical-189%
GladiaSolaria-1Try →156%
0%40%80%120%160%

Cost

lower is better

Published list price per thousand minutes; batch-only models show their batch rate.