Speech-to-Text · Multilingual

Spanish

Language

Request a new language

Tell us which language you want added to this benchmark.

Benchmarks

X
Y
500ms1.00s1.50s2.00s4.0%6.0%8.0%Finalize latency lower is betterWER lower is betterGPT-4o TranscribeUniversal-3.5 ProGPT-4o-mini TranscribeChirp 3ASRstt-rt-v5Nova-3Nova-2Scribe v2 RealtimeQwen3-ASR RealtimePulsebenchmarks.speko.ai · run 07-03

WER

Share of words the transcript got wrong.

AssemblyAIAssemblyAIUniversal-3.6 Pro2.53%
AssemblyAIAssemblyAIUniversal-3.5 Pro2.8%
ElevenLabsScribe v2 Realtime3.02%
OpenAIGPT-4o Transcribe3.11%
NariNariQwen3-ASR3.12%
GoogleChirp 33.56%
Sonioxstt-rt-v53.62%
OpenAIGPT-4o-mini Transcribe4.14%
ModulateModulateVelma 2 multilingual4.46%
MetaMetaMuse Voice Transcribe 1.04.94%
DeepgramNova-35.24%
Smallest AISmallest AIPulse5.35%
AlibabaQwen3-ASR Realtime6.6%
CartesiaInk-Whisper7.68%
GradiumASR8.5%
DeepgramNova-29.06%
0.0%5.0%10.0%15.0%20.0%

Finalize latency

lower is better

Time from the caller stopping to the finalized transcript, not the first partial — the agent cannot reply until it lands.

DeepgramNova-3272ms · 533ms
DeepgramNova-2288ms · 416ms
Sonioxstt-rt-v5478ms · 1.13s
AssemblyAIAssemblyAIUniversal-3.5 Pro650ms · 1.67s
Smallest AISmallest AIPulse876ms · 983ms
OpenAIGPT-4o-mini Transcribe898ms · 996ms
OpenAIGPT-4o Transcribe910ms · 1.15s
AlibabaQwen3-ASR Realtime936ms · 1.09s
GradiumASR1.06s · 1.25s
GoogleChirp 31.12s · 1.50s
ElevenLabsScribe v2 Realtime2.00s · 2.25s
0ms300ms600ms900ms1.20s

p50 p90

Time to first token

lower is better

How long before the first word of the transcript arrives.

AssemblyAIAssemblyAIUniversal-3.5 Pro1.77s · 2.28s
DeepgramNova-22.12s · 3.17s
DeepgramNova-32.12s · 3.03s
ElevenLabsScribe v2 Realtime2.21s · 3.16s
Sonioxstt-rt-v52.22s · 2.91s
Smallest AISmallest AIPulse2.39s · 3.60s
GradiumASR3.00s · 3.51s
GoogleChirp 36.23s · 7.41s
OpenAIGPT-4o Transcribe6.96s · 10.7s
OpenAIGPT-4o-mini Transcribe7.33s · 10.7s
AlibabaQwen3-ASR Realtime7.42s · 8.46s
0ms2.00s4.00s6.00s8.00s

p50 p90

Cost

lower is better

$ per 1,000 minutes of audio · vendor list price, the same in every language