← LLM 
Baseten
Nemotron-3-Ultra
Measured 2026-10-04
Run Nemotron-3-Ultra on Speko →One API, every model on this board.
Score
80
Task done
86.84%
74–97% 95% CI bootstrap over items · n=95 · measured 2026-10-04
Refusal quality
75.6%
names the gap 83% · offers a route 60% · 10 probes x 3 iterations · 1 silent turn scored zero
Fabrication
10%
3 of 30 probe runs
Dead-air
64.1%
195 of 304 turns
Tool silence
95.6%
195 of 204 tool-call turns
Stalled
16.7%
15 of 90 runs
TTFT p50
245ms
245–299 p50–p90 · n=38
Cost / 1M tok
$2.40
Share this result
Embed the live badge
Markdown
[](https://benchmarks.speko.ai/llm/baseten-nemotron-3-ultra)
HTML
<a href="https://benchmarks.speko.ai/llm/baseten-nemotron-3-ultra"><img src="https://benchmarks.speko.ai/badge/llm/baseten-nemotron-3-ultra.svg" alt="Speko llm rank"></a>
URL
https://benchmarks.speko.ai/llm/baseten-nemotron-3-ultra