← LLM

Baseten

Nemotron-3-Ultra

Measured 2026-10-04

Run Nemotron-3-Ultra on Speko →

One API, every model on this board.

Score

80

Task done

86.84%

74–97% 95% CI bootstrap over items · n=95 · measured 2026-10-04

Refusal quality

75.6%

names the gap 83% · offers a route 60% · 10 probes x 3 iterations · 1 silent turn scored zero

Fabrication

10%

3 of 30 probe runs

Dead-air

64.1%

195 of 304 turns

Tool silence

95.6%

195 of 204 tool-call turns

Stalled

16.7%

15 of 90 runs

TTFT p50

245ms

245–299 p50–p90 · n=38

Cost / 1M tok

$2.40

Share this result

Embed the live badge

Speko llm rank
Markdown
[![Speko llm rank](https://benchmarks.speko.ai/badge/llm/baseten-nemotron-3-ultra.svg)](https://benchmarks.speko.ai/llm/baseten-nemotron-3-ultra)
HTML
<a href="https://benchmarks.speko.ai/llm/baseten-nemotron-3-ultra"><img src="https://benchmarks.speko.ai/badge/llm/baseten-nemotron-3-ultra.svg" alt="Speko llm rank"></a>
URL
https://benchmarks.speko.ai/llm/baseten-nemotron-3-ultra