inkling

reasoning off (gateway default)

Measured 2026-08-17

* Conditional

975B total for 41B active — 211ms first token, but stalls on 42.2% of runs.

Score

Task done

71.14%

57–84% 95% CI bootstrap over items · n=95 · measured 2026-08-25

Refusal quality

74.4%

names the gap 60% · offers a route 73% · 10 probes x 3 iterations · 3 silent turns scored zero

Fabrication

1 of 30 probe runs

Dead-air

66.3%

203 of 306 turns

Tool silence

94.0%

203 of 216 tool-call turns

Stalled

42.2%

38 of 90 runs

TTFT p50

211ms

211–342 p50–p90

Cost / 1M tok

$4.05

Share this result

Download card (PNG) Post on X

Embed the live badge

Markdown

[![Speko llm rank](https://benchmarks.speko.ai/badge/llm/baseten-inkling.svg)](https://benchmarks.speko.ai/llm/baseten-inkling)

HTML

<a href="https://benchmarks.speko.ai/llm/baseten-inkling"><img src="https://benchmarks.speko.ai/badge/llm/baseten-inkling.svg" alt="Speko llm rank"></a>

URL

https://benchmarks.speko.ai/llm/baseten-inkling