Llama-3.3-70B

Score

66

Task done

54.30%

39–70% 95% CI bootstrap over items · n=95 · measured 2026-10-04

Refusal quality

20.0%

names the gap 33% · offers a route 13% · 10 probes x 3 iterations · 19 silent turns scored zero

Fabrication

0%

0 of 10 probes (30 probe runs) · ≤31%

Dead-air

48.5%

94 of 194 turns

Tool silence

100.0%

all of 19 items (94 tool-call turns) · ≥82%

Stalled

72.2%

65 of 90 runs

TTFT p50

525ms

525–725 p50–p90 · n=38

Cost / 1M tok

$1.04