Claude Haiku 4.5

Score

88

Task done

82.46%

67–95% 95% CI bootstrap over items · n=95 · measured 2026-08-25

Refusal quality

84.4%

names the gap 77% · offers a route 80% · 10 probes x 3 iterations

Fabrication

0%

0 of 10 probes (30 probe runs) · ≤31%

Dead-air

1.6%

4 of 248 turns

Tool silence

2.7%

4 of 148 tool-call turns

Stalled

25.6%

23 of 90 runs

TTFT p50

532ms

532–1787 p50–p90 · us-east4 direct

Cost / 1M tok

$5.00