← All runs

Evaluation run

self-correction chains

6 July 2026, 13:53 · eval-engine · 232478e · 89 cases

Did it hear the words right?

This run graded typed text only, so there is nothing here to have misheard.

Did it clean up correctly and safely?

96%
Light, ships on by default
85/89 cases passed · 231 ms typical
92%
Polish, experimental
82/89 cases passed · 265 ms typical
When a case fails, whose fault is it?
0 the microphone misheard the words  ·  11 the cleanup itself slipped

Every case

Each case shows the instant on-device cleanup, then what each mode did to it. Added words are marked, removed words are struck. For a spoken case, Heard is what the microphone transcribed and Was said is the reference it is scored against.

89 cases match

grammar-runon-01Typedclean
Instantso i went to the meeting and then i talked to sarah and then we decided to push the launch and also we need to tell the team
LightSo I went to the meeting and then i talked to Sarah; and then we decided to push the launch and also we need to tell the team. 556 ms
PolishSo I went to the meeting and then i talked to Sarah. and then We decided to push the launch, and also we also need to tell the team. 693 ms
grammar-tense-01Typedclean
Instantyesterday i go to the office and i see the new design
Lightyesterday i go to the office and i see the new design 304 msthe cleanup was rejected, so the original was kept
PolishYesterday, I go went to the office and i see saw the new design. 369 ms
num-chapterTypedclean
Instantlet's start with chapter one
LightLet's start with chapter one. 209 ms
PolishLet's start with chapter one. 187 ms
num-currencyTypedclean
Instantthe plan costs $25 a month
LightThe plan costs $25 a month. 207 ms
PolishThe plan costs $25 a month. 267 ms
num-decimalTypedclean
Instantthe download is 3 point 5 gigabytes
LightThe download is 3 point 5 3.5 gigabytes. 306 ms
PolishThe download is 3 point 5 3.5 gigabytes. 322 ms
num-decimal-pctTypedclean
Instantwe hit 99 point 9% uptime
LightWe hit 99 point 9% 99.9% uptime. 249 ms
PolishWe hit 99 point 9% 99.9% uptime. 266 ms
num-first-placeTypedclean
Instantshe came in first place at the meet
LightShe came in first place at the meet. 209 ms
PolishShe came in first place at the meet. 219 ms
num-halfTypedclean
Instantgive me half a second to think
LightGive me half a second to think. 229 ms
PolishGive me half a second to think. 200 ms
num-largeTypedclean
Instantwe shipped 120 units
LightWe shipped 120 units. 193 ms
PolishWe shipped 120 units. 198 ms
num-no-oneTypedclean
Instantno one showed up to the review
LightNo one showed up to the review. 190 ms
PolishNo one showed up to for the review. 192 ms