← All runs

Evaluation run

self-correction chains

6 July 2026, 13:53 · eval-engine · 232478e · 89 cases

Did it hear the words right?

This run graded typed text only, so there is nothing here to have misheard.

Did it clean up correctly and safely?

96%
Light, ships on by default
85/89 cases passed · 231 ms typical
92%
Polish, experimental
82/89 cases passed · 265 ms typical
When a case fails, whose fault is it?
0 the microphone misheard the words  ·  11 the cleanup itself slipped

Every case

Each case shows the instant on-device cleanup, then what each mode did to it. Added words are marked, removed words are struck. For a spoken case, Heard is what the microphone transcribed and Was said is the reference it is scored against.

89 cases match

num-one-dayTypedclean
Instantremind me in one day to check the logs
LightRemind me in one day to check the logs. 1012 ms
PolishRemind me in one day to check the logs in one day. 1040 ms
num-one-of-themTypedclean
Instantone of them is already broken
LightOne of them is already broken. 176 ms
PolishOne of them is already broken. 231 ms
num-one-on-oneTypedclean
Instantlet's do a one on one tomorrow
LightLet's do a one on one one-on-one tomorrow. 227 ms
PolishLet's do a one on one one-on-one tomorrow. 244 ms
num-one-secTypedclean
Instanti'll be ready in one sec
LightI'll be ready in one sec. 213 ms
PolishI'll be ready in one sec. 256 ms
num-percentTypedclean
Instantrevenue grew 25% last quarter
LightRevenue grew 25% last quarter. 208 ms
PolishRevenue grew 25% last quarter. 213 ms
num-phoneTypedclean
Instantcall me at five five five one two three four
LightCall me at five five five one two three four 555-1234. 299 ms
PolishCall me at five five five one two three four 555-1234. 320 ms
num-rangeTypedclean
Instantit should take 2 to 3 days
LightIt should take 2 to 3 days. 234 ms
PolishIt should take 2 to 3 days. 255 ms
num-roomTypedclean
Instantthe meeting is in room 205
LightThe meeting is in room 205. 275 ms
PolishThe meeting is in room 205. 284 ms
num-room-214Typedclean
Instantthe interview is in room 214
LightThe interview is in room 214. 245 ms
PolishThe interview is in room 214. 329 ms
num-selfcorrectTypedclean
Instantthe total comes to $60
LightThe total comes to $60. 225 ms
PolishThe total comes to $60. 235 ms