caps-properTypedclean
Instanti met sarah in new york on tuesday
LightI met Sarah in New York on Tuesday. 257 ms
PolishI met Sarah in New York on Tuesday. 222 ms
Evaluation run
self-correction chains
Did it hear the words right?
This run graded typed text only, so there is nothing here to have misheard.
Did it clean up correctly and safely?
96%
Light, ships on by default
85/89 cases passed · 231 ms typical
92%
Polish, experimental
82/89 cases passed · 265 ms typical
When a case fails, whose fault is it?
0 the microphone misheard the words · 11 the cleanup itself slipped
Every case
Each case shows the instant on-device cleanup, then what each mode did to it. Added words are marked, removed words are struck. For a spoken case, Heard is what the microphone transcribed and Was said is the reference it is scored against.
89 cases match
corr-money-noTypedclean
Instantthe plan is $40 a month
LightThe plan is $40 a month. 221 ms
PolishThe plan is $40 a month. 236 ms
corr-name-chainTypedneeds review
Instantcall john no jane no actually mike
Lightcall john no jane no actually mike 126 msthe cleanup was rejected, so the original was kept
Polishcall john no jane no actually mike 136 msthe cleanup was rejected, so the original was kept
Why?the result still contains “John” and “Jane”, which this case forbids
corr-num-chainTypedclean
Instantwe need 40 units
LightWe need 40 units. 189 ms
PolishWe need 40 units. 201 ms
corr-time-noTypedclean
Instantlet's meet at 4:30
LightLet's meet at 4:30. 239 ms
PolishLet's meet at 4:30. 251 ms
disf-dayTypedclean
Instantlet's do it on monday sorry i mean tuesday
LightLet's do it on monday sorry i mean Tuesday. 192 ms
PolishLet's do it on monday sorry i mean Tuesday. 189 ms
disf-false-startsTypedclean
Instantso the the main thing is the main point is we need to ship
LightSo the the main thing is the main point is we need to ship. 292 ms
PolishSo the the main thing is the main point is that we need to ship. 284 ms
disf-heavy-stutterTypedneeds review
Instanti i i think we we should just go go now
Lighti i i think We we should just go go now. 190 ms
PolishI i i think we we should just go go now. 231 ms
Why light?the result is missing “I think we should just go now”
disf-repeatTypedclean
Instantthe the report is is ready to go
LightThe the report is is ready to go. 183 ms
PolishThe the report is is ready to go. 188 ms
disf-restartTypedclean
Instanti think we should i think we should just ship it
Lighti think We should i think we should just ship it. 176 ms
Polishi think We should i think we should just ship it. 180 ms