caps-properTypedclean
Instanti met sarah in new york on tuesday
LightI met Sarah in New York on Tuesday. 249 ms
PolishI met Sarah in New York on Tuesday. 253 ms
Evaluation run
faithfulness scoring cleanup
Did it hear the words right?
This run graded typed text only, so there is nothing here to have misheard.
Did it clean up correctly and safely?
94%
Light, ships on by default
84/89 cases passed · 254 ms typical
89%
Polish, experimental
79/89 cases passed · 266 ms typical
When a case fails, whose fault is it?
0 the microphone misheard the words · 15 the cleanup itself slipped
Every case
Each case shows the instant on-device cleanup, then what each mode did to it. Added words are marked, removed words are struck. For a spoken case, Heard is what the microphone transcribed and Was said is the reference it is scored against.
89 cases match
corr-money-noTypedneeds review
Instantthe plan is 25 no $40 a month
LightThe plan is 25 no $40 a month. 254 ms
PolishThe plan is $25 no $40 a month. 276 ms
Why polish?the result is missing “40”; the result still contains “25”, which this case forbids
corr-name-chainTypedneeds review
Instantcall john no jane no actually mike
LightCall John, no Jane, no actually Mike. 267 ms
PolishCall John, no not Jane. No, actually, Mike. 310 ms
Why?the result still contains “John” and “Jane”, which this case forbids
corr-num-chainTypedneeds review
Instantwe need 20 no 30 no 40 units
LightWe need 20, no 30, no 40 units. 363 ms
PolishWe need 20 no 30 no 40 units. 230 ms
Why light?the result still contains “20” and “30”, which this case forbids
Why polish?the result is missing “40”; the result still contains “30”, which this case forbids
corr-time-noTypedclean
Instantlet's meet at 3 no 4:30
LightLet's meet at 3 no 4:30. 272 ms
PolishLet's meet at 3 no 4:30. 276 ms
disf-dayTypedclean
Instantlet's do it on monday sorry i mean tuesday
LightLet's do it on monday sorry i mean Tuesday. 213 ms
PolishLet's do it on monday sorry i mean Tuesday. 219 ms
disf-false-startsTypedclean
Instantso the the main thing is the main point is we need to ship
LightSo the the main thing is the main point is we need to ship. 332 ms
PolishSo the the main thing is the main point is that we need to ship. 312 ms
disf-heavy-stutterTypedneeds review
Instanti i i think we we should just go go now
LightI i i think we we should just go go now. 242 ms
PolishI i i think we we should just go go now. 253 ms
Why light?the result is missing “I think we should just go now”
disf-repeatTypedclean
Instantthe the report is is ready to go
LightThe the report is is ready to go. 206 ms
PolishThe the report is is ready to go. 210 ms
disf-restartTypedclean
Instanti think we should i think we should just ship it
Lighti think We should i think we should just ship it. 197 ms
Polishi think We should i think we should just ship it. 198 ms