Repository navigation
test(overnight): word bias for V02, accept a plain 22 on K02 - #214
Open
BrettKinny wants to merge 1 commit into
Open
BrettKinny wants to merge 1 commit into
BrettKinny wants to merge 1 commit into
Conversation
V02's reply is a bare word list, so the reference mic's Whisper had no context and returned "Apple", "Huckle" and "Couple" for "purple". Bias that case toward its own words. Re-transcribing the three saved V02 replies gave two exact matches and one "couple robot". Other replies and silence were unaffected, and losing a whole word still shows. The bias does fill in a clipped first word, so V02 stops detecting up to about 0.5 s of lost reply audio (#200). K02: the maintainer accepted a plain 22 for this release. "22 room" stays forbidden. Without this the case quarantines and can pause a run. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
V02-repeatgets areply_hotwordslist, passed to both reply transcriptions through a newhotword_argshelper.K02also accepts a plain "22" (maintainer decision 2026-11-02). "22 room" stays forbidden.Evidence
Offline only, using the three saved V02 replies from the overnight run. No new robot run.
Negative controls with the bias: three other cases' replies and a silent crop were not altered. Removing the first word entirely still shows up (cut at 2.0 s).
Known limit: please read before merging
With about 0.5 s cut from the start of a reply, the bias still wrote "purple". Clipped reply starts are the #200 part 2 bug, so the misreads may be partly real audio loss rather than evaluator error, and this bias would hide that on V02. Run V02 unbiased on the
agent/fw-reply-head-clipfirmware first. Saved reply 3 still fails on "couple", so this may not get V02 to three passes in a row.Tests
tests/test_dotty_overnight.pyandtests/test_dotty_overnight_states.py: 179 passed.AI-assisted: written by Claude Opus 5.5; needs human review before merge.
🤖 Generated with Claude Code