Skip to content

fix(tasks): a reply chain counts +2, not +6, in the duplicate check - #1497

Merged
leemour merged 1 commit into
mainfrom
fix/dup-reply-chain-weight
Oct 17, 2026
Merged

leemour merged 1 commit into
mainfrom
fix/dup-reply-chain-weight

Conversation

@leemour

@leemour leemour commented Oct 17, 2026 •

Copy link
Copy Markdown
Collaborator

Task

The owner chose to lower the reply-chain weight in the task duplicate check after the second labelled set of real-chat pairs.

Why

cli-testing performance/tasks/duplicates, "Follow-up: a second labelled set" labelled 213 pairs from real chats. Among the pairs shown as "maybe" or "likely", the ones with a reply chain were wrong 11 times in 13. At +2, shown-pair precision rose on both sets: 52% → 57% on the old set and 43% → 47% on the new one, losing one true pair on each.

What

  • TASK_SIMILARITY_WEIGHTS.reply.yes goes from +6 to +2, with its reason updated.
  • Other weights and the bands are unchanged. "4–14 days apart" is left for a separate check.
  • docs/dev/tasks-plan.md gets the new weight in its weights table.
  • One line under Unreleased → Fixed.
  • Tests:
    • the weight table and the reply-chain scores move to the new values;
    • "a reply that asks for something new" now stays "different", not "maybe";
    • the review-list tests relied on +6 to flag a bare "any news?" reply, so their reminders now name the invoice and amount.

Testing

  • pnpm typecheck: passes.
  • pnpm lint: no errors (the 69 warnings were already there).
  • pnpm test: 5155 passed, 4 skipped.
  • pnpm docs:check: ok. pnpm standard:docs: no changes.

Draft docs PR (merge after the release): WireCatLabs/cli-docs#305.

🤖 Generated with Claude Code

On 213 labelled pairs from real chats, pairs shown as possible duplicates
because one task's message replies to the other's were wrong 11 times in 13.
At +2 the shown pairs' precision rose on both labelled sets (52% -> 57%,
43% -> 47%) for one lost true pair each. Other weights unchanged.

The review-list tests relied on the old +6 to flag a bare "any news?" reply;
their reminders now name the invoice and amount, as a real reminder would.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
@leemour
leemour merged commit 4d6f530 into main Oct 17, 2026
4 checks passed
leemour added a commit to WireCatLabs/cli-docs that referenced this pull request Oct 18, 2026
…cond labelled set

Weights table and the real-chats paragraph, in en/ru/es. Merge after the cli-core
release that carries WireCatLabs/cli-core#1497.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
leemour added a commit to WireCatLabs/cli-docs that referenced this pull request Oct 18, 2026
## Task

Document the reply-chain weight change from WireCatLabs/cli-core#1497.

## Why

Among the pairs shown as "maybe" or "likely" in 213 labelled real-chat
pairs, the ones in one reply chain were wrong 11 times in 13. The weight
goes from +6 to +2. Source: [cli-testing, "Follow-up: a second labelled
set"](https://github.com/WireCatLabs/cli-testing/tree/main/performance/tasks/duplicates#follow-up-a-second-labelled-set-2026-10-17).

## What

In `content/docs/tasks-architecture{,.ru,.es}.mdx`:
- the weights table row "Reply chain: yes / no" now reads +2 / 0;
- the "On real chats" paragraph says what the second set showed.

## Merge

Draft. Merge after the cli-core release that carries #1497.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant