Skip to content

hackbench: copyedit README - #115

Merged
yyy-Apple merged 3 commits into
mainfrom
hackbench-localization-wording
Oct 26, 2026
Merged

yyy-Apple merged 3 commits into
mainfrom
hackbench-localization-wording

Conversation

@jacklanchantin

@jacklanchantin jacklanchantin commented Oct 26, 2026 •

Copy link
Copy Markdown
Contributor

Copyedits to the HackBench blog README.

  • Grammar/consistency fixes in Overview, HackBench Construction, Results, and Related Work: missing articles, "codebase", consistent model names (GLM-5.2, Kimi K3), "open-weight" instead of "open-sourced", red-teaming hyphenation, a double space.
  • Align claims with the localization-only evaluation: Fig. 1 caption ("All monitors miss many hacks"), contribution paragraph ("scoring localization"), Conclusion ("detected and localized").
  • "human-audited" -> "audited" (synthetic hacks are LLM-audited, with humans adjudicating disagreements).
  • Results paragraph now mentions Muse Wonder (second-best, 61.47 F1).
  • Remove the stale commented-out "Evaluation setup" section.

Table image fixes are in #116.

- Fix grammar and consistency issues in the Overview, Construction, and
  Related Work sections (articles, "codebase", model names GLM-5.2 /
  Kimi K3, "open-weight", red-teaming hyphenation, spacing).
- Conclusion: hacks "can be detected and localized".
- Fig. 2: relabel "NUMBERED LOCALIZATION OUTPUT" / "Numbered command
  localization" as "HACK LOCALIZATION OUTPUT" / "Hack localization".
@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Meta Open Source bot. label Oct 26, 2026
@jacklanchantin jacklanchantin changed the title hackbench: copyedit README and use "hack localization" in Fig. 2 hackbench: copyedit README Oct 26, 2026
- Fig. 1 caption and contribution paragraph: drop "detection" wording;
  only localization is scored.
- "human-audited" -> "audited" (synthetic hacks are LLM-audited, with
  humans adjudicating disagreements).
- Mention Muse Wonder (second-best, 61.47 F1) in the results paragraph.
- GLM 5.2 -> GLM-5.2 for consistency.
- Remove the stale commented-out "Evaluation setup" section.
@yyy-Apple
yyy-Apple merged commit 03da868 into main Oct 26, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Meta Open Source bot.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants