Skip to content

Add provenance detector to the leaderboard - #232

Open
makrout wants to merge 2 commits into
liamdugan:mainfrom
makrout:add-provenance-detector
Open

makrout wants to merge 2 commits into
liamdugan:mainfrom
makrout:add-provenance-detector

Conversation

@makrout

@makrout makrout commented Nov 1, 2026

Copy link
Copy Markdown

No description provided.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@makrout
makrout deployed to raid-main November 1, 2026 02:45 — with GitHub Actions Active
@github-actions

github-actions Bot commented Nov 4, 2026

Copy link
Copy Markdown

Eval run succeeded! Link to run: link

Here are the results of the submission(s):

provenance

Release date: 2026-10-31

I've committed detailed results of this detector's performance on the test set to this PR.

On the RAID dataset as a whole (aggregated across all generation models, domains, decoding strategies, repetition penalties, and adversarial attacks), it achieved an AUROC of 99.89 and a TPR of 99.65% at FPR=5% and 98.91% at FPR=1%.
Without adversarial attacks, it achieved AUROC of 99.96 and a TPR of 99.86% at FPR=5% and 99.54% at FPR=1%.

If all looks well, a maintainer will come by soon to merge this PR and your entry/entries will appear on the leaderboard. If you need to make any changes, feel free to push new commits to this PR. Thanks for submitting to RAID!

@liamdugan

Copy link
Copy Markdown
Owner

Congrats on the strong performance @makrout please let me know if you'd like me to merge your submission into the leaderboard

@makrout

makrout commented Nov 4, 2026

Copy link
Copy Markdown
Author

@liamdugan Thank you. Yes, please merge my submission into the leaderboard. Many thanks!

This branch was successfully deployed

1 active deployment
raid-main — 8355a671 Deployed Nov 4, 2026 by liamdugan via evaluate #413
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants