fix: move authoring policy out of the docs tree

[chideat]

Fixes the doc-pr-build-valkey pipeline, which has been failing on every PR regardless of content (#4, #5, #6 all fail identically at task build-docs, step build, exit 1; every other task succeeds).

Root cause

docs/agent/ held internal authoring policy — but anything under docs/ is a documentation route. doom rendered those five files as /agent/* pages and SSG crashed on them:

error  Page "/agent/products" SSG rendering failed.
       File: node_modules/@alauda/doom/lib/products/index.js
       TypeError: Cannot read properties of undefined (reading 'all_product_documentation')

Why it never showed up locally

Two CI behaviours diverge from a local build:

1. CI does not pass --ignore. doom.config.yml marked agent/**/* as internalRoutes and the build script passed --ignore=true, so the broken pages were skipped locally. The build-docs step runs yarn build-online-io (injected by modify_build_config.xsh), which renders internal routes.
2. CI discards the pinned doom version. install-dependencies runs yarn remove @alauda/doom → yarn add @alauda/doom → yarn up -R @alauda/doom, so it builds with the latest doom, not the pinned 1.12.1. Newer doom adds a generated /agent/products page in the same namespace — that's the page named in the log, and it does not exist in 1.12.1 at all.

So internalRoutes + --ignore=true was masking a genuinely broken page rather than fixing it.

The change

• Moves the five files to a root-level agent/, matching redis-docs — which keeps its agent instructions and TERMINOLOGY_CANDIDATES.md at the repository root and has never had a docs/agent/ directory on any branch.
• Updates the references in AGENTS.md (and therefore CLAUDE.md, a symlink) and llmstxt-config.yaml.
• Drops internalRoutes and both --ignore=true flags. With the files out of the docs tree they have nothing left to hide, and keeping them would restore the exact local/CI divergence that masked this.

Verification

build	before	after
doom 2.5.4 (what CI installs), no --ignore	fails on /agent/*	exit 0, 0 errors
pinned doom 1.12.1, yarn build	—	exit 0, 0 errors
yarn lint	—	0 errors, 0 warnings

dist/agent/ is no longer produced at all, so the policy files are not published even as stubs.

Related

• Backport to release-2.0: fix: move authoring policy out of the docs tree (release-2.0) #8
• ACP back-link fix: fix(sites): point the ACP back-link at 4.4 #5 / fix(sites): point the ACP back-link at 4.4 (release-2.0) #6

[cloudflare-workers-and-pages]

Deploying alauda-valkey with    Cloudflare Pages

Latest commit:	4903be1
Status:	✅  Deploy successful!
Preview URL:	https://f537bbcc.alauda-valkey.pages.dev
Branch Preview URL:	https://fix-move-agent-docs.alauda-valkey.pages.dev

View logs