Skip to content

docs(site): explain dictionary input checks with executable UTF-8 examples - #3906

Merged
LauraGPT merged 1 commit into
mainfrom
codex/site-dictionary-input-checklist-20261116
Nov 15, 2026
Merged

LauraGPT merged 1 commit into
mainfrom
codex/site-dictionary-input-checklist-20261116

Conversation

@LauraGPT

Copy link
Copy Markdown
Collaborator

Summary

Publish one Shanghai 2026-11-16 bilingual tutorial about diagnosing CharTokenizer segmentation-dictionary input. The executable UTF-8 inspector reports blank lines, duplicate keys with line numbers, empty mappings, BOM characters and uppercase keys without modifying the file.

The article distinguishes main's #3905 correction from the already published 1.4.26 wheel, and distinguishes file-format checks and synthetic CUDA input-chain evidence from pretrained ASR quality. It does not reinterpret model licensing or claim adoption, performance or benchmark improvements.

Scope

Five files: two existing-template article pages, the blog catalogue, legacy manifest and focused regression tests. Existing architecture and selected/lead entries remain unchanged. No runtime, model, dependency, workflow, service, production configuration or logging change.

Validation

  • RED: the new catalogue regression failed once as expected before adding content.
  • Focused article suite: 55 passes covering both languages, source and built examples, CLI execution, UTF-8/CRLF/BOM, duplicate overrides, empty values, original file-byte preservation, metadata and archive discovery.
  • Deterministic builds: identical inventories for 281 files.
  • Private Playwright: four accepted cases across ZH/EN and 360x900/1440x900; navigation, page bounds, loaded images and mobile code access checked. Four first-viewport screenshots visually inspected.
  • Static-deployment wrapper: five simulation tests passed against this exact archive. No production deployment is claimed by this PR.
  • The initial full-site run reached its 560-second limit and exited 124; that attempt is retained and is not a pass. The publication gate requires the same complete 660-case suite to finish successfully in a separately identified 1800-second bounded run. No cases are removed and no assertions or product code are changed to obtain acceptance.
  • Normal exact-head and new-main hosted CI, actual static-file hashes, public page/resource downloads, public browser verification and the atomic daily ledger remain separate gates.

Inline self-reviewed with Codex assistance; no independent GitHub review is claimed. Signed and DCO-signed-off. Nano remains paused, and the pre-existing package releases are not republished by this change.

…mples

Publish one dated bilingual source-configuration tutorial with an executable read-only example and explicit test limits.

Signed-off-by: LauraGPT <zhifu.gzf@alibaba-inc.com>
@LauraGPT
LauraGPT merged commit c1e3018 into main Nov 15, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant