Skip to content

Commit 5a95dfd

Browse files
committed
Record parallel benchmark workflow qualification evidence
1 parent 864aa37 commit 5a95dfd

1 file changed

Lines changed: 57 additions & 11 deletions

File tree

‎docs/implementation/unified-benchmarks-workflow.md‎

Lines changed: 57 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -7,8 +7,8 @@ durable delivery contract and evidence are retained here.
77

88
# Acceptance
99

10-
Goal: Benchmarks shows TimeSeries within common image preparation and the complete
11-
performance cohort, with no separate TimeSeries branch. Existing owner direction
10+
Goal: Benchmarks shows TimeSeries checks within common image preparation and runs
11+
the existing performance cohort in parallel, with no separate TimeSeries branch. Existing owner direction
1212
authorizes this repair and scoped main delivery. Actors: trusted own-main push or
1313
manual workflow, read-only native preparation/measurement and Pages-only deployment.
1414

@@ -62,12 +62,13 @@ Task graph:
6262

6363
| Task | AC | Owner / tier | Permission | Dependency/start | Artifact / verification | State/join |
6464
|---|---|---|---|---|---|---|
65-
| TASK-UB-01 | 001-004 | lead / planning | workflow/policy/ADR/docs writes | acceptance exists | scoped source diff, static governance | active |
66-
| TASK-UB-02 | 002 | workload review / inherited high capability | read only | plan exists | exact inventory, no omitted suite | pending; lead review |
67-
| TASK-UB-03 | 001/003 | regression review / inherited high capability | read only initially | plan exists | proposed TUnit ownership/gates | pending; lead review |
68-
| TASK-UB-04 | all | lead / integration | scoped commit/push, GitHub dispatch | joined source review | exact-SHA CI/Benchmarks jobs/artifacts | pending |
65+
| TASK-UB-01 | 001-004 | lead / planning | workflow/policy/ADR/docs writes | acceptance exists | scoped source diff, static governance | complete; integrated |
66+
| TASK-UB-02 | 002 | workload review / inherited high capability | read only | plan exists | exact inventory, no omitted suite | complete; reviewed |
67+
| TASK-UB-03 | 001/003/005/006 | regression review / inherited high capability | three owned regression files | plan exists | TUnit graph/name/completeness assertions | complete; reviewed; GitHub ordinary unit suite passed |
68+
| TASK-UB-04 | all | lead / integration | scoped commit/push, GitHub dispatch | joined source review | exact-SHA commits/jobs/artifacts and honest outcomes | complete; source delivered |
6969
| TASK-UB-05 | 005 | bounded Luna worker / high | exact11 contract/oracle files | approved frozen display map | scoped diff,6 JS syntax checks | complete; lead reviewed |
7070
| TASK-UB-06 | all | independent high-capability review | read only | joined source | graph/name/provenance/regression review | complete; no source defect found |
71+
| TASK-UB-07 | 002/003 | lead and independent native review | read only | real GitHub execution | complete cohort/CI qualification | failed; native failures and superseded run, no publication proof |
7172

7273
Ordered steps:
7374
- [x] Record owner correction and scope/acceptance before source edits.
@@ -78,7 +79,7 @@ Ordered steps:
7879
remove standalone branch and route qualify solely through the complete aggregate.
7980
- [x] Update ADR implementation/evidence traceability; inspect complete scoped diff.
8081
- [x] Static governance and YAML/JS source checks. No local test qualification.
81-
- [ ] Commit/push only task changes on existing main, dispatch/inspect exact-SHA
82+
- [x] Commit/push only task changes on existing main, dispatch/inspect exact-SHA
8283
CI and Benchmarks; retain real jobs/artifacts and update failures without skips.
8384

8485
Baseline: CI37117886564/ec3399ef279fda1f4cf510e5ce2a0650684776f9 passed.
@@ -93,13 +94,13 @@ and native preflight starts. Keep these actual states, not overall success claim
9394
- [x] Static shellcheck SC2016 informational finding exists identically in original
9495
and edited Release literal Markdown printf body. Preserve literal backticks;
9596
YAML/action validation passes, no new finding and no source suppression.
96-
- [ ] Exact delivered-source CI and complete Benchmarks outcome remain pending.
97-
- [ ] CI37119418418/45e4992d86fcb16d1568327e1d38e9a8e76140ec: new
97+
- [ ] Complete delivered-source CI and Benchmarks qualification remain unproven.
98+
- [x] CI37119418418/45e4992d86fcb16d1568327e1d38e9a8e76140ec: new
9899
WorkflowStepNameTests async test synchronously reads its composite file (CA1849).
99100
Repair with awaited cancellation-aware file IO; preserve every assertion.
100-
- [ ] Same exact-source CI: WorkflowLayoutUnifiedPerformanceTests synchronously
101+
- [x] Same exact-source CI: WorkflowLayoutUnifiedPerformanceTests synchronously
101102
reads its JSON contract (CA1849). Repair with awaited cancellation-aware IO.
102-
- [ ] Same exact-source CI: nodeCounts JSON machine key violates KLD0001. Extract
103+
- [x] Same exact-source CI: nodeCounts JSON machine key violates KLD0001. Extract
103104
the named property constant; do not suppress the repository analyzer.
104105

105106
Source milestone45e4992d8 was committed/pushed to main with only task-owned files
@@ -121,3 +122,48 @@ Validation order: source/schema review, static governance, GitHub build/format/
121122
ordinary TUnit suite, real Docker/image/native-cell qualification, authenticated
122123
aggregate and unchanged website qualification/deployment gates. Accepted ADR
123124
status remains until required provider evidence exists. Release stays manual.
125+
126+
# Delivered-source GitHub evidence
127+
128+
Repair commit `995721374fe3afa9af8b25e69fc438909f768870` fixes the three
129+
authored-regression diagnostics above with cancellation-aware awaited IO and named
130+
JSON property constants. No assertion or analyzer rule was weakened.
131+
132+
[CI37119641948](https://github.com/managedcode/KeyLoad/actions/runs/37119641948)
133+
on that exact SHA passed repository governance, the compiler analyzer fixture,
134+
Release build, formatting, ordinary TUnit unit tests and the genuine RF3 .NET/MCP
135+
client job. Its scalar unit step was cancelled and process recovery never ran when
136+
concurrent main delivery superseded this run. Overall conclusion is cancelled;
137+
this is not full CI qualification.
138+
139+
[Benchmarks37119641910](https://github.com/managedcode/KeyLoad/actions/runs/37119641910)
140+
on the same SHA passed build/checks, plan and common image qualification. The actual
141+
plan artifact records270 cells (108 CRUD,162 specialized),9 targets and node
142+
counts1/2/3. Common image qualification passed the relocated TimeSeries pinned-image
143+
probe and retained its facts. Real benchmark CRUD jobs ran while native preflight
144+
jobs were still running, confirming the matrices are independent. Runner capacity
145+
can queue admitted jobs; workflow dependencies and caps no longer serialize them.
146+
147+
This run retained native failures before being superseded/cancelled:
148+
149+
- [KeyLoad one-node preflight](https://github.com/managedcode/KeyLoad/actions/runs/37119641910/job/111194069823)
150+
failed registry readiness during native image import. Both images loaded and
151+
identity checks passed; the owned registry listened within one second and was
152+
still running when the importer failed after its30-second readiness bound.
153+
No push began. Retained native commands, registry log/state and cleanup receipts
154+
do not expose the original HTTP failure because readiness discards exceptions.
155+
The readiness source is unchanged by this repair; transport cause is unproven.
156+
- [KurrentDB two-node preflight](https://github.com/managedcode/KeyLoad/actions/runs/37119641910/job/111194069852)
157+
retained five measured StreamAppend repetitions, each10000 successes with no
158+
operation failures. Its subsequent volume regression expected empty original
159+
event metadata but observed76 bytes. Event identity/revision/data/type checks
160+
passed immediately before that assertion. Native reader/fixture/event creation
161+
source is identical before and after this repair; absent metadata bytes prevent
162+
attributing the server/SDK/oracle cause. The three-node preflight also failed its
163+
workload step and does not count as qualified.
164+
165+
No failed, skipped, cancelled or missing cell refreshes website metrics. Aggregation,
166+
website qualification/publication, scalar portability, process recovery and the
167+
unfinished intensive TimeSeries measurement delivery remain unqualified here.
168+
Concurrent main advanced to `864aa37809088a86d841b08cda9e98dc0639a567`; its
169+
separate CI/Benchmarks outcomes cannot be attributed to these two repair commits.

0 commit comments

Comments
 (0)