Skip to content

test: roll stable-test-runner to 1.64.0-alpha-2026-09-14 - #42706

Merged
Devin Rousso (dcrousso) merged 1 commit into
mainfrom
roll-stable-test-runner/2026-Sep-14
Sep 14, 2026
Merged

Devin Rousso (dcrousso) merged 1 commit into
mainfrom
roll-stable-test-runner/2026-Sep-14

Conversation

@microsoft-playwright-automation

Copy link
Copy Markdown
Contributor

No description provided.

@github-actions

Copy link
Copy Markdown
Contributor

Test results for "tests 1"

4 flaky ⚠️ [chromium-library] › library/popup.spec.ts:260 › should not throw when click closes popup `@chromium-ubuntu-22.04-node24`
⚠️ [chromium-library] › library/video.spec.ts:495 › screencast › should capture static page in persistent context Radoslav Kirilov (@smoke) `@chromium-ubuntu-22.04-node22`
⚠️ [firefox-library] › library/browsercontext-cookies-third-party.spec.ts:257 › third party 'Partitioned;' cookies `@firefox-ubuntu-22.04-node20`
⚠️ [firefox-library] › library/browsercontext-cookies-third-party.spec.ts:470 › top level 'Partitioned;' cookie and same origin iframe `@firefox-ubuntu-22.04-node20`

51692 passed, 1247 skipped


Merge workflow run.

@github-actions

Copy link
Copy Markdown
Contributor

Test results for "MCP"

1 failed
❌ [firefox] › mcp/cli-session.spec.ts:54 › idle timeout shuts the session down @mcp-windows-latest-firefox

8508 passed, 1436 skipped


Merge workflow run.

@github-actions

Copy link
Copy Markdown
Contributor

🟢 Nothing here points at this PR

The one failure — mcp/cli-session.spec.ts:54 on Firefox/Windows — is a pre-existing flake that also fails on a plain push SHA with no PR attached.

Details

This PR only bumps tests/playwright-test/stable-test-runner (package.json + lockfile), which is the pinned released runner used by the playwright-test suite. It doesn't reach the MCP CLI session code at all.

Pre-existing flake / infra

  • [firefox] › mcp/cli-session.spec.ts:54 › idle timeout shuts the session down @mcp-windows-latest-firefox — fails with expect(received).toContain("(no browsers)") while the report still shows ### Browsers - default: status: o…, i.e. the idle shutdown hadn't landed yet when the assertion ran. The identical failure appears on push sha d1ead3ec (no PR) and on feat(coverage): experimental istanbul coverage collection via tracing #42684, so this PR can't be responsible. Across the results DB it's 3 failed of 9 runs on mcp-windows-latest-firefox and 0 failed of 118 runs on every other MCP bot — a Windows/Firefox timing flake.

    🟩🟩🟩🟩🟩🟥🟩🟥🟥

The four flaky tests in the "tests 1" report (library/popup.spec.ts:260, library/video.spec.ts:495, two browsercontext-cookies-third-party.spec.ts cases) all passed on retry and aren't in the playwright-test suite either.

Triaged by the Playwright bot - agent run

@dcrousso
Devin Rousso (dcrousso) merged commit 4dc79d4 into main Sep 14, 2026
44 of 45 checks passed
@dcrousso
Devin Rousso (dcrousso) deleted the roll-stable-test-runner/2026-Sep-14 branch September 14, 2026 18:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant