Skip to content

[test] workflow-server PR #878 - #3886

Draft
vercel-gh-bot-4[bot] wants to merge 1 commit into
mainfrom
test/server-pr-878
Draft

[test] workflow-server PR #878#3886
vercel-gh-bot-4[bot] wants to merge 1 commit into
mainfrom
test/server-pr-878

Conversation

@vercel-gh-bot-4

Copy link
Copy Markdown

This PR was automatically created to test a workflow-server preview deployment.


This PR will be automatically closed after 24 hours.

@changeset-bot

changeset-bot Bot commented Aug 28, 2026

Copy link
Copy Markdown

⚠️ No Changeset found

Latest commit: db00e6a

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@vercel

vercel Bot commented Aug 28, 2026

Copy link
Copy Markdown
Contributor

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
example-nextjs-workflow-turbopack Ready Ready Preview, v0 Aug 28, 2026 5:34pm
example-nextjs-workflow-webpack Ready Ready Preview, v0 Aug 28, 2026 5:34pm
example-workflow Ready Ready Preview, v0 Aug 28, 2026 5:34pm
workbench-astro-workflow Ready Ready Preview, v0 Aug 28, 2026 5:34pm
workbench-express-workflow Ready Ready Preview, v0 Aug 28, 2026 5:34pm
workbench-fastify-workflow Ready Ready Preview, v0 Aug 28, 2026 5:34pm
workbench-hono-workflow Ready Ready Preview, v0 Aug 28, 2026 5:34pm
workbench-nestjs-workflow Ready Ready Preview, v0 Aug 28, 2026 5:34pm
workbench-nitro-workflow Ready Ready Preview, v0 Aug 28, 2026 5:34pm
workbench-nuxt-workflow Ready Ready Preview, v0 Aug 28, 2026 5:34pm
workbench-python-workflow Ready Ready Preview, v0 Aug 28, 2026 5:34pm
workbench-sveltekit-workflow Ready Ready Preview, v0 Aug 28, 2026 5:34pm
workbench-tanstack-start-workflow Ready Ready Preview, v0 Aug 28, 2026 5:34pm
workbench-vite-workflow Ready Ready Preview, v0 Aug 28, 2026 5:34pm
workflow-docs Ready Ready Preview, v0 Aug 28, 2026 5:34pm
workflow-swc-playground Ready Ready Preview, v0 Aug 28, 2026 5:34pm
workflow-tarballs Ready Ready Preview, v0 Aug 28, 2026 5:34pm
workflow-web Ready Ready Preview, v0 Aug 28, 2026 5:34pm

@github-actions

github-actions Bot commented Aug 28, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

Some tests failed

❌ Failed E2E Tests

▲ Vercel Production (8 failed)

python-node (8 failed):

  • promiseAllWorkflow | wrun_41M14Q3GJW0GZRBN7Q59SVRMN2 | 🔍 observability
  • sleepingWorkflow | wrun_41M14Q47010GR7S99R9CC4WDNN | 🔍 observability
  • parallelSleepWorkflow | wrun_41M14Q486Q0GH4BFG5WNDABNVS | 🔍 observability
  • nullByteWorkflow | wrun_41M14Q4FR70GZ568MK2K1XDEVT | 🔍 observability
  • cancelRun - cancelling a running workflow | wrun_41M14Q8SN40GNS9K2B5NMGGF33 | 🔍 observability
  • cancelRun via CLI - cancelling a running workflow | wrun_41M14Q8VEN0GG7158QKM4FRKXR | 🔍 observability
  • sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration | wrun_41M14Q93HG0GJEG964Y2402SYW | 🔍 observability
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_41M14Q9NJC0GNGBS0WXPN9PQWT | 🔍 observability
vercel-http-transport (19 failed)

nextjs-turbopack (19 failed):

  • DurableAgent e2e core basic text response
  • DurableAgent e2e core single tool call
  • DurableAgent e2e core multiple sequential tool calls
  • DurableAgent e2e core tool error recovery
  • DurableAgent e2e onStepFinish fires constructor + stream callbacks in order with step data
  • DurableAgent e2e onFinish fires constructor + stream callbacks in order with event data
  • DurableAgent e2e provider tools provider tool identity preserved across step boundaries
  • DurableAgent e2e provider tools mixed provider and function tools
  • DurableAgent e2e instructions string instructions are passed to the model
  • DurableAgent e2e timeout completes within timeout
  • DurableAgent e2e experimental_onStart (GAP) completes but callbacks are not called (GAP)
  • DurableAgent e2e experimental_onStepStart (GAP) completes but callbacks are not called (GAP)
  • DurableAgent e2e experimental_onToolCallStart (GAP) completes but callbacks are not called (GAP)
  • DurableAgent e2e experimental_onToolCallFinish (GAP) completes but callbacks are not called (GAP)
  • DurableAgent e2e prepareCall (GAP) completes but prepareCall is not applied (GAP)
  • DurableAgent e2e prepareStep on constructor agent-level prepareStep is called for each LLM step
  • DurableAgent e2e prepareStep on constructor stream-level prepareStep overrides constructor-level
  • DurableAgent e2e multimodal tool results passes through LanguageModelV3ToolResultOutput from tools
  • DurableAgent e2e tool approval (GAP) completes but needsApproval is not checked (GAP)

⚠️ Flaky E2E Tests (passed on retry)

These tests failed at least once and passed on a retry. A recurring entry here is a real race worth investigating.

  • getTailIndex returns correct index after stream completes (example)

🛠 Infra Events (absorbed by the harness)

Platform anomalies the e2e harness detected and worked around (e.g. a run the queue never picked up, replaced by a fresh run). Clustered timestamps indicate a backend blip; a steady drip indicates a platform issue worth escalating.

15 infra events
  • cold-start-warmup · suite warmup (python) · at 17:33:28Z · abandoned wrun_41M14PTD2Q0GG2KTM83G76J5DD · (+7 more)
  • run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 17:33:47Z · abandoned wrun_41M14PY2W00GP2PB2CFJHFDAVG
  • run-pickup-stall · sleepingWorkflow (python) · at 17:33:47Z · abandoned wrun_41M14PY2F30GHV3CH5EBS58JAH
  • run-pickup-stall · promiseAllWorkflow (python) · at 17:33:48Z · abandoned wrun_41M14PY2EX0GP2DYWM6VF6FK1S
  • run-pickup-stall · parallelSleepWorkflow (python) · at 17:33:48Z · abandoned wrun_41M14PY2F30GHV3CH5EBS58JAJ
  • run-pickup-stall · nullByteWorkflow (python) · at 17:33:50Z · abandoned wrun_41M14PY2F70GMCJ6A2CDJWTSGJ
  • run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 17:34:25Z · abandoned wrun_41M14PZ6840GHWWSPTAEFJ3T4P
  • run-pickup-stall · sleepingWorkflow (python) · at 17:34:49Z · abandoned wrun_41M14PZZ4R0GXJYVCY5TK7T80T
  • run-pickup-stall · parallelSleepWorkflow (python) · at 17:34:52Z · abandoned wrun_41M14Q00E50GJ8GT5739QG8773
  • run-pickup-stall · nullByteWorkflow (python) · at 17:34:53Z · abandoned wrun_41M14PZZQR0GXV79YDFMCCRQPW
  • run-pickup-stall · promiseAllWorkflow (python) · at 17:34:54Z · abandoned wrun_41M14Q03KJ0GJPBPKYP4BP95NV
  • run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 17:35:33Z · abandoned wrun_41M14Q0G1N0GMZKH77296W9GTX
  • run-pickup-stall · sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration (python) · at 17:36:35Z · abandoned wrun_41M14Q24DH0GG30QEPETMJDPV1
  • run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 17:37:26Z · abandoned wrun_41M14Q37Y70GXKC551DWSXB40X
  • run-pickup-stall · sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration (python) · at 17:38:08Z · abandoned wrun_41M14Q4WA20GYVGSZZ79BRW8G0

E2E Test Summary

Summary
Passed Failed Skipped Total
❌ ▲ Vercel Production 3570 8 742 4320
❌ vercel-http-transport 264 19 677 960
✅ vercel-multi-region 27 0 0 27
✅ vercel-ws-transport 553 0 87 640
Total 4414 27 1506 5947
Details by Category

❌ ▲ Vercel Production

App Passed Failed Skipped
✅ astro-node 132 0 28
✅ astro-quickjs 132 0 28
✅ example-node 132 0 28
✅ example-quickjs 132 0 28
✅ express-node 132 0 28
✅ express-quickjs 132 0 28
✅ fastify-node 132 0 28
✅ fastify-quickjs 132 0 28
✅ hono-node 132 0 28
✅ hono-quickjs 132 0 28
✅ nest-node 132 0 28
✅ nest-quickjs 132 0 28
✅ nextjs-turbopack-node 157 0 3
✅ nextjs-turbopack-quickjs 157 0 3
✅ nextjs-webpack-node 157 0 3
✅ nextjs-webpack-quickjs 157 0 3
✅ nitro-node 132 0 28
✅ nitro-quickjs 132 0 28
✅ nuxt-node 132 0 28
✅ nuxt-quickjs 132 0 28
❌ python-node 0 8 152
✅ sveltekit-node 151 0 9
✅ sveltekit-quickjs 151 0 9
✅ tanstack-start-node 132 0 28
✅ tanstack-start-quickjs 132 0 28
✅ vite-node 132 0 28
✅ vite-quickjs 132 0 28

❌ vercel-http-transport

App Passed Failed Skipped
✅ example 0 0 160
✅ express 132 0 28
✅ hono 0 0 160
❌ nextjs-turbopack 0 19 141
✅ nitro 132 0 28
✅ vite 0 0 160

✅ vercel-multi-region

App Passed Failed Skipped
✅ nextjs-turbopack 27 0 0

✅ vercel-ws-transport

App Passed Failed Skipped
✅ example 132 0 28
✅ express 132 0 28
✅ nextjs-turbopack 157 0 3
✅ vite 132 0 28

📋 View full workflow run

@github-actions

github-actions Bot commented Aug 28, 2026

Copy link
Copy Markdown
Contributor

Sim World

Simulated world deterministic testing for races. Traces

🟠 world-sim scenario book — 1 fail of 41 total

fence=per-spec

scenario outcome events virt replay violations
smoke-no-steps completed 3 0ms ok 0
smoke-one-step completed 6 0ms ok 0
hook-at-step-started completed 12 0ms ok 0
hook-at-step-completed completed 12 0ms ok 0
hook-at-hook-created completed 12 0ms ok 0
deadline-hook-wins completed 7 1.0h ok 0
deadline-expires completed 7 1.0h ok 0
long-sleep completed 11 30.0d ok 0
hook-never-arrives stalled 3 0ms skipped 0
step-retries-twice completed 10 2.0s ok 0
parallel-steps completed 9 0ms ok 0
hook-on-execution-state completed 12 0ms ok 0
peek-hook-before-branch completed 12 0ms ok 0
peek-hook-after-branch completed 12 0ms ok 0
peek-hook-at-registration completed 12 0ms ok 0
race-hook-before-probe completed 12 0ms ok 0
race-hook-after-probe completed 12 0ms ok 0
race-duplicate-delivery completed 13 0ms ok 0
attr-hook-before-step completed 11 0ms ok 0
attr-hook-after-step completed 11 0ms ok 0
attr-from-step-body completed 13 0ms ok 0
fork-hook-after-timeout completed 14 1.0m ok 0
fork-hook-before-timeout completed 14 1.0m ok 0
count-hook-after-timeout completed 17 1.0m ok 0
count-hook-before-timeout completed 20 1.0m ok 0
stale-read-step-count-fork completed 20 1.0m ok 0
stale-read-equal-step-counts completed 14 1.0m ok 0
step-vs-step-fork completed 12 0ms ok 0
step-vs-step-fork-fenced completed 12 0ms ok 0
fence-catches-benign-direction completed 12 5ms ok 0
in-flight-before-decision completed 17 1.0m ok 0
in-flight-before-decision-counted completed 17 1.0m ok 0
in-flight-after-decision completed 19 2.0m ok 0
stale-read-step-count-fork-fenced completed 20 1.0m ok 0
fork-hook-wins completed 13 1.0m ok 0
fork-timeout-wins completed 13 1.0m ok 0
unclaimed-payload-under-fork completed 17 1.0m ok 0
claimed-payload-under-fork completed 17 1.0m ok 0
writers-independent-step-bodies completed 12 0ms ok 0
writers-scripted-tempo completed 12 0ms ok 0
cancel-mid-step cancelled 7 0ms skipped 0

Full trace: world-sim.txt

@github-actions

github-actions Bot commented Aug 28, 2026

Copy link
Copy Markdown
Contributor
Framework Flow route Step reg. Framework output
hono 200.9 KiB (±0) 40.4 KiB (±0) 1.76 MiB (+37 B)
nextjs-turbopack 206.3 KiB (±0) 439 B (±0) 763.7 KiB (-17 B)
About these numbers

Sizes are gzip; parentheses show the change against main.
Flow route and Step reg. gate this job, on raw bytes rather than the gzip shown, at max(2%, 50.0 KiB). Framework output is informational.

db00e6a · run

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants