Initialize direct queue delivery before workers by NathanColosimo · Pull Request #3323 · vercel/workflow

NathanColosimo · 2026-08-04T07:06:14Z

Summary

Call the generated handler initialization hook before framework integrations start background workers.

Next.js, SvelteKit, Astro, Nest, Nitro, and Nuxt initialize POST before world.start().
Preserve the callable handler and its initialize property through framework wrappers.
Reuse the public WorkflowEntrypoint type in generated declarations.
Add shared conformance coverage proving the Postgres flow route returns 404 for normal and health requests.

The generated route stays in place for framework compatibility, but Postgres execution no longer depends on public HTTP traffic.

Validation

@workflow/nest: 35 passing tests
@workflow/nitro: 30 passing tests
@workflow/sveltekit: 7 passing tests
Production builds for Next.js Turbopack, Next.js Webpack, SvelteKit, Astro, Nest, Nitro, and Nuxt with the Postgres World

_{Stack created with GitHub Stacks CLI • Give Feedback 💬}

changeset-bot · 2026-08-04T07:06:23Z

🦋 Changeset detected

Latest commit: 364a1b1

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 16 packages

Name	Type
@workflow/astro	Patch
@workflow/nest	Patch
@workflow/nitro	Patch
@workflow/sveltekit	Patch
@workflow/world-testing	Patch
workflow	Patch
@workflow/nuxt	Patch
@workflow/core	Patch
@workflow/builders	Patch
@workflow/cli	Patch
@workflow/next	Patch
@workflow/vitest	Patch
@workflow/web-shared	Patch
@workflow/web	Patch
@workflow/rollup	Patch
@workflow/vite	Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

vercel · 2026-08-04T07:06:31Z

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Actions	Updated
example-nextjs-workflow-turbopack	Ready	Preview, v0	Sep 2, 2026 12:30am UTC
example-nextjs-workflow-webpack	Ready	Preview, v0	Sep 2, 2026 12:30am UTC
example-workflow	Ready	Preview, v0	Sep 2, 2026 12:30am UTC
workbench-astro-workflow	Ready	Preview, v0	Sep 2, 2026 12:30am UTC
workbench-express-workflow	Ready	Preview, v0	Sep 2, 2026 12:30am UTC
workbench-fastify-workflow	Ready	Preview, v0	Sep 2, 2026 12:30am UTC
workbench-hono-workflow	Ready	Preview, v0	Sep 2, 2026 12:30am UTC
workbench-nestjs-workflow	Ready	Preview, v0	Sep 2, 2026 12:30am UTC
workbench-nitro-workflow	Ready	Preview, v0	Sep 2, 2026 12:30am UTC
workbench-nuxt-workflow	Ready	Preview, v0	Sep 2, 2026 12:30am UTC
workbench-python-workflow	Ready	Preview, v0	Sep 2, 2026 12:30am UTC
workbench-sveltekit-workflow	Ready	Preview, v0	Sep 2, 2026 12:30am UTC
workbench-tanstack-start-workflow	Ready	Preview, v0	Sep 2, 2026 12:30am UTC
workbench-vite-workflow	Ready	Preview, v0	Sep 2, 2026 12:30am UTC
workflow-docs	Ready	Preview, v0	Sep 2, 2026 12:30am UTC
workflow-swc-playground	Ready	Preview, v0	Sep 2, 2026 12:30am UTC
workflow-tarballs	Ready	Preview, v0	Sep 2, 2026 12:30am UTC
workflow-web	Ready	Preview, v0	Sep 2, 2026 12:30am UTC

github-actions · 2026-08-04T07:06:46Z

🧪 E2E Test Results

❌ Some tests failed

❌ Failed E2E Tests

▲ Vercel Production (8 failed)

python-node (8 failed):

promiseAllWorkflow | wrun_41M1FR8J7K0GG1RPNW99FJCKHD | 🔍 observability
sleepingWorkflow | wrun_41M1FR9MXW0GVDXV2Y14J89M59 | 🔍 observability
parallelSleepWorkflow | wrun_41M1FR9SHM0GHHV9FFK8JM3VQG | 🔍 observability
nullByteWorkflow | wrun_41M1FRA4KQ0GGRDA6BWS9QNJW6 | 🔍 observability
cancelRun - cancelling a running workflow | wrun_41M1FREPYB0GWH0VS919ZHQZ8J | 🔍 observability
cancelRun via CLI - cancelling a running workflow | wrun_41M1FRETBP0GHT45877AREK17H | 🔍 observability
sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration | wrun_41M1FREXJC0GHVCZ86J70NK9N4 | 🔍 observability
resilient start: addTenWorkflow completes when run_created returns 500 | wrun_41M1FRFGVV0GT1C9RY7KA96185 | 🔍 observability

🐘 Local Postgres (28 failed)

astro-stable-node (1 failed):

health check endpoint (HTTP) - workflow endpoint responds to __health query parameter

astro-stable-quickjs (1 failed):

health check endpoint (HTTP) - workflow endpoint responds to __health query parameter

express-stable-node (1 failed):

health check endpoint (HTTP) - workflow endpoint responds to __health query parameter

express-stable-quickjs (1 failed):

health check endpoint (HTTP) - workflow endpoint responds to __health query parameter

fastify-stable-node (1 failed):

health check endpoint (HTTP) - workflow endpoint responds to __health query parameter

fastify-stable-quickjs (1 failed):

health check endpoint (HTTP) - workflow endpoint responds to __health query parameter

hono-stable-node (1 failed):

health check endpoint (HTTP) - workflow endpoint responds to __health query parameter

hono-stable-quickjs (1 failed):

health check endpoint (HTTP) - workflow endpoint responds to __health query parameter

nest-stable-node (1 failed):

health check endpoint (HTTP) - workflow endpoint responds to __health query parameter

nest-stable-quickjs (1 failed):

health check endpoint (HTTP) - workflow endpoint responds to __health query parameter

nextjs-turbopack-canary-node (1 failed):

health check endpoint (HTTP) - workflow endpoint responds to __health query parameter

nextjs-turbopack-canary-quickjs (1 failed):

health check endpoint (HTTP) - workflow endpoint responds to __health query parameter

nextjs-turbopack-stable-node (1 failed):

health check endpoint (HTTP) - workflow endpoint responds to __health query parameter

nextjs-turbopack-stable-quickjs (1 failed):

health check endpoint (HTTP) - workflow endpoint responds to __health query parameter

nextjs-webpack-canary-node (1 failed):

health check endpoint (HTTP) - workflow endpoint responds to __health query parameter

nextjs-webpack-canary-quickjs (1 failed):

health check endpoint (HTTP) - workflow endpoint responds to __health query parameter

nextjs-webpack-stable-node (1 failed):

health check endpoint (HTTP) - workflow endpoint responds to __health query parameter

nextjs-webpack-stable-quickjs (1 failed):

health check endpoint (HTTP) - workflow endpoint responds to __health query parameter

nitro-stable-node (1 failed):

health check endpoint (HTTP) - workflow endpoint responds to __health query parameter

nitro-stable-quickjs (1 failed):

health check endpoint (HTTP) - workflow endpoint responds to __health query parameter

nuxt-stable-node (1 failed):

health check endpoint (HTTP) - workflow endpoint responds to __health query parameter

nuxt-stable-quickjs (1 failed):

health check endpoint (HTTP) - workflow endpoint responds to __health query parameter

sveltekit-stable-node (1 failed):

health check endpoint (HTTP) - workflow endpoint responds to __health query parameter

sveltekit-stable-quickjs (1 failed):

health check endpoint (HTTP) - workflow endpoint responds to __health query parameter

tanstack-start-node (1 failed):

health check endpoint (HTTP) - workflow endpoint responds to __health query parameter

tanstack-start-quickjs (1 failed):

health check endpoint (HTTP) - workflow endpoint responds to __health query parameter

vite-stable-node (1 failed):

health check endpoint (HTTP) - workflow endpoint responds to __health query parameter

vite-stable-quickjs (1 failed):

health check endpoint (HTTP) - workflow endpoint responds to __health query parameter

🌐 Cross-language Conformance (9 failed)

python (9 failed):

deploymentId: 'latest' is a no-op in non-Vercel worlds | wrun_01M1FRJACNEYZ58WMA1CQSEHV8
promiseAllWorkflow | wrun_41M1FR8J7K0GG1RPNW99FJCKHD
sleepingWorkflow | wrun_41M1FR9MXW0GVDXV2Y14J89M59
parallelSleepWorkflow | wrun_41M1FR9SHM0GHHV9FFK8JM3VQG
nullByteWorkflow | wrun_41M1FRA4KQ0GGRDA6BWS9QNJW6
cancelRun - cancelling a running workflow | wrun_41M1FREPYB0GWH0VS919ZHQZ8J
cancelRun via CLI - cancelling a running workflow | wrun_41M1FRETBP0GHT45877AREK17H
sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration | wrun_41M1FREXJC0GHVCZ86J70NK9N4
resilient start: addTenWorkflow completes when run_created returns 500 | wrun_41M1FRFGVV0GT1C9RY7KA96185

⚠️ Flaky E2E Tests (passed on retry)

These tests failed at least once and passed on a retry. A recurring entry here is a real race worth investigating.

23 flaky tests

negative startIndex (reads from end) (fastify) — flaked in 2 jobs
abortAnyInStepWorkflow: AbortSignal.any inside a step composes deserialized signals (tanstack-start)
abortAnyInStepWorkflow: AbortSignal.any inside a step composes deserialized signals (vite)
abortThrowIfAbortedWorkflow: throwIfAborted causes FatalError, no retries (nextjs-turbopack)
abortTimeoutWorkflow: timeout cancels long-running step (astro)
abortTimeoutWorkflow: timeout cancels long-running step (nest)
AllInOneService.processNumber - static workflow method using sibling static step methods (express)
AllInOneService.processNumber - static workflow method using sibling static step methods (nuxt)
basic step error preserves message and stack trace (nitro)
distributedAbortController - TTL expiration triggers signal (nitro)
errorSubclassRoundTripWorkflow - first-class Error subclasses survive every serialization boundary (astro)
getTailIndex returns correct index after stream completes (nextjs-turbopack)
hookClaimOnlyMutexWorkflow - hook works as a pure run mutex without payload data (nitro)
hookCleanupTestWorkflow - hook token reuse after workflow completion (fastify)
hookCleanupTestWorkflow - hook token reuse after workflow completion (nextjs-webpack)
hookGetConflictWorkflow - awaiting hook.getConflict() registers hook without payload (express)
hookWithSleepFinalStepWorkflow - step only on final payload (fastify)
promiseAllWorkflow (nextjs-turbopack)
spawnWorkflowFromStepWorkflow - spawning a child workflow using start() inside a step (nextjs-webpack)
step throw round-trips FatalError with cause chain to workflow catch (nuxt)
stepFunctionAsStartArgWorkflow - step function reference passed as start() argument (nitro)
stepFunctionAsStartArgWorkflow - step function reference passed as start() argument (sveltekit)
thisSerializationWorkflow - step function invoked with .call() and .apply() (vite)

🛠 Infra Events (absorbed by the harness)

Platform anomalies the e2e harness detected and worked around (e.g. a run the queue never picked up, replaced by a fresh run). Clustered timestamps indicate a backend blip; a steady drip indicates a platform issue worth escalating.

36 infra events

cold-start-warmup · suite warmup (python) · at 00:29:41Z · abandoned wrun_41M1FR7CGP0GGYDBSWC6E950MV · (+6 more)
run-pickup-stall · sleepingWorkflow (python) · at 00:29:57Z · abandoned wrun_41M1FRB1C90GWQGWKGA9M7RFS3
run-pickup-stall · promiseAllWorkflow (python) · at 00:29:57Z · abandoned wrun_41M1FRB1C10GSB9ADVNSF1SW37
run-pickup-stall · nullByteWorkflow (python) · at 00:29:57Z · abandoned wrun_41M1FRB1CC0GS977APJMHPSYNE
run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 00:29:59Z · abandoned wrun_41M1FRB1QC0GG7NVEXKV36DSGQ
run-pickup-stall · parallelSleepWorkflow (python) · at 00:30:00Z · abandoned wrun_41M1FRB1C90GWQGWKGA9M7RFS4
run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 00:30:32Z · abandoned wrun_41M1FRC3FT0GGBF9M4RJET534N
run-pickup-stall · promiseAllWorkflow (python) · at 00:30:58Z · abandoned wrun_41M1FRCWT50GXS7BR426N0SZAM
run-pickup-stall · nullByteWorkflow (python) · at 00:30:58Z · abandoned wrun_41M1FRCWVV0GG6SVNRV5EJFFER
run-pickup-stall · parallelSleepWorkflow (python) · at 00:30:58Z · abandoned wrun_41M1FRCWXK0GVR52B8DWRK61FH
run-pickup-stall · sleepingWorkflow (python) · at 00:30:58Z · abandoned wrun_41M1FRCWXX0GRGEBNRV7239M08
cold-start-warmup · suite warmup (tanstack-start) · at 00:31:26Z · abandoned wrun_01M1FRDD2HFSQ3DXJX6HSD1E06
run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 00:31:48Z · abandoned wrun_41M1FRD3450GXMPMG3YA0B7KFB
cold-start-warmup · suite warmup (python) · at 00:32:24Z · abandoned wrun_01M1FRCBZ6WX1Z5R53G56S8VK2 · (+7 more)
run-pickup-stall · sleepingWorkflow (python) · at 00:32:39Z · abandoned wrun_01M1FRG13W72NNRAAN95KHRQMJ
run-pickup-stall · deploymentId: 'latest' is a no-op in non-Vercel worlds (python) · at 00:32:39Z · abandoned wrun_01M1FRG13PT89Y9HEBNHQ45B3E
run-pickup-stall · promiseAllWorkflow (python) · at 00:32:39Z · abandoned wrun_01M1FRG13QAHCGWEWRC8Q4XSFQ
run-pickup-stall · parallelSleepWorkflow (python) · at 00:32:39Z · abandoned wrun_01M1FRG13Y7BSMX5BQ3EQC5Q02
run-pickup-stall · nullByteWorkflow (python) · at 00:32:39Z · abandoned wrun_01M1FRG1403E9QMZV73PYNAFAA
run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 00:33:23Z · abandoned wrun_41M1FRFV0P0GV2Y12M67SQQJDA
run-pickup-stall · sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration (python) · at 00:33:29Z · abandoned wrun_41M1FREYWT0GPABK7DP22ZC36B
run-pickup-stall · deploymentId: 'latest' is a no-op in non-Vercel worlds (python) · at 00:33:39Z · abandoned wrun_01M1FRHVQGGF9C9X4PNPD913ME
run-pickup-stall · sleepingWorkflow (python) · at 00:33:39Z · abandoned wrun_01M1FRHVQK90AFY17X359BMB57
run-pickup-stall · promiseAllWorkflow (python) · at 00:33:39Z · abandoned wrun_01M1FRHVQHCTWRCF6FMQVYZ170
run-pickup-stall · parallelSleepWorkflow (python) · at 00:33:39Z · abandoned wrun_01M1FRHVQNDJN0NAGSWQ81CN2F
run-pickup-stall · nullByteWorkflow (python) · at 00:33:39Z · abandoned wrun_01M1FRHVQRGTKQAE0R508TGY49
run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 00:34:39Z · abandoned wrun_01M1FRKPB48BM3X5E6ZRS9K7VA
run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 00:34:39Z · abandoned wrun_01M1FRKPBEVAHDE0527CVN5TST
run-pickup-stall · sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration (python) · at 00:34:39Z · abandoned wrun_01M1FRKPBKJ7Q38F02TPEA9GYT
run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 00:35:09Z · abandoned wrun_01M1FRMKPD81WJY1KJ3BDEYB7J
run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 00:35:09Z · abandoned wrun_01M1FRMKPTP37PZEVN0F7D47P2
run-pickup-stall · sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration (python) · at 00:35:39Z · abandoned wrun_01M1FRNGYNTCYR8Q0110VBFYQA
run-pickup-stall · nested function calls preserve message and stack trace (nextjs-webpack) · at 00:36:07Z · abandoned wrun_01M1FRPCBE13GRQRT5DYPG7C57
run-pickup-stall · cross-file imports preserve message and stack trace (nextjs-webpack) · at 00:36:11Z · abandoned wrun_01M1FRPG9P4VD58PV72VWY8PFV
run-pickup-stall · basic step error preserves message and stack trace (nextjs-webpack) · at 00:36:12Z · abandoned wrun_01M1FRPGWKMH2VKXCNNN94BSP3
run-pickup-stall · cross-file step error preserves message and function names in stack (nextjs-webpack) · at 00:36:14Z · abandoned wrun_01M1FRPJF7NFCBR9RCN0RSEJB9

E2E Test Summary

Summary

	Passed	Failed	Skipped	Total
❌ ▲ Vercel Production	3570	8	742	4320
✅ 💻 Local Development	3781	0	539	4320
✅ 📦 Local Production	3922	0	558	4480
❌ 🐘 Local Postgres	3894	28	558	4480
✅ 🪟 Windows	320	0	0	320
❌ 🌐 Cross-language Conformance	0	9	132	141
✅ vercel-http-transport	817	0	143	960
✅ vercel-multi-region	27	0	0	27
✅ vercel-ws-transport	553	0	87	640
Total	16884	45	2759	19688

Details by Category

❌ ▲ Vercel Production

App	Passed	Failed	Skipped
✅ astro-node	132	0	28
✅ astro-quickjs	132	0	28
✅ example-node	132	0	28
✅ example-quickjs	132	0	28
✅ express-node	132	0	28
✅ express-quickjs	132	0	28
✅ fastify-node	132	0	28
✅ fastify-quickjs	132	0	28
✅ hono-node	132	0	28
✅ hono-quickjs	132	0	28
✅ nest-node	132	0	28
✅ nest-quickjs	132	0	28
✅ nextjs-turbopack-node	157	0	3
✅ nextjs-turbopack-quickjs	157	0	3
✅ nextjs-webpack-node	157	0	3
✅ nextjs-webpack-quickjs	157	0	3
✅ nitro-node	132	0	28
✅ nitro-quickjs	132	0	28
✅ nuxt-node	132	0	28
✅ nuxt-quickjs	132	0	28
❌ python-node	0	8	152
✅ sveltekit-node	151	0	9
✅ sveltekit-quickjs	151	0	9
✅ tanstack-start-node	132	0	28
✅ tanstack-start-quickjs	132	0	28
✅ vite-node	132	0	28
✅ vite-quickjs	132	0	28

✅ 💻 Local Development

App	Passed	Skipped
✅ astro-stable-node	134	26
✅ astro-stable-quickjs	134	26
✅ express-stable-node	134	26
✅ express-stable-quickjs	134	26
✅ fastify-stable-node	134	26
✅ fastify-stable-quickjs	134	26
✅ hono-stable-node	134	26
✅ hono-stable-quickjs	134	26
✅ nest-stable-node	134	26
✅ nest-stable-quickjs	134	26
✅ nextjs-turbopack-canary-node	141	19
✅ nextjs-turbopack-canary-quickjs	141	19
✅ nextjs-turbopack-stable-node	160	0
✅ nextjs-turbopack-stable-quickjs	160	0
✅ nextjs-webpack-canary-quickjs	141	19
✅ nextjs-webpack-stable-node	160	0
✅ nextjs-webpack-stable-quickjs	160	0
✅ nitro-stable-node	134	26
✅ nitro-stable-quickjs	134	26
✅ nuxt-stable-node	134	26
✅ nuxt-stable-quickjs	134	26
✅ sveltekit-stable-node	153	7
✅ sveltekit-stable-quickjs	153	7
✅ tanstack-start-node	134	26
✅ tanstack-start-quickjs	134	26
✅ vite-stable-node	134	26
✅ vite-stable-quickjs	134	26

✅ 📦 Local Production

App	Passed	Skipped
✅ astro-stable-node	134	26
✅ astro-stable-quickjs	134	26
✅ express-stable-node	134	26
✅ express-stable-quickjs	134	26
✅ fastify-stable-node	134	26
✅ fastify-stable-quickjs	134	26
✅ hono-stable-node	134	26
✅ hono-stable-quickjs	134	26
✅ nest-stable-node	134	26
✅ nest-stable-quickjs	134	26
✅ nextjs-turbopack-canary-node	141	19
✅ nextjs-turbopack-canary-quickjs	141	19
✅ nextjs-turbopack-stable-node	160	0
✅ nextjs-turbopack-stable-quickjs	160	0
✅ nextjs-webpack-canary-node	141	19
✅ nextjs-webpack-canary-quickjs	141	19
✅ nextjs-webpack-stable-node	160	0
✅ nextjs-webpack-stable-quickjs	160	0
✅ nitro-stable-node	134	26
✅ nitro-stable-quickjs	134	26
✅ nuxt-stable-node	134	26
✅ nuxt-stable-quickjs	134	26
✅ sveltekit-stable-node	153	7
✅ sveltekit-stable-quickjs	153	7
✅ tanstack-start-node	134	26
✅ tanstack-start-quickjs	134	26
✅ vite-stable-node	134	26
✅ vite-stable-quickjs	134	26

❌ 🐘 Local Postgres

App	Passed	Failed	Skipped
❌ astro-stable-node	133	1	26
❌ astro-stable-quickjs	133	1	26
❌ express-stable-node	133	1	26
❌ express-stable-quickjs	133	1	26
❌ fastify-stable-node	133	1	26
❌ fastify-stable-quickjs	133	1	26
❌ hono-stable-node	133	1	26
❌ hono-stable-quickjs	133	1	26
❌ nest-stable-node	133	1	26
❌ nest-stable-quickjs	133	1	26
❌ nextjs-turbopack-canary-node	140	1	19
❌ nextjs-turbopack-canary-quickjs	140	1	19
❌ nextjs-turbopack-stable-node	159	1	0
❌ nextjs-turbopack-stable-quickjs	159	1	0
❌ nextjs-webpack-canary-node	140	1	19
❌ nextjs-webpack-canary-quickjs	140	1	19
❌ nextjs-webpack-stable-node	159	1	0
❌ nextjs-webpack-stable-quickjs	159	1	0
❌ nitro-stable-node	133	1	26
❌ nitro-stable-quickjs	133	1	26
❌ nuxt-stable-node	133	1	26
❌ nuxt-stable-quickjs	133	1	26
❌ sveltekit-stable-node	152	1	7
❌ sveltekit-stable-quickjs	152	1	7
❌ tanstack-start-node	133	1	26
❌ tanstack-start-quickjs	133	1	26
❌ vite-stable-node	133	1	26
❌ vite-stable-quickjs	133	1	26

✅ 🪟 Windows

App	Passed	Failed	Skipped
✅ nextjs-turbopack-node	160	0	0
✅ nextjs-turbopack-quickjs	160	0	0

❌ 🌐 Cross-language Conformance

App	Passed	Failed	Skipped
❌ python	0	9	132

✅ vercel-http-transport

App	Passed	Skipped
✅ example	132	28
✅ express	132	28
✅ hono	132	28
✅ nextjs-turbopack	157	3
✅ nitro	132	28
✅ vite	132	28

✅ vercel-multi-region

App	Passed	Failed	Skipped
✅ nextjs-turbopack	27	0	0

✅ vercel-ws-transport

App	Passed	Skipped
✅ example	132	28
✅ express	132	28
✅ nextjs-turbopack	157	3
✅ vite	132	28

📋 View full workflow run

github-actions · 2026-08-04T07:25:22Z

📊 Workflow Benchmarks

commit a76e76c · Tue, 01 Sep 2026 22:24:53 GMT · run logs

Backend: vercel · app: nextjs-turbopack

Metric	Scenario	Best (ms)	P75 (ms)	P90 (ms)	P99 (ms)	Samples
TTFS	step	115 (-36%) 💚	180 (-84%) 💚	221 (-81%) 💚	255 (-79%) 💚	30
TTFS	stream	119 (-42%) 💚	199 (-82%) 💚	249 (-79%) 💚	326 (-74%) 💚	30
TTFS	hook + stream	351 (-72%) 💚	427 🔴 (-69%) 💚	455 🔴 (-68%) 💚	595 (-59%) 💚	30
Fan-out TTFS	Promise.all(100 steps)	437 (-21%) 💚	641 (-66%) 💚	964 (-49%) 💚	981 (-49%) 💚	10
Fan-out TTLS	Promise.all(100 steps)	1632 (-4.0%)	1942 (-52%) 💚	1978 (-53%) 💚	6696 (+1.1%)	10
STSO	1020 steps (inline)	108 (+8.0%)	136 (-13%)	154 (-19%) 💚	194 (-43%) 💚	1019
WO	1020 steps	137871 (-11%)	137871 (-11%)	137871 (-11%)	137871 (-11%)	1
CRTT	first chunk (pooled)	72 (-27%) 💚	108 (-33%) 💚	115 (-38%) 💚	134 (-75%) 💚	28

Streams

Scenario	CRTT 1st	p75	p90	p99	CDV max	iters
paced control (100/s, 60B)	93 (-27%)	117 (-30%)	148 (-27%)	370 (+1%)	87 (-50%)	10
size sweep (100/s, 160B-12KB)	96.5 (-32%)	118 (-49%)	138 (-61%)	197 (-70%)	98.5 (-39%)	10
replay gateway-gpt-5.4-nano-2000t (1x)	92 (-41%)	380 (+138%)	2232 (+1027%)	3901 (+558%)	191 (-29%)	3
replay eve-gpt-5.6-sol-2000t (1x)	91 (-71%)	118 (-33%)	158 (-45%)	311 (-40%)	250 (-42%)	2
replay eve-gpt-5.6-sol-2000t (2x)	79 (-56%)	131 (-90%)	176 (-93%)	519 (-87%)	359 (-60%)	3

📈 STSO distribution vs main (inline / queue-hop histograms)

1020 steps (inline)

Cumulative STSO time: main 154195ms → this run 137723ms (Δ -16472ms, -11%)

100-150 ms  ███████████████████░░░░┃  main 706  this 895  +189
150-200 ms  ██┃███                    main 227  this 114  -113
200-250 ms  ┃                         main  48  this   7   -41
250-300 ms  ┃                         main  19  this   2   -17
300-350 ms  ┃                         main  10  this   0   -10
350-400 ms  ┃                         main   4  this   0    -4
400-450 ms  ┃                         main   2  this   0    -2
450-500 ms  ┃                         main   2  this   0    -2
500-550 ms  ┃                         main   1  this   0    -1
650-700 ms  ┃                         main   0  this   1    +1

📈 CRTT drill-down vs main (RTT distributions & profiles)

variant  RTT 1ms→5s+             avg         p50            p90           p99     n
control  ······█▅▁····   97.6 (-30%)   90 (-31%)     148 (-27%)     370 (+1%)  3000
sweep    ······██▁····  101.5 (-37%)  100 (-29%)     138 (-61%)    197 (-70%)  3000
gw 1x    ·····▁█▆▁▁▁▁·  248.8 (+75%)   94 (-28%)  2232 (+1027%)  3901 (+558%)  5295
eve 1x   ·····▁█▅▁▁···   95.5 (-38%)   83 (-35%)     158 (-45%)    311 (-40%)  5186
eve 2x   ·····▁██▁▁···  114.4 (-72%)   98 (-47%)     176 (-93%)    519 (-87%)  7779

RTT over stream progress (avg per tenth of stream, bars scaled min→max):

control  ▅▂▃▁▂▅▄█▆▂  89–111ms
sweep    ▄▁▄▆▆▇▅▄█▇  97–104ms
gw 1x    ▁▆█▂▂▂▁▁▁▁  96–814ms
eve 1x   ▆▂▂▂▁▁▅█▂▁  85–119ms
eve 2x   ▃▂▂▂▁▂▆█▃▃  89–167ms

RTT by chunk size (avg per log size bin, ~160B → ~12KB serialized, bars scaled min→max):

sweep  █▄▁▂▄▄▃  100–104ms

Delivery jitter over stream progress (avg positive CDV per tenth of stream, bars scaled min→max):

control  █▆▁▁▆█▆▂▆▂  27–32ms
sweep    ▁▅▇▅▄▆▅▅▂█  37–47ms
gw 1x    ▃█▂▃▄▃▂▂▁▂  26–65ms
eve 1x   ▄▆▁▃▄▄██▅▃  19–25ms
eve 2x   ▃▂▁▃▃▆█▆▄▇  17–25ms

📜 Previous results (1)

`523a760`

Tue, 04 Aug 2026 07:43:31 GMT · run logs

vercel / nextjs-turbopack

Metric	Scenario	Best (ms)	P75 (ms)	P90 (ms)	P99 (ms)	Samples
TTFS	step	1274 (+504%) 🔻	1352 🔴 (+23%) 🔻	1376 🔴 (+23%) 🔻	1654 🔴 (+17%) 🔻	30
TTFS	stream	302 (+37%) 🔻	1325 🔴 (+18%) 🔻	1357 🔴 (+15%) 🔻	1420 🔴 (+13%)	30
TTFS	hook + stream	1503 (+297%) 🔻	1605 🔴 (+24%) 🔻	1668 🔴 (+20%) 🔻	1743 🔴 (+18%) 🔻	30
STSO	1020 steps (inline)	87 (-6.5%)	132 (-14%)	158 (-16%) 💚	254 (-22%) 💚	1018
STSO	1020 steps (queue-hop)	3104 (+3.0%)	3104 (+3.0%)	3104 (+3.0%)	3104 (+3.0%)	1
WO	1020 steps	137667 (-11%)	137667 (-11%)	137667 (-11%)	137667 (-11%)	1
SL	stream latency	115 (+32%) 🔻	151 🔴 (+8.6%)	163 🔴 (-5.2%)	382 🔴 (-43%) 💚	30
SO	stream overhead (text)	100 (-25%) 💚	172 (-54%) 💚	192 (-72%) 💚	246 (-86%) 💚	30
SO	stream overhead (structured)	117 (-2.5%)	231 (-33%) 💚	329 (-58%) 💚	627 (-32%) 💚	30

ℹ️ Metric definitions & methodology

_{Streams: first-chunk RTT (the stream-open path, before any buffering/backpressure), CRTT percentiles, and worst delivery stall (CDV max). Cells are medians across iterations; per-run values in the artifacts. No 🔴/🟢 marks until targets attach.}

_{The collapsed STSO distribution section above buckets every step gap, split inline (same warm process — pure framework overhead) vs queue-hop (fresh process — dispatch, reinit, replay). █ = main, ┃ = this run, ░ = fill.}

_{The collapsed CRTT drill-down: per-variant RTT histograms (fixed log bins, · = empty) and mean RTT/positive-CDV profile lines over stream progress and chunk size. Histograms, avgs, and profiles merge exactly across runs; p50–p99 are percentile-of-percentiles. Per-index rows live in the artifacts.}

_{Best/P75/P90/P99 deltas compare against the most recent benchmark run on main at the time of this run. 🔻 flags a delta worse than +15%, 💚 one better than −15%.}

_{Metrics — TTFS: time to first step body (in-deployment start() → first step body) · Fan-out TTFS: fan-out time to first step (in-deployment start() → first of the parallel step bodies to complete) · Fan-out TTLS: fan-out time to last step (in-deployment start() → last of the parallel step bodies to complete, i.e. when the Promise.all resolves) · STSO: step-to-step overhead (gap between consecutive step bodies) · WO: workflow overhead (whole-run time outside step bodies, in-deployment anchored) · CRTT: chunk round-trip time (per-chunk write → read latency, one clock domain: deployment → stream backend → same deployment) · CDV: chunk delay variation / delivery jitter (inter-arrival gap minus inter-write gap per seq-adjacent pair; skew-free; the row is each run's MAX positive value, so one stall moves it)}

_{Scenarios — step: one trivial no-op step, no stream; no hooks, so the run stays in turbo mode (in-process fast path) · stream: one streaming step; no hooks, so the run stays in turbo mode (in-process fast path) · hook + stream: registers a hook before one step, which exits turbo mode (dispatch path) · 1020 steps: 1020 trivial sequential steps; STSO is measured between consecutive steps in the given step ranges, and WO is the whole-run overhead outside step bodies · Promise.all(100 steps): 100 trivial no-op steps started together in a single Promise.all; Fan-out TTFS is the first of them to complete and Fan-out TTLS the last, both from the in-deployment clientStart, so their gap is the spread the runtime adds across the fan-out · paced control (100/s, 60B): the control: 300 tiny (~60B) deltas metronome-paced at 100/s — zero workload structure, so it reads the transport floor and flush cadence, and disambiguates transport-wide vs workload-specific when a replay row moves · size sweep (100/s, 160B-12KB): same pacing as the control with deltas padded in rotation across seven log-spaced sizes (~160B–12KB) — rotation decouples size from stream position, so it isolates whether chunk size causes latency · replay gateway-gpt-5.4-nano-2000t (1x): raw provider SSE cadence captured at the AI gateway boundary (gpt-5.4-nano, the most popular gateway model; per-token deltas p50 208B = the modal production chunk size), replayed exactly as measured — the typical customer's workload; its CDV is the typical customer's real delivery jitter · replay eve-gpt-5.6-sol-2000t (1x): a captured eve turn (gpt-5.6-sol, the most-used demanding eve model; ~2000 output tokens = production p50 turn length) replayed exactly as measured — eve's envelope protocol re-ships the cumulative message so sizes ramp 142B→13KB; the demanding outlier tenant's reality · replay eve-gpt-5.6-sol-2000t (2x): the same eve capture at 2x — the headroom/stress row; real fast-tier models emit the same chunk sizes at proportionally higher rate, so time compression is a faithful speed model · first chunk (pooled): every run's seq-0 RTT pooled across all stream scenarios — the first chunk precedes any workload differentiation, so pooling samples one shared stream-open path with exact percentiles}

_{Replay cadences (semantic sha256) — eve-gpt-5.6-sol-2000t eaf22f5946e7c61f3c65c7006d550df180cfabd4e706254a09f22aec0cfb420d · gateway-gpt-5.4-nano-2000t 6f24ac518b6b83ff1d0e85a5fe78230db192716d66a7fc6b2fe022752001d041}

_{🔴 marks a percentile over its target (within target is left unmarked). Targets (p75/p90/p99, ms) — TTFS 200/300/600}

_{All timestamps are deployment-side; runs are triggered in-deployment, so the CI runner and api.vercel.com sit outside every measured window. TTFS = start() → first step body (includes dispatch + any cold start); Fan-out TTFS/TTLS = first/last step completion of one Promise.all from the same anchor (the gap is the runtime’s fan-out spread); STSO/WO between step bodies; CRTT inside the workflow (excludes the api.vercel.com read path).}

_{Cold starts stay in the numbers (real bursty-workload latency, inflates P75+); Best is the warm floor.}

github-actions · 2026-09-01T22:08:34Z

Sim World

Simulated world deterministic testing for races. Traces

🟠 world-sim scenario book — 1 fail of 41 total

fence=per-spec

scenario	outcome	events	virt	replay
✅ `smoke-no-steps`	completed	3	0ms	ok
✅ `smoke-one-step`	completed	6	0ms	ok
✅ `hook-at-step-started`	completed	12	0ms	ok
✅ `hook-at-step-completed`	completed	12	0ms	ok
✅ `hook-at-hook-created`	completed	12	0ms	ok
✅ `deadline-hook-wins`	completed	7	1.0h	ok
✅ `deadline-expires`	completed	7	1.0h	ok
✅ `long-sleep`	completed	11	30.0d	ok
✅ `hook-never-arrives`	stalled	3	0ms	skipped
✅ `step-retries-twice`	completed	10	2.0s	ok
✅ `parallel-steps`	completed	9	0ms	ok
✅ `hook-on-execution-state`	completed	12	0ms	ok
✅ `peek-hook-before-branch`	completed	12	0ms	ok
✅ `peek-hook-after-branch`	completed	12	0ms	ok
✅ `peek-hook-at-registration`	completed	12	0ms	ok
✅ `race-hook-before-probe`	completed	12	0ms	ok
✅ `race-hook-after-probe`	completed	12	0ms	ok
✅ `race-duplicate-delivery`	completed	13	0ms	ok
✅ `attr-hook-before-step`	completed	11	0ms	ok
✅ `attr-hook-after-step`	completed	11	0ms	ok
✅ `attr-from-step-body`	completed	13	0ms	ok
✅ `fork-hook-after-timeout`	completed	14	1.0m	ok
✅ `fork-hook-before-timeout`	completed	14	1.0m	ok
✅ `count-hook-after-timeout`	completed	17	1.0m	ok
✅ `count-hook-before-timeout`	completed	20	1.0m	ok
✅ `stale-read-step-count-fork`	completed	20	1.0m	ok
✅ `stale-read-equal-step-counts`	completed	14	1.0m	ok
✅ `step-vs-step-fork`	completed	12	0ms	ok
✅ `step-vs-step-fork-fenced`	completed	12	0ms	ok
✅ `fence-catches-benign-direction`	completed	12	5ms	ok
✅ `in-flight-before-decision`	completed	17	1.0m	ok
❌ `in-flight-before-decision-counted`	completed	17	1.0m	ok
✅ `in-flight-after-decision`	completed	19	2.0m	ok
✅ `stale-read-step-count-fork-fenced`	completed	20	1.0m	ok
✅ `fork-hook-wins`	completed	13	1.0m	ok
✅ `fork-timeout-wins`	completed	13	1.0m	ok
✅ `unclaimed-payload-under-fork`	completed	17	1.0m	ok
✅ `claimed-payload-under-fork`	completed	17	1.0m	ok
✅ `writers-independent-step-bodies`	completed	12	0ms	ok
✅ `writers-scripted-tempo`	completed	12	0ms	ok
✅ `cancel-mid-step`	cancelled	7	0ms	skipped

Full trace: world-sim.txt

github-actions · 2026-09-01T22:09:32Z

Framework	Flow route	Step reg.	Framework output
hono	200.9 KiB (±0)	40.6 KiB (±0)	1.77 MiB (+1.2 KiB)
nextjs-turbopack	206.3 KiB (±0)	439 B (±0)	766.1 KiB (+579 B)

About these numbers

Sizes are gzip; parentheses show the change against main.
Flow route and Step reg. gate this job, on raw bytes rather than the gzip shown, at max(2%, 50.0 KiB). Framework output is informational.

a76e76c · run

NathanColosimo · 2026-09-02T22:00:44Z

Folded into #3322 so direct Postgres delivery and the framework startup required to run it are reviewed and tested as one independently runnable PR.

vercel Bot deployed to Preview – workflow-web August 4, 2026 07:07

View deployment

vercel Bot deployed to Preview – workbench-nestjs-workflow August 4, 2026 07:07

View deployment

vercel Bot deployed to Preview – workflow-tarballs August 4, 2026 07:07

View deployment

vercel Bot deployed to Preview – workbench-hono-workflow August 4, 2026 07:07

View deployment

vercel Bot deployed to Preview – workbench-fastify-workflow August 4, 2026 07:07

View deployment

vercel Bot deployed to Preview – workbench-express-workflow August 4, 2026 07:07

View deployment

vercel Bot deployed to Preview – workbench-nitro-workflow August 4, 2026 07:07

View deployment

vercel Bot deployed to Preview – workbench-astro-workflow August 4, 2026 07:07

View deployment

vercel Bot deployed to Preview – workbench-vite-workflow August 4, 2026 07:07

View deployment

vercel Bot deployed to Preview – example-workflow August 4, 2026 07:07

View deployment

vercel Bot deployed to Preview – workbench-tanstack-start-workflow August 4, 2026 07:07

View deployment

vercel Bot deployed to Preview – workbench-sveltekit-workflow August 4, 2026 07:07

View deployment

vercel Bot deployed to Preview – example-nextjs-workflow-turbopack August 4, 2026 07:08

View deployment

vercel Bot deployed to Preview – example-nextjs-workflow-webpack August 4, 2026 07:08

View deployment

vercel Bot deployed to Preview – workbench-nuxt-workflow August 4, 2026 07:08

View deployment

vercel Bot deployed to Preview – workflow-docs August 4, 2026 07:08

View deployment

vercel Bot deployed to Preview – workflow-swc-playground August 4, 2026 07:09

View deployment

NathanColosimo force-pushed the nathanc/postgres-direct-execution branch from ef018c8 to 814e1a4 Compare August 4, 2026 07:24

NathanColosimo force-pushed the nathanc/postgres-worker-integrations branch from c8dca2f to 523a760 Compare August 4, 2026 07:24

vercel Bot deployed to Preview – workflow-web August 4, 2026 07:25

View deployment

vercel Bot deployed to Preview – workflow-tarballs August 4, 2026 07:26

View deployment

vercel Bot deployed to Preview – workbench-express-workflow August 4, 2026 07:26

View deployment

vercel Bot deployed to Preview – workbench-fastify-workflow August 4, 2026 07:26

View deployment

vercel Bot deployed to Preview – workbench-nestjs-workflow August 4, 2026 07:26

View deployment

vercel Bot deployed to Preview – workbench-astro-workflow August 4, 2026 07:26

View deployment

vercel Bot deployed to Preview – workbench-nitro-workflow August 4, 2026 07:26

View deployment

vercel Bot deployed to Preview – workbench-hono-workflow August 7, 2026 02:55

View deployment

vercel Bot deployed to Preview – workbench-tanstack-start-workflow August 7, 2026 02:55

View deployment

vercel Bot deployed to Preview – workbench-astro-workflow August 7, 2026 02:55

View deployment

vercel Bot deployed to Preview – example-workflow August 7, 2026 02:55

View deployment

vercel Bot deployed to Preview – workbench-vite-workflow August 7, 2026 02:55

View deployment

vercel Bot deployed to Preview – workbench-sveltekit-workflow August 7, 2026 02:55

View deployment

vercel Bot deployed to Preview – example-nextjs-workflow-turbopack August 7, 2026 02:55

View deployment

vercel Bot deployed to Preview – workbench-nuxt-workflow August 7, 2026 02:55

View deployment

vercel Bot deployed to Preview – example-nextjs-workflow-webpack August 7, 2026 02:55

View deployment

vercel Bot deployed to Preview – workflow-swc-playground August 7, 2026 02:57

View deployment

NathanColosimo force-pushed the nathanc/postgres-direct-execution branch from 3ba1592 to 15f7971 Compare September 1, 2026 22:04

NathanColosimo force-pushed the nathanc/postgres-worker-integrations branch from f185769 to 586b62c Compare September 1, 2026 22:04

vercel Bot deployed to Preview – workbench-python-workflow September 1, 2026 22:05

View deployment

NathanColosimo changed the title ~~Load the flow module at boot across framework integrations~~ Load direct queue handlers during framework boot Sep 1, 2026

vercel Bot deployed to Preview – workflow-web September 1, 2026 22:06

View deployment

vercel Bot deployed to Preview – workbench-tanstack-start-workflow September 1, 2026 22:07

View deployment

vercel Bot deployed to Preview – workbench-express-workflow September 1, 2026 22:07

View deployment

vercel Bot deployed to Preview – workbench-nestjs-workflow September 1, 2026 22:07

View deployment

vercel Bot deployed to Preview – workbench-fastify-workflow September 1, 2026 22:07

View deployment

vercel Bot deployed to Preview – workbench-nitro-workflow September 1, 2026 22:07

View deployment

vercel Bot deployed to Preview – workbench-hono-workflow September 1, 2026 22:07

View deployment

vercel Bot deployed to Preview – workbench-nuxt-workflow September 1, 2026 22:07

View deployment

vercel Bot deployed to Preview – example-workflow September 1, 2026 22:07

View deployment

vercel Bot deployed to Preview – workflow-tarballs September 1, 2026 22:07

View deployment

NathanColosimo added 3 commits September 1, 2026 17:18

Add explicit workflow handler initialization

5ab52e7

Deliver Postgres queue messages in process

738e80e

Initialize direct queue delivery before workers

364a1b1

Navigation Menu

Repository navigation

Initialize direct queue delivery before workers - #3323

Initialize direct queue delivery before workers#3323
NathanColosimo wants to merge 3 commits into
nathanc/postgres-direct-executionfrom
nathanc/postgres-worker-integrations

NathanColosimo commented Aug 4, 2026 •

edited

Loading

Uh oh!

changeset-bot Bot commented Aug 4, 2026 •

edited

Loading

Uh oh!

vercel Bot commented Aug 4, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Aug 4, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Aug 4, 2026 •

edited

Loading

`523a760`

Uh oh!

github-actions Bot commented Sep 1, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Sep 1, 2026 •

edited

Loading

Uh oh!

NathanColosimo commented Sep 2, 2026

Uh oh!

This branch was successfully deployed

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

NathanColosimo commented Aug 4, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Validation

Uh oh!

changeset-bot Bot commented Aug 4, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🦋 Changeset detected

Uh oh!

vercel Bot commented Aug 4, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Aug 4, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🧪 E2E Test Results

❌ Failed E2E Tests

▲ Vercel Production (8 failed)

🌐 Cross-language Conformance (9 failed)

⚠️ Flaky E2E Tests (passed on retry)

🛠 Infra Events (absorbed by the harness)

E2E Test Summary

Uh oh!

github-actions Bot commented Aug 4, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

📊 Workflow Benchmarks

523a760

Uh oh!

github-actions Bot commented Sep 1, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Sim World

Uh oh!

github-actions Bot commented Sep 1, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

NathanColosimo commented Sep 2, 2026

Uh oh!

This branch was successfully deployed

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

NathanColosimo commented Aug 4, 2026 •

edited

Loading

changeset-bot Bot commented Aug 4, 2026 •

edited

Loading

vercel Bot commented Aug 4, 2026 •

edited

Loading

github-actions Bot commented Aug 4, 2026 •

edited

Loading

github-actions Bot commented Aug 4, 2026 •

edited

Loading

`523a760`

github-actions Bot commented Sep 1, 2026 •

edited

Loading

github-actions Bot commented Sep 1, 2026 •

edited

Loading