feat(core): Add streamGenAiSpans options to stream gen_ai spans
#47042
andreiborzabuild.yml
on: pull_request
Get CI Metadata
/
Get Metadata
8s
Check PR branches
3s
Matrix: job_node_core_integration_tests
Matrix: job_node_integration_tests
Matrix: job_node_unit_tests
Matrix: job_remix_integration_tests
Lint
1m 7s
Circular Dependency Check
1m 48s
Browser Unit Tests
4m 25s
Bun Unit Tests
51s
Deno Unit Tests
56s
Cloudflare Integration Tests
2m 41s
Bun Integration Tests
43s
Check for faulty .d.ts files
37s
Matrix: job_browser_loader_tests
Matrix: job_browser_playwright_tests
Matrix: job_optional_e2e_tests
Matrix: job_e2e_tests
All required jobs passed or were skipped
5s
Annotations
45 errors and 9 notices
|
Cloudflare Integration Tests
Process completed with exit code 1.
|
|
suites/tracing/openai/test.ts > traces a basic chat completion request:
dev-packages/cloudflare-integration-tests/suites/tracing/openai/test.ts#L31
AssertionError: expected undefined to be defined
❯ suites/tracing/openai/test.ts:31:25
❯ assertEnvelopeMatches runner.ts:138:11
❯ newEnvelope runner.ts:192:13
❯ ../test-utils/src/server.ts:19:7
❯ Layer.handle [as handle_request] ../../node_modules/express/lib/router/layer.js:95:5
❯ next ../../node_modules/express/lib/router/route.js:149:13
❯ Route.dispatch ../../node_modules/express/lib/router/route.js:119:3
❯ Layer.handle [as handle_request] ../../node_modules/express/lib/router/layer.js:95:5
❯ ../../node_modules/express/lib/router/index.js:284:15
❯ param ../../node_modules/express/lib/router/index.js:365:14
|
|
suites/tracing/langgraph/test.ts > traces langgraph compile and invoke operations:
dev-packages/cloudflare-integration-tests/suites/tracing/langgraph/test.ts#L29
AssertionError: expected undefined to be defined
❯ suites/tracing/langgraph/test.ts:29:25
❯ assertEnvelopeMatches runner.ts:138:11
❯ newEnvelope runner.ts:192:13
❯ ../test-utils/src/server.ts:19:7
❯ Layer.handle [as handle_request] ../../node_modules/express/lib/router/layer.js:95:5
❯ next ../../node_modules/express/lib/router/route.js:149:13
❯ Route.dispatch ../../node_modules/express/lib/router/route.js:119:3
❯ Layer.handle [as handle_request] ../../node_modules/express/lib/router/layer.js:95:5
❯ ../../node_modules/express/lib/router/index.js:284:15
❯ param ../../node_modules/express/lib/router/index.js:365:14
|
|
suites/tracing/langchain/test.ts > traces langchain chat model, chain, and tool invocations:
dev-packages/cloudflare-integration-tests/suites/tracing/langchain/test.ts#L30
AssertionError: expected undefined to be defined
❯ suites/tracing/langchain/test.ts:30:25
❯ assertEnvelopeMatches runner.ts:138:11
❯ newEnvelope runner.ts:192:13
❯ ../test-utils/src/server.ts:19:7
❯ Layer.handle [as handle_request] ../../node_modules/express/lib/router/layer.js:95:5
❯ next ../../node_modules/express/lib/router/route.js:149:13
❯ Route.dispatch ../../node_modules/express/lib/router/route.js:119:3
❯ Layer.handle [as handle_request] ../../node_modules/express/lib/router/layer.js:95:5
❯ ../../node_modules/express/lib/router/index.js:284:15
❯ param ../../node_modules/express/lib/router/index.js:365:14
|
|
suites/tracing/google-genai/test.ts > traces Google GenAI chat creation and message sending:
dev-packages/cloudflare-integration-tests/suites/tracing/google-genai/test.ts#L30
AssertionError: expected undefined to be defined
❯ suites/tracing/google-genai/test.ts:30:25
❯ assertEnvelopeMatches runner.ts:138:11
❯ newEnvelope runner.ts:192:13
❯ ../test-utils/src/server.ts:19:7
❯ Layer.handle [as handle_request] ../../node_modules/express/lib/router/layer.js:95:5
❯ next ../../node_modules/express/lib/router/route.js:149:13
❯ Route.dispatch ../../node_modules/express/lib/router/route.js:119:3
❯ Layer.handle [as handle_request] ../../node_modules/express/lib/router/layer.js:95:5
❯ ../../node_modules/express/lib/router/index.js:284:15
❯ param ../../node_modules/express/lib/router/index.js:365:14
|
|
suites/tracing/anthropic-ai/test.ts > traces a basic message creation request:
dev-packages/cloudflare-integration-tests/suites/tracing/anthropic-ai/test.ts#L29
AssertionError: expected undefined to be defined
❯ suites/tracing/anthropic-ai/test.ts:29:25
❯ assertEnvelopeMatches runner.ts:138:11
❯ newEnvelope runner.ts:192:13
❯ ../test-utils/src/server.ts:19:7
❯ Layer.handle [as handle_request] ../../node_modules/express/lib/router/layer.js:95:5
❯ next ../../node_modules/express/lib/router/route.js:149:13
❯ Route.dispatch ../../node_modules/express/lib/router/route.js:119:3
❯ Layer.handle [as handle_request] ../../node_modules/express/lib/router/layer.js:95:5
❯ ../../node_modules/express/lib/router/index.js:284:15
❯ param ../../node_modules/express/lib/router/index.js:365:14
|
|
Unhandled error:
dev-packages/cloudflare-integration-tests/suites/tracing/openai/test.ts#L31
AssertionError: expected undefined to be defined
❯ suites/tracing/openai/test.ts:31:25
❯ assertEnvelopeMatches runner.ts:138:11
❯ newEnvelope runner.ts:192:13
❯ ../test-utils/src/server.ts:19:7
❯ Layer.handle [as handle_request] ../../node_modules/express/lib/router/layer.js:95:5
❯ next ../../node_modules/express/lib/router/route.js:149:13
❯ Route.dispatch ../../node_modules/express/lib/router/route.js:119:3
❯ Layer.handle [as handle_request] ../../node_modules/express/lib/router/layer.js:95:5
❯ ../../node_modules/express/lib/router/index.js:284:15
❯ param ../../node_modules/express/lib/router/index.js:365:14
This error originated in "suites/tracing/openai/test.ts" test file. It doesn't mean the error was thrown inside the file itself, but while it was running.
The latest test that might've caused the error is "traces a basic chat completion request". It might mean one of the following:
- The error was thrown, while Vitest was running this test.
- If the error occurred after the test had been completed, this was the last documented test before it was thrown.
|
|
E2E nextjs-15 (turbo) Test (optional)
Process completed with exit code 1.
|
|
[chromium] › tests/ai-test.test.ts:4:5 › should create AI spans with correct attributes:
../../_temp/test-application/tests/ai-test.test.ts#L0
2) [chromium] › tests/ai-test.test.ts:4:5 › should create AI spans with correct attributes ───────
Test timeout of 30000ms exceeded.
|
|
[chromium] › tests/ai-error.test.ts:4:5 › should create AI spans with correct attributes and error linking:
../../_temp/test-application/tests/ai-error.test.ts#L0
1) [chromium] › tests/ai-error.test.ts:4:5 › should create AI spans with correct attributes and error linking
Test timeout of 30000ms exceeded.
|
|
E2E nextjs-16 Test
Process completed with exit code 1.
|
|
[chromium] › tests/ai-test.test.ts:4:5 › should create AI spans with correct attributes:
../../_temp/test-application/tests/ai-test.test.ts#L0
2) [chromium] › tests/ai-test.test.ts:4:5 › should create AI spans with correct attributes ───────
Test timeout of 30000ms exceeded.
|
|
[chromium] › tests/ai-error.test.ts:4:5 › should create AI spans with correct attributes and error linking:
../../_temp/test-application/tests/ai-error.test.ts#L0
1) [chromium] › tests/ai-error.test.ts:4:5 › should create AI spans with correct attributes and error linking
Test timeout of 30000ms exceeded.
|
|
E2E nextjs-15 Test
Process completed with exit code 1.
|
|
[chromium] › tests/ai-test.test.ts:4:5 › should create AI spans with correct attributes:
../../_temp/test-application/tests/ai-test.test.ts#L0
2) [chromium] › tests/ai-test.test.ts:4:5 › should create AI spans with correct attributes ───────
Test timeout of 30000ms exceeded.
|
|
[chromium] › tests/ai-error.test.ts:4:5 › should create AI spans with correct attributes and error linking:
../../_temp/test-application/tests/ai-error.test.ts#L0
1) [chromium] › tests/ai-error.test.ts:4:5 › should create AI spans with correct attributes and error linking
Test timeout of 30000ms exceeded.
|
|
E2E nextjs-15 (latest) Test (optional)
Process completed with exit code 1.
|
|
[chromium] › tests/ai-test.test.ts:4:5 › should create AI spans with correct attributes:
../../_temp/test-application/tests/ai-test.test.ts#L0
2) [chromium] › tests/ai-test.test.ts:4:5 › should create AI spans with correct attributes ───────
Test timeout of 30000ms exceeded.
|
|
[chromium] › tests/ai-error.test.ts:4:5 › should create AI spans with correct attributes and error linking:
../../_temp/test-application/tests/ai-error.test.ts#L0
1) [chromium] › tests/ai-error.test.ts:4:5 › should create AI spans with correct attributes and error linking
Test timeout of 30000ms exceeded.
|
|
E2E nextjs-16 (latest, turbopack) Test
Process completed with exit code 1.
|
|
[chromium] › tests/ai-test.test.ts:4:5 › should create AI spans with correct attributes:
../../_temp/test-application/tests/ai-test.test.ts#L0
2) [chromium] › tests/ai-test.test.ts:4:5 › should create AI spans with correct attributes ───────
Test timeout of 30000ms exceeded.
|
|
[chromium] › tests/ai-error.test.ts:4:5 › should create AI spans with correct attributes and error linking:
../../_temp/test-application/tests/ai-error.test.ts#L0
1) [chromium] › tests/ai-error.test.ts:4:5 › should create AI spans with correct attributes and error linking
Test timeout of 30000ms exceeded.
|
|
E2E nextjs-16 (latest, webpack) Test
Process completed with exit code 1.
|
|
[chromium] › tests/ai-test.test.ts:4:5 › should create AI spans with correct attributes:
../../_temp/test-application/tests/ai-test.test.ts#L0
2) [chromium] › tests/ai-test.test.ts:4:5 › should create AI spans with correct attributes ───────
Test timeout of 30000ms exceeded.
|
|
[chromium] › tests/ai-error.test.ts:4:5 › should create AI spans with correct attributes and error linking:
../../_temp/test-application/tests/ai-error.test.ts#L0
1) [chromium] › tests/ai-error.test.ts:4:5 › should create AI spans with correct attributes and error linking
Test timeout of 30000ms exceeded.
|
|
E2E nextjs-16 (webpack) Test
Process completed with exit code 1.
|
|
[chromium] › tests/ai-test.test.ts:4:5 › should create AI spans with correct attributes:
../../_temp/test-application/tests/ai-test.test.ts#L0
2) [chromium] › tests/ai-test.test.ts:4:5 › should create AI spans with correct attributes ───────
Test timeout of 30000ms exceeded.
|
|
[chromium] › tests/ai-error.test.ts:4:5 › should create AI spans with correct attributes and error linking:
../../_temp/test-application/tests/ai-error.test.ts#L0
1) [chromium] › tests/ai-error.test.ts:4:5 › should create AI spans with correct attributes and error linking
Test timeout of 30000ms exceeded.
|
|
E2E nextjs-16 (canary, turbopack) Test (optional)
Process completed with exit code 1.
|
|
[chromium] › tests/ai-test.test.ts:4:5 › should create AI spans with correct attributes:
../../_temp/test-application/tests/ai-test.test.ts#L0
2) [chromium] › tests/ai-test.test.ts:4:5 › should create AI spans with correct attributes ───────
Test timeout of 30000ms exceeded.
|
|
[chromium] › tests/ai-error.test.ts:4:5 › should create AI spans with correct attributes and error linking:
../../_temp/test-application/tests/ai-error.test.ts#L0
1) [chromium] › tests/ai-error.test.ts:4:5 › should create AI spans with correct attributes and error linking
Test timeout of 30000ms exceeded.
|
|
E2E nextjs-16 (canary, webpack) Test (optional)
Process completed with exit code 1.
|
|
[chromium] › tests/ai-test.test.ts:4:5 › should create AI spans with correct attributes:
../../_temp/test-application/tests/ai-test.test.ts#L0
2) [chromium] › tests/ai-test.test.ts:4:5 › should create AI spans with correct attributes ───────
Test timeout of 30000ms exceeded.
|
|
[chromium] › tests/ai-error.test.ts:4:5 › should create AI spans with correct attributes and error linking:
../../_temp/test-application/tests/ai-error.test.ts#L0
1) [chromium] › tests/ai-error.test.ts:4:5 › should create AI spans with correct attributes and error linking
Test timeout of 30000ms exceeded.
|
|
Node (22) Integration Tests
The job has exceeded the maximum execution time of 15m0s
|
|
Node (22) Integration Tests
The operation was canceled.
|
|
Node (24) Integration Tests
The job has exceeded the maximum execution time of 15m0s
|
|
Node (24) Integration Tests
The operation was canceled.
|
|
Node (24) (TS 3.8) Integration Tests
The job has exceeded the maximum execution time of 15m0s
|
|
Node (24) (TS 3.8) Integration Tests
The operation was canceled.
|
|
Node (18) Integration Tests
The job has exceeded the maximum execution time of 15m0s
|
|
Node (18) Integration Tests
The operation was canceled.
|
|
Node (20) Integration Tests
The job has exceeded the maximum execution time of 15m0s
|
|
Node (20) Integration Tests
The operation was canceled.
|
|
All required jobs passed or were skipped
Process completed with exit code 1.
|
|
🎭 Playwright Run Summary
2 failed
[chromium] › tests/ai-error.test.ts:4:5 › should create AI spans with correct attributes and error linking
[chromium] › tests/ai-test.test.ts:4:5 › should create AI spans with correct attributes ────────
2 skipped
27 passed (1.7m)
|
|
🎭 Playwright Run Summary
2 failed
[chromium] › tests/ai-error.test.ts:4:5 › should create AI spans with correct attributes and error linking
[chromium] › tests/ai-test.test.ts:4:5 › should create AI spans with correct attributes ────────
2 skipped
39 passed (2.1m)
|
|
🎭 Playwright Run Summary
2 failed
[chromium] › tests/ai-error.test.ts:4:5 › should create AI spans with correct attributes and error linking
[chromium] › tests/ai-test.test.ts:4:5 › should create AI spans with correct attributes ────────
2 skipped
27 passed (1.7m)
|
|
🎭 Playwright Run Summary
2 failed
[chromium] › tests/ai-error.test.ts:4:5 › should create AI spans with correct attributes and error linking
[chromium] › tests/ai-test.test.ts:4:5 › should create AI spans with correct attributes ────────
2 skipped
27 passed (1.6m)
|
|
🎭 Playwright Run Summary
2 failed
[chromium] › tests/ai-error.test.ts:4:5 › should create AI spans with correct attributes and error linking
[chromium] › tests/ai-test.test.ts:4:5 › should create AI spans with correct attributes ────────
2 skipped
39 passed (2.1m)
|
|
🎭 Playwright Run Summary
2 failed
[chromium] › tests/ai-error.test.ts:4:5 › should create AI spans with correct attributes and error linking
[chromium] › tests/ai-test.test.ts:4:5 › should create AI spans with correct attributes ────────
2 skipped
39 passed (2.1m)
|
|
🎭 Playwright Run Summary
2 failed
[chromium] › tests/ai-error.test.ts:4:5 › should create AI spans with correct attributes and error linking
[chromium] › tests/ai-test.test.ts:4:5 › should create AI spans with correct attributes ────────
2 skipped
39 passed (2.0m)
|
|
🎭 Playwright Run Summary
2 failed
[chromium] › tests/ai-error.test.ts:4:5 › should create AI spans with correct attributes and error linking
[chromium] › tests/ai-test.test.ts:4:5 › should create AI spans with correct attributes ────────
2 skipped
39 passed (2.0m)
|
|
🎭 Playwright Run Summary
2 failed
[chromium] › tests/ai-error.test.ts:4:5 › should create AI spans with correct attributes and error linking
[chromium] › tests/ai-test.test.ts:4:5 › should create AI spans with correct attributes ────────
2 skipped
39 passed (2.1m)
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
E2E Test Dump (nextjs-15 (latest))
|
49.9 KB |
sha256:cf590a17cd6c70ec5deed9d4d915f978450b56195b845e8f09fff91e0aa87839
|
|
|
E2E Test Dump (nextjs-15 (turbo))
|
56.9 KB |
sha256:426b70a070cbf5dde073a6baad628f53aa91aff0e2056f6eb04ea0a865c70def
|
|
|
E2E Test Dump (nextjs-15)
|
48.7 KB |
sha256:272be5f59755d2984773bd2b7215dfc4f5c961c0703bcd69b89377727aef6281
|
|
|
E2E Test Dump (nextjs-16 (canary, turbopack))
|
118 KB |
sha256:2bd8044b6a8223afeaeaeac00e75b64f49ca7cf084f8bd58455fbe5ea31bc99c
|
|
|
E2E Test Dump (nextjs-16 (canary, webpack))
|
108 KB |
sha256:97f953ccaee8ea9ae38b6246be4ced31ac5ad2141a4489c2193ff1b43c19683c
|
|
|
E2E Test Dump (nextjs-16 (latest, turbopack))
|
122 KB |
sha256:f3eda1c72a550deeda3917d3b16108a75e1c5a5ac591d5bf591e3c01c3bf248d
|
|
|
E2E Test Dump (nextjs-16 (latest, webpack))
|
115 KB |
sha256:7317d230ecd3f067965de85868262f385f15005beca42a349b1c820a56a7996a
|
|
|
E2E Test Dump (nextjs-16 (webpack))
|
112 KB |
sha256:b8ae6e12b6876e0c1102057133f5c013fcfb2e4309a8b0d9bf8c7715bbf6a211
|
|
|
E2E Test Dump (nextjs-16)
|
121 KB |
sha256:f2b434efe27a5e7249d184c9c1befbc25f01950eae859f77ec079d8e6b848c28
|
|
|
playwright-traces-job_e2e_playwright_tests-nextjs-15
|
44 KB |
sha256:7bcf60ce45c1f9fa0bca58b8b160cf5555727fc53f2b86d8e151094bc0060356
|
|
|
playwright-traces-job_e2e_playwright_tests-nextjs-16
|
43.5 KB |
sha256:d7c4b868b0752d0522b79350afdbf4f41e73b120a9e597cc775141645f1ca56c
|
|
|
playwright-traces-job_e2e_playwright_tests-nextjs-16
|
43.4 KB |
sha256:3e6c5255b3a9bab908b0fca7e1b3dc7335fe552b7aeca7b4ad494ebe3f5b6716
|
|