test: get snapshots working again #7032
build.yml
on: pull_request
Playwright Build
3m 33s
Build
6m 2s
Matrix: playwright
Merge Playwright Reports
39s
Annotations
5 errors, 9 warnings, and 7 notices
|
[firefox] › src/end-to-end/shadcn/shadcn.test.ts:28:7 › Check ShadCN UI › Check link toolbar:
tests/src/end-to-end/shadcn/shadcn.test.ts#L41
1) [firefox] › src/end-to-end/shadcn/shadcn.test.ts:28:7 › Check ShadCN UI › Check link toolbar ──
Error: expect(Buffer).toMatchSnapshot(expected)
209 pixels (ratio 0.01 of all image pixels) are different.
Expected: /__w/BlockNote/BlockNote/tests/src/end-to-end/shadcn/shadcn.test.ts-snapshots/shadcn-link-toolbar-firefox-linux.png
Received: /__w/BlockNote/BlockNote/tests/test-results/shadcn-shadcn-Check-ShadCN-UI-Check-link-toolbar-firefox/shadcn-link-toolbar-actual.png
Diff: /__w/BlockNote/BlockNote/tests/test-results/shadcn-shadcn-Check-ShadCN-UI-Check-link-toolbar-firefox/shadcn-link-toolbar-diff.png
39 |
40 | await page.waitForTimeout(700);
> 41 | expect(await page.screenshot()).toMatchSnapshot("shadcn-link-toolbar.png");
| ^
42 | });
43 | test("Check slash menu", async ({ page }) => {
44 | await focusOnEditor(page);
at /__w/BlockNote/BlockNote/tests/src/end-to-end/shadcn/shadcn.test.ts:41:37
|
|
[webkit] › src/end-to-end/customblocks/customblocks.test.ts:24:7 › Check custom block functionality › Should be able to interactively update React custom blocks:
tests/src/end-to-end/customblocks/customblocks.test.ts#L33
2) [webkit] › src/end-to-end/customblocks/customblocks.test.ts:24:7 › Check custom block functionality › Should be able to interactively update React custom blocks
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(Buffer).toMatchSnapshot(expected)
34732 pixels (ratio 0.01 of all image pixels) are different.
Expected: /__w/BlockNote/BlockNote/tests/src/end-to-end/customblocks/customblocks.test.ts-snapshots/react-interactivity-webkit-linux.png
Received: /__w/BlockNote/BlockNote/tests/test-results/customblocks-customblocks--ee421--update-React-custom-blocks-webkit-retry1/react-interactivity-actual.png
Diff: /__w/BlockNote/BlockNote/tests/test-results/customblocks-customblocks--ee421--update-React-custom-blocks-webkit-retry1/react-interactivity-diff.png
31 |
32 | await compareDocToSnapshot(page, "reactInteractivity");
> 33 | expect(await page.screenshot()).toMatchSnapshot("react-interactivity.png");
| ^
34 | });
35 | });
36 |
at /__w/BlockNote/BlockNote/tests/src/end-to-end/customblocks/customblocks.test.ts:33:37
|
|
[webkit] › src/end-to-end/customblocks/customblocks.test.ts:24:7 › Check custom block functionality › Should be able to interactively update React custom blocks:
tests/src/end-to-end/customblocks/customblocks.test.ts#L33
2) [webkit] › src/end-to-end/customblocks/customblocks.test.ts:24:7 › Check custom block functionality › Should be able to interactively update React custom blocks
Error: expect(Buffer).toMatchSnapshot(expected)
34732 pixels (ratio 0.01 of all image pixels) are different.
Expected: /__w/BlockNote/BlockNote/tests/src/end-to-end/customblocks/customblocks.test.ts-snapshots/react-interactivity-webkit-linux.png
Received: /__w/BlockNote/BlockNote/tests/test-results/customblocks-customblocks--ee421--update-React-custom-blocks-webkit/react-interactivity-actual.png
Diff: /__w/BlockNote/BlockNote/tests/test-results/customblocks-customblocks--ee421--update-React-custom-blocks-webkit/react-interactivity-diff.png
31 |
32 | await compareDocToSnapshot(page, "reactInteractivity");
> 33 | expect(await page.screenshot()).toMatchSnapshot("react-interactivity.png");
| ^
34 | });
35 | });
36 |
at /__w/BlockNote/BlockNote/tests/src/end-to-end/customblocks/customblocks.test.ts:33:37
|
|
[webkit] › src/end-to-end/customblocks/customblocks.test.ts:10:7 › Check custom block functionality › Should be able to interactively update vanilla custom blocks:
tests/src/end-to-end/customblocks/customblocks.test.ts#L19
1) [webkit] › src/end-to-end/customblocks/customblocks.test.ts:10:7 › Check custom block functionality › Should be able to interactively update vanilla custom blocks
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(Buffer).toMatchSnapshot(expected)
33106 pixels (ratio 0.01 of all image pixels) are different.
Expected: /__w/BlockNote/BlockNote/tests/src/end-to-end/customblocks/customblocks.test.ts-snapshots/vanilla-interactivity-webkit-linux.png
Received: /__w/BlockNote/BlockNote/tests/test-results/customblocks-customblocks--8679c-pdate-vanilla-custom-blocks-webkit-retry1/vanilla-interactivity-actual.png
Diff: /__w/BlockNote/BlockNote/tests/test-results/customblocks-customblocks--8679c-pdate-vanilla-custom-blocks-webkit-retry1/vanilla-interactivity-diff.png
17 |
18 | await compareDocToSnapshot(page, "vanillaInteractivity");
> 19 | expect(await page.screenshot()).toMatchSnapshot(
| ^
20 | "vanilla-interactivity.png",
21 | );
22 | });
at /__w/BlockNote/BlockNote/tests/src/end-to-end/customblocks/customblocks.test.ts:19:37
|
|
[webkit] › src/end-to-end/customblocks/customblocks.test.ts:10:7 › Check custom block functionality › Should be able to interactively update vanilla custom blocks:
tests/src/end-to-end/customblocks/customblocks.test.ts#L19
1) [webkit] › src/end-to-end/customblocks/customblocks.test.ts:10:7 › Check custom block functionality › Should be able to interactively update vanilla custom blocks
Error: expect(Buffer).toMatchSnapshot(expected)
33106 pixels (ratio 0.01 of all image pixels) are different.
Expected: /__w/BlockNote/BlockNote/tests/src/end-to-end/customblocks/customblocks.test.ts-snapshots/vanilla-interactivity-webkit-linux.png
Received: /__w/BlockNote/BlockNote/tests/test-results/customblocks-customblocks--8679c-pdate-vanilla-custom-blocks-webkit/vanilla-interactivity-actual.png
Diff: /__w/BlockNote/BlockNote/tests/test-results/customblocks-customblocks--8679c-pdate-vanilla-custom-blocks-webkit/vanilla-interactivity-diff.png
17 |
18 | await compareDocToSnapshot(page, "vanillaInteractivity");
> 19 | expect(await page.screenshot()).toMatchSnapshot(
| ^
20 | "vanilla-interactivity.png",
21 | );
22 | });
at /__w/BlockNote/BlockNote/tests/src/end-to-end/customblocks/customblocks.test.ts:19:37
|
|
Playwright Build
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4, actions/checkout@v4, actions/setup-node@v4, actions/upload-artifact@v4, pnpm/action-setup@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Build
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4, actions/checkout@v4, actions/setup-node@v4, actions/upload-artifact@v4, pnpm/action-setup@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Playwright Tests - chromium (2/2)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/download-artifact@v4, actions/setup-node@v4, actions/upload-artifact@v4, pnpm/action-setup@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Playwright Tests - webkit (2/2)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/download-artifact@v4, actions/setup-node@v4, actions/upload-artifact@v4, pnpm/action-setup@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Playwright Tests - firefox (2/2)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/download-artifact@v4, actions/setup-node@v4, actions/upload-artifact@v4, pnpm/action-setup@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Playwright Tests - chromium (1/2)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/download-artifact@v4, actions/setup-node@v4, actions/upload-artifact@v4, pnpm/action-setup@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Playwright Tests - firefox (1/2)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/download-artifact@v4, actions/setup-node@v4, actions/upload-artifact@v4, pnpm/action-setup@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Playwright Tests - webkit (1/2)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/download-artifact@v4, actions/setup-node@v4, actions/upload-artifact@v4, pnpm/action-setup@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Merge Playwright Reports
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/download-artifact@v4, actions/setup-node@v4, actions/upload-artifact@v4, pnpm/action-setup@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Build
{
"workflowData": {
"owner": "TypeCellOS",
"repo": "BlockNote",
"sha": "39c3c3284994badc7bdd7e832ed3a831a6cc510d",
"ref": "2554"
},
"key": "pQsU5znei5",
"runId": 22951471735,
"webhookDebug": {
"action": "requested",
"head_branch": "snaps",
"head_repository_full_name": "TypeCellOS/BlockNote",
"full_name": "TypeCellOS/BlockNote",
"isPullRequest": true,
"prNumber": 2554,
"prNumberType": "number",
"isNewPullRequest": true,
"isOldPullRequest": false,
"prKey": "TypeCellOS/BlockNote:snaps",
"oldPrDataHash": "RoyULopbq8",
"lookupKey": "TypeCellOS/BlockNote:snaps",
"data": {
"owner": "TypeCellOS",
"repo": "BlockNote",
"sha": "2ff0c863bd64c8e083eea62f4effe54ea19bc6e6",
"ref": "2554"
}
}
}
|
|
🎭 Playwright Run Summary
38 passed (34.7s)
|
|
🎭 Playwright Run Summary
38 passed (57.7s)
|
|
🎭 Playwright Run Summary
1 flaky
[firefox] › src/end-to-end/shadcn/shadcn.test.ts:28:7 › Check ShadCN UI › Check link toolbar ───
37 passed (47.3s)
|
|
🎭 Playwright Run Summary
2 skipped
82 passed (1.1m)
|
|
🎭 Playwright Run Summary
12 skipped
72 passed (1.4m)
|
|
🎭 Playwright Run Summary
2 flaky
[webkit] › src/end-to-end/customblocks/customblocks.test.ts:10:7 › Check custom block functionality › Should be able to interactively update vanilla custom blocks
[webkit] › src/end-to-end/customblocks/customblocks.test.ts:24:7 › Check custom block functionality › Should be able to interactively update React custom blocks
10 skipped
72 passed (2.0m)
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
blob-report-chromium-1
Expired
|
114 KB |
sha256:d6ef1a60edad42a6675cba78ae1bd802fd9b550f7cb942d7d5894e383c97df8c
|
|
|
blob-report-chromium-2
Expired
|
46.5 KB |
sha256:dbd3d54ba152aace93079eede63523f03738ae60e03ff004bceb2c946b28fbaf
|
|
|
blob-report-firefox-1
Expired
|
103 KB |
sha256:d6f5fc4668b71319de9a083a21e8d52590b401a780ff5e86c1d1dd57a4a70d98
|
|
|
blob-report-firefox-2
Expired
|
199 KB |
sha256:78758e5f1f8be3a86c841ede0cc51292ba37382f3618054ca0448f83819efcb1
|
|
|
blob-report-webkit-1
Expired
|
1.34 MB |
sha256:7f557de6da988f02325b882325c63724800dd1e4fa709a5df82edbd275b6ebaa
|
|
|
blob-report-webkit-2
Expired
|
47 KB |
sha256:d1cdcb63d2b68c9d6e7d316a0c885c2913e895a401f06b8401e9279e1a2eff2c
|
|
|
playwright-build
Expired
|
26.2 MB |
sha256:f637bcdaefbd5ea99d6c88f8ee0dd49fc7731af429304caec820f9e4b82d06e6
|
|
|
playwright-report-chromium-1
Expired
|
247 KB |
sha256:02cdf68ae465aaba643f9071169b720ffc23d2edb8e2bae7376b2dabc30c8652
|
|
|
playwright-report-chromium-2
Expired
|
205 KB |
sha256:8068ddccc4ffade9a81181dae97e953738a8b318c045f194e7c8931eee931261
|
|
|
playwright-report-firefox-1
Expired
|
240 KB |
sha256:4f65ad086ba4e22b67fd87d1a133342ab6ad91a066311b166e322d63648712e1
|
|
|
playwright-report-firefox-2
Expired
|
739 KB |
sha256:da96683ec5b12f980d946cbe97390f4184657db4fc3897fc1be52e4462dcc548
|
|
|
playwright-report-merged
Expired
|
1.66 MB |
sha256:41689ff59f2ef9d9ae4ad08144b7db8f119ee9770685a7d74c6b10d32122f4d2
|
|
|
playwright-report-webkit-1
Expired
|
1.45 MB |
sha256:6cdb3dc04cdafebefd4308922aef281e203a6e0b69a58bc936a704ca8178e50a
|
|
|
playwright-report-webkit-2
Expired
|
205 KB |
sha256:9c72ae7df3e6fc330719ca719b93fa760a4635330da23f4d493fb4e4a635bca0
|
|
|
relative-ci-artifacts-editor
|
46.8 KB |
sha256:2b82ba654ec352213b2be69f1422c86deb3532eee264515e29ac0f94e7345ee0
|
|