Skip to content

test: get snapshots working again #7032

test: get snapshots working again

test: get snapshots working again #7032

Triggered via pull request March 11, 2026 11:59
@nperez0111nperez0111
synchronize #2554
snaps
Status Success
Total duration 8m 45s
Artifacts 15

build.yml

on: pull_request
Matrix: playwright
Merge Playwright Reports
39s
Merge Playwright Reports
Fit to window
Zoom out
Zoom in

Annotations

5 errors, 9 warnings, and 7 notices
[firefox] › src/end-to-end/shadcn/shadcn.test.ts:28:7 › Check ShadCN UI › Check link toolbar: tests/src/end-to-end/shadcn/shadcn.test.ts#L41
1) [firefox] › src/end-to-end/shadcn/shadcn.test.ts:28:7 › Check ShadCN UI › Check link toolbar ── Error: expect(Buffer).toMatchSnapshot(expected) 209 pixels (ratio 0.01 of all image pixels) are different. Expected: /__w/BlockNote/BlockNote/tests/src/end-to-end/shadcn/shadcn.test.ts-snapshots/shadcn-link-toolbar-firefox-linux.png Received: /__w/BlockNote/BlockNote/tests/test-results/shadcn-shadcn-Check-ShadCN-UI-Check-link-toolbar-firefox/shadcn-link-toolbar-actual.png Diff: /__w/BlockNote/BlockNote/tests/test-results/shadcn-shadcn-Check-ShadCN-UI-Check-link-toolbar-firefox/shadcn-link-toolbar-diff.png 39 | 40 | await page.waitForTimeout(700); > 41 | expect(await page.screenshot()).toMatchSnapshot("shadcn-link-toolbar.png"); | ^ 42 | }); 43 | test("Check slash menu", async ({ page }) => { 44 | await focusOnEditor(page); at /__w/BlockNote/BlockNote/tests/src/end-to-end/shadcn/shadcn.test.ts:41:37
[webkit] › src/end-to-end/customblocks/customblocks.test.ts:24:7 › Check custom block functionality › Should be able to interactively update React custom blocks: tests/src/end-to-end/customblocks/customblocks.test.ts#L33
2) [webkit] › src/end-to-end/customblocks/customblocks.test.ts:24:7 › Check custom block functionality › Should be able to interactively update React custom blocks Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(Buffer).toMatchSnapshot(expected) 34732 pixels (ratio 0.01 of all image pixels) are different. Expected: /__w/BlockNote/BlockNote/tests/src/end-to-end/customblocks/customblocks.test.ts-snapshots/react-interactivity-webkit-linux.png Received: /__w/BlockNote/BlockNote/tests/test-results/customblocks-customblocks--ee421--update-React-custom-blocks-webkit-retry1/react-interactivity-actual.png Diff: /__w/BlockNote/BlockNote/tests/test-results/customblocks-customblocks--ee421--update-React-custom-blocks-webkit-retry1/react-interactivity-diff.png 31 | 32 | await compareDocToSnapshot(page, "reactInteractivity"); > 33 | expect(await page.screenshot()).toMatchSnapshot("react-interactivity.png"); | ^ 34 | }); 35 | }); 36 | at /__w/BlockNote/BlockNote/tests/src/end-to-end/customblocks/customblocks.test.ts:33:37
[webkit] › src/end-to-end/customblocks/customblocks.test.ts:24:7 › Check custom block functionality › Should be able to interactively update React custom blocks: tests/src/end-to-end/customblocks/customblocks.test.ts#L33
2) [webkit] › src/end-to-end/customblocks/customblocks.test.ts:24:7 › Check custom block functionality › Should be able to interactively update React custom blocks Error: expect(Buffer).toMatchSnapshot(expected) 34732 pixels (ratio 0.01 of all image pixels) are different. Expected: /__w/BlockNote/BlockNote/tests/src/end-to-end/customblocks/customblocks.test.ts-snapshots/react-interactivity-webkit-linux.png Received: /__w/BlockNote/BlockNote/tests/test-results/customblocks-customblocks--ee421--update-React-custom-blocks-webkit/react-interactivity-actual.png Diff: /__w/BlockNote/BlockNote/tests/test-results/customblocks-customblocks--ee421--update-React-custom-blocks-webkit/react-interactivity-diff.png 31 | 32 | await compareDocToSnapshot(page, "reactInteractivity"); > 33 | expect(await page.screenshot()).toMatchSnapshot("react-interactivity.png"); | ^ 34 | }); 35 | }); 36 | at /__w/BlockNote/BlockNote/tests/src/end-to-end/customblocks/customblocks.test.ts:33:37
[webkit] › src/end-to-end/customblocks/customblocks.test.ts:10:7 › Check custom block functionality › Should be able to interactively update vanilla custom blocks: tests/src/end-to-end/customblocks/customblocks.test.ts#L19
1) [webkit] › src/end-to-end/customblocks/customblocks.test.ts:10:7 › Check custom block functionality › Should be able to interactively update vanilla custom blocks Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(Buffer).toMatchSnapshot(expected) 33106 pixels (ratio 0.01 of all image pixels) are different. Expected: /__w/BlockNote/BlockNote/tests/src/end-to-end/customblocks/customblocks.test.ts-snapshots/vanilla-interactivity-webkit-linux.png Received: /__w/BlockNote/BlockNote/tests/test-results/customblocks-customblocks--8679c-pdate-vanilla-custom-blocks-webkit-retry1/vanilla-interactivity-actual.png Diff: /__w/BlockNote/BlockNote/tests/test-results/customblocks-customblocks--8679c-pdate-vanilla-custom-blocks-webkit-retry1/vanilla-interactivity-diff.png 17 | 18 | await compareDocToSnapshot(page, "vanillaInteractivity"); > 19 | expect(await page.screenshot()).toMatchSnapshot( | ^ 20 | "vanilla-interactivity.png", 21 | ); 22 | }); at /__w/BlockNote/BlockNote/tests/src/end-to-end/customblocks/customblocks.test.ts:19:37
[webkit] › src/end-to-end/customblocks/customblocks.test.ts:10:7 › Check custom block functionality › Should be able to interactively update vanilla custom blocks: tests/src/end-to-end/customblocks/customblocks.test.ts#L19
1) [webkit] › src/end-to-end/customblocks/customblocks.test.ts:10:7 › Check custom block functionality › Should be able to interactively update vanilla custom blocks Error: expect(Buffer).toMatchSnapshot(expected) 33106 pixels (ratio 0.01 of all image pixels) are different. Expected: /__w/BlockNote/BlockNote/tests/src/end-to-end/customblocks/customblocks.test.ts-snapshots/vanilla-interactivity-webkit-linux.png Received: /__w/BlockNote/BlockNote/tests/test-results/customblocks-customblocks--8679c-pdate-vanilla-custom-blocks-webkit/vanilla-interactivity-actual.png Diff: /__w/BlockNote/BlockNote/tests/test-results/customblocks-customblocks--8679c-pdate-vanilla-custom-blocks-webkit/vanilla-interactivity-diff.png 17 | 18 | await compareDocToSnapshot(page, "vanillaInteractivity"); > 19 | expect(await page.screenshot()).toMatchSnapshot( | ^ 20 | "vanilla-interactivity.png", 21 | ); 22 | }); at /__w/BlockNote/BlockNote/tests/src/end-to-end/customblocks/customblocks.test.ts:19:37
Playwright Build
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4, actions/checkout@v4, actions/setup-node@v4, actions/upload-artifact@v4, pnpm/action-setup@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Build
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4, actions/checkout@v4, actions/setup-node@v4, actions/upload-artifact@v4, pnpm/action-setup@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Playwright Tests - chromium (2/2)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/download-artifact@v4, actions/setup-node@v4, actions/upload-artifact@v4, pnpm/action-setup@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Playwright Tests - webkit (2/2)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/download-artifact@v4, actions/setup-node@v4, actions/upload-artifact@v4, pnpm/action-setup@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Playwright Tests - firefox (2/2)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/download-artifact@v4, actions/setup-node@v4, actions/upload-artifact@v4, pnpm/action-setup@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Playwright Tests - chromium (1/2)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/download-artifact@v4, actions/setup-node@v4, actions/upload-artifact@v4, pnpm/action-setup@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Playwright Tests - firefox (1/2)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/download-artifact@v4, actions/setup-node@v4, actions/upload-artifact@v4, pnpm/action-setup@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Playwright Tests - webkit (1/2)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/download-artifact@v4, actions/setup-node@v4, actions/upload-artifact@v4, pnpm/action-setup@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Merge Playwright Reports
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/download-artifact@v4, actions/setup-node@v4, actions/upload-artifact@v4, pnpm/action-setup@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Build
{ "workflowData": { "owner": "TypeCellOS", "repo": "BlockNote", "sha": "39c3c3284994badc7bdd7e832ed3a831a6cc510d", "ref": "2554" }, "key": "pQsU5znei5", "runId": 22951471735, "webhookDebug": { "action": "requested", "head_branch": "snaps", "head_repository_full_name": "TypeCellOS/BlockNote", "full_name": "TypeCellOS/BlockNote", "isPullRequest": true, "prNumber": 2554, "prNumberType": "number", "isNewPullRequest": true, "isOldPullRequest": false, "prKey": "TypeCellOS/BlockNote:snaps", "oldPrDataHash": "RoyULopbq8", "lookupKey": "TypeCellOS/BlockNote:snaps", "data": { "owner": "TypeCellOS", "repo": "BlockNote", "sha": "2ff0c863bd64c8e083eea62f4effe54ea19bc6e6", "ref": "2554" } } }
🎭 Playwright Run Summary
38 passed (34.7s)
🎭 Playwright Run Summary
38 passed (57.7s)
🎭 Playwright Run Summary
1 flaky [firefox] › src/end-to-end/shadcn/shadcn.test.ts:28:7 › Check ShadCN UI › Check link toolbar ─── 37 passed (47.3s)
🎭 Playwright Run Summary
2 skipped 82 passed (1.1m)
🎭 Playwright Run Summary
12 skipped 72 passed (1.4m)
🎭 Playwright Run Summary
2 flaky [webkit] › src/end-to-end/customblocks/customblocks.test.ts:10:7 › Check custom block functionality › Should be able to interactively update vanilla custom blocks [webkit] › src/end-to-end/customblocks/customblocks.test.ts:24:7 › Check custom block functionality › Should be able to interactively update React custom blocks 10 skipped 72 passed (2.0m)

Artifacts

Produced during runtime
Name Size Digest
blob-report-chromium-1 Expired
114 KB
sha256:d6ef1a60edad42a6675cba78ae1bd802fd9b550f7cb942d7d5894e383c97df8c
blob-report-chromium-2 Expired
46.5 KB
sha256:dbd3d54ba152aace93079eede63523f03738ae60e03ff004bceb2c946b28fbaf
blob-report-firefox-1 Expired
103 KB
sha256:d6f5fc4668b71319de9a083a21e8d52590b401a780ff5e86c1d1dd57a4a70d98
blob-report-firefox-2 Expired
199 KB
sha256:78758e5f1f8be3a86c841ede0cc51292ba37382f3618054ca0448f83819efcb1
blob-report-webkit-1 Expired
1.34 MB
sha256:7f557de6da988f02325b882325c63724800dd1e4fa709a5df82edbd275b6ebaa
blob-report-webkit-2 Expired
47 KB
sha256:d1cdcb63d2b68c9d6e7d316a0c885c2913e895a401f06b8401e9279e1a2eff2c
playwright-build Expired
26.2 MB
sha256:f637bcdaefbd5ea99d6c88f8ee0dd49fc7731af429304caec820f9e4b82d06e6
playwright-report-chromium-1 Expired
247 KB
sha256:02cdf68ae465aaba643f9071169b720ffc23d2edb8e2bae7376b2dabc30c8652
playwright-report-chromium-2 Expired
205 KB
sha256:8068ddccc4ffade9a81181dae97e953738a8b318c045f194e7c8931eee931261
playwright-report-firefox-1 Expired
240 KB
sha256:4f65ad086ba4e22b67fd87d1a133342ab6ad91a066311b166e322d63648712e1
playwright-report-firefox-2 Expired
739 KB
sha256:da96683ec5b12f980d946cbe97390f4184657db4fc3897fc1be52e4462dcc548
playwright-report-merged Expired
1.66 MB
sha256:41689ff59f2ef9d9ae4ad08144b7db8f119ee9770685a7d74c6b10d32122f4d2
playwright-report-webkit-1 Expired
1.45 MB
sha256:6cdb3dc04cdafebefd4308922aef281e203a6e0b69a58bc936a704ca8178e50a
playwright-report-webkit-2 Expired
205 KB
sha256:9c72ae7df3e6fc330719ca719b93fa760a4635330da23f4d493fb4e4a635bca0
relative-ci-artifacts-editor
46.8 KB
sha256:2b82ba654ec352213b2be69f1422c86deb3532eee264515e29ac0f94e7345ee0