Skip to content

Audio block: test the block for visual regressions #99546

Audio block: test the block for visual regressions

Audio block: test the block for visual regressions #99546

Re-run triggered March 19, 2024 11:09
Status Failure
Total duration 19m 0s
Artifacts 2

end2end-test.yml

on: pull_request
Matrix: e2e-playwright
Report to GitHub
6s
Report to GitHub
Fit to window
Zoom out
Zoom in

Annotations

11 errors, 9 warnings, and 8 notices
[chromium] › editor/blocks/audio.spec.js:15:2 › Visual Regression Testing › should match baseline screenshot: test/e2e/specs/editor/blocks/audio.spec.js#L29
1) [chromium] › editor/blocks/audio.spec.js:15:2 › Visual Regression Testing › should match baseline screenshot Error: Screenshot comparison failed: 3932 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/__snapshots__/Visual-Regression-Testing-should-match-baseline-screenshot-1-chromium.png Received: /home/runner/work/gutenberg/gutenberg/artifacts/test-results/editor-blocks-audio-Visual-Regression-Testing-should-match-baseline-screenshot-chromium/Visual-Regression-Testing-should-match-baseline-screenshot-1-actual.png Diff: /home/runner/work/gutenberg/gutenberg/artifacts/test-results/editor-blocks-audio-Visual-Regression-Testing-should-match-baseline-screenshot-chromium/Visual-Regression-Testing-should-match-baseline-screenshot-1-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 3932 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 3932 pixels (ratio 0.01 of all image pixels) are different. 27 | const postId = await editor.publishPost(); 28 | await page.goto( `/?p=${ postId }` ); > 29 | await expect( page ).toHaveScreenshot(); | ^ 30 | } ); 31 | } ); 32 | at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/audio.spec.js:29:24
[chromium] › editor/blocks/audio.spec.js:15:2 › Visual Regression Testing › should match baseline screenshot: test/e2e/specs/editor/blocks/audio.spec.js#L29
1) [chromium] › editor/blocks/audio.spec.js:15:2 › Visual Regression Testing › should match baseline screenshot Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 3932 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/__snapshots__/Visual-Regression-Testing-should-match-baseline-screenshot-1-chromium.png Received: /home/runner/work/gutenberg/gutenberg/artifacts/test-results/editor-blocks-audio-Visual-Regression-Testing-should-match-baseline-screenshot-chromium-retry1/Visual-Regression-Testing-should-match-baseline-screenshot-1-actual.png Diff: /home/runner/work/gutenberg/gutenberg/artifacts/test-results/editor-blocks-audio-Visual-Regression-Testing-should-match-baseline-screenshot-chromium-retry1/Visual-Regression-Testing-should-match-baseline-screenshot-1-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 3932 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 3932 pixels (ratio 0.01 of all image pixels) are different. 27 | const postId = await editor.publishPost(); 28 | await page.goto( `/?p=${ postId }` ); > 29 | await expect( page ).toHaveScreenshot(); | ^ 30 | } ); 31 | } ); 32 | at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/audio.spec.js:29:24
[chromium] › editor/blocks/audio.spec.js:15:2 › Visual Regression Testing › should match baseline screenshot: test/e2e/specs/editor/blocks/audio.spec.js#L29
1) [chromium] › editor/blocks/audio.spec.js:15:2 › Visual Regression Testing › should match baseline screenshot Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 3932 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/__snapshots__/Visual-Regression-Testing-should-match-baseline-screenshot-1-chromium.png Received: /home/runner/work/gutenberg/gutenberg/artifacts/test-results/editor-blocks-audio-Visual-Regression-Testing-should-match-baseline-screenshot-chromium-retry2/Visual-Regression-Testing-should-match-baseline-screenshot-1-actual.png Diff: /home/runner/work/gutenberg/gutenberg/artifacts/test-results/editor-blocks-audio-Visual-Regression-Testing-should-match-baseline-screenshot-chromium-retry2/Visual-Regression-Testing-should-match-baseline-screenshot-1-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 3932 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 3932 pixels (ratio 0.01 of all image pixels) are different. 27 | const postId = await editor.publishPost(); 28 | await page.goto( `/?p=${ postId }` ); > 29 | await expect( page ).toHaveScreenshot(); | ^ 30 | } ); 31 | } ); 32 | at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/audio.spec.js:29:24
[chromium] › editor/blocks/buttons.spec.js:282:2 › Buttons › can apply named colors: test/e2e/specs/editor/blocks/buttons.spec.js#L294
2) [chromium] › editor/blocks/buttons.spec.js:282:2 › Buttons › can apply named colors ─────────── TimeoutError: page.click: Timeout 10000ms exceeded. Call log: - waiting for locator('role=option[name="Color: Cyan bluish gray"i]') 292 | 'role=region[name="Editor settings"i] >> role=button[name="Color Text styles"i]' 293 | ); > 294 | await page.click( 'role=option[name="Color: Cyan bluish gray"i]' ); | ^ 295 | await page.click( 296 | 'role=region[name="Editor settings"i] >> role=button[name="Color Background styles"i]' 297 | ); at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/buttons.spec.js:294:14
[chromium] › editor/blocks/buttons.spec.js:282:2 › Buttons › can apply named colors: test/e2e/specs/editor/blocks/buttons.spec.js#L294
2) [chromium] › editor/blocks/buttons.spec.js:282:2 › Buttons › can apply named colors ─────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── TimeoutError: page.click: Timeout 10000ms exceeded. Call log: - waiting for locator('role=option[name="Color: Cyan bluish gray"i]') 292 | 'role=region[name="Editor settings"i] >> role=button[name="Color Text styles"i]' 293 | ); > 294 | await page.click( 'role=option[name="Color: Cyan bluish gray"i]' ); | ^ 295 | await page.click( 296 | 'role=region[name="Editor settings"i] >> role=button[name="Color Background styles"i]' 297 | ); at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/buttons.spec.js:294:14
[chromium] › editor/blocks/buttons.spec.js:282:2 › Buttons › can apply named colors: test/e2e/specs/editor/blocks/buttons.spec.js#L294
2) [chromium] › editor/blocks/buttons.spec.js:282:2 › Buttons › can apply named colors ─────────── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── TimeoutError: page.click: Timeout 10000ms exceeded. Call log: - waiting for locator('role=option[name="Color: Cyan bluish gray"i]') 292 | 'role=region[name="Editor settings"i] >> role=button[name="Color Text styles"i]' 293 | ); > 294 | await page.click( 'role=option[name="Color: Cyan bluish gray"i]' ); | ^ 295 | await page.click( 296 | 'role=region[name="Editor settings"i] >> role=button[name="Color Background styles"i]' 297 | ); at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/buttons.spec.js:294:14
[chromium] › editor/blocks/buttons.spec.js:343:2 › Buttons › can apply named gradient background color: test/e2e/specs/editor/blocks/buttons.spec.js#L359
3) [chromium] › editor/blocks/buttons.spec.js:343:2 › Buttons › can apply named gradient background color TimeoutError: page.click: Timeout 10000ms exceeded. Call log: - waiting for locator('role=option[name="Gradient: Purple to yellow"i]') 357 | ); 358 | await page.click( 'role=tab[name="Gradient"i]' ); > 359 | await page.click( 'role=option[name="Gradient: Purple to yellow"i]' ); | ^ 360 | 361 | // Check the content. 362 | const content = await editor.getEditedPostContent(); at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/buttons.spec.js:359:14
[chromium] › editor/blocks/buttons.spec.js:343:2 › Buttons › can apply named gradient background color: test/e2e/specs/editor/blocks/buttons.spec.js#L359
3) [chromium] › editor/blocks/buttons.spec.js:343:2 › Buttons › can apply named gradient background color Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── TimeoutError: page.click: Timeout 10000ms exceeded. Call log: - waiting for locator('role=option[name="Gradient: Purple to yellow"i]') 357 | ); 358 | await page.click( 'role=tab[name="Gradient"i]' ); > 359 | await page.click( 'role=option[name="Gradient: Purple to yellow"i]' ); | ^ 360 | 361 | // Check the content. 362 | const content = await editor.getEditedPostContent(); at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/buttons.spec.js:359:14
[chromium] › editor/blocks/buttons.spec.js:343:2 › Buttons › can apply named gradient background color: test/e2e/specs/editor/blocks/buttons.spec.js#L359
3) [chromium] › editor/blocks/buttons.spec.js:343:2 › Buttons › can apply named gradient background color Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── TimeoutError: page.click: Timeout 10000ms exceeded. Call log: - waiting for locator('role=option[name="Gradient: Purple to yellow"i]') 357 | ); 358 | await page.click( 'role=tab[name="Gradient"i]' ); > 359 | await page.click( 'role=option[name="Gradient: Purple to yellow"i]' ); | ^ 360 | 361 | // Check the content. 362 | const content = await editor.getEditedPostContent(); at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/buttons.spec.js:359:14
[chromium] › editor/blocks/classic.spec.js:31:2 › Classic › should be inserted: test/e2e/specs/editor/blocks/classic.spec.js#L34
4) [chromium] › editor/blocks/classic.spec.js:31:2 › Classic › should be inserted ──────────────── TimeoutError: page.click: Timeout 10000ms exceeded. Call log: - waiting for locator('.mce-content-body') 32 | await editor.insertBlock( { name: 'core/freeform' } ); 33 | // Ensure there is focus. > 34 | await page.click( '.mce-content-body' ); | ^ 35 | await page.keyboard.type( 'test' ); 36 | // Move focus away. 37 | await pageUtils.pressKeys( 'shift+Tab' ); at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/classic.spec.js:34:14
Report to GitHub
Unable to download artifact(s): Artifact not found for name: flaky-tests-report Please ensure that your artifact is not expired and the artifact was uploaded using a compatible version of toolkit/upload-artifact. For more information, visit the GitHub Artifacts FAQ: https://github.com/actions/toolkit/blob/main/packages/artifact/docs/faq.md
Playwright - 3
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-node@64ed1c7eab4cce3362f8c340dee64e5eaeef8f7c, actions/cache@88522ab9f39a2ea568f7027eddc7d8d8bc9d59c8. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Puppeteer
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-node@64ed1c7eab4cce3362f8c340dee64e5eaeef8f7c, actions/cache@88522ab9f39a2ea568f7027eddc7d8d8bc9d59c8. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Playwright - 5
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-node@64ed1c7eab4cce3362f8c340dee64e5eaeef8f7c, actions/cache@88522ab9f39a2ea568f7027eddc7d8d8bc9d59c8. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Playwright - 2
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-node@64ed1c7eab4cce3362f8c340dee64e5eaeef8f7c, actions/cache@88522ab9f39a2ea568f7027eddc7d8d8bc9d59c8. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Playwright - 4
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-node@64ed1c7eab4cce3362f8c340dee64e5eaeef8f7c, actions/cache@88522ab9f39a2ea568f7027eddc7d8d8bc9d59c8. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Playwright - 7
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-node@64ed1c7eab4cce3362f8c340dee64e5eaeef8f7c, actions/cache@88522ab9f39a2ea568f7027eddc7d8d8bc9d59c8. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Playwright - 6
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-node@64ed1c7eab4cce3362f8c340dee64e5eaeef8f7c, actions/cache@88522ab9f39a2ea568f7027eddc7d8d8bc9d59c8. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Playwright - 8
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-node@64ed1c7eab4cce3362f8c340dee64e5eaeef8f7c, actions/cache@88522ab9f39a2ea568f7027eddc7d8d8bc9d59c8. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Playwright - 1
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-node@64ed1c7eab4cce3362f8c340dee64e5eaeef8f7c, actions/cache@88522ab9f39a2ea568f7027eddc7d8d8bc9d59c8. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
🎭 Playwright Run Summary
1 skipped 179 passed (9.2m)
🎭 Playwright Run Summary
181 passed (8.0m)
🎭 Playwright Run Summary
1 skipped 188 passed (9.4m)
🎭 Playwright Run Summary
1 skipped 182 passed (9.6m)
🎭 Playwright Run Summary
218 passed (12.7m)
🎭 Playwright Run Summary
3 skipped 181 passed (5.8m)
🎭 Playwright Run Summary
3 skipped 144 passed (7.9m)
🎭 Playwright Run Summary
6 failed [chromium] › editor/blocks/audio.spec.js:15:2 › Visual Regression Testing › should match baseline screenshot [chromium] › editor/blocks/buttons.spec.js:282:2 › Buttons › can apply named colors ──────────── [chromium] › editor/blocks/buttons.spec.js:343:2 › Buttons › can apply named gradient background color [chromium] › editor/blocks/classic.spec.js:31:2 › Classic › should be inserted ───────────────── [chromium] › editor/blocks/classic.spec.js:42:2 › Classic › should insert media, convert to blocks, and undo in one step [chromium] › editor/blocks/classic.spec.js:104:2 › Classic › Should not fail after save/reload ─ 11 skipped 171 passed (12.5m)

Artifacts

Produced during runtime
Name Size
failures-artifacts Expired
31.9 MB