Audio block: test the block for visual regressions #99546
end2end-test.yml
on: pull_request
Matrix: e2e-playwright
Puppeteer
5m 29s
Report to GitHub
6s
Annotations
11 errors, 9 warnings, and 8 notices
[chromium] › editor/blocks/audio.spec.js:15:2 › Visual Regression Testing › should match baseline screenshot:
test/e2e/specs/editor/blocks/audio.spec.js#L29
1) [chromium] › editor/blocks/audio.spec.js:15:2 › Visual Regression Testing › should match baseline screenshot
Error: Screenshot comparison failed:
3932 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/__snapshots__/Visual-Regression-Testing-should-match-baseline-screenshot-1-chromium.png
Received: /home/runner/work/gutenberg/gutenberg/artifacts/test-results/editor-blocks-audio-Visual-Regression-Testing-should-match-baseline-screenshot-chromium/Visual-Regression-Testing-should-match-baseline-screenshot-1-actual.png
Diff: /home/runner/work/gutenberg/gutenberg/artifacts/test-results/editor-blocks-audio-Visual-Regression-Testing-should-match-baseline-screenshot-chromium/Visual-Regression-Testing-should-match-baseline-screenshot-1-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 3932 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 3932 pixels (ratio 0.01 of all image pixels) are different.
27 | const postId = await editor.publishPost();
28 | await page.goto( `/?p=${ postId }` );
> 29 | await expect( page ).toHaveScreenshot();
| ^
30 | } );
31 | } );
32 |
at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/audio.spec.js:29:24
|
[chromium] › editor/blocks/audio.spec.js:15:2 › Visual Regression Testing › should match baseline screenshot:
test/e2e/specs/editor/blocks/audio.spec.js#L29
1) [chromium] › editor/blocks/audio.spec.js:15:2 › Visual Regression Testing › should match baseline screenshot
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
3932 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/__snapshots__/Visual-Regression-Testing-should-match-baseline-screenshot-1-chromium.png
Received: /home/runner/work/gutenberg/gutenberg/artifacts/test-results/editor-blocks-audio-Visual-Regression-Testing-should-match-baseline-screenshot-chromium-retry1/Visual-Regression-Testing-should-match-baseline-screenshot-1-actual.png
Diff: /home/runner/work/gutenberg/gutenberg/artifacts/test-results/editor-blocks-audio-Visual-Regression-Testing-should-match-baseline-screenshot-chromium-retry1/Visual-Regression-Testing-should-match-baseline-screenshot-1-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 3932 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 3932 pixels (ratio 0.01 of all image pixels) are different.
27 | const postId = await editor.publishPost();
28 | await page.goto( `/?p=${ postId }` );
> 29 | await expect( page ).toHaveScreenshot();
| ^
30 | } );
31 | } );
32 |
at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/audio.spec.js:29:24
|
[chromium] › editor/blocks/audio.spec.js:15:2 › Visual Regression Testing › should match baseline screenshot:
test/e2e/specs/editor/blocks/audio.spec.js#L29
1) [chromium] › editor/blocks/audio.spec.js:15:2 › Visual Regression Testing › should match baseline screenshot
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
3932 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/__snapshots__/Visual-Regression-Testing-should-match-baseline-screenshot-1-chromium.png
Received: /home/runner/work/gutenberg/gutenberg/artifacts/test-results/editor-blocks-audio-Visual-Regression-Testing-should-match-baseline-screenshot-chromium-retry2/Visual-Regression-Testing-should-match-baseline-screenshot-1-actual.png
Diff: /home/runner/work/gutenberg/gutenberg/artifacts/test-results/editor-blocks-audio-Visual-Regression-Testing-should-match-baseline-screenshot-chromium-retry2/Visual-Regression-Testing-should-match-baseline-screenshot-1-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 3932 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 3932 pixels (ratio 0.01 of all image pixels) are different.
27 | const postId = await editor.publishPost();
28 | await page.goto( `/?p=${ postId }` );
> 29 | await expect( page ).toHaveScreenshot();
| ^
30 | } );
31 | } );
32 |
at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/audio.spec.js:29:24
|
[chromium] › editor/blocks/buttons.spec.js:282:2 › Buttons › can apply named colors:
test/e2e/specs/editor/blocks/buttons.spec.js#L294
2) [chromium] › editor/blocks/buttons.spec.js:282:2 › Buttons › can apply named colors ───────────
TimeoutError: page.click: Timeout 10000ms exceeded.
Call log:
- waiting for locator('role=option[name="Color: Cyan bluish gray"i]')
292 | 'role=region[name="Editor settings"i] >> role=button[name="Color Text styles"i]'
293 | );
> 294 | await page.click( 'role=option[name="Color: Cyan bluish gray"i]' );
| ^
295 | await page.click(
296 | 'role=region[name="Editor settings"i] >> role=button[name="Color Background styles"i]'
297 | );
at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/buttons.spec.js:294:14
|
[chromium] › editor/blocks/buttons.spec.js:282:2 › Buttons › can apply named colors:
test/e2e/specs/editor/blocks/buttons.spec.js#L294
2) [chromium] › editor/blocks/buttons.spec.js:282:2 › Buttons › can apply named colors ───────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
TimeoutError: page.click: Timeout 10000ms exceeded.
Call log:
- waiting for locator('role=option[name="Color: Cyan bluish gray"i]')
292 | 'role=region[name="Editor settings"i] >> role=button[name="Color Text styles"i]'
293 | );
> 294 | await page.click( 'role=option[name="Color: Cyan bluish gray"i]' );
| ^
295 | await page.click(
296 | 'role=region[name="Editor settings"i] >> role=button[name="Color Background styles"i]'
297 | );
at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/buttons.spec.js:294:14
|
[chromium] › editor/blocks/buttons.spec.js:282:2 › Buttons › can apply named colors:
test/e2e/specs/editor/blocks/buttons.spec.js#L294
2) [chromium] › editor/blocks/buttons.spec.js:282:2 › Buttons › can apply named colors ───────────
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
TimeoutError: page.click: Timeout 10000ms exceeded.
Call log:
- waiting for locator('role=option[name="Color: Cyan bluish gray"i]')
292 | 'role=region[name="Editor settings"i] >> role=button[name="Color Text styles"i]'
293 | );
> 294 | await page.click( 'role=option[name="Color: Cyan bluish gray"i]' );
| ^
295 | await page.click(
296 | 'role=region[name="Editor settings"i] >> role=button[name="Color Background styles"i]'
297 | );
at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/buttons.spec.js:294:14
|
[chromium] › editor/blocks/buttons.spec.js:343:2 › Buttons › can apply named gradient background color:
test/e2e/specs/editor/blocks/buttons.spec.js#L359
3) [chromium] › editor/blocks/buttons.spec.js:343:2 › Buttons › can apply named gradient background color
TimeoutError: page.click: Timeout 10000ms exceeded.
Call log:
- waiting for locator('role=option[name="Gradient: Purple to yellow"i]')
357 | );
358 | await page.click( 'role=tab[name="Gradient"i]' );
> 359 | await page.click( 'role=option[name="Gradient: Purple to yellow"i]' );
| ^
360 |
361 | // Check the content.
362 | const content = await editor.getEditedPostContent();
at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/buttons.spec.js:359:14
|
[chromium] › editor/blocks/buttons.spec.js:343:2 › Buttons › can apply named gradient background color:
test/e2e/specs/editor/blocks/buttons.spec.js#L359
3) [chromium] › editor/blocks/buttons.spec.js:343:2 › Buttons › can apply named gradient background color
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
TimeoutError: page.click: Timeout 10000ms exceeded.
Call log:
- waiting for locator('role=option[name="Gradient: Purple to yellow"i]')
357 | );
358 | await page.click( 'role=tab[name="Gradient"i]' );
> 359 | await page.click( 'role=option[name="Gradient: Purple to yellow"i]' );
| ^
360 |
361 | // Check the content.
362 | const content = await editor.getEditedPostContent();
at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/buttons.spec.js:359:14
|
[chromium] › editor/blocks/buttons.spec.js:343:2 › Buttons › can apply named gradient background color:
test/e2e/specs/editor/blocks/buttons.spec.js#L359
3) [chromium] › editor/blocks/buttons.spec.js:343:2 › Buttons › can apply named gradient background color
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
TimeoutError: page.click: Timeout 10000ms exceeded.
Call log:
- waiting for locator('role=option[name="Gradient: Purple to yellow"i]')
357 | );
358 | await page.click( 'role=tab[name="Gradient"i]' );
> 359 | await page.click( 'role=option[name="Gradient: Purple to yellow"i]' );
| ^
360 |
361 | // Check the content.
362 | const content = await editor.getEditedPostContent();
at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/buttons.spec.js:359:14
|
[chromium] › editor/blocks/classic.spec.js:31:2 › Classic › should be inserted:
test/e2e/specs/editor/blocks/classic.spec.js#L34
4) [chromium] › editor/blocks/classic.spec.js:31:2 › Classic › should be inserted ────────────────
TimeoutError: page.click: Timeout 10000ms exceeded.
Call log:
- waiting for locator('.mce-content-body')
32 | await editor.insertBlock( { name: 'core/freeform' } );
33 | // Ensure there is focus.
> 34 | await page.click( '.mce-content-body' );
| ^
35 | await page.keyboard.type( 'test' );
36 | // Move focus away.
37 | await pageUtils.pressKeys( 'shift+Tab' );
at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/classic.spec.js:34:14
|
Report to GitHub
Unable to download artifact(s): Artifact not found for name: flaky-tests-report
Please ensure that your artifact is not expired and the artifact was uploaded using a compatible version of toolkit/upload-artifact.
For more information, visit the GitHub Artifacts FAQ: https://github.com/actions/toolkit/blob/main/packages/artifact/docs/faq.md
|
Playwright - 3
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-node@64ed1c7eab4cce3362f8c340dee64e5eaeef8f7c, actions/cache@88522ab9f39a2ea568f7027eddc7d8d8bc9d59c8. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Puppeteer
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-node@64ed1c7eab4cce3362f8c340dee64e5eaeef8f7c, actions/cache@88522ab9f39a2ea568f7027eddc7d8d8bc9d59c8. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Playwright - 5
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-node@64ed1c7eab4cce3362f8c340dee64e5eaeef8f7c, actions/cache@88522ab9f39a2ea568f7027eddc7d8d8bc9d59c8. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Playwright - 2
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-node@64ed1c7eab4cce3362f8c340dee64e5eaeef8f7c, actions/cache@88522ab9f39a2ea568f7027eddc7d8d8bc9d59c8. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Playwright - 4
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-node@64ed1c7eab4cce3362f8c340dee64e5eaeef8f7c, actions/cache@88522ab9f39a2ea568f7027eddc7d8d8bc9d59c8. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Playwright - 7
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-node@64ed1c7eab4cce3362f8c340dee64e5eaeef8f7c, actions/cache@88522ab9f39a2ea568f7027eddc7d8d8bc9d59c8. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Playwright - 6
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-node@64ed1c7eab4cce3362f8c340dee64e5eaeef8f7c, actions/cache@88522ab9f39a2ea568f7027eddc7d8d8bc9d59c8. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Playwright - 8
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-node@64ed1c7eab4cce3362f8c340dee64e5eaeef8f7c, actions/cache@88522ab9f39a2ea568f7027eddc7d8d8bc9d59c8. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Playwright - 1
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-node@64ed1c7eab4cce3362f8c340dee64e5eaeef8f7c, actions/cache@88522ab9f39a2ea568f7027eddc7d8d8bc9d59c8. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
🎭 Playwright Run Summary
1 skipped
179 passed (9.2m)
|
🎭 Playwright Run Summary
181 passed (8.0m)
|
🎭 Playwright Run Summary
1 skipped
188 passed (9.4m)
|
🎭 Playwright Run Summary
1 skipped
182 passed (9.6m)
|
🎭 Playwright Run Summary
218 passed (12.7m)
|
🎭 Playwright Run Summary
3 skipped
181 passed (5.8m)
|
🎭 Playwright Run Summary
3 skipped
144 passed (7.9m)
|
🎭 Playwright Run Summary
6 failed
[chromium] › editor/blocks/audio.spec.js:15:2 › Visual Regression Testing › should match baseline screenshot
[chromium] › editor/blocks/buttons.spec.js:282:2 › Buttons › can apply named colors ────────────
[chromium] › editor/blocks/buttons.spec.js:343:2 › Buttons › can apply named gradient background color
[chromium] › editor/blocks/classic.spec.js:31:2 › Classic › should be inserted ─────────────────
[chromium] › editor/blocks/classic.spec.js:42:2 › Classic › should insert media, convert to blocks, and undo in one step
[chromium] › editor/blocks/classic.spec.js:104:2 › Classic › Should not fail after save/reload ─
11 skipped
171 passed (12.5m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
failures-artifacts
Expired
|
31.9 MB |
|