Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix flakiness of integration tests on Circle CI #805

Closed
marcysutton opened this issue Mar 26, 2018 · 2 comments
Closed

Fix flakiness of integration tests on Circle CI #805

marcysutton opened this issue Mar 26, 2018 · 2 comments
Labels
core Issues in the core code (lib/core)

Comments

@marcysutton
Copy link
Contributor

marcysutton commented Mar 26, 2018

It seems like ever since we upgraded to Circle 2.0, our Webdriver tests have gotten extremely flaky. Almost every merge to develop or master results in failing tests, which are usually fixed by triggering a build with no changes to the code. We should figure out what's going on there.

Here's an error report:

    Running "parallel:browser-test" (parallel) task

    Running "test-webdriver:firefox" (test-webdriver) task
    
    >> The geckodriver executable could not be found on the current PATH. Please download the latest version from https://github.com/mozilla/geckodriver/releases/WebDriver and ensure it can be found on your PATH.
    Aborted testing using firefox
    
    Done.
    
    Running "test-webdriver:ie" (test-webdriver) task
    
    Skipped ie as it is not supported on this platform
    
    Done.
    
    >> Running "test-webdriver:chrome-mobile" (test-webdriver) task
    >> >> ScriptTimeoutError: asynchronous script timeout: result was not received in 60 seconds
    >> >>   (Session info: chrome=64.0.3282.140)
    >> >>   (Driver info: chromedriver=2.35.528139 (47ead77cb35ad2a9a83248b292151462a66cd881),platform=Linux 4.4.0-109-generic x86_64)
    >> Warning: Task "test-webdriver:chrome-mobile" failed.� Use --force to continue.
    >> 
    >> Aborted due to warnings.
    Warning: Task "parallel:browser-test" failed.� Use --force to continue.

Aborted due to warnings.
npm ERR! Test failed.  See above for more details.
Exited with code 1
@WilcoFiers WilcoFiers added the core Issues in the core code (lib/core) label Apr 17, 2018
@WilcoFiers WilcoFiers added this to the Q2 2018 update milestone Apr 17, 2018
@marcysutton
Copy link
Contributor Author

marcysutton commented May 15, 2018

I get this parallel test failure locally some of the time now in Node 9, but the only thing I see is about http2:

    Done.

    >> (node:73088) ExperimentalWarning: The http2 module is an experimental API.
    Warning: Task "parallel:browser-test" failed. Use --force to continue.

Here's a related issue that doesn't look very helpful: gruntjs/grunt-contrib-connect#235

@jeeyyy
Copy link
Contributor

jeeyyy commented May 25, 2018

Fix in PR: #917

@jeeyyy jeeyyy closed this as completed May 25, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
core Issues in the core code (lib/core)
Projects
None yet
Development

No branches or pull requests

3 participants