Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: re-enable cypress checks #32008

Merged
merged 3 commits into from
Jan 30, 2025
Merged

fix: re-enable cypress checks #32008

merged 3 commits into from
Jan 30, 2025

Conversation

mistercrunch
Copy link
Member

@mistercrunch mistercrunch commented Jan 28, 2025

I got a bit confused and reckless on #31858 while dealing with a sizable merge conflict, proceeded to disable many cypress tests, many of which are or may be flaky at times, but in this instance were probably triggered by some real issues in that PR.

Renabling them all and will monitor PRs and master merges to re-disable the ones flaking as needed.

Note that prior to the PR issues I created on #31858, there were all sorts of cypress issues that we couldn't pinpoint to any particular merges, and that led a few of us to make to call to "disable all flaking tests" with the intent to fix or replace with unit tests:
Screenshot 2025-01-27 at 9 41 17 PM

Seems there are other new issues with the way we goup/report tests as well. Still needs weeding.

Copy link

@korbit-ai korbit-ai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've completed my review and didn't find any issues.

Need a new review? Comment /korbit-review on this PR and I'll review your latest changes.

Korbit Guide: Usage and Customization

Interacting with Korbit

  • You can manually ask Korbit to review your PR using the /korbit-review command in a comment at the root of your PR.
  • You can ask Korbit to generate a new PR description using the /korbit-generate-pr-description command in any comment on your PR.
  • Too many Korbit comments? I can resolve all my comment threads if you use the /korbit-resolve command in any comment on your PR.
  • Chat with Korbit on issues we post by tagging @korbit-ai in your reply.
  • Help train Korbit to improve your reviews by giving a 👍 or 👎 on the comments Korbit posts.

Customizing Korbit

  • Check out our docs on how you can make Korbit work best for you and your team.
  • Customize Korbit for your organization through the Korbit Console.

Current Korbit Configuration

General Settings
Setting Value
Review Schedule Automatic excluding drafts
Max Issue Count 10
Automatic PR Descriptions
Issue Categories
Category Enabled
Naming
Database Operations
Documentation
Logging
Error Handling
Systems and Environment
Objects and Data Structures
Readability and Maintainability
Asynchronous Processing
Design Patterns
Third-Party Libraries
Performance
Security
Functionality

Feedback and Support

Note

Korbit Pro is free for open source projects 🎉

Looking to add Korbit to your team? Get started with a free 2 week trial here

I got a bit confused and reckless on
#31858, when I disabled many
cypress tests, many of which are or may be flaky at times, but in this
instance were probably triggered by some real issues in that PR.

Renabling them all and will monitor PRs and master merges to re-disable
the ones flaking as needed
@mistercrunch mistercrunch force-pushed the reenable-cypress-checks branch from 1107221 to e30a2e4 Compare January 29, 2025 06:09
Copy link
Member

@sadpandajoe sadpandajoe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@mistercrunch mistercrunch merged commit b12f515 into master Jan 30, 2025
47 checks passed
@mistercrunch mistercrunch deleted the reenable-cypress-checks branch January 30, 2025 07:29
@michael-s-molina
Copy link
Member

@mistercrunch This seems to have broken CI. Should we revert?

Screenshot 2025-01-30 at 12 07 14

@mistercrunch
Copy link
Member Author

mistercrunch commented Jan 30, 2025

Oh yes, this is due to checks being different on master and PRs, I was trying to address (amongst other things) a master-specific bug on retries, but flying blind. Let's revert for now.

I little while back we decided to only use the Cypress dashboard feature on master and on-demand, but there's a bug that's specific to retries on that side of the logic. I vote for having the same process on master and PRs, and keep the Cypress dashboard feature on-demand (workflow_dispatch) only.

All this started when we unknowingly accumulated significant costs related to our high usage last year, and decided to try and shut down the bulk of the load.

mistercrunch added a commit that referenced this pull request Jan 30, 2025
@mistercrunch
Copy link
Member Author

Revert is here -> #32045

tmsjordan pushed a commit to tmsdevelopment/superset that referenced this pull request Feb 1, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants