Skip to content

Conversation

@sam-github
Copy link
Contributor

@sam-githubsam-github commented Feb 24, 2020

They fail on OS X 10.15 (aka "Catalina"), but pass on earlier OS X.

Refs: #30030
Refs: nodejs/build#2189 (comment)

Note: CI doesn't test on Catalina, yet (though I assume nodejs developers do). Test failures will indirectly block fixing of #29216, which requires running notarization on Catalina, which requires tests passing on Catalina.

Checklist
  • make -j4 test (UNIX), or vcbuild test (Windows) passes
  • tests and/or benchmarks are included
  • documentation is changed or added
  • commit message follows commit guidelines

They fail on OS X 10.15 (aka "Catalina"), but pass on earlier OS X. Refs: nodejs#30030 Refs: nodejs/build#2189 (comment)
@nodejs-github-botnodejs-github-bot added the test Issues and PRs related to the tests. label Feb 24, 2020
@sam-githubsam-github added the flaky-test Issues and PRs related to the tests with unstable failures on the CI. label Feb 24, 2020
@sam-github
Copy link
ContributorAuthor

I don't have access to a machine I can repro this on, but I asked @AshCripps to try it (nodejs/build#2189 (comment)). @lpinca , perhaps you can review, too?

@lpinca
Copy link
Member

lpinca commented Feb 24, 2020

I've run make -j8 test with the patch applied but the process still exits with 2 not sure if expected. All the tested listed here timeout as expected.

Copy link
Member

@AshCrippsAshCripps left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Works for me. @lpinca you have to run the tests manually using the python script to skip flaky-tests like the ci does:

bash-3.2$ tools/test.py --flaky-tests=skip [07:30|% 100|+ 2790|- 0]: Done bash-3.2$ 

@lpinca
Copy link
Member

Oh, I forgot to use the --flaky-tests flag.

@nodejs-github-bot
Copy link
Collaborator

@sam-github
Copy link
ContributorAuthor

@AshCripps would it be helpful to get this fast-tracked? I kicked of a full CI on it, but it still needs 25 hours, but we can fast-track given its triviality and impact on CI stability if its blocking bringing the OS X 10.15/Catalina machines into CI.

@AshCripps
Copy link
Member

@sam-github Fast track would be useful, pretty sure every release line will fail these tests when 10.15 is added to CI

@nodejs-github-bot
Copy link
Collaborator

@sam-github
Copy link
ContributorAuthor

@nodejs/build @nodejs/testing Can we fast-track marking these tests flaky?

@sam-githubsam-github added the fast-track PRs that do not need to wait for 48 hours to land. label Feb 25, 2020
@sam-github
Copy link
ContributorAuthor

Btw, the build status reported is incorrect - PR passed on everything but arm, as would be expected. I kicked a resume on the PR, though.

@nodejs-github-bot
Copy link
Collaborator

@sam-github
Copy link
ContributorAuthor

Landed in 24a4f76

sam-github added a commit that referenced this pull request Feb 26, 2020
They fail on OS X 10.15 (aka "Catalina"), but pass on earlier OS X. Refs: #30030 Refs: nodejs/build#2189 (comment) PR-URL: #31936 Reviewed-By: Luigi Pinca <[email protected]> Reviewed-By: Beth Griggs <[email protected]> Reviewed-By: James M Snell <[email protected]> Reviewed-By: Rod Vagg <[email protected]>
BethGriggs pushed a commit that referenced this pull request Feb 27, 2020
They fail on OS X 10.15 (aka "Catalina"), but pass on earlier OS X. Refs: #30030 Refs: nodejs/build#2189 (comment) PR-URL: #31936 Reviewed-By: Luigi Pinca <[email protected]> Reviewed-By: Beth Griggs <[email protected]> Reviewed-By: James M Snell <[email protected]> Reviewed-By: Rod Vagg <[email protected]>
codebytere pushed a commit that referenced this pull request Feb 27, 2020
They fail on OS X 10.15 (aka "Catalina"), but pass on earlier OS X. Refs: #30030 Refs: nodejs/build#2189 (comment) PR-URL: #31936 Reviewed-By: Luigi Pinca <[email protected]> Reviewed-By: Beth Griggs <[email protected]> Reviewed-By: James M Snell <[email protected]> Reviewed-By: Rod Vagg <[email protected]>
@codebyterecodebytere mentioned this pull request Feb 29, 2020
@sam-githubsam-github deleted the catalina-udp-flakes branch March 6, 2020 19:04
puzpuzpuz pushed a commit to puzpuzpuz/node that referenced this pull request Mar 8, 2020
They fail on OS X 10.15 (aka "Catalina"), but pass on earlier OS X. Refs: nodejs#30030 Refs: nodejs/build#2189 (comment) PR-URL: nodejs#31936 Reviewed-By: Luigi Pinca <[email protected]> Reviewed-By: Beth Griggs <[email protected]> Reviewed-By: James M Snell <[email protected]> Reviewed-By: Rod Vagg <[email protected]>
@puzpuzpuzpuzpuzpuz mentioned this pull request Mar 8, 2020
3 tasks
@BethGriggsBethGriggs mentioned this pull request Mar 12, 2020
codebytere pushed a commit that referenced this pull request Mar 14, 2020
They fail on OS X 10.15 (aka "Catalina"), but pass on earlier OS X. Refs: #30030 Refs: nodejs/build#2189 (comment) PR-URL: #31936 Reviewed-By: Luigi Pinca <[email protected]> Reviewed-By: Beth Griggs <[email protected]> Reviewed-By: James M Snell <[email protected]> Reviewed-By: Rod Vagg <[email protected]> PR-URL: #32146 Reviewed-By: Rich Trott <[email protected]> Reviewed-By: Vladimir de Turckheim <[email protected]> Reviewed-By: Stephen Belanger <[email protected]> Reviewed-By: Ruben Bridgewater <[email protected]> Reviewed-By: Shelley Vohr <[email protected]>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

fast-trackPRs that do not need to wait for 48 hours to land.flaky-testIssues and PRs related to the tests with unstable failures on the CI.testIssues and PRs related to the tests.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

8 participants

@sam-github@lpinca@nodejs-github-bot@AshCripps@jasnell@rvagg@BethGriggs@targos