test: add Actions annotation output#34590
Closed
Uh oh!
There was an error while loading. Please reload this page.
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters
Collaborator
not lite ci: redacted to fix ncu |
nodejs-github-bot added meta 
mmarchiniforce-pushed the annotate-js-tests branch from 4a6e576 to 5bcf97eCompareUh oh!
There was an error while loading. Please reload this page.
Trott approved these changes Aug 5, 2020
It's possible to annotate failures in Actions by printing "::error file={},line={},col={}::{message}". This methos is preferrable over using a problem matcher because problem matchers only allow single-line messages, whereas ::error allows multi-line messages.mmarchiniforce-pushed the annotate-js-tests branch from 5bcf97e to 8815926Compare
richardlau approved these changes Aug 7, 2020
mmarchini added a commit that referenced this pull request Aug 7, 2020
It's possible to annotate failures in Actions by printing "::error file={},line={},col={}::{message}". This methos is preferrable over using a problem matcher because problem matchers only allow single-line messages, whereas ::error allows multi-line messages. PR-URL: #34590 Reviewed-By: Rich Trott <[email protected]> Reviewed-By: Richard Lau <[email protected]>
ContributorAuthor
mmarchini commented Aug 7, 2020
Landed in 46bef7b |
Member
addaleax commented Aug 8, 2020
@mmarchini This would need a manual backport to v14.x, unfortunately |
targos pushed a commit that referenced this pull request May 16, 2021
It's possible to annotate failures in Actions by printing "::error file={},line={},col={}::{message}". This methos is preferrable over using a problem matcher because problem matchers only allow single-line messages, whereas ::error allows multi-line messages. PR-URL: #34590 Reviewed-By: Rich Trott <[email protected]> Reviewed-By: Richard Lau <[email protected]>targos pushed a commit that referenced this pull request Jun 11, 2021
It's possible to annotate failures in Actions by printing "::error file={},line={},col={}::{message}". This methos is preferrable over using a problem matcher because problem matchers only allow single-line messages, whereas ::error allows multi-line messages. PR-URL: #34590 Reviewed-By: Rich Trott <[email protected]> Reviewed-By: Richard Lau <[email protected]>Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment
6 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
It's possible to annotate failures in Actions by printing
::error file={},line={},col={}::{message}. This methos is preferrable over using a problem matcher because problem matchers only allow single-line messages, whereas ::error allows multi-line messages.When the test being annotated is edited in a Pull Request, GitHub will show it inline where the error happened:
If the failing test was not edited, it will still be possible to see the error with the following steps:
The link on the annotation in this case will point to the last commit in the PR instead of pointing to the file (which is a bit unfortunate, but that's a GitHub Actions Runner limitation apparently). The filename on the annotation is still correct though, so this is still an improvement over the current situation where we need to look at the logs (which can be confusing for newcomers).
Checklist
make -j4 test(UNIX), orvcbuild test(Windows) passes