Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

ci: output annotations for failures #3727

Merged
merged 3 commits into from
Mar 20, 2023
Merged

Conversation

crazy-max
Copy link
Member

@crazy-max crazy-max commented Mar 18, 2023

follow-up #2900 and #3411

Atm it's not easy to go through the logs and quickly find what tests are currently failing.

With this change we'll have GitHub annotations for failed tests directly reported in "Files changed" for a pull request.

Tested here: https://github.com/crazy-max/buildkit/pull/12/files

image


image


image

Signed-off-by: CrazyMax <crazy-max@users.noreply.github.com>
Signed-off-by: CrazyMax <crazy-max@users.noreply.github.com>
uses: actions/github-script@v6
name: Generate annotations
if: always()
uses: crazy-max/.github/.github/actions/gotest-annotations@main
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Using a remote composite action to reduce dedup. Will use a commit sha if we are ok with this implementation.

See https://github.com/crazy-max/.github#gotest-annotations

@crazy-max crazy-max marked this pull request as ready for review March 18, 2023 10:22
Atm it's not easy to go through the logs and quickly find what
tests are currently failing.

With this change we'll have GitHub annotations for failed tests
directly reported in the pull request.

Signed-off-by: CrazyMax <crazy-max@users.noreply.github.com>
@crazy-max
Copy link
Member Author

crazy-max commented Mar 20, 2023

Hum there's smth odd going on. https://github.com/moby/buildkit/actions/runs/4466712165/jobs/7845304694#step:7:1455 fails and annotation is generated but GitHub checks is green 🤔. Will look at this.

Edit: That's fine, we continue-on-error for nydus integration tests:

continue-on-error: ${{ matrix.tags == 'nydus' }}

@crazy-max crazy-max merged commit 35287b9 into moby:master Mar 20, 2023
@crazy-max crazy-max deleted the test-annotations branch March 20, 2023 10:16
# for free to join this conversation on GitHub. Already have an account? # to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants