Skip to content

ci: GHA: use scripts/report-coverage.sh #6553

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Jan 24, 2020

Conversation

blueyed
Copy link
Contributor

@blueyed blueyed commented Jan 24, 2020

This allows for more control, e.g. -X fix with codecov-bash, and it has all the coverage-calls we need already etc.

@blueyed blueyed requested a review from nicoddemus January 24, 2020 11:55
@nicoddemus
Copy link
Member

TBH I prefer using the action instead of a custom script, so I'm -0 (but not completely opposed).

@blueyed
Copy link
Contributor Author

blueyed commented Jan 24, 2020

@nicoddemus
Why do you prefer the action? It wraps codecov-bash apparently also only (#6463 (comment)), while not handling e.g. retries which we have with our curl invocation already.
Also it seems to be basically a large, obfuscated code blob, while using the bash script ourselves is more transparent.
Additionally, it might result in differences with regard to what is reported between Travis and GHA.

blueyed added a commit to blueyed/pytest that referenced this pull request Jan 24, 2020
This should make it obvious if missing coverage is due to the upload
having failed.

Using pytest-dev#6553 would be an
alternative, but this can be used already if that takes longer.

Ref: pytest-dev#6463 (comment)
blueyed added a commit to blueyed/pytest that referenced this pull request Jan 24, 2020
This should make it obvious if missing coverage is due to the upload
having failed.

Using pytest-dev#6553 would be an
alternative, but this can be used already if that takes longer.

Ref: pytest-dev#6463 (comment)
@blueyed
Copy link
Contributor Author

blueyed commented Jan 24, 2020

Alternative: #6560 - but failed on the first run already, and then the 2nd..!

@blueyed blueyed force-pushed the ci-gha-use-report-coverage.sh branch 2 times, most recently from b5f9b8e to e5a362d Compare January 24, 2020 17:53
@nicoddemus
Copy link
Member

Actually it does retries automatically, I've seen it sleeping for 30s a number of times before trying to upload again before codecov doesn't respond.

Also it seems to be basically a large, obfuscated code blob, while using the bash script ourselves is more transparent.

Not sure if you mean the yaml configuration or the action code itself.

Additionally, it might result in differences with regard to what is reported between Travis and GHA.

But this is temporary, I hope. Which would be fine to narrow down why GH action coverage is less than Travis.

Like I said, I'm -0 on this, so please go ahead if think it is better. 👍

@blueyed blueyed merged commit 5dcd24f into pytest-dev:master Jan 24, 2020
@blueyed blueyed deleted the ci-gha-use-report-coverage.sh branch January 24, 2020 18:20
@blueyed
Copy link
Contributor Author

blueyed commented Jan 24, 2020

Not sure if you mean the yaml configuration or the action code itself.

The JS code (the action).

But this is temporary, I hope. Which would be fine to narrow down why GH action coverage is less than Travis.

Well, it also is helpful to have it failing. As seen in #6560 it failed twice in a row, which likely is the reason for flaky coverage.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants