SE-0501: HTML coverage report - #9076
Draft
bkhouri wants to merge 1 commit into
Draft
Conversation
bkhouri
force-pushed
the
t/main/swift-testing-generate-covreport
branch
4 times, most recently
from
September 18, 2025 15:48
e5b2559 to
8761ac3
Compare
bkhouri
force-pushed
the
t/main/swift-testing-generate-covreport
branch
6 times, most recently
from
September 29, 2025 04:54
d184ab9 to
be05442
Compare
bkhouri
force-pushed
the
t/main/swift-testing-generate-covreport
branch
4 times, most recently
from
October 2, 2025 02:19
0f83da6 to
235517a
Compare
bkhouri
force-pushed
the
t/main/swift-testing-generate-covreport
branch
3 times, most recently
from
November 13, 2025 04:06
74feb40 to
f17b23d
Compare
bkhouri
force-pushed
the
t/main/swift-testing-generate-covreport
branch
from
November 18, 2025 16:51
f17b23d to
89f8663
Compare
bkhouri
force-pushed
the
t/main/swift-testing-generate-covreport
branch
from
November 19, 2025 17:51
b0d20ee to
e541cfe
Compare
bkhouri
force-pushed
the
t/main/swift-testing-generate-covreport
branch
2 times, most recently
from
January 12, 2026 07:25
f31c064 to
5b5935a
Compare
bkhouri
changed the title
bkhouri
changed the title
bkhouri
force-pushed
the
t/main/swift-testing-generate-covreport
branch
from
April 9, 2026 01:44
5b5935a to
5c884e0
Compare
bkhouri
force-pushed
the
t/main/swift-testing-generate-covreport
branch
2 times, most recently
from
May 5, 2026 13:38
65b5ef5 to
c0a054d
Compare
Contributor
Author
|
This PR is blocked on a Swift Argument Parser release which contains apple/swift-argument-parser#830 |
This was referenced May 25, 2026
bkhouri
added a commit
to bkhouri/swift
that referenced
this pull request
May 27, 2026
Update Swift Argument Parser to use release 1.8.1 to support SE-0501: HTML Coverage report Relates to: swiftlang/swift-package-manager#9076
bkhouri
added a commit
to bkhouri/swift
that referenced
this pull request
May 27, 2026
Update Swift Argument Parser to use release 1.8.1 to support SE-0501: HTML Coverage report Relates to: swiftlang/swift-package-manager#9076 (cherry picked from commit a914523)
bkhouri
added a commit
to bkhouri/swift
that referenced
this pull request
May 27, 2026
Update Swift Argument Parser to use release 1.8.1 to support SE-0501: HTML Coverage report Relates to: swiftlang/swift-package-manager#9076 (cherry picked from commit a914523)
bkhouri
force-pushed
the
t/main/swift-testing-generate-covreport
branch
from
May 30, 2026 06:47
c0a054d to
aac2de3
Compare
bkhouri
changed the title
bkhouri
force-pushed
the
t/main/swift-testing-generate-covreport
branch
from
May 30, 2026 19:02
aac2de3 to
b059f6e
Compare
bkhouri
added a commit
to bkhouri/swift
that referenced
this pull request
Jun 22, 2026
Update Swift Argument Parser to use release 1.8.1 to support SE-0501: HTML Coverage report Relates to: swiftlang/swift-package-manager#9076
bkhouri
added a commit
to bkhouri/swift
that referenced
this pull request
Jun 22, 2026
Update Swift Argument Parser to use release 1.8.1 to support SE-0501: HTML Coverage report Relates to: swiftlang/swift-package-manager#9076 (cherry picked from commit a914523)
bkhouri
added a commit
to bkhouri/swift
that referenced
this pull request
Jun 22, 2026
Update Swift Argument Parser to use release 1.8.1 to support SE-0501: HTML Coverage report Relates to: swiftlang/swift-package-manager#9076 (cherry picked from commit 9529cf5)
bkhouri
added a commit
to bkhouri/swift
that referenced
this pull request
Jun 29, 2026
Update Swift Argument Parser to use release 1.8.1 to support SE-0501: HTML Coverage report Relates to: swiftlang/swift-package-manager#9076
bkhouri
added a commit
to bkhouri/swift
that referenced
this pull request
Jun 29, 2026
Update Swift Argument Parser to use release 1.8.1 to support SE-0501: HTML Coverage report Relates to: swiftlang/swift-package-manager#9076 (cherry picked from commit a3e8cdf)
bkhouri
added a commit
to bkhouri/swift
that referenced
this pull request
Jun 29, 2026
Update Swift Argument Parser to use release 1.8.2 to support SE-0501: HTML Coverage report Relates to: swiftlang/swift-package-manager#9076
bkhouri
added a commit
to bkhouri/swift
that referenced
this pull request
Jun 29, 2026
Update Swift Argument Parser to use release 1.8.2 to support SE-0501: HTML Coverage report Relates to: swiftlang/swift-package-manager#9076 (cherry picked from commit 241fcbb)
bkhouri
added a commit
to bkhouri/swift
that referenced
this pull request
Jul 15, 2026
Update Swift Argument Parser to use release 1.8.2 to support SE-0501: HTML Coverage report Relates to: swiftlang/swift-package-manager#9076
bkhouri
added a commit
to bkhouri/swift
that referenced
this pull request
Aug 10, 2026
Update Swift Argument Parser to use release 1.8.2 for `main`, `rebranch` and `next` to support SE-0501: HTML Coverage report, and another proposal, allow for deprecating package products, which is currently in a pitch [1]. Relates to: swiftlang/swift-package-manager#9076 [1]: https://forums.swift.org/t/pitch-deprecating-package-products-in-the-package-manifest/88468/
Member
|
@bkhouri What is the latest on this? The evolution has been accepted but the implementation is still pending |
bkhouri
force-pushed
the
t/main/swift-testing-generate-covreport
branch
from
August 11, 2026 15:54
b059f6e to
a415f45
Compare
bkhouri
changed the title
Contributor
Author
@FranzBusch : This change required a feature in Swift Argument Parser 1.8.1, but that version requires being build with Swift 6.0. Building the toolchain on linux currently failed as the base version in the images uses Swift 5.x. So this PR is currently blocked on swiftlang/swift#89403. We need @shahmishal to update the Swift version used in the docker images used to build the Linux toolchain. |
Member
The Docker images were updated for |
bkhouri
force-pushed
the
t/main/swift-testing-generate-covreport
branch
from
August 13, 2026 19:34
a415f45 to
40e464d
Compare
Currently, `swift test` supports generating a JSON coverage report, which is great for ingesting into various systems. The JSON coverage report generation is processed by `llvm-cov`` where SwiftPM is simply orchestrating the command line invocation. The JSON, however, is not very "human consumable friendly" while iterating at-desk. This change adds an additional command line argument to swift test that allows specify whether to generate a JSON or HTML report. Selecting HTML will produce a `llvm-cov`` HTML report, that is more easily consumable by a developer at desk. Similar to the JSON coverage report, Swift Package Manager is only responsible for constructing the command line argument that will be passed to `llvm-cov``, which will produce the HTML report. Since `llvm-cov show` (which would produce the HTML) has numerous CLI arguments that allows configurations of the HTML report, this change supports `-Xcov` argument for specifying additional coverage report arguments.
bkhouri
force-pushed
the
t/main/swift-testing-generate-covreport
branch
from
August 14, 2026 21:47
40e464d to
de046a6
Compare
Contributor
Author
|
@swift-ci test |
Contributor
Author
|
@swift-ci test windows |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Currently,
swift testsupports generating a JSON coverage report, which is great for ingesting into various systems. The JSON coverage report generation is processed byllvm-covwhere SwiftPM is simply orchestrating the command line invocation. The JSON, however, is not very "human consumable friendly" while iterating at-desk.This change adds an additional command line argument to swift test that allows specify whether to generate a JSON or HTML report. Selecting HTML will produce a
llvm-covHTML report, that is more easily consumable by a developer at desk. Similar to the JSON coverage report, Swift Package Manager is only responsible for constructing the command line argument that will be passed tollvm-cov, which will produce the HTML report.Since
llvm-cov show(which would produce the HTML) has numerous CLI arguments that allows configurations of the HTML report, this change supports-Xcovargument for specifying additional coverage report arguments.See SE-0501: HTML Coverage Report and an update to the proposal
TODO:
-Xcovarguments to the JSON and HTML reportDepends on: apple/swift-argument-parser#830
Depends on: #9162
Depends on: #10146
Depends on: #10400
Depends on: swiftlang/swift#89403