Repository navigation
Compare project coverage per Codecov flag - #954
Merged
Merged
Conversation
The project status now compares the unit-tests flag and the nightly flag separately, each against the same flag on the base. The combined report on a main commit whose nightly session is carried forward does not equal the union of its own flag reports, so the combined comparison could fail on lines a PR never touched while both flags rose. Each flag compares like with like: the main baseline and the PR run the same unit selection, and nightly compares with nightly. codecov/project keeps its name and now reads the unit-tests flag; codecov/project/nightly is new.
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #954 +/- ##
=======================================
Coverage 95.53% 95.54%
=======================================
Files 127 127
Lines 21160 21160
Branches 3595 3595
=======================================
+ Hits 20216 20217 +1
+ Misses 944 943 -1
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Harness. 🚀 New features to boost your workflow:
|
8 tasks done
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
codecov/projectfailed on #952 and #953 although both raised coverage in each flag (unit tests 92.14 to 92.15 and 92.16 %, nightly 95.45 to 95.52 and 95.53 %) and neither touched the lines it reported. On a main commit whose nightly session is carried forward, the combined Codecov report is not the union of its two flag reports: on a2c5c17, eight branch statements ininterior_energeticscount as hit or partial in the combined report and as missed in both theunit-testsand thenightlyview. A PR head with real uploads then reads lower. Once main gets its own nightly upload the combined report agrees with the flags again (26f73aa: 11 mismatched lines before its nightly upload, 0 after).This PR compares project coverage per flag, so each flag compares like with like:
codecov/projectkeeps its name and reads theunit-testsflag.codecov/project/nightlyis new and reads thenightlyflag. Until the branch nightly has run, the head carries the nightly data of the base as it was at the head's first upload, so it can differ from the base if main got a newer nightly in between; the branch nightly settles it.codecov/patchis unchanged and still reads all flags. Targets are unchanged.A PR whose new code only the smoke or slow tiers cover now shows a lower
codecov/project;codecov/project/nightlyshows that code once the branch nightly has run.Validation of changes
codecov.ymlpasses codecov.io/validate.codecov/project92.15 % (+0.00 %),codecov/project/nightly95.44 % (+0.00 %) without a branch nightly, and 95.53 % (+0.08 %) after it. The combined total on that branch fell from 95.56 to 95.53 %, which is the case that failed Require fwl-aragog 26.10.03 #952.codecov/project92.16 % (+0.00 %);codecov/project/nightlyread 95.44 % (-0.09 %) before the branch nightly, because the head's first upload came before main's own nightly, and 95.53 % (+0.00 %) after it.Checklist