Skip to content

Improve mutation tests performance by ensuring solution file isn't discovered#2589

Merged
martincostello merged 1 commit into
App-vNext:mainfrom
slang25:slang25-patch-1
Apr 14, 2025
Merged

Improve mutation tests performance by ensuring solution file isn't discovered#2589
martincostello merged 1 commit into
App-vNext:mainfrom
slang25:slang25-patch-1

Conversation

@slang25

@slang25 slang25 commented Apr 14, 2025

Copy link
Copy Markdown
Contributor

I was doing some testing locally and I've noticed that what is happening with the Cake build script is that when mutation tests are triggered, because they are launched from the root of the repo, the solution file is automatically detected which causes all tests to run.

This should limit each mutation test to only run the tests from the matching project.

@codecov

codecov Bot commented Apr 14, 2025

Copy link
Copy Markdown

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 96.23%. Comparing base (e15a4a0) to head (f47cc29).
Report is 1 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #2589   +/-   ##
=======================================
  Coverage   96.23%   96.23%           
=======================================
  Files         311      311           
  Lines        7327     7327           
  Branches     1013     1013           
=======================================
  Hits         7051     7051           
  Misses        222      222           
  Partials       54       54           
Flag Coverage Δ
linux 96.23% <ø> (ø)
macos 96.23% <ø> (ø)
windows 96.22% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@martincostello

Copy link
Copy Markdown
Member

Nice find - feels like a bit of a footgun on the part of Stryker to do that given that it was given a specific project, but 10 minutes less runtime is a definite improvement.

@martincostello martincostello merged commit e5a8c40 into App-vNext:main Apr 14, 2025
@martincostello martincostello added this to the v8.5.3 milestone Apr 15, 2025
@github-actions

Copy link
Copy Markdown
Contributor

Thanks for your contribution @slang25 - the changes from this pull request have been published as part of version 8.6.0 📦, which is now available from NuGet.org 🚀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants