Hive
Support test coverage analysis when running tests selectively
GitHub issue · Open
Why is this needed?
Test coverage tools assume you always run all the tests. However, that’s not the case with selective testing, where only a subset of them run. Therefore, there’s value in us providing coverage data taking into account the tests that have been selected.
Investigate, reproduce, or fix this item in an isolated repository. Each Flight preserves its outcome and agent session.
Start a Flight and preserve its objective, outcome, and session here.
we have a dashboard that tracks coverage per module per branch but main is the only one that provides “true” coverage for the whole module since we run tests for the entire module there. prior to selective testing we also had a bot that would hit the metrics server and grab the diff to main and post it as a comment, but that’s useless ever since enabling selective testing.