[CI] Integrate Automated Test Coverage & XML Reporting#33
Open
aviralsaxena16 wants to merge 6 commits intoOSIPI:mainfrom
Open
[CI] Integrate Automated Test Coverage & XML Reporting#33aviralsaxena16 wants to merge 6 commits intoOSIPI:mainfrom
aviralsaxena16 wants to merge 6 commits intoOSIPI:mainfrom
Conversation
This was referenced Mar 3, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Resolves #30
Following the establishment of the backend CI pipeline #21 and the deterministic fixture framework #22 , this PR introduces the final foundational testing component: Visibility.
It adds visibility into code coverage metrics to identify testing blind spots and guide systematic reliability improvements.
Enhancements
pytest-covinto the CI matrix. The pipeline now automatically prints a--cov-report=term-missingtable directly in the GitHub Actions logs.app/code covered by our regression tests, and specifically which line numbers remain untested (as seen in the attached screenshot).coverage.xmlreport. This requires zero overhead right now but perfectly sets the stage for a 1-click integration with Codecov or Coveralls in the future.Why No Hard Threshold Yet?
To avoid unnecessarily failing the build for other contributors, I have intentionally omitted a hard
--cov-fail-underflag. This allows us to establish our current baseline coverage naturally. Once we are comfortable with the baseline, we can enforce a soft threshold (e.g., 70%) to prevent coverage from degrading as we scale toward DCE/DSC modalities.This PR builds upon the regression framework introduced in #22.
Local Coverage Run: