Skip to content

[SPARK-55286][INFRA] Add test summary to GitHub Actions for better failure visibility#54069

Closed
yaooqinn wants to merge 1 commit intoapache:masterfrom
yaooqinn:SPARK-55286-test-summary
Closed

[SPARK-55286][INFRA] Add test summary to GitHub Actions for better failure visibility#54069
yaooqinn wants to merge 1 commit intoapache:masterfrom
yaooqinn:SPARK-55286-test-summary

Conversation

@yaooqinn
Copy link
Copy Markdown
Member

What changes were proposed in this pull request?

This PR adds test-summary/action@v2 to GitHub Actions workflows to display test failures directly in the job summary.

Jobs updated:

  • build - Scala/Java unit tests
  • pyspark - Python tests
  • sparkr - R tests
  • tpcds - TPC-DS benchmark tests
  • docker-integration-tests - Docker integration tests

The action parses JUnit XML test reports and generates a summary table showing:

  • Failed tests grouped by class/suite name
  • Error messages and stack traces
  • Pass/fail/skip statistics

Why are the changes needed?

Currently, GitHub Actions CI generates verbose logs that make it hard to find test failures quickly. Developers have to scroll through extensive log output to identify which tests failed.

With this change, test failures appear directly in the GitHub Actions workflow summary, making it easy to identify failures at a glance.

Example output:

Result Test
org.apache.spark.sql.SomeTestSuite › testMethod1
org.apache.spark.sql.SomeTestSuite › testMethod2

Does this PR introduce any user-facing change?

No. This only affects the CI/CD workflow display.

How was this patch tested?

  • YAML syntax validated locally
  • The test-summary/action is a well-maintained GitHub Action with 1000+ stars
  • Uses if: always() to ensure summary is generated even when tests fail

Was this patch authored or co-authored using generative AI tooling?

Generated-by: GitHub Copilot

…ilure visibility

Add test-summary/action@v2 to display test failures directly in the
GitHub Actions job summary. This makes it easier to identify failures
without scrolling through verbose logs.

Jobs updated: build, pyspark, sparkr, tpcds, docker-integration-tests
@github-actions
Copy link
Copy Markdown

JIRA Issue Information

=== Improvement SPARK-55286 ===
Summary: [INFRA] Add test summary to GitHub Actions for better failure visibility
Assignee: None
Status: Open
Affected: ["4.2.0"]


This comment was automatically generated by GitHub Actions

@github-actions github-actions Bot added the INFRA label Jan 30, 2026
@yaooqinn
Copy link
Copy Markdown
Member Author

https://github.com/yaooqinn/spark/actions/runs/21505022749#summary-61961633818

After this change, you can view the test failure in summary instead of searching the console log.

Copy link
Copy Markdown

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR enhances GitHub Actions CI visibility by adding the test-summary/action@v2 to display test failures directly in workflow job summaries, eliminating the need to scroll through verbose logs.

Changes:

  • Added test-summary/action@v2 step to 5 test jobs (build, pyspark, sparkr, tpcds-1g, docker-integration-tests)
  • Configured action to parse JUnit XML reports from **/target/test-reports/*.xml and **/target/surefire-reports/*.xml
  • Used if: always() condition to ensure summaries are generated even when tests fail

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

@HyukjinKwon
Copy link
Copy Markdown
Member

Merged to master.

@yaooqinn yaooqinn deleted the SPARK-55286-test-summary branch February 2, 2026 05:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants