-
Notifications
You must be signed in to change notification settings - Fork 276
Description
Test Results — 2026-03-04
Overall Status: PARTIAL (all non-skipped tests passed, #17 skipped)
PR Used for Review Testing: #19576 (Update CLI versions)
Run: §22667873177
Core Tests (#1–10)
| # | Test | Result |
|---|---|---|
| 1 | GitHub MCP Testing (last 2 merged PRs: #19570, #19539) | ✅ |
| 2 | Safe Inputs GH CLI (queried PRs #19585, #19584) | ✅ |
| 3 | Serena MCP (activated project; find_symbol returned 92k+ chars of symbols) |
✅ |
| 4 | Make Build (make build succeeded, binary compiled) |
✅ |
| 5 | Playwright (github.com title: "GitHub · Change is constant…") | ✅ |
| 6 | Tavily Web Search ("GitHub Agentic Workflows" returned 3 results) | ✅ |
| 7 | File Writing (/tmp/gh-aw/agent/smoke-test-claude-22667873177.txt created) |
✅ |
| 8 | Bash Tool (file content verified via cat) |
✅ |
| 9 | Discussion Interaction (discussion #19578, comic-book comment added) | ✅ |
| 10 | Agentic Workflows MCP (smoke-claude: active, compiled, every 12h) |
✅ |
PR Review Safe Output Tests (#11–17)
| # | Test | Result |
|---|---|---|
| 11 | Update PR body (appended test message) | ✅ |
| 12 | PR Review Comments (2 comments on 2 different files) | ✅ |
| 13 | Submit PR Review (COMMENT review submitted) | ✅ |
| 14 | Resolve Review Thread (PRRT_kwDOPc1QR85yCkfW resolved) |
✅ |
| 15 | Add Reviewer (copilot added) |
✅ |
| 16 | Push to PR Branch (smoke test file committed and pushed) | ✅ |
| 17 | Close PR |
Test Details
Test #3 — Serena: Project activated at /home/runner/work/gh-aw/gh-aw (Go, TypeScript, Bash). find_symbol("main") returned 92,548 chars of results (many symbols found).
Test #4 — Make Build: Output: go build -ldflags "-s -w -X main.version=cc1817c" -o gh-aw ./cmd/gh-aw — success.
Test #5 — Playwright: Page title: "GitHub · Change is constant. GitHub keeps you ahead. · GitHub" ✅
Test #6 — Tavily: Top result: "My Experience with GitHub Agentic Workflows" (score: 0.9999924).
Test #10 — Agentic Workflows: smoke-claude workflow: engine=claude, compiled=Yes, status=active, triggers: PR (label: smoke), reaction: heart, schedule every 12h.
Test #12 — Review Comments:
.changeset/patch-update-cli-versions-20260304.mdline 3: changeset type feedback.github/workflows/agent-performance-analyzer.lock.ymlline 75: version bump note
Test #16 — Push: smoke-test-push-22667873177.txt committed and pushed to copilot/update-cli-versions.
💥 [THE END] — Illustrated by Smoke Claude · ◷
- expires on Mar 4, 2026, 1:53 PM UTC