Consolidate E2E test suite into cli repo

[khaong]

Summary

• Moves the consolidated E2E test suite from entire-cli-e2e-tests into e2e/ as the single E2E suite
• Removes the old shadow-hook based suite at cmd/entire/cli/e2e_test/
• Updates mise tasks to point at new e2e/tests/... path with optional filter args

What's in e2e/

• 3 agents: Claude Code, Gemini CLI, OpenCode — all run via ForEachAgent
• E2E_AGENT env var for CI matrix targeting (when set, only matching agent registers)
• //go:build e2e tag on all test files (invisible to normal go build/go test)
• 37 tests covering: single/multi session, auto-commit, attribution, rewind, stash workflows, split commits, subagent flows, session lifecycle, edge cases, checkpoint metadata validation
• Artifact capture (git log, tree, checkpoint metadata, entire logs, console transcript) for failure debugging
• exploratory/ directory for on-demand test scenarios not run by CI

Key design decisions

• Always uses os.MkdirTemp instead of t.TempDir() — Go's nested subtest dirs confuse some agents' path resolution
• OpenCode gets opencode.json config written to allow external_directory permission in non-interactive mode
• filepath.EvalSymlinks resolves macOS /var → /private/var so agent CLIs see consistent paths

Test plan

• mise run test:e2e:claude TestSingleSessionManualCommit — PASS
• mise run test:e2e:opencode TestSingleSessionManualCommit — PASS
• go build ./... — clean (e2e tests invisible without build tag)
• go test -tags=e2e -list '.*' ./e2e/tests/... — all 37 tests listed
• Full suite run against Claude
• Full suite run against Gemini
• Full suite run agains Opencode
• CI workflow update

🤖 Generated with Claude Code

[cursor]

PR Summary

Medium Risk
Moderate risk due to large test-suite relocation and CI workflow changes (new dependencies, agent initialization/auth, and artifact handling) that could cause flaky or failing E2E runs despite no core runtime logic changes.

Overview
Migrates E2E coverage into a new top-level e2e/ suite (agents + shared testutil + entire CLI wrapper) and deletes the previous cmd/entire/cli/e2e_test/ shadow-hook based harness and scenarios.

Adds a tmux-driven interactive runner and per-agent registration/gating (Claude/Gemini/OpenCode), plus a new set of //go:build e2e tests that exercise checkpointing/rewind/attribution and various commit flows using the real entire binary.

Updates the GitHub Actions e2e.yml workflow to install tmux, build/install entire, warm up OpenCode, configure Claude API-key auth, write artifacts to E2E_ARTIFACT_DIR, and upload them; also updates linting exclusions for e2e/ and ignores e2e/artifacts/ in git.

^{Written by Cursor Bugbot for commit ed6e83c. Configure here.}

[Copilot]

Pull request overview

This PR consolidates E2E test infrastructure by moving the comprehensive test suite from a separate repository into e2e/ within the CLI repo, replacing the older shadow-hook based suite at cmd/entire/cli/e2e_test/.

Changes:

• Adds new consolidated E2E test suite in e2e/ with 37 tests covering single/multi-session workflows, auto-commit, attribution, rewind, stash, split commits, and edge cases
• Removes old shadow-hook based E2E suite from cmd/entire/cli/e2e_test/
• Updates mise tasks to point at e2e/tests/... with optional filter arguments for running specific tests

Reviewed changes

Copilot reviewed 40 out of 41 changed files in this pull request and generated no comments.

Show a summary per file

File	Description
mise.toml	Updates E2E test tasks to target new e2e/tests/... path with filter arguments
e2e/testutil/repo.go	Core test utilities for repo setup, agent execution, and git operations
e2e/testutil/metadata.go	Checkpoint and session metadata structures for validation
e2e/testutil/assertions.go	Test assertion helpers for checkpoint validation and verification
e2e/testutil/artifacts.go	Artifact capture system for debugging failed tests
e2e/tests/*.go	37 comprehensive E2E tests across multiple workflow scenarios
e2e/agents/*.go	Agent abstraction layer supporting Claude Code, Gemini CLI, and OpenCode
e2e/entire/entire.go	CLI wrapper functions for entire commands in tests
cmd/entire/cli/e2e_test/*.go	Removed old E2E test suite files (11 files deleted)
.gitignore	Adds e2e/artifacts/ to ignored files

[khaong]

bugbot run

[cursor]

Cursor Bugbot has reviewed your changes and found 4 potential issues.

^{Bugbot Autofix is OFF. To automatically fix reported issues with Cloud Agents, enable Autofix in the Cursor dashboard.}

Comment @cursor review or bugbot run to trigger another review on this PR

[Soph]

I tried this locally, and I couldn't get it to work at all :(

Claude thinks:

⏺ That's the bug. StartSession has the comment:
  // Locally, we skip CLAUDE_CONFIG_DIR so the Keychain-based auth works.

  But RunPrompt always sets CLAUDE_CONFIG_DIR, even locally. On macOS, Claude Code uses Keychain for auth, which is tied to the default ~/.claude path. When you override CLAUDE_CONFIG_DIR to a temp dir, Claude Code can't find auth credentials in the Keychain for that path → "Not logged in".

  RunPrompt needs the same CI-only guard that StartSession has. But this is the branch author's code, not ours. Do you want me to fix it, or flag it to the branch author?

I'm not sure if this is a me thing or why it works for you, so stopping trying to fix it :(

Also:

1. files_touched per-checkpoint validation is gone from most tests
2. Shadow branch cleanup checks are gone
3. Subagent task checkpoint fields not validated (to be fair, those were logs only so fine to skip them)

And last but not least: it's just testing the binary in path, I feel mise run test:e2e makes it look like if it would test what's checked out and that's what we should do, right?

[khaong]

I tried this locally, and I couldn't get it to work at all :(

Claude thinks:

⏺ That's the bug. StartSession has the comment:
  // Locally, we skip CLAUDE_CONFIG_DIR so the Keychain-based auth works.

  But RunPrompt always sets CLAUDE_CONFIG_DIR, even locally. On macOS, Claude Code uses Keychain for auth, which is tied to the default ~/.claude path. When you override CLAUDE_CONFIG_DIR to a temp dir, Claude Code can't find auth credentials in the Keychain for that path → "Not logged in".

  RunPrompt needs the same CI-only guard that StartSession has. But this is the branch author's code, not ours. Do you want me to fix it, or flag it to the branch author?

I'm not sure if this is a me thing or why it works for you, so stopping trying to fix it :(

Also:

1. files_touched per-checkpoint validation is gone from most tests
2. Shadow branch cleanup checks are gone
3. Subagent task checkpoint fields not validated (to be fair, those were logs only so fine to skip them)

And last but not least: it's just testing the binary in path, I feel mise run test:e2e makes it look like if it would test what's checked out and that's what we should do, right?

@Soph - Yup, it was a real problem 🤦‍♂️

It turns out that I've got my claude set up just a little bit different to the 'standard OAuth' flow.

Thanks to @dvydra @toothbrush we've got to the bottom of it and fixed some other 'user scope' transgressions the tests were doing.

I think longer term we want to move these tests to docker in any case, just to be 100% certain about blast radius.

[khaong]

@Soph and as for the other points:

1. files_touched per-checkpoint validation

TestCheckpointMetadataDeepValidation validates files_touched end-to-end, and the assertion helpers (AssertCheckpointFilesTouched, AssertCheckpointFilesTouchedContains) are available for any test that needs them. Detailed per-field checkpoint validation is also covered extensively in integration tests (17 test files in cmd/entire/cli/integration_test/).

2. Shadow branch cleanup checks

TestShadowBranchCleanedAfterAgentCommit covers the e2e path. Detailed shadow branch lifecycle is covered in integration tests.

3. Testing the binary in PATH

Intentional design - the suite is meant to run against any installed binary for version comparison and regression detection. TestMain prints the version and stamps entire-version.txt into the artifact dir. Also added the version to the mise task output so it's explicit upfront what binary is being tested.