Skip to content

docs: update incremental benchmarks (3.9.1)#879

Merged
carlos-alm merged 2 commits intomainfrom
benchmark/incremental-v3.9.1-20260406-070204
Apr 6, 2026
Merged

docs: update incremental benchmarks (3.9.1)#879
carlos-alm merged 2 commits intomainfrom
benchmark/incremental-v3.9.1-20260406-070204

Conversation

@github-actions
Copy link
Copy Markdown
Contributor

@github-actions github-actions bot commented Apr 6, 2026

Automated incremental benchmark update for 3.9.1 from workflow run #667.

@greptile-apps
Copy link
Copy Markdown
Contributor

greptile-apps bot commented Apr 6, 2026

Greptile Summary

This PR adds automated incremental benchmark results for codegraph v3.9.1 (570 files, measured 2026-04-06), generated by workflow run #667.

  • Native full-build improved 20% (6.5s → 5.2s) while WASM held roughly flat (6.8s → 6.9s)
  • The native incremental-rebuild regression (1-file: 527ms → 757ms, no-op: 6ms → 15ms) is already tracked in issue perf: investigate native engine incremental rebuild regression in v3.9.1 #882 — no new action needed here
  • All percentage-change annotations in the summary table are mathematically consistent with the underlying raw JSON values (e.g. nativeBatchMs 5.1ms → 7ms = +37.25% ≈ ↑37%; jsFallbackMs 10.8ms → 12.2ms = +12.96% ≈ ↑13%)
  • Import-resolution speedup ratio correctly updated from 2.1x to 1.7x to reflect the new 7ms / 12.2ms timing ratio

Confidence Score: 5/5

Safe to merge — documentation-only update with correct, internally consistent benchmark data.

No code is changed. All numeric values and percentage deltas have been verified against the raw embedded JSON. The only notable regression (native incremental rebuild) was already flagged and tracked in issue #882 before this review. No new issues found.

No files require special attention.

Important Files Changed

Filename Overview
generated/benchmarks/INCREMENTAL-BENCHMARKS.md Automated 3.9.1 benchmark data appended; summary table percentage deltas and embedded raw JSON are internally consistent

Flowchart

%%{init: {'theme': 'neutral'}}%%
flowchart TD
    A[CI Workflow Run #667] --> B[Run codegraph on its own codebase]
    B --> C{Engine}
    C -->|Native Rust| D[Full: 5.2s\nNo-op: 15ms\n1-file: 757ms]
    C -->|WASM| E[Full: 6.9s\nNo-op: 14ms\n1-file: 603ms]
    D --> F[Import resolution\nNative: 7ms / JS: 12.2ms\nSpeedup: 1.7x]
    E --> F
    F --> G[Generate INCREMENTAL-BENCHMARKS.md]
    G --> H[PR 879: docs: update incremental benchmarks 3.9.1]
Loading

Reviews (2): Last reviewed commit: "docs: update incremental benchmarks (3.9..." | Re-trigger Greptile

Comment on lines +9 to +10
| 3.9.1 | native | 570 | 5.2s ↓20% | 15ms ↑150% | 757ms ↑44% | 7ms ↑37% | 12ms ↑13% |
| 3.9.1 | wasm | 570 | 6.9s ↑2% | 14ms ↑17% | 603ms ↑11% | 7ms ↑37% | 12ms ↑13% |
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Native incremental builds slower than WASM

The 3.9.1 data shows the native engine's 1-file rebuild (757ms) is now 25% slower than WASM (603ms). In prior releases the two engines were roughly at parity for incremental builds (3.9.0: native 527ms vs WASM 541ms). Combined with the no-op rebuild regression (6ms → 15ms, +150%), this suggests the native engine may have a performance issue introduced in 3.9.1 specifically in the incremental code path.

This PR correctly records the measured data, but it may be worth opening a follow-up issue to investigate the root cause before the next release.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good catch. Opened #882 to track investigating the native incremental rebuild regression before the next release. Since this PR only records the measured data (which is correct), merging as-is and addressing the root cause separately.

@carlos-alm
Copy link
Copy Markdown
Contributor

@greptileai

@carlos-alm carlos-alm merged commit 1cf2910 into main Apr 6, 2026
10 of 13 checks passed
@carlos-alm carlos-alm deleted the benchmark/incremental-v3.9.1-20260406-070204 branch April 6, 2026 07:35
@github-actions github-actions bot locked and limited conversation to collaborators Apr 6, 2026
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant