Skip to content

[WIP] Add checkpoint stress benchmarks and CI gates#630

Draft
svarlamov wants to merge 2 commits intomainfrom
codex/checkpoint-stress-benchmarks
Draft

[WIP] Add checkpoint stress benchmarks and CI gates#630
svarlamov wants to merge 2 commits intomainfrom
codex/checkpoint-stress-benchmarks

Conversation

@svarlamov
Copy link
Copy Markdown
Member

Summary\n- add a new brutal checkpoint benchmark harness with absolute p99 gates\n- benchmark basic checkpoint scenario (~100 files, <1k lines) with p99 < 100ms target\n- benchmark long-history churn scenario (100 files x 10k lines x 100 checkpoint series) with p99 < 250ms target\n- run the full checkpoint stress gate in PR and nightly performance workflows\n\n## Notes\n- this is intentionally a red-team workload and expected to be punishing\n- local full run currently fails both thresholds on this branch\n\n## Local full-run result snapshot\n- basic_checkpoint p99: 214.885ms (target <100ms)\n- churn_long_history_checkpoint p99: 371.939ms (target <250ms)\n

@git-ai-cloud-dev
Copy link
Copy Markdown

git-ai-cloud-dev Bot commented Mar 4, 2026

Stats powered by Git AI

🧠 you    ███████████████████░  94%
🤖 ai     ░░░░░░░░░░░░░░░░░░░█  6%
More stats
  • 1.0 lines generated for every 1 accepted
  • 0 seconds waiting for AI
  • Top model: codex::gpt-5.3-codex (59 accepted lines, 59 generated lines)

AI code tracked with git-ai

@git-ai-bot-svarlamov-dev
Copy link
Copy Markdown

Stats powered by Git AI

🧠 you    ███████████████████░  94%
🤖 ai     ░░░░░░░░░░░░░░░░░░░█  6%
More stats
  • 1.0 lines generated for every 1 accepted
  • 0 seconds waiting for AI
  • Top model: codex::gpt-5.3-codex (59 accepted lines, 59 generated lines)

AI code tracked with git-ai

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant