Skip to content

[system_tests] Fix flaky debugger tests#6393

Draft
vlad-scherbich wants to merge 2 commits intomainfrom
vlad/system-tests-fix-debugger-test-flakes
Draft

[system_tests] Fix flaky debugger tests#6393
vlad-scherbich wants to merge 2 commits intomainfrom
vlad/system-tests-fix-debugger-test-flakes

Conversation

@vlad-scherbich
Copy link
Contributor

@vlad-scherbich vlad-scherbich commented Feb 27, 2026

https://datadoghq.atlassian.net/browse/PROF-13796

Motivation

While iterating on PR #6377 (IAST standalone fix), CI repeatedly failed on debugger scenarios (DEBUGGER_TELEMETRY, DEBUGGER_PII_REDACTION, DEBUGGER_PROBES_SNAPSHOT_WITH_SCM, DEBUGGER_SYMDB) across dotnet, java, golang, and python jobs.

Fixing them now to reduces CI noise.

Changes

  • DebuggerScenario (utils/_context/_scenarios/debugger.py): library_interface_timeout 5 → 15 seconds for all debugger scenarios.
  • debugger_telemetry scenario (utils/_context/_scenarios/__init__.py): library_interface_timeout 5 → 20 seconds (dotnet needs more time for RC + telemetry).
  • test_debugger_telemetry.py: Add explicit wait_for_telemetry timeouts (5s default, 25s for dotnet).
  • test_debugger_pii.py:
    • Add wait_for_all_probes(statuses=["EMITTING"]) in the retry loop.
    • Add defensive check for missing probe snapshots before iterating (clear AssertionError instead of KeyError).

Reviewer checklist

  • Anything but tests/ or manifests/ is modified ? I have the approval from R&P team
  • A docker base image is modified?
    • the relevant build-XXX-image label is present
  • A scenario is added, removed or renamed?

@github-actions
Copy link
Contributor

github-actions bot commented Feb 27, 2026

CODEOWNERS have been resolved as:

tests/debugger/test_debugger_pii.py                                     @DataDog/debugger @DataDog/system-tests-core
tests/debugger/test_debugger_telemetry.py                               @DataDog/debugger @DataDog/system-tests-core
utils/_context/_scenarios/__init__.py                                   @DataDog/system-tests-core
utils/_context/_scenarios/debugger.py                                   @DataDog/system-tests-core

@datadog-datadog-prod-us1-2

This comment has been minimized.

@vlad-scherbich vlad-scherbich force-pushed the vlad/system-tests-fix-debugger-test-flakes branch from 1821224 to 8e6f676 Compare March 5, 2026 16:59
@vlad-scherbich vlad-scherbich changed the title Vlad/system tests fix debugger test flakes [system_tests] Fix flaky debugger tests Mar 5, 2026
@vlad-scherbich vlad-scherbich force-pushed the vlad/system-tests-fix-debugger-test-flakes branch from 8e6f676 to d427e21 Compare March 5, 2026 17:17
@vlad-scherbich vlad-scherbich requested review from a team and taegyunkim March 5, 2026 17:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant