[system_tests] Fix flaky IAST standalone tests via library_interface_timeout#6377
[system_tests] Fix flaky IAST standalone tests via library_interface_timeout#6377vlad-scherbich wants to merge 16 commits intomainfrom
Conversation
|
|
|
✅ Tests 🎉 All green!❄️ No new flaky tests detected 🔗 Commit SHA: 26cff74 | Docs | Datadog PR Page | Was this helpful? React with 👍/👎 or give us feedback! |
8f85efa to
b048484
Compare
8ffe6ab to
1cdbc66
Compare
There was a problem hiding this comment.
💡 Codex Review
Here are some automated review suggestions for this pull request.
Reviewed commit: 1cdbc66095
ℹ️ About Codex in GitHub
Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".
6e3aa92 to
ef911ea
Compare
ef911ea to
ca1185b
Compare
Pull request was converted to draft
d216ed3 to
06e22f4
Compare
There was a problem hiding this comment.
💡 Codex Review
Here are some automated review suggestions for this pull request.
Reviewed commit: 06e22f4288
ℹ️ About Codex in GitHub
Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".
e4fa7a2 to
0dbceb0
Compare
…sts from their setup funcs
0dbceb0 to
4b11b29
Compare
Motivation
Flaky tests in
test_asm_standalone.py::Test_IastStandalone_UpstreamPropagation_V2(e.g.test_no_appsec_upstream__no_asm_event__is_kept_with_priority_1__from_0). See PROF-13796.Root cause: traces sometimes weren't flushed to the agent before the scenario shut down the weblog. The tracer sends traces asynchronously; without enough delay, traces could still be buffered when containers stop.
Changes
iast_standalonescenario (utils/_context/_scenarios/__init__.py): Setlibrary_interface_timeout=15so the tracer has 15 seconds to flush traces before the weblog shuts down.test_asm_standalone.py: Remove the per-setup_iast_standalone_wait_for_tracepoll loop. Per-review feedback: avoidwait_forin setup functions (makes the scenario slow when many tests run). Use the globallibrary_interface_timeoutinstead—one delay before shutdown achieves the same effect.Reviewer checklist
tests/ormanifests/is modified ? I have the approval from R&P teambuild-XXX-imagelabel is present