Skip to content

Temporarily disable tests depending on SSH#1124

Closed
europaul wants to merge 3 commits intolf-edge:masterfrom
europaul:temporarily-disable-tests
Closed

Temporarily disable tests depending on SSH#1124
europaul wants to merge 3 commits intolf-edge:masterfrom
europaul:temporarily-disable-tests

Conversation

@europaul
Copy link
Copy Markdown
Contributor

Since SSH to EVE doesn't work reliably, we're going to disable the flaky tests that rely on it

  • vector
  • log_test

Also this PR fixes two other flaky tests (see the respective commits for details):

  • metadata
  • ctrl_cert_change

europaul and others added 3 commits March 25, 2026 14:50
SSH to EVE is unreliable, causing both
tests to fail consistently. Disable them in the smoke suite until the
underlying EVE SSH issue is resolved.

See lf-edge#1123

Signed-off-by: Paul Gaiduk <paulg@zededa.com>
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
The metadata test's ssh.sh script was given only 5 minutes to connect
to the app's SSH, but the port forwarding chain (host → QEMU → EVE
portmap → app) can take longer to become operational. All SSH attempts
showed "Connection timed out during banner exchange", meaning TCP
connected but EVE's portmap to the app wasn't ready yet.

Increase the timeout to 20 minutes, matching eclient.txt which uses the
same SSH retry pattern with a 20-minute timeout.

Signed-off-by: Paul Gaiduk <paulg@zededa.com>
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
The check_sign_cert.sh script would break out of the retry loop as
soon as it found any JSON cert files, then pick the last one
alphabetically. When multiple certs existed (old + new), this could
pick the old cert since filenames are hashes with no meaningful order.

Restructure the script to compare each extracted cert against the
expected cert inside the retry loop, and keep retrying until a match
is found or the 2-minute exec timeout is reached.

Also redirect stderr from ls to /dev/null to prevent SSH error output
from polluting the certfiles list.

Signed-off-by: Paul Gaiduk <paulg@zededa.com>
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@europaul europaul requested a review from uncleDecart as a code owner March 25, 2026 13:56
@milan-zededa
Copy link
Copy Markdown
Contributor

Since SSH to EVE doesn't work reliably

Is it the SSH connectivity that is flaky or sshd logging something when new client connects?

@europaul
Copy link
Copy Markdown
Contributor Author

@milan-zededa I think it's the SSH connectivity, but now that TestEdenScripts/ssh fail on all runs I don't even know anymore 🙈

Copy link
Copy Markdown
Contributor

@eriknordmark eriknordmark left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

FWIW the changes to ctrl_cert_change and metadata look fine.
But the ssh root cause is evasive.

@europaul
Copy link
Copy Markdown
Contributor Author

@milan-zededa I blame everything on the runners - I tested on the self-hosted setup https://github.com/europaul/eden/actions/runs/23492857272/job/68365581145?pr=2 - everything works

so my plan is to wait until #1125 is merged, rebase and profit

@eriknordmark
Copy link
Copy Markdown
Contributor

so my plan is to wait until #1125 is merged, rebase and profit

#1125 has merged so can you rebase this one and change to have the improvements but not the disable of vector and log tests.

@europaul
Copy link
Copy Markdown
Contributor Author

europaul commented Apr 9, 2026

I'm gonna close this PR in favor of #1123

@europaul europaul closed this Apr 9, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants