Skip to content

test(acceptance): skip flaky focus-related tests in concepts#3828

Open
rohitpaulk wants to merge 1 commit intomainfrom
skip-flaky-focus-tests
Open

test(acceptance): skip flaky focus-related tests in concepts#3828
rohitpaulk wants to merge 1 commit intomainfrom
skip-flaky-focus-tests

Conversation

@rohitpaulk
Copy link
Copy Markdown
Member

@rohitpaulk rohitpaulk commented Mar 13, 2026

Mark several focus- and keyboard-interaction tests in concepts-test.js as
skipped due to intermittent failures in CI. These tests frequently fail
because expected elements are not focused or found, causing flakiness.

Skipping these tests improves CI stability while investigating the root cause.


Note

Low Risk
Low risk: only test suite behavior changes by skipping several flaky focus/keyboard interaction acceptance tests; no production code is modified.

Overview
Reduces CI flakiness by converting several focus- and keyboard-navigation assertions in tests/acceptance/concepts-test.js from test to skip, with inline comments documenting intermittent failures (missing focus / missing focusedOption).

Updates the QUnit import to include skip so these acceptance tests are no longer executed until the underlying focus issues are addressed.

Written by Cursor Bugbot for commit 75f57ac. This will update automatically on new commits. Configure here.

Mark several focus- and keyboard-interaction tests in concepts-test.js as 
skipped due to intermittent failures in CI. These tests frequently fail 
because expected elements are not focused or found, causing flakiness.

Skipping these tests improves CI stability while investigating the root cause.
@codecov
Copy link
Copy Markdown

codecov Bot commented Mar 13, 2026

Bundle Report

Changes will decrease total bundle size by 1.64kB (-0.0%) ⬇️. This is within the configured threshold ✅

Detailed changes
Bundle name Size Change
client-array-push 39.42MB -1.64kB (-0.0%) ⬇️

Affected Assets, Files, and Routes:

view changes for bundle: client-array-push

Assets Changed:

Asset Name Size Change Total Size Change (%)
assets/chunk.*.js -1.56kB 3.41MB -0.05%
assets/chunk.*.js -82 bytes 41.53kB -0.2%

@github-actions
Copy link
Copy Markdown

Test Results

  1 files  ±0    1 suites  ±0   9m 41s ⏱️ +43s
707 tests +6  646 ✅ + 5  59 💤 +7  0 ❌ ±0  2 🔥  - 6 
722 runs  +6  659 ✅ +11  59 💤 +7  2 ❌  - 6  2 🔥  - 6 

For more details on these errors, see this check.

Results for commit 75f57ac. ± Comparison against base commit 35b513b.

This pull request removes 1 and adds 7 tests. Note that renamed tests count towards both.
Chrome ‑ error
Chrome 143.0 ‑ Acceptance | header-test: campus badge redirects to /settings/billing
Chrome 143.0 ‑ Acceptance | header-test: header should show campus badge if user has an institution membership grant
Chrome 143.0 ‑ Acceptance | header-test: header should show custom leaderboard link if user has feature flag enabled
Chrome 143.0 ‑ Acceptance | header-test: header should show generic leaderboard link if user has feature flag enabled and leaderboard entries
Chrome 143.0 ‑ Acceptance | header-test: header should show member badge if user has an active subscription
Chrome 143.0 ‑ Acceptance | header-test: header should show upgrade button if user does not have an active subscription
Chrome 143.0 ‑ Acceptance | header-test: member badge redirects to /settings/billing
This pull request skips 7 tests.
Chrome 143.0 ‑ Acceptance | concepts-test: can navigate using arrow keys and select option using enter
Chrome 143.0 ‑ Acceptance | concepts-test: can navigate using j/k and select option using enter
Chrome 143.0 ‑ Acceptance | concepts-test: can use Delete and Backspace keys in the feedback popup
Chrome 143.0 ‑ Acceptance | concepts-test: navigating options wraps around the list for the current question card only
Chrome 143.0 ‑ Acceptance | concepts-test: pressing enter while continue button is not focused only advances one block group
Chrome 143.0 ‑ Acceptance | concepts-test: users can interact with concepts, and the expected elements are focused
Chrome 143.0 ‑ Acceptance | concepts-test: while navigating using keys, options are traversed one at a time

@codecov
Copy link
Copy Markdown

codecov Bot commented Mar 13, 2026

❌ 2 Tests Failed:

Tests completed Failed Passed Skipped
648 2 646 59
View the top 2 failed test(s) by shortest run time
Chrome 143.0::Acceptance | course-admin | view-code-example-evaluator: can create trusted evaluation for existing evaluation
Stack Traces | 1.31s run time
Promise rejected during "can create trusted evaluation for existing evaluation": Failed to visit URL '.../redis/admin/code-example-evaluators': ChunkLoadError: Loading chunk vendors-components_file-contents-card_ts-components_file-diff-card_ts failed.
(error: http://localhost:7357/assets/chunk.8bfebcd2ba9bf8efaf32.js)

PageObject: 'page.visit("[object Object]")'
  Selector: ':first'
Chrome 143.0::Acceptance | course-page | switch-repository: can switch repository
Stack Traces | 6.46s run time
Test took longer than 5000ms; test timed out.

To view more test analytics, go to the Test Analytics Dashboard
📋 Got 3 mins? Take this short survey to help us improve Test Analytics.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant