Skip to content

Streamline E2E startup test #13137

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 2 commits into
base: main
Choose a base branch
from
Open

Streamline E2E startup test #13137

wants to merge 2 commits into from
+40 −62

Conversation

@dereknola
Copy link
Member

@dereknola dereknola commented Oct 31, 2025 •
edited
Loading

Background

Our E2E Startup test is our longest running test, and responsible for the most GHA minutes. Its now taking around 15-16 minutes for each run.

Proposed Changes

  • Remove ineffective testlet on prefer-bundled-bin. This is already being tested more effectively with an integration test. Reduces test by about 45-60s.
  • Migrate the bad token testlet from E2E to Integration test. We are just looking for an error message from one server. This testlet takes around 30s in E2E, it only takes 4s in integration.
  • Minimize waiting for kubeconfig testlet. We don't need to wait for pods to be up, we just need kubectl commands to be available. Reduces testlet time by about 20s
  • Only kill docker containers for cri-dockerd testlet. Only the cri-dockerd testlet uses docker containers. Eliminating this from the Kill Cluster step reduces test time by about 5-10s for each call to KillK3sCluster

Types of Changes

E2E Test

Verification

Seeing consistently faster runtime of E2E Startup test by abou 90 to 120s.
Old Time:

Testing

Its all testing

Linked Issues

N/A

User-Facing Change

Further Comments
@dereknola dereknola requested a review from a team as a code owner October 31, 2025 17:25
brandond
brandond requested changes Oct 31, 2025
View reviewed changes
@codecov
Copy link

codecov bot commented Oct 31, 2025 •
edited
Loading

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 21.91%. Comparing base (72ca761) to head (c42dfb6).
⚠️ Report is 2 commits behind head on main.

❗ There is a different number of reports uploaded between BASE (72ca761) and HEAD (c42dfb6). Click for more details.

HEAD has 1 upload less than BASE
Flag BASE (72ca761) HEAD (c42dfb6)
e2etests 1 0
Additional details and impacted files 
@@             Coverage Diff             @@
##             main   #13137       +/-   ##
===========================================
- Coverage   47.01%   21.91%   -25.11%     
===========================================
  Files         189      186        -3     
  Lines       15242    15174       -68     
===========================================
- Hits         7166     3325     -3841     
- Misses       6889    11412     +4523     
+ Partials     1187      437      -750
Flag Coverage Δ
e2etests ?
unittests 21.91% <ø> (-0.02%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
@dereknola
Streamline E2E startup test
4e19d8d 
- Remove ineffective testlet on prefer-bundled-bin
- Minimize waiting for kubeconfig testlet
- Only kill docker containers for cri-dockerd testlet
Signed-off-by: Derek Nola <derek.nola@suse.com>
@dereknola
Migrate bad token testlet from E2E to Integration test
c42dfb6 
Signed-off-by: Derek Nola <derek.nola@suse.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

2 participants

@dereknola @brandond