Repository navigation
ci: run the slow tier's tests two at a time on each shard - #600
Open
andrewpark-scaleai wants to merge 1 commit into
Open
andrewpark-scaleai wants to merge 1 commit into
andrewpark-scaleai wants to merge 1 commit into
Conversation
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Why
The goal is a faster slow tier on the same 12 runners, with no test weakened. Each slow shard runs one test at a time today, while its runner uses at most 4 GB of its 16 GB.
What changes
The slow step runs
pytest -n 2 --dist loadfile. Each shard runs two test files at a time. A file's tests, and its module fixtures andpytest.mark.dependencychains, stay on one worker. No test or assertion changes.Evidence
The #582 experiment ran this setup on
mainplus #580:Neither experiment run tested this exact commit, so this PR's own
local-backendsrun is the check. I'll report its per-shard times here.Known limits
chromium_app_test.pytakes about 550s.-n autowith the same exposure.

Confidence Score: 5/5
The PR appears safe to merge; no blocking failures were found.Summary
Runs two slow-test workers on each of the existing 12 shards.
andrewpark-scaleai acknowledged the known host-port collision exposure. andrewpark-scaleai also disclosed the earlier apt failures and missing stderr; no concrete failure caused by this change was established.
Reviews (1) · Last reviewed commit: "ci: run the slow tier's tests two at a t..." · Reviewed by Greptile