- Issue created by @catch
- last update
about 1 year ago 30,363 pass - @catch opened merge request.
- 🇬🇧United Kingdom catch
Once the worst culprits in 📌 [meta] Refactor ultra-slow tests Active are done, any remaining slower tests tend to stick out towards the end of test runs. We probably want to mark most functional tests with more than 5 methods as #slow. The limit is that we don't wan to mark more tests slow than concurrency * parallel job runs, because that could push one of the very slow tests into the second batch of tests, which would then make the total run slower again.
So if we have 6 parallel functional test runs at concurrency 16 each, the absolute maximum number of @group #slow classes should be 6 * 16 = 96.
- last update
about 1 year ago 30,363 pass - Status changed to Needs review
about 1 year ago 9:59am 27 September 2023 - last update
about 1 year ago 30,360 pass - Status changed to RTBC
about 1 year ago 1:35pm 27 September 2023 - 🇺🇸United States smustgrave
Seems a lot of tests are slow haha. looks good though.
- last update
about 1 year ago 30,360 pass - last update
about 1 year ago 30,360 pass - last update
about 1 year ago 30,360 pass - Status changed to Needs review
about 1 year ago 4:24pm 27 September 2023 - 🇬🇧United Kingdom catch
Had some commits locally to push, back to needs review but just more of the same.
https://git.drupalcode.org/project/drupal/-/pipelines/24325 shows the results (combined with several other issues) - 11m1s for a full test run.
If you look at the individual jobs on https://git.drupalcode.org/project/drupal/-/pipelines/24325 and ctrl-F for 'test run duration' you can see all the functional tests are finishing in 5-6 minutes. It is not perfectly balanced and there are still one or two tests that are 'ultra slow' and overshoot all the others, but it's a lot closer than without the MR when they could vary more like 4-8 minutes.
Kernel tests and Functional JavaScript tests are also 'balanced enough'. We can probably do some more work on kernel tests to mark the slow ones there, but could happen in a follow-up.
- last update
about 1 year ago 30,362 pass - last update
about 1 year ago 30,362 pass - Status changed to RTBC
about 1 year ago 2:19pm 28 September 2023 - 🇺🇸United States smustgrave
Kept this open for close to 24 hours in case you found more. But going to remark it now.
- First commit to issue fork.
- last update
about 1 year ago 30,361 pass - Status changed to Fixed
about 1 year ago 7:53pm 28 September 2023 - 🇫🇮Finland lauriii Finland
- 🇬🇧United Kingdom catch
fwiw with functional test concurrency, the current numbers look like this:
HEAD:
6*32=192
After 📌 [PP-1] Tweak gitlab CI concurrency, parallelism and test running order for 11 minute test runs Needs review it's lower but still high.
to 7 * 24=168
So still a lot of headroom to add #slow unless we significantly constrain the number of tests we run at once. Obviously it would be better if we made the actual tests less slow too so they don't need the tag.
Automatically closed - issue fixed for 2 weeks with no activity.