Created on 13 September 2024, 7 months ago

Problem/Motivation

Tests currently take over 30 minutes to run which makes the feedback loop extremely slow for pushing changes to CI. Since this module contains so many dependencies and submodules, it's hard to set this up properly locally for development.

Steps to reproduce

Run CI, go grab a coffee, make a sandwich, check back, still not done...

Proposed resolution

Remove redundant tests
Use less http requests and more API
Combine test cases where appropriate to avoid setup/tearDown
....

πŸ“Œ Task
Status

Active

Version

6.3

Component

Code

Created by

πŸ‡¦πŸ‡ΊAustralia acbramley

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Merge Requests

Comments & Activities

  • Issue created by @acbramley
  • πŸ‡¦πŸ‡ΊAustralia mstrelan

    Maybe also setting _PHPUNIT_CONCURRENT could help.

  • Merge request !516Speed up tests β†’ (Merged) created by mstrelan
  • πŸ‡ΊπŸ‡ΈUnited States nicxvan

    I was just looking for that setting, but you beat me to it.

  • Pipeline finished with Failed
    7 months ago
    Total: 585s
    #281722
  • πŸ‡ΊπŸ‡ΈUnited States nicxvan

    That cut 25 minutes off of the tests!

    Head is still failing tests I think. I'm not sure if we want to merge this in, or just manually port it to the other issue since tests are passing there.

  • Status changed to Needs review 7 months ago
  • πŸ‡ΊπŸ‡ΈUnited States nicxvan
  • πŸ‡¨πŸ‡¦Canada Liam Morland Ontario, CA πŸ‡¨πŸ‡¦

    6.3.x is currently passing except for the "next major" tests. This suggests that _PHPUNIT_CONCURRENT is causing the failure.

  • First commit to issue fork.
  • πŸ‡ΊπŸ‡ΈUnited States jrockowitz Brooklyn, NY

    Re-rolling and let's see if the tests pass.

  • Pipeline finished with Success
    5 months ago
    Total: 551s
    #347557
  • πŸ‡ΊπŸ‡ΈUnited States jrockowitz Brooklyn, NY
  • πŸ‡ΊπŸ‡ΈUnited States jrockowitz Brooklyn, NY
  • Pipeline finished with Canceled
    5 months ago
    Total: 77s
    #347604
  • Pipeline finished with Canceled
    5 months ago
    Total: 113s
    #347607
  • Pipeline finished with Success
    5 months ago
    Total: 479s
    #347611
  • πŸ‡¨πŸ‡¦Canada Liam Morland Ontario, CA πŸ‡¨πŸ‡¦

    We'll need to keen an eye on this. In πŸ“Œ Enable concurrent phpunit Active , this change was causing the tests to be flaky.

  • πŸ‡ΊπŸ‡ΈUnited States jrockowitz Brooklyn, NY

    Okay. It is easy enough to remove.

  • Automatically closed - issue fixed for 2 weeks with no activity.

  • Pipeline finished with Canceled
    4 months ago
    Total: 91s
    #372241
  • Pipeline finished with Success
    3 months ago
    Total: 1028s
    #389834
  • Pipeline finished with Canceled
    3 months ago
    Total: 106s
    #390086
  • Status changed to Fixed about 2 months ago
  • πŸ‡ΊπŸ‡ΈUnited States nicxvan
  • Pipeline finished with Failed
    about 2 months ago
    Total: 534s
    #432942
  • Pipeline finished with Failed
    about 2 months ago
    Total: 741s
    #432985
  • Pipeline finished with Failed
    about 2 months ago
    Total: 762s
    #433547
  • Pipeline finished with Failed
    about 2 months ago
    Total: 817s
    #433581
  • Pipeline finished with Success
    about 2 months ago
    Total: 926s
    #433601
  • Pipeline finished with Skipped
    about 2 months ago
    #433622
  • Pipeline finished with Success
    4 days ago
    Total: 216s
    #468139
  • Pipeline finished with Canceled
    4 days ago
    Total: 163s
    #468160
  • Pipeline finished with Success
    4 days ago
    Total: 234s
    #468164
Production build 0.71.5 2024