[experiment] Run Unit tests with paratest

Created on 27 September 2024, 3 months ago

Problem/Motivation

An issue for using paratest exists already, 📌 [experiment] Explore paratest to run our phpunit tests in parallel Needs work

Here a sandbox to keep attempts separate from that issue.

Steps to reproduce

Proposed resolution

Remaining tasks

User interface changes

Introduced terminology

API changes

Data model changes

Release notes snippet

📌 Task
Status

Active

Version

11.0 🔥

Component

phpunit

Created by

🇮🇹Italy mondrake 🇮🇹

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Merge Requests

Comments & Activities

  • Issue created by @mondrake
  • Merge request !9664Experiment paratest → (Open) created by mondrake
  • Pipeline finished with Failed
    3 months ago
    Total: 116s
    #294890
  • Pipeline finished with Failed
    3 months ago
    Total: 232s
    #294902
  • Pipeline finished with Failed
    3 months ago
    Total: 116s
    #294913
  • Pipeline finished with Failed
    3 months ago
    Total: 100s
    #294921
  • Pipeline finished with Failed
    3 months ago
    Total: 115s
    #294929
  • Pipeline finished with Failed
    3 months ago
    Total: 216s
    #294942
  • Pipeline finished with Failed
    3 months ago
    Total: 240s
    #294957
  • Pipeline finished with Failed
    3 months ago
    Total: 225s
    #294968
  • Pipeline finished with Failed
    3 months ago
    #294996
  • Pipeline finished with Failed
    3 months ago
    Total: 316s
    #295643
  • Pipeline finished with Failed
    3 months ago
    Total: 246s
    #296057
  • Pipeline finished with Failed
    3 months ago
    #296059
  • 🇮🇹Italy mondrake 🇮🇹
  • Pipeline finished with Success
    3 months ago
    Total: 216s
    #296320
  • 🇬🇧United Kingdom catch

    The disconnect between paratest and run-tests.sh timings looked a bit too much, so I checked phpunit test timings in HEAD and found bugs in the run-tests.sh logic (recently introduced by me).

    📌 Try a shorter polling time in run-tests.sh Active is the issue.

    https://git.drupalcode.org/project/drupal/-/jobs/2938499 reports 42 seconds to run tests now so a better baseline for comparison.

  • 🇬🇧United Kingdom alexpott 🇪🇺🌍

    Also, in the past when I've used paratest on projects I've had problems with deprecation testing and how Symfony adds the info. Maybe with the recent PHPUnit / Symfony PHPUnit Bridge changes this is no longer a problem but we need to confirm whether deprecation fails are still reported correctly - both that the test fails and that we can see the deprecation that causes the fail.

  • 🇮🇹Italy mondrake 🇮🇹
  • Pipeline finished with Failed
    2 months ago
    Total: 68s
    #326387
  • Pipeline finished with Canceled
    2 months ago
    Total: 194s
    #326391
  • Pipeline finished with Success
    2 months ago
    Total: 220s
    #326393
  • 🇮🇹Italy mondrake 🇮🇹

    plain PHPUnit: 1 min 54 secs
    paratest: 24 secs
    run-tests: 31 secs

Production build 0.71.5 2024