[CI] Components tests coverage metrics differ by PHP version

Created on 28 April 2025, about 1 month ago

Problem/Motivation

Follow-up of ๐Ÿ“Œ [PP-1][CI] Spin off Drupal Components tests in a job of their own Postponed .

Components tests coverage metrics differ slightly by PHP version, and apparently the last PHP version job completing the components unit test is winning the box. Not a big deal, but this can cause some confusion when looking at test results and seeing that metrics are changing even if components code/tests are not part of the MR.

Example from HEAD on Apr 28, 2025:

PHP 8.3 and 8.4

  Classes: 31.62% (37/117)   
  Methods: 46.88% (315/672)  
  Lines:   36.59% (2782/7604)

PHP 8.5

  Classes: 30.77% (36/117)   
  Methods: 46.43% (312/672)  
  Lines:   36.53% (2778/7604)

Proposed resolution

Possible solutions:

  1. Produce code coverage report only in the job running the default PHP version; no code coverage for the other PHP versions.
  2. Produce a different set of metrics for each PHP version.
  3. Investigate why the differences and try to remove them (might be impossible if there are code paths dependent on PHP version checking)

Remaining tasks

User interface changes

Introduced terminology

API changes

Data model changes

Release notes snippet

๐Ÿ› Bug report
Status

Active

Version

11.0 ๐Ÿ”ฅ

Component

phpunit

Created by

๐Ÿ‡ฎ๐Ÿ‡นItaly mondrake ๐Ÿ‡ฎ๐Ÿ‡น

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Merge Requests

Comments & Activities

Production build 0.71.5 2024