TestDiscovery expects @group annotations, fails with #[Group()] attributes

Created on 12 May 2024, about 2 months ago
Updated 20 May 2024, about 1 month ago

Problem/Motivation

TestDiscovery expects @group annotations, fails with #[Group()] attributes.

Proposed resolution

Refactor TestDiscovery. Possibly get rid of custom code and just rely on PHPUnit to discover tests (?)

Remaining tasks

User interface changes

API changes

Data model changes

Release notes snippet

📌 Task
Status

Needs review

Version

11.0 🔥

Component
PHPUnit 

Last updated about 18 hours ago

Created by

🇮🇹Italy mondrake 🇮🇹

Live updates comments and jobs are added and updated live.
  • Needs framework manager review

    It is used to alert the framework manager core committer(s) that an issue significantly impacts (or has the potential to impact) multiple subsystems or represents a significant change or addition in architecture or public APIs, and their signoff is needed (see the governance policy draft for more information). If an issue significantly impacts only one subsystem, use Needs subsystem maintainer review instead, and make sure the issue component is set to the correct subsystem.

Sign in to follow issues

Merge Requests

Comments & Activities

  • Issue created by @mondrake
  • Merge request !8054Closes #3446705 → (Open) created by mondrake
  • Pipeline finished with Failed
    about 2 months ago
    Total: 189s
    #171746
  • Pipeline finished with Failed
    about 2 months ago
    Total: 180s
    #171753
  • Pipeline finished with Failed
    about 2 months ago
    Total: 196s
    #171765
  • Pipeline finished with Failed
    about 2 months ago
    Total: 363s
    #171781
  • Pipeline finished with Failed
    about 2 months ago
    Total: 189s
    #171916
  • Pipeline finished with Failed
    about 2 months ago
    Total: 665s
    #171918
  • Status changed to Needs review about 2 months ago
  • 🇮🇹Italy mondrake 🇮🇹

    Tests need fixing, but I think the concept is reviewable.

    Getting rid of custom code and just relying on PHPUnit to discover tests is a bit too far and actually PHPUnit itself only recently changed format for --list-tests-xml output, and modified test list filtering options, in PHPUnit 11.1. So better wait to be on that before trying it.

    For now just extended TestDiscovery to look into attributes of test classes, falling back to annotations if they do not exist (like PHPUnit itself is doing).

  • Pipeline finished with Failed
    about 2 months ago
    Total: 209s
    #172194
  • Pipeline finished with Failed
    about 2 months ago
    Total: 363s
    #172198
  • Pipeline finished with Failed
    about 2 months ago
    Total: 616s
    #172234
  • Pipeline finished with Failed
    about 2 months ago
    Total: 194s
    #172361
  • Pipeline finished with Failed
    about 2 months ago
    Total: 697s
    #172366
  • Pipeline finished with Failed
    about 2 months ago
    Total: 604s
    #172388
  • Pipeline finished with Failed
    about 2 months ago
    Total: 655s
    #172637
  • Pipeline finished with Success
    about 2 months ago
    Total: 1111s
    #173114
  • Pipeline finished with Failed
    about 2 months ago
    Total: 175s
    #173155
  • Pipeline finished with Failed
    about 2 months ago
    Total: 643s
    #173156
  • Pipeline finished with Failed
    about 2 months ago
    Total: 648s
    #173210
  • Pipeline finished with Failed
    about 2 months ago
    Total: 165s
    #173398
  • Pipeline finished with Failed
    about 2 months ago
    Total: 527s
    #173403
  • Pipeline finished with Failed
    about 2 months ago
    Total: 606s
    #173689
  • Pipeline finished with Success
    about 2 months ago
    Total: 665s
    #174240
  • 🇮🇹Italy mondrake 🇮🇹

    Tests are green now.

  • 🇮🇹Italy mondrake 🇮🇹

    Added draft CR.

  • Pipeline finished with Success
    about 1 month ago
    Total: 635s
    #174588
  • Pipeline finished with Failed
    about 1 month ago
    Total: 992s
    #175865
  • 🇮🇹Italy mondrake 🇮🇹

    FWIW, I am pretty close to have an alternative implementation using PHPStan's BetterReflection.

    This would have the benefit of not loading all test classes via PHP's Reflection.

    But two drawbacks:
    1) it will be much slower
    2) it would require, at least for now, 📌 Downgrade (temporarily) nikic/php-parser to ^4 Closed: won't fix

    I do not think that's worth doing. In the future, I'd suggest to switch TestDiscovery to get the test list by executing PHPUnit's CLI with the --list-tests-xml option and parsing the resulting XML. That would effectively mean delegating 'how' test classes are discovered entirely to PHPUnit, in a separate process so that PHP's own allocated memory allocated would not be a constraint (if it is right now, today, I doubt anyway).

  • Merge request !8125Resolve #3446705 "Using betterreflection" → (Open) created by mondrake
  • Pipeline finished with Failed
    about 1 month ago
    Total: 194s
    #176489
  • 🇫🇷France andypost

    Just a question why new conflict added to composer?

    "nikic/php-parser": ">=5"
  • 🇮🇹Italy mondrake 🇮🇹

    MR!8054 uses PHP reflection.

    MR!8125 implements #7, uses BetterReflection (static reflection, no class loading in memory), and requires downgrading nikic/php-parser to 4, for the reasons discussed in 📌 Downgrade (temporarily) nikic/php-parser to ^4 Closed: won't fix .

    We need to decide on which horse to bet.

  • Pipeline finished with Failed
    about 1 month ago
    #176491
  • 🇫🇷France andypost

    As I get https://github.com/Roave/BetterReflection/pull/1387 already fixed and BetterReflection should work with v5 too

  • Status changed to Needs work about 1 month ago
  • The Needs Review Queue Bot tested this issue. It no longer applies to Drupal core. Therefore, this issue status is now "Needs work".

    This does not mean that the patch necessarily needs to be re-rolled or the MR rebased. Read the Issue Summary, the issue tags and the latest discussion here to determine what needs to be done.

    Consult the Drupal Contributor Guide to find step-by-step guides for working with issues.

  • Status changed to Needs review about 1 month ago
  • 🇮🇹Italy mondrake 🇮🇹

    Can I ask, please, to get a review of the two options and guidance on which one (or others) to follow? Not very keen in keeeping two alternative approaches rebased just to keep the NR; the second option would require rebasing anytime a dependency is bumped.

  • Pipeline finished with Success
    about 1 month ago
    Total: 608s
    #177967
  • Pipeline finished with Success
    about 1 month ago
    Total: 604s
    #185104
  • Pipeline finished with Success
    19 days ago
    Total: 499s
    #196379
Production build 0.69.0 2024