Improve unit test coverage for ModuleHandler

Created on 25 June 2023, about 1 year ago
Updated 8 November 2023, 8 months ago

Problem/Motivation

When trying to refactor ModuleHandler in 📌 Hux-style hooks, proof of concept Needs work , I noticed that some bugs or changes of behavior introduced into the ModuleHandler did not cause ModuleHandlerTest to fail, while other tests did fail.

This means that Drupal\Tests\Core\Extension\ModuleHandlerTest is incomplete in its coverage of Drupal\Core\ExtensionModuleHandler.

I also noticed a heavy reliance on mocking protected methods. It would be nice to avoid or reduce that.

Steps to reproduce

Look at failed runs in the other issue #3368812.

Proposed resolution

Add more cases in ModuleHandlerTest.

Remaining tasks

User interface changes

API changes

Data model changes

Release notes snippet

📌 Task
Status

Needs work

Version

11.0 🔥

Component
Base 

Last updated less than a minute ago

Created by

🇩🇪Germany donquixote

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

  • Issue created by @donquixote
  • last update about 1 year ago
    29,553 pass
  • @donquixote opened merge request.
  • last update 12 months ago
    Custom Commands Failed
  • 🇩🇪Germany donquixote

    Some people believe that separate functionalities should be covered by separate test methods.
    Some people (and books, blog posts etc) even argue to only have one assert per test method.

    In this MR I add stuff into the same method where it is practical.

    Tradeoffs:
    - Multiple asserts means you only see the first failure, later failures are unreachable. -> More iterations to fix the test.
    - Multiple scenarios combined makes it harder to understand failure reports. It also makes it harder to understand what exactly we are testing and why.
    - More separate test methods means slower test. This is generally ok for unit tests, though.
    - More methods can mean more code and more effort to write them..
    - There can be a risk of overcoverage in specific areas, which leads to redundant failure reports.

    In this PR I want high coverage at low cost (effort and slowness)

  • last update 12 months ago
    Custom Commands Failed
  • last update 12 months ago
    29,559 pass
  • last update 12 months ago
    29,560 pass
  • last update 12 months ago
    29,561 pass
  • Status changed to Needs review 12 months ago
  • 🇩🇪Germany donquixote

    First round of review could be nice to see if the direction is good.
    And maybe others have more ideas what we need to cover.

    There are many permutations of:
    - What's in the cache
    - Which files are already included at time of discovery.
    - Different things happening in hook_module_implements_alter(): Removal or adding of implementations, changing the "group" of an implementation, changing the order.
    - Hooks being sent in combination to ->alter().

  • Status changed to RTBC 9 months ago
  • 🇺🇸United States smustgrave

    Ticket has seemed to stale. I like the idea but may be above my head. I'm placing in committer bucket to get eyes on.

  • last update 9 months ago
    30,367 pass
  • last update 9 months ago
    30,369 pass
  • last update 9 months ago
    30,386 pass
  • last update 9 months ago
    30,384 pass
  • last update 9 months ago
    30,389 pass
  • last update 9 months ago
    30,399 pass
  • last update 9 months ago
    30,404 pass
  • 24:08
    19:59
    Running
  • last update 8 months ago
    30,420 pass
  • last update 8 months ago
    30,424 pass
  • Status changed to Needs review 8 months ago
  • 🇳🇿New Zealand quietone New Zealand

    I'm triaging RTBC issues . I read the IS and the comments. Comment #5 clearly asks for a first round of review and there is no evidence of such a review. I am setting back to Needs Review and tagging "Needs architectural review'.

    I do understand how challenging it can be to get a review on an issue where there are few people with expertise, having experienced that in migration. However, the RTBC queue is for issues that are complete and all Core Gates are passed. One can argue that having an issue set RTBC is actually reducing the number of potential eyes on it.

    Both myself and catch suggest continuing to ask in #contribute for reviews and perhaps asking those who can review to have a look. I expect we just have to wait until someone has the time available.

  • 🇬🇧United Kingdom joachim

    This is a big MR and complicated to review. Just some vague impressions for now :)

    At the risk of starting a round of bikeshedding, I wonder if it might be better to split it into several issues, as I can see that each commit on the branch is testing something fairly different. Unless there's a lot of overlap in the fixture code?

    Also, commit "Use constants for path to test modules." seems like a good idea but is adding noise.

    > $expected_alter_combined_2

    Variables with a 2 is a naming smell.

    Overall this could do with a lot more explanation of what it's doing -- why the 3 .inc files, for instance? The @file block should say what is special about each one. I don't really understand the .inc files in general -- is the idea that they will get picked up by the module handler without needing to enable a module?

  • Status changed to Needs work 8 months ago
  • 🇺🇸United States smustgrave

    lets try that. Seems this issue has kinda stalled hard so maybe breaking up with help momentum.

  • 🇩🇪Germany donquixote

    I don't really understand the .inc files in general -- is the idea that they will get picked up by the module handler without needing to enable a module?

    The purpose is to easily enable specific hook implementations through the fixtures in providerTestHookOrder(), without adding more and more complete module directories.

    The goal is to cover niche scenarios where behavior could change if we try to refactor the system.
    E.g. a typical fragile scenario is when calling ->alter() with more than one hook name, while some of these hook names are altered with hook_module_implements_alter().

    It can be argued that coverage of a high range of combinations is paid for with a lack of clarity.
    So yes, perhaps I should split this up and also make it more clear.

Production build 0.69.0 2024