Opt-in to wider test coverage from templates via gitlab-ci.yml variables

Created on 9 April 2024, 3 months ago
Updated 24 April 2024, 2 months ago

Problem/Motivation

The DA-supported shared Gitlab CI testing templates have support to make it really easy to do automated testing across multiple configurations of core. We should use that to make sure we're ready for movement from core, to confirm we still work with the older versions of things we claim to support, etc.

Steps to reproduce

Proposed resolution

Add the following to our .gitlab-ci.yml file, under variables:

Use DeprecationHelper to maintain backward compatibility.
@see https://www.drupal.org/node/3379306

  OPT_IN_TEST_PREVIOUS_MINOR: 1
  OPT_IN_TEST_NEXT_MINOR: 1
  OPT_IN_TEST_PREVIOUS_MAJOR: 1
  OPT_IN_TEST_MAX_PHP: 1

Remaining tasks

There were 22 errors:

1) Drupal\Tests\webform_example_element\Functional\WebformExampleElementTest::testWebformExampleElement
Behat\Mink\Exception\ExpectationException: The string "<div class="js-form-item form-item js-form-type-webform-example-element form-item-webform-example-element js-form-item-webform-example-element">" was not found anywhere in the HTML response of the current page.

/builds/project/webform/modules/webform_example_element/tests/src/Functional/WebformExampleElementTest.php:36

2) Drupal\Tests\webform_jqueryui_datepicker\Functional\WebformJqueryUiDatepickerTest::testDatepickerElements
Behat\Mink\Exception\ExpectationException: The string "<input data-drupal-selector="edit-datetime-datepicker-date" title="Date (e.g. Wed, 04/10/2024)" type="text" min="Mon, 01/01/1900" max="Sat, 12/31/2050" data-drupal-date-format="D, m/d/Y" placeholder="YYYY-MM-DD" data-help="Enter the date using the format YYYY-MM-DD (e.g., Wed, 04/10/2024)." id="edit-datetime-datepicker-date" name="datetime_datepicker[date]" value="Tue, 08/18/2009" size="15" maxlength="128" class="form-text" />" was not found anywhere in the HTML response of the current page.

/builds/project/webform/modules/webform_jqueryui_datepicker/tests/src/Functional/WebformJqueryUiDatepickerTest.php:46

3) Drupal\Tests\webform\Functional\Element\WebformElementCheckboxesTest::testCheckboxes
Behat\Mink\Exception\ExpectationException: The string "<div data-custom="custom wrapper data" style="border: red 1px solid" class="one-custom-wrapper-class js-form-item form-item js-form-type-checkbox form-item-checkboxes-options-properties-two js-form-item-checkboxes-options-properties-two">" was not found anywhere in the HTML response of the current page.

/builds/project/webform/tests/src/Functional/Element/WebformElementCheckboxesTest.php:46

4) Drupal\Tests\webform\Functional\Element\WebformElementCompositeTest::testComposite
Behat\Mink\Exception\ExpectationException: The string "<div class="js-form-item form-item js-form-type-radios form-item-radios-wrapper-form-element js-form-item-radios-wrapper-form-element">" was not found anywhere in the HTML response of the current page.

/builds/project/webform/tests/src/Functional/Element/WebformElementCompositeTest.php:128

5) Drupal\Tests\webform\Functional\Element\WebformElementComputedTest::testComputedElement
Behat\Mink\Exception\ExpectationException: The string " <div class="webform-element webform-element-type-webform-computed-token js-form-item form-item js-form-type-item form-item-webform-computed-token-text js-form-item-webform-computed-token-text" id="test_element_computed_token--webform_computed_token_text">" was not found anywhere in the HTML response of the current page.

/builds/project/webform/tests/src/Functional/Element/WebformElementComputedTest.php:78

6) Drupal\Tests\webform\Functional\Element\WebformElementDateTimeTest::testDateTime
Behat\Mink\Exception\ExpectationException: The string "<input data-drupal-selector="edit-datetime-timepicker-date" title="Date (e.g. Wed, 04/10/2024)" type="text" min="Mon, 01/01/1900" max="Sat, 12/31/2050" placeholder="YYYY-MM-DD" data-help="Enter the date using the format YYYY-MM-DD (e.g., Wed, 04/10/2024)." id="edit-datetime-timepicker-date" name="datetime_timepicker[date]" value="Tue, 08/18/2009" size="15" class="form-text" />" was not found anywhere in the HTML response of the current page.

/builds/project/webform/tests/src/Functional/Element/WebformElementDateTimeTest.php:57

7) Drupal\Tests\webform\Functional\Element\WebformElementDetailsTest::testDetails
Behat\Mink\Exception\ExpectationException: The string "<summary role="button" aria-controls="edit-details" aria-expanded="true" aria-pressed="true" class="js-form-required form-required">details<span class="webform-element-help js-webform-element-help" role="tooltip" tabindex="0" aria-label="details" data-webform-help="&lt;div class=&quot;webform-element-help--title&quot;&gt;details&lt;/div&gt;&lt;div class=&quot;webform-element-help--content&quot;&gt;This is help text.&lt;/div&gt;"><span aria-hidden="true">?</span>" was not found anywhere in the HTML response of the current page.

/builds/project/webform/tests/src/Functional/Element/WebformElementDetailsTest.php:31

8) Drupal\Tests\webform\Functional\Element\WebformElementEmailConfirmTest::testEmailConfirm
Behat\Mink\Exception\ExpectationException: The string "<div class="js-form-item form-item js-form-type-email form-item-email-confirm-basic-mail-1 js-form-item-email-confirm-basic-mail-1">" was not found anywhere in the HTML response of the current page.

/builds/project/webform/tests/src/Functional/Element/WebformElementEmailConfirmTest.php:30

9) Drupal\Tests\webform\Functional\Element\WebformElementFormatCustomTest::testFormatCustom
Behat\Mink\Exception\ExpectationException: The string "<summary role="button" aria-controls="test_element_format_custom--fieldset_custom" aria-expanded="true" aria-pressed="true">fieldset_custom</summary>" was not found anywhere in the HTML response of the current page.

/builds/project/webform/tests/src/Functional/Element/WebformElementFormatCustomTest.php:123

10) Drupal\Tests\webform\Functional\Element\WebformElementHelpTest::testHelp
Behat\Mink\Exception\ExpectationException: The string "<summary role="button" aria-controls="edit-help-details" aria-expanded="false" aria-pressed="false">help_details<span class="webform-element-help js-webform-element-help" role="tooltip" tabindex="0" aria-label="help_details" data-webform-help="&lt;div class=&quot;webform-element-help--title&quot;&gt;help_details&lt;/div&gt;&lt;div class=&quot;webform-element-help--content&quot;&gt;{This is an example of help for a details element}&lt;/div&gt;"><span aria-hidden="true">?</span>" was not found anywhere in the HTML response of the current page.

/builds/project/webform/tests/src/Functional/Element/WebformElementHelpTest.php:56

11) Drupal\Tests\webform\Functional\Element\WebformElementLikertTest::testLikertElement
Behat\Mink\Exception\ExpectationException: The string "<td><div class="js-form-item form-item js-form-type-radio form-item-likert-default-q1 js-form-item-likert-default-q1">" was not found anywhere in the HTML response of the current page.

/builds/project/webform/tests/src/Functional/Element/WebformElementLikertTest.php:31

12) Drupal\Tests\webform\Functional\Element\WebformElementMultipleTest::testMultiple
Behat\Mink\Exception\ExpectationException: The string "<td><div class="js-form-item form-item js-form-type-textfield form-item-webform-multiple-default-items-0--item- js-form-item-webform-multiple-default-items-0--item- form-no-label">" was not found anywhere in the HTML response of the current page.

/builds/project/webform/tests/src/Functional/Element/WebformElementMultipleTest.php:131

13) Drupal\Tests\webform\Functional\Element\WebformElementOtherTest::testBuildingOtherElements
Behat\Mink\Exception\ExpectationException: The string "<div class="js-webform-select-other webform-select-other js-form-item form-item js-form-type-webform-select-other form-item-wrapper-other-form-element js-form-item-wrapper-other-form-element" id="edit-wrapper-other-form-element">" was not found anywhere in the HTML response of the current page.

/builds/project/webform/tests/src/Functional/Element/WebformElementOtherTest.php:97

14) Drupal\Tests\webform\Functional\Element\WebformElementRadiosTest::testElementRadios
Behat\Mink\Exception\ExpectationException: The string "<div data-custom="custom wrapper data" style="border: red 1px solid" class="one-custom-wrapper-class js-form-item form-item js-form-type-radio form-item-radios-options-properties js-form-item-radios-options-properties">" was not found anywhere in the HTML response of the current page.

/builds/project/webform/tests/src/Functional/Element/WebformElementRadiosTest.php:53

15) Drupal\Tests\webform\Functional\Element\WebformElementRangeTest::testRating
Behat\Mink\Exception\ExpectationException: The string "<span class="field-prefix"><div class="js-form-item form-item js-form-type-number form-item-range-output-left__output js-form-item-range-output-left__output form-no-label">" was not found anywhere in the HTML response of the current page.

/builds/project/webform/tests/src/Functional/Element/WebformElementRangeTest.php:43

16) Drupal\Tests\webform\Functional\Element\WebformElementTableTest::testTable
Behat\Mink\Exception\ExpectationException: The string "<td><div class="js-form-item form-item js-form-type-textfield form-item-table__1__first-name js-form-item-table__1__first-name form-no-label">" was not found anywhere in the HTML response of the current page.

/builds/project/webform/tests/src/Functional/Element/WebformElementTableTest.php:49

17) Drupal\Tests\webform\Functional\Settings\WebformSettingsPreviewTest::testPreview
Behat\Mink\Exception\ExpectationException: The string "<div class="format-attributes-class webform-element webform-element-type-textfield js-form-item form-item js-form-type-item form-item-name js-form-item-name" id="test_form_preview--name">" was not found anywhere in the HTML response of the current page.

/builds/project/webform/tests/src/Functional/Settings/WebformSettingsPreviewTest.php:67

18) Drupal\Tests\webform\Functional\States\WebformStatesHiddenTest::testFormStatesHidden
Behat\Mink\Exception\ExpectationException: The string "<div class="js-webform-states-hidden js-form-item form-item js-form-type-textfield form-item-dependent-textfield js-form-item-dependent-textfield">" was not found anywhere in the HTML response of the current page.

/builds/project/webform/tests/src/Functional/States/WebformStatesHiddenTest.php:47

19) Drupal\Tests\webform\Functional\WebformEntityTranslationTest::testWebformTranslate
Behat\Mink\Exception\ExpectationException: The string "<a href="/web/admin/structure/webform/manage/test_translation/translate/es/edit">Edit</a>" was not found anywhere in the HTML response of the current page.

/builds/project/webform/tests/src/Functional/WebformEntityTranslationTest.php:96

20) Drupal\Tests\webform\Functional\WebformSubmissionViewTest::testView
Behat\Mink\Exception\ExpectationException: The string "<summary role="button" aria-controls="test_element--standard_elements" aria-expanded="true" aria-pressed="true">Standard Elements</summary>" was not found anywhere in the HTML response of the current page.

/builds/project/webform/tests/src/Functional/WebformSubmissionViewTest.php:94

21) Drupal\Tests\webform\Functional\Wizard\WebformWizardAdvancedTest::testAdvancedWizard
Behat\Mink\Exception\ExpectationException: The string "<div class="webform-element webform-element-type-textarea js-form-item form-item js-form-type-item form-item-comments js-form-item-comments form-no-label" id="test_form_wizard_advanced--comments">" was not found anywhere in the HTML response of the current page.

/builds/project/webform/tests/src/Functional/Wizard/WebformWizardAdvancedTest.php:158

22) Drupal\Tests\webform\Functional\Wizard\WebformWizardBasicTest::testBasicWizard
Behat\Mink\Exception\ExpectationException: The string "<summary role="button" aria-controls="edit-page-1" aria-expanded="false" aria-pressed="false">Page 1</summary>" was not found anywhere in the HTML response of the current page.

/builds/project/webform/tests/src/Functional/Wizard/WebformWizardBasicTest.php:50

There were 2 failures:

1) Drupal\Tests\webform_submission_export_import\Functional\WebformSubmissionImportExportFunctionalTest::testSubmissionImport
Failed asserting that two arrays are equal.

/builds/project/webform/modules/webform_submission_export_import/tests/src/Functional/WebformSubmissionImportExportFunctionalTest.php:296

2) Drupal\Tests\webform\Functional\WebformSubmissionApiTest::testApi

/builds/project/webform/tests/src/Functional/WebformSubmissionApiTest.php:60

📌 Task
Status

Fixed

Version

6.2

Component

Code

Created by

🇺🇸United States jrockowitz Brooklyn, NY

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Merge Requests

Comments & Activities

Production build 0.69.0 2024