[meta] Fix and re-enable tests skipped for random failures

Created on 1 March 2022, almost 3 years ago
Updated 14 June 2023, over 1 year ago

Problem/Motivation

Follow-up from #3267124: Temporarily skip failing tests β†’ .

The following JavaScript test methods are currently skipped for random fails:

Layout Builder

  1. LayoutBuilderUiTest::assertHighlightNotExists.

Other

Proposed resolution

  1. File children to debug and un-skip each.
  2. Un-skip one method per issue and run the affected test 500x.
  3. Queue 8 test runs of 1000x against MySQL or MariaDB environments.
  4. Post a patch that un-skips the test without any attempted fix to get a baseline fail rate, and always test this patch at the same time as any proposed fix with the same environment.
  5. Skip other methods in the test if it becomes necessary due to out-of-scope fails.

Remaining tasks

  1. Add items to the above summary for::

Already fixed

  1. \Drupal\Tests\ckeditor5\FunctionalJavascript\MediaLibraryTest::testButton: #3268368: Robustify and restore \Drupal\Tests\ckeditor5\FunctionalJavascript\MediaLibraryTest::testButton β†’
  2. LayoutBuilderDisableInteractionsTest::testFormsLinksDisabled(): #3268680: [random test failure] Restore and fix LayoutBuilderDisableInteractionsTest::testFormsLinksDisabled() β†’
  3. #3272797: [random test failure] Restore LayoutBuilderTest::testConfigurableLayoutSections() β†’
  4. QuickEditIntegrationTest::testArticleNode() #3268244: [random test failure] Un-skip and fix QuickEditIntegrationTest::testArticleNode() β†’
  5. QuickEditIntegrationTest::testCustomBlock() #3267258: Remove Quick Edit support from editor.module β†’
  6. AjaxBlockTest::testAddAjaxBlock() #3304371: Fix intermittent failure in AjaxBlockTest β†’
  7. ContentPreviewToggleTest::testContentPreviewToggle(): #3268678: [random test failure] Restore ContentPreviewToggleTest::testContentPreviewToggle() β†’
  8. SettingsTrayBlockFormTest::testEditModeEnableDisable(): #3304901: Fix intermittently failing Settings Tray Functional Javascript tests β†’
  9. LayoutBuilderDisableInteractionsTest::assertContextualLinksClickable() πŸ“Œ [no random test failure] Try to un-skip and fix LayoutBuilderDisableInteractionsTest::assertContextualLinksClickable in context of [#3353085] Fixed
  10. πŸ“Œ [random test failure] Try to un-skip and fix LayoutBuilderTest::testLayoutBuilderUi in context of [#3353085] Fixed
  11. πŸ“Œ [random test failure] Try to un-skip and fix LayoutBuilderNestedFormUiTest::testAddingFormBlocksToDefaults in context of [#3353085] Fixed
  12. πŸ“Œ [random test failure] Try to un-skip and fix ContextualLinksTest in context of [#3353085] Fixed
  13. πŸ“Œ [random test failure] Try to un-skip and fix LayoutBuilderNestedFormUiTest::testAddingFormBlocksToOverrides in context of [#3353085] Fixed
  14. BlockFormMessagesTest::testValidationMessage() πŸ“Œ [random test failure] Try to un-skip and fix BlockFormMessagesTest::testValidationMessage() in context of [#3353085] Fixed
  15. πŸ“Œ Skip Drupal\Tests\media\FunctionalJavascript\MediaSourceFileTest Fixed
🌱 Plan
Status

Active

Version

11.0 πŸ”₯

Component
BaseΒ  β†’

Last updated 2 days ago

Created by

πŸ‡¬πŸ‡§United Kingdom catch

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

Not all content is available!

It's likely this issue predates Contrib.social: some issue and comment data are missing.

Production build 0.71.5 2024