Implement automatic visual regression testing

Created on 10 September 2024, 7 months ago

Problem/Motivation

Automatic visual regression testing is useful for any site that has deployments, but it would be especially useful on a site like api.drupal.org, which has static content. You can test that the content remains the same across different deployments. It would have caught many current issues before they were released.

Proposed resolution

There are a variety of automatic visual regression testing services, TestSigma, Saucelabs, Applitools, BrowserStack. There is Diffy that supports Drupal specifically. You can also build your own automatic visual regression testing using tools like selenium and BackstopJS.

Remaining tasks

Pick an approach
Implement it

✨ Feature request
Status

Active

Version

2.0

Component

Tests

Created by

πŸ‡ΊπŸ‡ΈUnited States charginghawk

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

  • Issue created by @charginghawk
  • πŸ‡ΊπŸ‡ΈUnited States drumm NY, US
  • πŸ‡ΊπŸ‡ΈUnited States cpierce42

    Core has nightwatch as optional test running. Could that be extended to use the Visual Regression testing add on?

  • πŸ‡¨πŸ‡¦Canada ygerasimov

    Diffy founder here. You have our full support. Just let me know how we can help.

    Easiest would be if the staging environment is accessible from the internet -- we could take screenshots and compare them to production.

    I am not much familiar with the development workflow of the site so please point me to the documentation.

Production build 0.71.5 2024