Move performance test to selenium

Created on 25 July 2024, about 1 month ago
Updated 27 July 2024, about 1 month ago

Problem/Motivation

Move performance tests to selenium. Follow-up to 🐛 Performance test gitlab job is broken Active and blocks 📌 Deprecate non-W3C compliant testing Postponed

Steps to reproduce

Move job to use selenium and all tests are skipped.

Proposed resolution

Fix container. I'm pretty sure it has something to do with

  tags:
    - performance-test-runner

As the tests run successfully on selenium as part of the main job.

Remaining tasks

User interface changes

Introduced terminology

API changes

Data model changes

Release notes snippet

📌 Task
Status

Active

Version

11.0 🔥

Component
PHPUnit 

Last updated about 11 hours ago

Created by

🇬🇧United Kingdom alexpott 🇪🇺🌍

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Merge Requests

Comments & Activities

  • Issue created by @alexpott
  • Pipeline finished with Success
    about 1 month ago
    #233671
  • First commit to issue fork.
  • Pipeline finished with Success
    about 1 month ago
    #233677
  • Pipeline finished with Canceled
    about 1 month ago
    Total: 229s
    #233687
  • Pipeline finished with Failed
    about 1 month ago
    Total: 530s
    #233689
  • Pipeline finished with Canceled
    about 1 month ago
    #233701
  • Pipeline finished with Failed
    about 1 month ago
    Total: 4793s
    #233705
  • 🇬🇧United Kingdom catch

    Added verbose logging, the logging is more verbose but it's not giving me any more hints about what's going wrong.

  • 🇬🇧United Kingdom alexpott 🇪🇺🌍

    From the verbose we see:

    [0;37m[service:selenium__standalone-chrome-selenium-standalone-chrome-selenium] 2024-07-27T08:33:55.799363620Z 08:33:55.799 DEBUG [DriverService.start] - Starting driver at /usr/bin/chromedriver with [--port=6662, --log-path=/builds/chromedriver.log][0;m
    [0;37m[service:selenium__standalone-chrome-selenium-standalone-chrome-selenium] 2024-07-27T08:33:55.806694897Z 08:33:55.806 DEBUG [UrlChecker.waitUntilAvailable] - Waiting for [http://localhost:6662/status][0;m
    [0;37m[service:selenium__standalone-chrome-selenium-standalone-chrome-selenium] 2024-07-27T08:33:55.807341040Z 08:33:55.807 DEBUG [UrlChecker.lambda$waitUntilAvailable$1] - Polling http://localhost:6662/status[0;m
    [0;37m[service:selenium__standalone-chrome-selenium-standalone-chrome-selenium] 2024-07-27T08:33:55.807568985Z 08:33:55.807 DEBUG [ExternalProcess$Builder.lambda$start$0] - completed to copy the output of process 64[0;m
    [0;37m[service:selenium__standalone-chrome-selenium-standalone-chrome-selenium] 2024-07-27T08:33:55.810179587Z 08:33:55.809 WARN [DriverServiceSessionFactory.apply] - Error while creating session with the driver service. Stopping driver service: Driver server process died prematurely.[0;m
    

    So the key part seems to be that selenium fails to start up chromedriver - it'd be great to see what is in /builds/chromedriver.log

  • Pipeline finished with Running
    about 1 month ago
    #236250
Production build 0.71.5 2024