Toolbar Prototype Usability Testing Phase 3

Created on 8 October 2023, about 1 year ago
Updated 20 November 2023, 12 months ago

Problem/Motivation

Previous user tests:

This round of tests was finally focused on testing the initial mobile implementation in person and discover how users react to the current implementation. The tests were conducted thanks to @AaronMcHale and @Emma Horrell during the sprints at DrupalCon Lille 2023 on Friday on the contribution room.

Some of the other items we wanted to tests were moved to 📌 Toolbar Prototype Usability Testing Phase 4 Active .

Results

7 pop-up tests were conducted at the DrupalCon Lile Contribution Day. The tests were done on a mobile device - iPhone 12 Pro Max and using the Safari web browser. We tested:

  1. When starting with the sidebar open, whether users could successfully navigate to the Language screen, which requires traversing several levels into the admin menu and (on mobile) requires scrolling.
  2. Whether when using the Umami demo site on mobile, starting on the homepage, if users could successfully identify the link to open the sidebar navigation.

The participants were a mix of those who had a lot of experience of Drupal Core’s admin IA and those who had less experience.

We identified the following:

  1. Users were able to successfully traverse the navigation to locate the Language screen (under Configuration, Region and Language). Users did not have to be prompted to scroll, when expanding Configuration, without prompting, it was clear to users that they needed to scroll to see all of the menu items.
  2. The font-size and spacing between items was not an issue for users at the top level, users felt that the font-size and spacing was as they would expect from a mobile interface. As users started to traverse the menu, most felt the font-size and spacing was okay, with one user specifically noting that this is what they expected, while another users was concerned by the decreasing font-size and spacing.
  3. When on the Umami site homepage, users were asked to open the navigation. Most users were first drawn to the Umami hamburger menu, but then very quickly reoriented and noticed the “expand sidebar” link at the top of the screen. Once oriented users understood the difference between the “expand sidebar” and Umami hamburger. However, one user did note that they were unsure if “expand sidebar” opened the navigation, while another user noted that the hamburger icon for “expand sidebar” was not what they would have expected to see.
  4. Some users were unsure if the “expand sidebar” top-bar was part of the site or if it was actually part of the mobile web browser. One user specifically noted that they expected the top-bar to be a dark color as that’s what they were used to currently.
📌 Task
Status

Fixed

Version

1.0

Component

Code

Created by

🇪🇸Spain ckrina Barcelona

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

  • Issue created by @ckrina
  • 🇬🇧United Kingdom AaronMcHale Edinburgh, Scotland

    7 pop-up tests were conducted at the DrupalCon Lile Contribution Day. The tests were done on a mobile device - iPhone 12 Pro Max and using the Safari web browser. We tested:

    1. When starting with the sidebar open, whether users could successfully navigate to the Language screen, which requires traversing several levels into the admin menu and (on mobile) requires scrolling.
    2. Whether when using the Umami demo site on mobile, starting on the homepage, if users could successfully identify the link to open the sidebar navigation.

    The participants were a mix of those who had a lot of experience of Drupal Core’s admin IA and those who had less experience.

    We identified the following:

    1. Users were able to successfully traverse the navigation to locate the Language screen (under Configuration, Region and Language). Users did not have to be prompted to scroll, when expanding Configuration, without prompting, it was clear to users that they needed to scroll to see all of the menu items.
    2. The font-size and spacing between items was not an issue for users at the top level, users felt that the font-size and spacing was as they would expect from a mobile interface. As users started to traverse the menu, most felt the font-size and spacing was okay, with one user specifically noting that this is what they expected, while another users was concerned by the decreasing font-size and spacing.
    3. When on the Umami site homepage, users were asked to open the navigation. Most users were first drawn to the Umami hamburger menu, but then very quickly reoriented and noticed the “expand sidebar” link at the top of the screen. Once oriented users understood the difference between the “expand sidebar” and Umami hamburger. However, one user did note that they were unsure if “expand sidebar” opened the navigation, while another user noted that the hamburger icon for “expand sidebar” was not what they would have expected to see.
    4. Some users were unsure if the “expand sidebar” top-bar was part of the site or if it was actually part of the mobile web browser. One user specifically noted that they expected the top-bar to be a dark color as that’s what they were used to currently.
  • 🇬🇧United Kingdom dunx

    ckrina credited dunx .

  • 🇩🇰Denmark NikMis Copenhagen
  • 🇪🇸Spain ckrina Barcelona

    Adding credit to everybody that participated on the mobile tests. Thanks all, it was super helpful!

  • Status changed to Fixed about 1 year ago
  • 🇪🇸Spain ckrina Barcelona

    Huge thanks to @AaronMcHale and @Emma Horrell for conducting this tests.

  • 🇬🇧United Kingdom dunx

    Good work team. And sorry for saying "Good luck with Drupal Madrid" about 30 minutes later. Yeah, that was me. Proper facepalm moment haha.

  • Automatically closed - issue fixed for 2 weeks with no activity.

  • Status changed to Fixed 12 months ago
  • 🇪🇸Spain ckrina Barcelona
Production build 0.71.5 2024