RP003A Tooltip Usability Test

View full report here

Contents

1. Prerequisites
   1. Test Plan
2. Preparation
   1. Website Overview Page
   2. Target Users
   3. Sample Project Landing Pages
3. Recruitment
   1. End Users
   2. Volunteer UXRs
4. Interview Logistics
   1. Interview Materials
   2. Tool Setup
   3. UXRs Training
5. Results
   1. Interview Records
   2. Identified Issues
6. Additional Resources
   1. Guide to Usability Testing
   2. Referenced Resources
   3. Contact Us

1 - Prerequisites

i - Test Plan

• Created a test plan which was tailored to the product end users
  • Referenced RP002 prior usability testing 2
    • Research Plan: Usability Testing 2: Study Plan - TDM Internal testing within HfLA [Brainstorming Phase - can use for next round of testing]
  • Discussed Recruitment with Stakeholder
    • See Target Users section below
  • Test Plan (depreciated) - team never created but the research was done
  • Participant Tracker - contains PII stored in the PII drive

2 - Preparation

i - Website Overview Page

• Reused the overview webpage [website needs update] which presents the LA TDM Calculator project
  • Serves as a landing page for user recruitment in usability testing
  • Introduces LA TDM Calculator Project detailing about:
    • TDM and TDM Calculator
    • TDM Program Update
    • Current status of TDM Calculator
    • Resources from LADOT

ii - Target Users

Reused work from prior usability testing

• Identified and grouped users types into buckets that best represent end users
  • Specified user permission levels and user stories in context of TDM Calculator to later match end users with the appropriate sample project landing pages
  • Referenced survey from EmpowerLA which is another HfLA project

New for this usability test

• Utilized HfLA community to represent users for usability testing

iii - Sample Project Landing Pages

• Worked with LADOT and LACP to Created landing page assets
  • Reviewed content of the LADOT/LACP landing pages
  • Referenced Landing page content from previous research
  • Referenced sample test cases to determine sample project information
• Created Landing page assets to use during user interviews. Text in both landing pages is the same, however the Green Boxes with the “LA TDM Calculator Website” text on each page go to different versions of the calculator (UAT & Dev). Purpose of the two environments was to test the before and after with the same user, to see if the users from both groups had the same experience or if the changes led to easier discovery of the tooltips.
  • Landing Page - UAT
    • Get image of create project page from TDM Calculator Usability Testing Discussion Guide [TEMPLATE]-Current Active to show the Before version
  • Landing Page - Dev
    • Get image of create project page from [3-18-23] Tooltip Discoverability - Presentation Final to show the After changes were
  • Instruction Landing Pages created for individual user tests - these are from Research #2

3 - Recruitment

i - End Users

Reused work from prior usability testing

• Sent out slack messages with a recruitment form on HfLA slack channels for internal usability testing and received 11 responses from the HfLA community
• Conducted internal usability tests within the HfLA community. Recruited 11 surveyed users interested end users via distributed TDM Internal Testing on HfLA platform Summarized demographic information of all interested end users who responded to the user survey
  • Intended to check if the sample is representative and help assigning interested end users into corresponding groups
• Sent invitation to interview to interested end users through coordination with HfLA interviewers
• Contacted participants directly on slack to schedule and confirm testing session time
• Organized scheduling and testing information on a participant tracker
  • Enrollment Log: contains information about each participant’s name and email, interviewer, testing date and time, and confirmation status
• Need to process data/result of end users who actually registered for the interview sessions to help determining appropriate sample projects for each registered end users

ii - Volunteer UXRs

• Prepared materials to interview volunteers from HfLA UX/UI community
• Prepared survey for UXR volunteer interest. Did not utilize the survey.

4 - Interview Logistics

i - Interview Materials

• Referenced usability testing 2
• Script template for interviews
• Description: Interview Script and Template for 1:1 interviews including intro, site testing, and closing questions, which helps UXR to follow the same procedures for all interview sessions and make notes accordingly as interviews proceed. A copy of this template is created for each interview and the link placed into the Usability Testing Session Table.
• Background image for interviews - zoom background image for UXR interview sessions
• Enrollment Log: contains information about each participant’s name and email, interviewer, testing date and time, and confirmation status

ii - Tool Setup

• Used the TDM-UX@Hackforla.org to setup the following tools
  • Zoom: Used to conduct interviews by UXRs
  • OtterAi (paid): to transcribe the interviews
  • Calendly: Used to allow interviewees to select/add to calendar time slot they are available.
  • Google Calendar: sent out calendar invites
  • Slack (provided by HfLA)

iii - UXRs Training

• No training was conducted specific to this round because training was smaller in scale, internal, and there were no new UXR volunteers.
• Current UXRs reviewed prior usability testing documentation to ensure consistency between previous testing and the tooltip usability testing.

5 - Results

i - Interview Records

• Interview Records - link to interview recordings
• Data Management Cleaning and Analysis
• Finding Report - link to stakeholder report

ii - Identified Issues

• Identified Issues - link to Issue Tracker
  • Proposed solution - link to design presentation

6 - Additional Resources

i - Guide to Usability Testing

• Guide to Usability Testing - Beginner’s Guide to Usability Testing by Maze

ii - Referenced Resources

• Dogfooding GitHub Issue - link to GitHub
• Previous Research - link to Github Wiki page
• Miro Board - link to Miro Board
• Technology Guidelines

iii - Contact Us

• Our Slack channel: #tdm-ux

Return to Contents