Skip to content

RP001 Usability Testing Round1

Bonnie Wolfe edited this page May 23, 2024 · 1 revision

TBD: Short paragraph on goal and purpose of this usability testing.

Contents

  1. Prerequisites
    1. Internal Testing
    2. Test Plan
  2. Preparation
    1. Website Overview Page
    2. Target Users
    3. Sample Project Landing Pages
  3. Recruitment
    1. End Users
    2. Volunteer UXRs
  4. Interview Logistics
    1. Interview Materials
    2. Tool Setup
    3. UXRs Training
  5. Results
    1. Interview Records
    2. Data Analysis
    3. Identified Issues
    4. Journey Map
  6. Additional Resources
    1. Guide to Usability Testing
    2. Referenced Resources
    3. Contact Us

1 - Prerequisites

i - Internal Testing

ii - Test Plan

  • Created a test plan which was tailored to the product end users

2 - Preparation

i - Website Overview Page

  • Built an overview webpage which presents the LA TDM Calculator project
    • Serves as a current landing page for user interviews in usability testing
    • Introduces LA TDM Calculator Project detailing about:
      • TDM and TDM Calculator
      • TDM Program Update
      • Current status of TDM Calculator
      • Resources from LADOT
    • Becomes future homepage for the HfLA TDM Calculator project
      • Future state of the website will be an overview of the project detailing about HfLA's contributions
      • The design will have to be reworked to make a clear distinction from the TDM calculator and our project which seeks to work on government calculators

ii - Target Users

iii - Sample Project Landing Pages

3 - Recruitment

i - End Users

  • Recruited 31 interested end users via distributed user survey on ArcGIS platform
    • Summarized demographic information of all interested end users who responded to the user survey
      • Intended to check if the sample is representative and help assigning interested end users into corresponding groups
  • Sent invitation to interview to interested end users through coordination with LADOT and LACP

ii - Volunteer UXRs

4 - Interview Logistics

i - Interview Materials

  • Steps used in finalizing the draft
  • Script Template for Interviews: Template - TDM Calculator Usability Testing Discussion Guide
    • Description: Interview Script and Template for 1:1 interviews including intro, site testing, SUS scores and closing questions, which helps UXR to follow the same procedures for all interview sessions and make notes accordingly as interviews go. A copy of this template is created for each interview and the link placed into the Usability Testing Session Table
  • Background Image for interview
    • Description: Zoom background image for UXRs to use for interview sessions
  • 02 Usability Testing Session Table
    • Description: Contact management spreadsheet used by the Project team to understand the status of the outreach being done by LACP and LADOT and pairing each interview with the interviewer and all the information they required to conduct the interviews including their name and email, designated interviewee guides/notes, individual link to the websites (sample project info if they don't have one, login credentials, SUS and scale question outline), project type, username and passwords, and interview time

ii - Tool Setup

  • Used the [email protected] to setup the following tools
    • Zoom: Used to conduct interviews by UXRs
    • OtterAi: to transcribe the interviews
    • Calendly: Used to allow interviewees to select/add to calendar time slot they are available.
    • Google Calendar: For the Calendly integration
    • Slack (provided by HfLA)
    • Zapier (free): used to do the automated posting to our slack channel when someone chooses a time in Calendly
    • Otter.ai (paid) -> KEVIN NEED TO WORK ON THIS!!!!!!!
    • Doodle (free)?

iii - UXRs Training

Pre-Interview

Post-Interview

  • 06 TDM Usability Testing - UX Team Lead Documentation / Responsibilities
    • Description: UXR Team Lead overview of the responsibilities for each team member to ensure follow through with end user interviewees with guidance on the following topics:
      • How UXRs claim interviews as the interviewees sign up for time slots.
      • What UX team lead should do when time slots are not claimed.
      • How Team Lead notes session responsibility in the Usability Testing Session Table
      • How Team Lead handles zoom link not working for UXR
  • 07 TDM Usability Testing - Researchers Documentation / Responsibilities
    • Description: Volunteer UXRs overview of the responsibilities to ensure follow through with end user interviewees with guidance on the following topics:
      • How UXRs respond to interviews' email invitation after being the first one claim timeslots
      • Where UXRs find all the resources (included in the Usability Testing Session Table) to prepare and conduct the interviews
      • How UXRs change Zoom background for interview sessions
      • Additional resources to help UXRs understand the interview processes and TDM Calculator project, and get assistance

5 - Results

i - Interview Records

ii - Data Analysis

iii - Identified Issues

iv - Journey Map

6 - Additional Resources

i - Guide to Usability Testing

ii - Referenced Resources

  • Our survey questions were informed by the survey work Hack for LA's Open Community Survey project did with EmpowerLA (see their survey)

iii - Contact Us

Return to Contents

Clone this wiki locally