First Iteration Testing

For the testing of the first iteration of our prototype, we had already agreed upon what scenarios would be best to test and the documentation needed while testing. I personally had difficulty testing on mobile due to technical difficulties so opted instead to test purely on the desktop.

We tested independently and then later compared our results.

Participants overview

As part of my testing I tested with a total of six participants. Initial interviews involved family members (participants 1-3, table 1), these proved to be too informal resulting in interruptions and divergence from the tasks by participants. They proved not to be a total loss as it was possible to compare them against the earlier observational tasks performed by these participants and also acted as excellent preparation for myself.

Number Age Experience Gender
1 64 No Experience Female
2 68 Beginner Male
3 39 Average Male
4 28 Average Female
5 32 Expert Female
6 34 Expert Male

Table:1 Participants overview

Software

Various software packages where trialled such as Screenomatic and Lookback, due to licensing issues and hardware requirements Camtasia was selected.

Results

Due to users 1-3 videos not really being of presentable quality I will only show actual video and data results from users 4 – 6. For the full results which include all users please view the document at the following link, User Test results and Testers Notes

User #4 Test

Date: 17 / 01 / 18
Location:  Office
Time:  8min 46 sec
Experience Average
Have you seen this site before?   No
Just from looking at this site, what kinds of information do you think you could get from this site? Please be specific. It’s a cinema website

Table 2: User #4 details

 

 

Scenario #2
Observations: 
  • Wanted to use quick pick as she was familiar with it, (we hadn’t enabled it for this test)
  • Selected book now button, form carousel but wasn’t  aware this referred to the actual movie in the carousel
  • Had to prompt as there is only one way to get back to homepage
  • Commented that “our screenings” was not meaningful
  • Scrolls down and tries to select Paddington movie, (we hadn’t enabled it for this test)
  • User quite confused how to get to movies, this is mainly due to non- enabled items
  • Had questions about carousel and how it would function
  • Finds active link to whats on today after prompting as to how software works
  • Scrolls down and finds movie and selected time
  • Adds tickets with no issues
  • Seating selection is a little confusing, felt there should be a confirmation notice.
  • Adding food had a small issue with naming but may have been more to do with not reading titles.
  • Mentioned add button in food should be in the seating
  • Pay button make it bigger
Pathway:
  • “What’s on Today” after much clicking on disabled options

Table 3: User #4 Results

User #4: Exit Questions/ Impressions

  1. What is your overall impression of the site?
    • Good, clear, pictures would have made it easier
  2. What is your impression of the filter functionality?
    • Didn’t see it
  3. Do you feel this site is current? Why?
    • Yes, grid layout, blocks of content.
  4. What did you like best about the site?
    • Times clear and upfront and buttons, seats food and tickets not there till needed. Big buttons. Being able to see food in advance
  5. What did you like least about the site?
    • Our screenings caused confusion and felt foolish as movies were already there
  6. Is there anything that you feel is missing on this site? (Probe: content or site features/functions)
    • Ratings for movies, release date might show how busy cinema might be.
  7. If you were to describe this site to a colleague in a sentence or two, what would you say?
    • Quick
  8. Do you have any other final comments or questions?
    • Main navigation items unsure of their relevance search what does it do. Quick would have been useful if enabled.

——————————————————————————————————————————————————-

User #5 Test

Date: 17 / 01 / 18
Location:  Office
Time:  #2=2min 42 sec & #3=1 min 20
Experience Expert
Have you seen this site before?   No
Just from looking at this site, what kinds of information do you think you could get from this site? Please be specific. It’s a prototype or wireframe for a cinema website

Table 4: User #5 details

Scenario #2
Observations: 
  • Ignored filter menu
  • Finds Paddington movie easily enough.
  • First selected time option is not available, (not enabled)
  • No problem understanding accordion functionality
  • Seating, not immediately clear that seats had been preselected
  • No issues with task of adding food to the booking
  • We forced users to check the box for spam, this was an oversight when creating porotype.
  • Order complete page wasn’t clear where end of page was
  • User never uses the running total option down the bottom, probably because we didn’t set it as a task in the scenario
Pathway:
  • What’s on Today

Table5: User #5 Results

Exit Questions/User #5 Impressions

  1. What is your overall impression of the site?
    • Easy to use, straightforward, easy steps, seat election a bit of an issues
  2. What is your impression of the filter functionality?
    • Didn’t see it, (should have asked users opinion on the filters)
  3. Do you feel this site is current? Why?
    • Yes, laid out well, quick selection of options
  4. What did you like best about the site?
    • Including food, never seen that before and a good add on for children
  5. What did you like least about the site?
    • Overall fine, maybe make things clearer
  6. Is there anything that you feel is missing on this site? (Probe: content or site features/functions)
    • Profile icon bigger, more colour (but knows it’s a prototype)
  7. If you were to describe this site to a colleague in a sentence or two, what would you say?
    • Booking engine for movies and includes food,
  8. Do you have any other final comments or questions?
    • Very easy to use and understand

——————————————————————————————————————————————————-

User #6 Test

Date: 14 / 01 / 18
Location:  Home office
Time:  2min 34 sec
Experience Expert
Have you seen this site before?   No
Just from looking at this site, what kinds of information do you think you could get from this site? Please be specific. Well it’s clearly a site or prototype for booking Movies, yes, no?

Table 6: User #6 details

 

Scenario #1: 
Observations: 
  • Felt after selecting a time which had Mezz on it, why was it giving the option on the ticket selection to change the type of ticket.
  • Seating selection not as clear as could be. Moving the legend would be helpful and providing more feedback. But changes seating with ease
  • We hadn’t enabled all of the options for the food section which caused a small amount of confusion.
Pathway:
  • Carousel ‘Book Now button’

Table 7: User #6 Results

Leave a Reply

Your email address will not be published.

Proudly powered by WordPress | Theme: Baskerville 2 by Anders Noren.

Up ↑