User Tests

Alison Divvya Kevin Igor

User Melissa Anita Rathore Jodie Yui

Time and 12/11/2017 14/11/2017, 14/11/2017, 14.11.2017, 7-8PM,

Place 15:12-16:0 6:00pm- 20:00-21:00pm house in Phuket
0pm, home 7:00pm, ,
in Pretoria apartment in apartment in
New Delhi. Shanghai

Role of INT, NTR, INT, NTR, INT, NTR, INT, NTR, OBSR
Group OBSR OBSR OBSR
Member

User Notes
User Reflection

01. Raw User Testing Notes (condendensed, readable version)

User #1:
a. Task 1: Searching and adding new products, comparing and nominating them.
i. Got stuck at changing search options such as currency and budget (in the
prototype).
ii. Couldn’t select multiple websites, didn’t know how to. Add an instruction.
iii. Did not understand what does add manually mean, was confused at an
overall level why so many ways of adding products was available. Wanted
to compare features before adding products. Consider reordering or
incorporating ‘compare feature’ while searching for products.
iv. ‘Pick from device apps’ feature was not clear. User thought it will compare
across all device apps.
b. Task 2: Sending out invites to friends, setting access settings, chatting and
commenting on products.
i. Order of collaboration menu was not clear. User needed to send out
invites first. Felt settings should be an overall menu item (as settings was
not present for every section)
ii. User did not end up exploring the collaboration channel menu options as
the user did not notice it.
iii. User thought thumbs up meant Facebook likes and comment icon meant
likes on the app.
iv. Some screens did not have a back button.
c. Task 3: Viewing and adding goals, viewing progress, adding transactions and
viewing financial options.
i. Finance options weren’t clear, whether the interest rate meant to pay or to
earn i.e. whether it was a loan or an investment.
ii. Did not understand what ‘category’ meant, whether a product category or
a priority category.
iii. No way to reach main menu until the user keeps going back to the first
‘goals’ screen.
d. Task 4: Creating and viewing queries.
i. Alert and notifications seemed out of place to the user, felt it should be
part of overall settings. The user did not explore this feature further.
ii. User did not understand whether the advice was from other people using
the app or from experts.
iii. No back button on multiple screens.
e. Responses to Interview Questions:
i. Easy to navigate, but not to return back to main and sub menus.
ii. Easy to understand and to use.
 iii. Goal graph was not clear - what the two lines meant. ‘Adding from device
apps’ was confusing. User also felt that comparing products should come
before adding products.
iv. Liked the fact that products could be collated and sorted all on one app.
Liked the idea of goals.
v. User disliked the inconsistency between the sections, some sections had
setting, others didn’t. User was of the opinion that ‘settings’ should be an
overall menu item i.e. in the dotted hamburger icon.
vi. User wanted an option to change the selected product even mid-way
through financing it, in such a case where the user may change his/her
mind while saving for a product.
vii. Not applicable.
viii. User couldn’’t understand where the money would be saved, or what the
financial options were. Suggested that clearer information regarding
finances would help understand that better.
ix. User felt that app would help collate, plan and save for the purchase but
still felt live interaction with the product was an absolute requirement for
any large purchase.

User #2:
a. Task 1: Searching and adding new products, comparing and nominating them.
i. User was unsure about the adding of products manually.
ii. The option to pick from device apps was not understood by user.

b. Task 2: Sending out invites to friends, setting access settings, chatting and
commenting on products.
i. Screens did not have a back button and user didn’t know how to get back

c. Task 3: Viewing and adding goals, viewing progress, adding transactions and
viewing financial options.
i. User was unsure about what category meant, and also some options
weren’t clear.

d. Task 4: Creating and viewing queries.

i. There were no back buttons on some of the screens.
ii. User wasn’t sure about what type of queries to post
iii. User was unsure about what type of alerts and notifications were going to
be set.
2. User Evaluation Reflection

Overall, our testing went well according to user tests that were set out. The testing that
was completed was intended to help us improve features of our prototype, such as
refining specific tasks and buttons, etc. We received valuable feedback through our
testing as well as some feedback from the users.

All activities completed in the user testing were helpful as it gave users a broad
overview of what the app would be about. Furthemore, the testing allowed us to gather
the opinions of group members and provided us with suggestions as to how we can
possibly improve our prototype.

All four group members took on the role of observing, taking notes as well as
interviewing, and, since all four of us have similar findings, we do not feel it is necessary
to do more usability evaluations.

User Test Results

Features that worked well:
1. User liked that all products could be viewed together. Goals helped plan towards
saving for a product. Feedback from friends was considered as both a positive
and a negative influence. User liked the fact that financial advice was available.
2. Users found it relatively easy to navigate through prototype because they are
familiar with standardisation aspects.
Features that did not work well:
1. User felt that the different sections weren’t uniform in tone and structure.
2. User did not understand addition of products, goal chart and shared queries quite
clearly.
3. Structuring of app needs to be a bit more consistent.
4. Users did not always understand what action needed to be completed first
5. Simplification of headings and actions to be taken by user
Additional features and design improvements:
1. Some more information on what addition of products means. Ability to compare
products before adding them.
2. An easier menu navigation, access to all menu items/ back button etc.
3. ‘Settings’ as an overall menu item and not part of certain subsections only.
4. Ability to add vendor contact details.
5. Ability to add extra expenditures on the product such as repairs/ restructuring etc.
6. Clearer financial options and what they entail.
7. Ability to change the finalized product mid-way through financing.
8. A way to request vendor to allow in-person interaction with product.
9. Introducing a landing page which gives users a clear overview of what actions
need to be completed first ( for example a mini slideshow that users can swipe
through)
10. Include more “shortcuts” for users to complete actions with more ease.
11. Include a search bar in the main heading page