Memorandum

To: Professor Vytautas Malesh

From: Matthew Gatzek
Date: March 4th, 2016
Re: User testing of wikiHow Instructions
Introduction:
This memo is regarding the user test results for my wikiHow instructions set, How to Draw a
Pitbull. Namely, the instructions are set out to show the user how to draw a simple line art head of a
pitbull. The instructions are targeted towards novice- and intermediate-level audiences, with little to no
background in drawing or art (expert artists could use my instructions, albeit they could surely provide
better instructions themselves).
The user test was conducted via a small survey following completion of the instructions. The user
results were overall positive, with only a few minor critiques on small portions of the instructions.

Objective:
My user test was designed to evaluate the usability of the language that accompanied each
illustration. I believe it is very easy to follow step-by-step illustration instructions just by looking at the
pictures, but the wikiHow community needs words accompanying illustrations in order to provide the best
possible instructions for as many users as possible. I wanted to ensure that the language was both
understandable and helpful.
My user test was also designed in such a way that I wanted to see whether or not the users were
pleased with the end result of their drawing. If the users can perform the task at hand, then the instructions
prove to aid in producing an end result. However, I was not looking for the users to simply be able to
recreate the image, but also be pleased with the end result of their labor.

Method:

I used three classmates to test my set of wikiHow instructions. I didnt necessarily choose the
participants, but rather held my hand up and announced, Who wants to test my instructions? They are
about how to draw something. Of the three participants, two were novices and one was intermediately
skilled.

The three users provided feedback via a 5-question survey with a Likert scale format. For each
test, we only had roughly 20 minutes, 15 committed to testing and 5 committed to gaining feedback. The
quick questionnaire asked the questions I felt were most pertinent to my objective, as well as provided the
users with a chance to vary their answers.

The surveys, as shown in Appendices A-C, were quick to fill out and made more sense to me than
conducting individual interviews. I provided a space and specifically asked for a few lines of additional
feedback so that each user could provide me with their abstract overall thoughts of my instructions, as
well as specifically point out any issues that may not have been covered in the 5 questions.

Each student was handed a survey following the completion of the instructions and were allowed
to revisit the instructions in order to reference any specific problematic steps or layout errors. They were
each finished within 2 minutes, which left us time to discuss the instructions and survey, as well.

Results:

The results of the user test were more positive than I expected them to be. The main problem I
was worried about was the description of each step. It is easy to visualize organic forms and shapes, but I
found it very difficult to accurately describe the steps as I drew them. There were also a few vague
statements like draw a curved line which I felt wouldnt be very descriptive to the user.

Nonetheless, most all the user feedback I received was positive. I received no debilitating
comments which made me reconsider major aspects of my instructions, which helped me to focus in on
smaller, less noticeable errors.

The survey sheets provided much more feedback than the small discussion I had with each user
following the completion of the survey. Users A and C had nothing but good things to say, which instilled
a sense of confidence in me. However, it would have been more productive to receive more constructive
criticism so that I could enhance the usefulness of my instructions even more.

User A, a novice tester, found that the language was easy to follow and made sense whilst
accompanying the illustrations. She decided that the pictures were the most useful feature of the
instructions, as they helped guide her and make sense of the written steps. She was very happy with the
end result of the test, and she was surprised that she recreated the drawing as well as she did.

User B, an intermediate tester, did not provide much use during the user test. He simply followed
the pictures, which he found to be the only important feature of the instructions. Although it was nice to
know that the steps were easy to follow, I would have preferred more feedback regarding the written
instructions themselves. He did not say much when we discussed the instructions and survey, either, and
did not really comment on his end result.

User C, another novice tester, provided me with the most helpful feedback. He, like user A, found
that the written instructions were very clear and concise, and they helped him in completing the task. He
agreed that the illustrations helped him the most during the testing period. He said he had not really drawn
something in nearly two years, and he was the most pleased and surprised with how well his end result
turned out.

All three users exclaimed that the pictures were the defining feature of the instructions, and
helped make the instruction set much more usable. I took step-by-step pictures to ensure that each user
would know exactly what to do for each step. I was worried that the length of my instructions, 34 separate
steps, may have proved tiresome to the users, but they each finished the instructions with ease in around 5
minutes.

All three users pointed out a very obvious adjustment I needed to make to my instruction: the
pictures were all sideways when I uploaded them. This made for a bit of trouble when completing the
instructions, as the users had to tilt their head to match the orientation of the illustrations. The minor
problem was a quick fix, and upon revision, the instructions appear much more professional and usable.

There were only a few more adjustments I made to the instructions. I added a small FAQ/Tips
section, and I formatted a few steps differently. User C noted I should have explained Step 14 in more
detail, but I felt the language I used in the instructions was easy enough to follow in-unison with the
illustration.

Conclusion:

I believe that the user tests proved that my instructions started off very thorough, detailed,
and informative, and after the reading the surveys, I realized I did not have that much to tweak in
my instruction set.

My main concern was my abstract explanations of how to draw an organic figure. While
it is fairly easy to draw, putting each step into words proves a separate challenge. I felt that my
over-descriptive steps may have hindered the user from performing the test, and that the lengthy
34 steps would prove tiresome or boring to the users.

However, after conducting the user tests, the users (A and C, especially) helped me
realize that the wordiness of my instructions only helped to simplify the drawing. They felt it was
easier taking it step-by-step rather than as a few, broad steps.

The few changes I felt necessary to maximize my instructions were to adjust the
orientation of my illustrations so that the pictures were not sideways. This proved to not only
make the steps easier to follow, but also made the instructions look more professional and
complete. I also added a small FAQ/Tips section, to answer address a few minor problems that
users may run into.

User C and I came to a disagreement when he felt I should describe a step a bit more
thoroughly. He felt the words accompanying step 14 were a bit vague, but I felt that the picture,
along with the lengthy description, were more than helpful in allowing the user to draw that step.

I was surprised with how well the instructions turned out, and even more surprised with
how committed I got to these instructions. I was initially annoyed with my topic and very unsure
of how I would produce a detailed instructions set for a simple task, but after hours of work, I
feel that they are to the best of my ability.

Appendix A: User A Feedback

wikiHow Feedback
Name: Jamie Hedges
#1: Written instructions were clear, concise, and detailed
1
2
3
4
5
Strongly
Agree
Neutral
Disagree
Strongly
agree
disagree
#2. Drawings helped you visualize the written instructions
1
2
3
4
5
Strongly
Agree
Neutral
Disagree
Strongly
agree
disagree
#3. Instructions were easy to follow and dialogue made sense
1
2
3
4
5
Strongly
Agree
Neutral
Disagree
Strongly
agree
disagree
#4. All steps were necessary and helped add to simplicity
1
2
3
4
5
Strongly
Agree
Neutral
Disagree
Strongly
agree
disagree
#5. You were happy with the end result
1
2
3
Strongly
Agree
Neutral
agree

4
Disagree

5
Strongly
disagree

Additional feedback:
Terminology used was very helpful and specific. The pictures also helped a lot also.

Appendix B: User B Feedback

wikiHow Feedback
Name: Jordan Shimel

#1: Written instructions were clear, concise, and detailed

1
2
3
4
5
Strongly
Agree
Neutral
Disagree
Strongly
agree
disagree
#2. Drawings helped you visualize the written instructions
1
2
3
4
5
Strongly
Agree
Neutral
Disagree
Strongly
agree
disagree
#3. Instructions were easy to follow and dialogue made sense
1
2
3
4
5
Strongly
Agree
Neutral
Disagree
Strongly
agree
disagree
#4. All steps were necessary and helped add to simplicity
1
2
3
4
5
Strongly
Agree
Neutral
Disagree
Strongly
agree
disagree
#5. You were happy with the end result
1
2
3
Strongly
Agree
Neutral
agree

4
Disagree

5
Strongly
disagree

Additional feedback:
I didnt actually read the instructions, I just followed the pictures.

Appendix C: User C Feedback

wikiHow Feedback
Name: Austin Morales
#1: Written instructions were clear, concise, and detailed
1
2
3
4
5
Strongly
Agree
Neutral
Disagree
Strongly
agree
disagree
#2. Drawings helped you visualize the written instructions

6
Not
applicable

1
Strongly
agree

2
Agree

3
Neutral

4
Disagree

5
Strongly
disagree

#3. Instructions were easy to follow and dialogue made sense

1
2
3
4
5
Strongly
Agree
Neutral
Disagree
Strongly
agree
disagree
#4. All steps were necessary and helped add to simplicity
1
2
3
4
5
Strongly
Agree
Neutral
Disagree
Strongly
agree
disagree
#5. You were happy with the end result
1
2
3
Strongly
Agree
Neutral
agree

4
Disagree

5
Strongly
disagree

Additional feedback:
The pictures are really the selling point of the instructions, good job. The only criticism I have is
about the facial features part where the eye accents are drawn that could use a bit more detail.
However, over all it was very well done.