For my instructions project, I think that a document markup test (described in Instructor Blog #6) will be most appropriate for my project. I think this test would be most appropriate for my instructions because it will help me identify the places in my instructions where I haven't explained clearly how to find the commands or buttons in the InDesign workspace. I have read several InDesign instructions (and other Adobe programs, e.g. Photoshop) that can be very confusing because they don't clearly explain where the tools are located or how they function, and I think it can be difficult to explain these types of things once you know how to use them.
In my test, I will have a peer attempt to re-create a sample master page and then apply it to an actual document. I will post the sample text and graphic files to use in the sample page for the usability test.
I think that this test will help me find the instances in my instructions where someone who is unfamiliar with the process of creating and applying a Master Page works through the process while using my document would help me improve the wording and explanation of my instructions, as well as identifying the portions that require more broken down steps, even in the expert instructions. (Hopefully someone in the course is familiar enough with InDesign to help me improve those!).
Specifically, I hope the usability test will also help me use effective graphics. As someone who has worked with the InDesign work space for a long time, I feel as though I might have trouble identifying what will be most helpful to my audiences visually. It's hard to remember what was confusing or what I had trouble finding when it's been years since I started using this version of the program.
An Expert Teaching A Novice
Kristen, for your instructions regarding InDesign I believe that you have chosen the correct usability test. With a software system that not many people have used before, and you have obviously used it a lot, it is going to be hard for you to remember every single step you used to do when you first started using it. Personally, if I was doing your test I would not have a clue what I was doing and would need to have every step told to me with specific details. Having your test taker try and make the same sample that you did from following your instructions will show you the areas that you need to improve upon in your instruction set and point out what information you have left out.
Some good advice for making your instructions would be to think of the first time you used InDesign and all of the problems you had with it, and then go step by step from there.
Remebering when you were a novice
I agree with you and Joey that after using a piece of software for a long time. It starts to become so second nature, that it is very hard to remember which parts of it gave you trouble the first time you used it. I remember when I first learned how to use visual studio, I had to have someone show me what to do at almost every step, and now I can use it without thinking. Because of this it can be difficult to write instructions for novices using the software for the first time. I think having someone try and go through and recreate the Master page that you did is an excellent way to make sure your instructions are clear and easy to use for every step.
Patrick Griffin
pgriffin@purdue.edu
Examples vs. Custom Documents
I'm not sure that I completely understand your strategy for the test. Correct me if I'm wrong, but do you plan on supplying the sample text and graphics to the user to make a generic layout that can be used to create a new document for the user's own purposes? If this is true, then I'd agree that it will probably be effective in creating the document correctly, but the user may be deterred to go to so much trouble. Personally, I prefer instructions that show me how to use a program or apply tools for my own purposes, instead of creating samples or examples. I'm not familiar with InDesign though, so if the purpose of the program is to create templates for the user, then maybe this is a good approach. Secondly, I'm glad you're focused on using effective graphics. As a new user, one of my primary concerns would be locating tools within the program. For your project especially, the usability test will be important for making sure that the readers don't get lost.
InDesign = Buttons
I just looked up InDesign, I've never used it before, but it looks like it can be rather complicated. You're probably right, the mark up test will be best in this case. I wouldn't rule out the read and locate test though; this program (as well as most other Adobe programs) have seemingly infinite tools, buttons, and options. If the reader can locate where you reference a specific button or action in the text easily and quickly-this could indicate their level of understanding. It is easy, when skimming a document, to skip over something you aren't familiar with, this could be an indicator to that end. I'm probably not explaining this very well, but think about it. Also, this would depend on the length of the document-it wouldn't be worthwhile if it were short, but I expect that it won't be.
include icon pictures
Your topic for this project is very specialized and many people will not be familiar with it, so having someone peer review your instructions sounds like a good idea. That will help you see all the areas in which you are so familiar with, that you weren’t able to fully explain. I also think that it would be appropriate to have the user locate each icon and button in the design program, by describing in your instructions exactly where each icon and button is and what it looks like. For a topic like yours that is very specialized I think it will be most beneficial for you to have pictures of the different buttons you must push to operate the program, because so many people are not excellent at computer usage.
Jumping a big gap in expertise
I really like the idea of using markup in a case (like yours) where the difference between your level of expertise and the users' is especially high. As you said, you've used InDesign extensively, so you might have a hard time figuring out what the basics are and how to communicate them to a beginner. Using something open-ended like a document markup allows the user to tell you "I didn't get this part." You will get feedback you weren't expecting, and suggestions on areas where you didn't realize you needed improvement.
Recreation
I like your idea about having a peer trying to recreate what the instructions are trying to say. This seems like a great way to find out if an inexperienced user is able to due what you are trying to get them to do through your instruction set. The only thing that I have to recommend about this testing process is to possibly try and get more than one of your peers to perform this test. This will help cover any problems that one user is able to figure out but someone else may not be able to.
Photoshop Instructions = Confusing, well usually
If this InDesign program is anything like other Adobe programs, yes identifying the proper tools will be a challenge. This seems to always be the hardest thing for me in Photoshop instructions. I think its good that you have identified this issue though. It appears you are working hard to circumvent these issues though! Having your tester try and recreate something in this program is a great idea. Letting them markup will definitely show you where you may have fallen short. You may also want them to specifically note how they did find a tool if they had trouble finding it with just your instructions, i.e. did they use a search function to find the tool or just peer around the screen? This will help you establish what may be easier for them in finding the proper tools.