User Research isn't something that comes along in the process of product or service development; it is deeply affected by every decision in design and development.
Ensure that the process of user research is properly implemented by:
- Involving users throughout the process
- Engineering it into products and services through an interative design and development process
- Allowing usability and users' needs to drive design decisions
- Working in teams that include skilled usability specialists, interface designers, and technical communicators
- Setting quantitative and qualitative research goals early in the process
- Testing products and services for usability, but also integrating usabilty testing with other inspection methods for ensuring usabilty
- Being committed to making technology work for people
This page covers Usability inspections, which is a generic term for several methods. When the subject of Usability and user testing comes up, there are typically two elements that deter the process from evolving. The first is time and cost. It’s true that time is required to develop proper testing, build user profiles, test users in the field or in a lab, and gather the final results for analysis. The cost of all those parts can be considerable, if we simply look at empirical Usability testing, which is often and erroneously promoted as the only way to go. That’s not to say that empirical Usability testing isn’t valuable. It is indeed highly valuable. Taking time and cost into consideration though, there is an even more costly road that companies often take: redeveloping after market goals are not attained. Redeveloping in the aftermath is often damaging to a developing company, but it can be very damaging to a large company trying to develop new and innovative technology in the hopes of gaining new revenue platforms that will prevent stagnation. Simply put, performing quality research and analysis of user needs before development yields greater return on investment.
The following list is drawn from the book, Usability Inspection Methods, by Jakob Nielson and Robert L. Mack. They did not invent the methods, but are responsible for culling them all together in meaningful text. I always like to offer up the following list as a way to start working toward interacting with the user community, and allaying any fears about usability inspection methods. You’ll see that we have already covered some points in the list, but a deeper inspection with greater attention is warranted. You’ll also see that some of the points may not applicable to Verizon. These can be easily recognized and judged. Finally, these methods are not set in stone. They can be combined and even built upon to create a hybrid inspection method(s) that suits Verizon’s needs.
- Heuristic evaluation: This is the most informal method and involves having usability specialists judge whether each dialogue element conforms to established usability principles. These principles are normally referred to as the heuristics and give the method its name.
- Guideline reviews: These are inspections where an interface is checked for conformance with a comprehensive list of usability guidelines. However, since guideline documents contain on the order of 1000 guidelines, guideline reviews require a high degree of expertise and are fairly rare in practice. The method is somewhat of a cross between a heuristic evaluation, discussed previously, and a standards inspection, which will be discussed further on in this list.
- Pluralist walkthroughs: These are meetings where users, developers, and human factors people step through a scenario, discussing usability issues associated with dialogue elements involved in the scenario steps. This allows the information designer/tester and developer to work closely with defined goals that help to achieve the ultimate goal of timely completion and delivery to market, as well as the most usable product possible.
- Consistency inspections: These types of inspections have designers that represent multiple projects inspect an interface to see whether it does things in a way that is consistent with their own designs. Thus, consistency inspections are aimed at evaluating consistency across the family of products that has been evaluated by an inspection team.
- Standards inspections: These types of inspections have an expert on some interface standard inspect the interface for compliance. Thus, standards are aimed at increasing the degree to which a given interface is in the range of other systems on the market that follow the same standards.
- Cognitive walkthroughs: Cognitive walkthroughs use a more explicitly detailed procedure to simulate a user’s problem-solving process at each step in the human-computer dialogue, checking to see if the simulated user’s goals and memory for actions can be assumed to lead to the next correct action.
- Formal usability inspections: A formal usability inspection is intended to be very similar to the code inspection methods with which many developers are already familiar. In this method, the various participants have well-defined responsibilities: a moderator is appointed to manage both individual and focused inspections, and the full team inspection meeting; a design owner is responsible for design and redesigns; the inspectors have the job of finding problems; and a scribe records all defects and issues identified during the meetings. Inspections are performed through a six-step process: planning, a kickoff meeting, a preparation phase where inspectors review the interface individually, the main inspection review when the inspectors’ lists of usability problems are merged, and a follow-up phase where the effectiveness of the inspection process itself is assessed.
- Feature inspections: These focus on the functionality to be delivered – the usefulness of interface function, and not simply the usability of the interface as an implementation of the function. For example, whether the function, as designed, meets the needs of intended end-users. Feature inspections can involve not only evaluation of a function, but can also involve the design of that function.
In order to get the most out of any inspection method, User & Task Analysis must also be taken into consideration. I will provide details concerning User & Task Analysis in my next document. Developing User Profiles helps to focus on user goals, macro and micro tasks, and ultimately develop a true requirements document that combines business requirements and user goals.
[ Top ]
The following heuristics can be used for many different aspects of evaluating users' experience when interacting product or even a service; this includes all elements of technology testing and template/document design, as well as how people work together to accomplish specific goals. Ultimately, incorporating a good set of heuristics and following a rigorous usability testing procedure saves money because development takes place only after user tasks and goals as well as business requirements are fully detailed and understood.
- Follow archetypes when applicable
- Use concise language
- Speak the user's language
- Temper consistency with context
- Provide feedback (visibility of system status)
- Provide clearly marked exits
- Match between system and the real world
- Recognition rather than recall
- Provide shortcuts
- Aesthetic and minimalist design
- Dynamic modularity
- Create error messages that empower
- Error Prevention
- Offer adequate performance support
For more detailed heuristics and review criteria, a usability review template and a standard usability testing template with an outlined task and timing list can be developed. The available basic samples were developed for Genuity in the late 1990s; they remain intact. New templates are developed and customized as needed.
[ Top ]
The User Interview (PDF)
Implementing a user-centered design process in an organization requires a methodical selection of methods as well as gauging the effectiveness of those methods in the outcome (company goals, user adoption, greater return on investment, etc.). This is achieved by building UX Maturity into the organization so that everyone clearly understands the selection, benefits, and measurable outcome. Starting with a UX Maturity Menu is one way to get business leadership and development talking and invested in the understanding and selection of user research practices and experience design assets; this leads to streamlined growth and innovation.
UX Maturity Menu (PDF)