Usability evaluation

We ask participants to use commercial products or prototypes under development (including software), and by observing and analyzing their behavior we make suggestions on what users are able to use easily, and what needs to be improved.

What is a usability evaluation?

Recently, the opportunity has increased for people to use PCs, the Internet, and various other electronic devices. Therefore usability of these products is becoming more and more important.

Also, concepts and terms regarding usability, such as "Usability", "User centered design", "Accessibility" and "Universal design" have started to be used by people on a daily basis.

Currently, usability is becoming an increasingly more important element of a product, which affects the merchantability, design and quality of the design.

The state of the usability of a product has to be understood at all times during its planning, design and quality management stages. A "Usability evaluation" is an effective method that can be used to understand the usability of products, and its results can be used to identify problems and issues that need to be improved.

Our service

For our standard service, we will do all of the following tasks, from evaluation planning to debrief report.

• Evaluation planning
• Test preparation
• Participant recruitment
• Conduct usability test (Facilitate, observation record, camera shooting etc.)
• Analyze results (write report)
• Give report presentation at debrief session.

We will provide an evaluation method that meets clients' requirements (evaluation purpose, evaluation target, schedule, budget and various requirements).
Also in some cases, it is possible to request only a selection of the above deliverables.

Various evaluations

We can conduct various evaluations that meet clients' requirements, such as evaluation purpose or status of development of the target products.

Normal output

The normal output from a usability evaluation project will be as follows:

Written plan

This is a statement of agreement to agree the purpose, evaluation area, method, participants' requirements, task and schedule or the project that is written upon receiving the evaluation request. This describes the plan to carry out the evaluation work.

Observation sheet

This is a recording sheet created to record information during the tests. We encourage our clients to attend and observe the tests. They are welcome to use this observation sheet during the tests.

Report

This is a document, which records up the test results. Typically the document contains the following contents:

• Evaluation concept (evaluation purpose, method etc.)
• Task achievement (we capture and record where users come across problems or confusion during a series of tasks)
• Issue analysis (a list of usability issues as well as a description, the assumed cause, and direction on how to improve each issue)
• Prospect (points that cannot be captured in the issue analysis are described in the Prospect section)
• Materials (digital camera image of the test view, an index of video tape etc)

Videotape

Unedited videotape which captures the actions and speech of participants during the task will be provided. Clients can use this as a record of the test, to support the report or enlighten stakeholders in the office.

CD-R

Deliverables can be in the format of Word, Excel or JPEG files on CD-R. You can add or alter these for your own purposes.

Usability evaluation service procedure

Here, we would like to introduce the most basic work procedure that we follow:

• We ask about clients' requirements, such as evaluation purpose, evaluation target products, and desired participants' requirements etc.
• Based on the above result, we will write the plan, and have the clients check the contents, and revise.
• Based on the written plan, we will proceed with test preparation, such as starting the participants' recruitment, setting the test site up etc.
• We will have clients come and observe how things go with participants and see how they react during the tests.
• We will write up the test results into a report.
• We will give a presentation of evaluation results as a form of debrief session, and deliver the report.

Advantages of using our company

Appropriate evaluation plan

We will suggest the most appropriate evaluation method in compliance with your requirements (evaluation purpose, evaluation target, participants' requirements, schedule, and other various requirements).

Actually observe how participants act and what they say

With audio and image, you can understand clearly how participants operate and react during the session. Also you can ask questions to participants on the spot, via the facilitator during the session.
In addition developers who do not have much opportunity to contact users on a regular basis may be able to recognize anew of the importance of usability.

Detailed analysis

We will report in detail the products issues, assumed causes and how improvements can be made.

Past case examples

Case examples of usability evaluation on protocols

Case examples of usability evaluation on commercial items

How to request

Email: info@humaninterface.co.jp (sales representative)

We will reply with details and an application form.
* Please send us your request as soon as possible.

Create in 2001.08.15
Edit in 2003.09.01