Effect of gender difference and survey design in a tool usability testing
Date
Authors
Major Professor
Advisor
Committee Member
Journal Title
Journal ISSN
Volume Title
Publisher
Altmetrics
Authors
Research Projects
Organizational Units
Journal Issue
Is Version Of
Versions
Series
Department
Abstract
Good user satisfaction facilitates a company to confirm its value and also is the key to secure customer loyalty and achieve the goal of competitive advantage. User satisfaction can be measured by many market research techniques. A common approach nowadays is usability testing. In the process of the measurement of user satisfaction, we believe the impact of gender difference cannot be ignored. Because of the physical and psychological differences between men and women, their perceptions of things are also affected. Thus, taking this effect into account during the usability testing process may be helpful in the evaluation of a product.
In addition, the use of a questionnaire as a survey method was widely used and proven effective in previous studies to collect data from users in many fields, such as internet service, digital equipment, public transportation, housing, banking industry, etc. A well-designed questionnaire has a positive impact on user's comprehension of the questions and the whole user testing process. Researchers have been developing good solutions to help respondents understand the questionnaire. Some studies also attempted different survey methods to help respond-ents answer image-based surveys and video-based Web surveys.
This paper reports a tool study of people's gender influence on subjective perception in a drill usability testing based on the questionnaire survey method, and it reports how the perception and survey influence their feedback.
To determine the characteristics of an electric drill that the user prefers, we designed a questionnaire survey for people who possibly have a demand for an electric drill to meet the needs of daily work and life in the future. The questionnaire was used for two purposes: one was to ask the participants to rate the comfort level of their muscles in the experiment, and an-other was to collect their feedback on the design and form of the questionnaire itself. In this study, we tested their satisfaction with different concerns of three different makes and models of electric drills. This study has three assumptions. The first one is that male participants and female participants have different concerns about the use and purchasing of drills. The second one is that a questionnaire survey can influence the decision participants make for product selection. The third one is that, compared to the electronic form questionnaire with only questions, visual assistances help make it easier for participants to understand the questions and review the experience.
The results show in this case that gender difference has no significant impact on the feature concerns of the drill, even the drill preference and the total evaluation of the drill. The results regarding the second hypothesis show the questionnaire did not have a significant impact on people's preference of the drill but did help them to make easy and better decisions. For the survey method comparison, the results show the video survey was not accepted by half of the participants. The best questionnaire form was to have questions with image assistance, which effectively helped participants better understand the questions.
Even though these results may not be very helpful in the development of the usability of power tools due to some limitations in the study, the survey method part could be a reference to a future study in helping with questionnaire design and development.
Future related work could also consider the limitation of this study as a reference to help develop better investigation.