Computer-based rating method for evaluating multiple visual stimuli on multiple scales

Yaliang Chuang, Lin-Lin Chen, Ming-Chuen Chuang

Research output: Contribution to journalArticlepeer-review

2 Scopus citations

Abstract

In this research, two joint evaluation rating methods (focus-on-attribute and drag-and-drop) and a separate evaluation rating method (focus-on-stimulus) are proposed for rating multiple visual stimuli with respect to multiple scales. All three interactive methods incorporate a real-time adjusting mechanism, allowing respondents to interactively adjust their ratings. Using the traditional paper-and-pencil method as the basis for comparison, the performance of these computer-based rating methods and the proposed real-time adjusting mechanism were investigated. First, it was found that the computer-based methods not only produced results equivalent to those produced by the paper-and-Pencil method, but also improved the data quality by preventing the occurrence of missing values and allowing respondents to adjust their scores. Second, the two joint evaluation methods performed better than the separate evaluation method in terms of usage experience, test-retest reliability, and the likelihood of simulating the daily shopping experience, in which multiple consumer products are often compared simultaneously. Of the two joint evaluation methods, the drag-and-drop method received better subjective evaluations than the focus-on-attribute method. Third, the proposed real-time adjusting mechanism was found to obtain better subjective satisfaction in rating. In summary, for measuring multiple visual stimuli with multiple scales, the computer-based joint evaluation rating methods using a real-time adjusting mechanism were found to be better choices among the measurement tools investigated. (C) 2007 Elsevier Ltd. All rights reserved.
Original languageEnglish
Pages (from-to)1929-1946
Number of pages18
JournalComputers in Human Behavior
Volume24
Issue number5
DOIs
StatePublished - Sep 2008

Keywords

  • joint evaluation; separate evaluation; comparative rating; real-time adjustment

Fingerprint Dive into the research topics of 'Computer-based rating method for evaluating multiple visual stimuli on multiple scales'. Together they form a unique fingerprint.

Cite this