Design prototype evaluation plays a crucial role in user experience assessment. This paper proposes an evaluation scheme to investigate interactions between design features of a product and user facial characteristics. Glasses frames design is used as an example to illustrate how the scheme works. 3D scanning technology is applied to capture the facial features of users and reconstruct their 3D face models. Those models allow us to post-process individual facial feature without changing the others. Subjects respond to three affective measures: confidence, friendliness, and attractiveness, signified by the faces wearing the factorized glasses frames. The results show that changing certain design features indeed influences the impressions of the faces with varied facial characteristics. The proposed scheme facilitates design of products related to personal appearance.