“Understanding the impact of animated gesture performance on personality perceptions” by Smith and Neff
Conference:
Type:
Title:
- Understanding the impact of animated gesture performance on personality perceptions
Session/Category Title: People Power
Presenter(s)/Author(s):
Moderator(s):
Abstract:
Applications such as virtual tutors, games, and natural interfaces increasingly require animated characters to take on social roles while interacting with humans. The effectiveness of these applications depends on our ability to control the social presence of characters, including their personality. Understanding how movement impacts the perception of personality allows us to generate characters more capable of fulfilling this social role. The two studies described herein focus on gesture as a key component of social communication and examine how a set of gesture edits, similar to the types of changes that occur during motion warping, impact the perceived personality of the character. Surprisingly, when based on thin-slice gesture data, people’s judgments of character personality mainly fall in a 2D subspace rather than independently impacting the full set of traits in the standard Big Five model of personality. These two dimensions are plasticity, which includes extraversion and openness, and stability, which includes emotional stability, agreeableness, and conscientiousness. A set of motion properties is experimentally determined that impacts each of these two traits. We show that when these properties are systematically edited in new gesture sequences, we can independently influence the character’s perceived stability and plasticity (and the corresponding Big Five traits), to generate distinctive personalities. We identify motion adjustments salient to each judgment and, in a series of perceptual studies, repeatedly generate four distinctly perceived personalities. The effects extend to novel gesture sequences and character meshes, and even largely persist in the presence of accompanying speech. This paper furthers our understanding of how gesture can be used to control the perception of personality and suggests both the potential and possible limits of motion editing approaches.
References:
1. Norman Badler, Jan Allbeck, Liwei Zhao, and Meeran Byun. 2002. Representing and parameterizing agent behaviors. In Computer Animation, 2002. Proceedings of. IEEE, 133–143. Google ScholarCross Ref
2. Yoav Benjamini and Yosef Hochberg. 1995. Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society. Series B (Methodological) (1995), 289–300.Google Scholar
3. Peter Borkenau, Steffi Brecke, Christine Möttig, and Marko Paelecke. 2009. Extraversion is accurately perceived after a 50-ms exposure to a face. Journal of Research in Personality 43, 4 (2009), 703–706. Google ScholarCross Ref
4. Peter Borkenau and Anette Liebler. 1993. Consensus and Self-Other Agreement for Trait Inferences from Minimal Information. Journal of Personality 61, 4 (1993), 477–496. Google ScholarCross Ref
5. Matthew Brand and Aaron Hertzmann. 2000. Style machines. In Proceedings of the 27th annual conference on Computer graphics and interactive techniques. ACM Press/Addison-Wesley Publishing Co., 183–192.Google ScholarDigital Library
6. J Cappella and M Palmer. 1990. The structure and organization of verbal and non-verbal behavior: Data for models of production. Handbook of language and social psychology (1990), 141–161.Google Scholar
7. Paul T Costa and Robert R McCrae. 1992. Four ways five factors are basic. Personality and individual differences 13, 6 (1992), 653–665. Google ScholarCross Ref
8. Charles Darwin, Paul Ekman, and Phillip Prodger. 1998. The expression of the emotions in man and animals. Oxford University Press, USA.Google Scholar
9. Jan de Ruiter. 1995. Why do people gesture at the telephone? Proceedings of the CLS opening Academic Year 1995–1996 (1995).Google Scholar
10. Colin G DeYoung. 2006. Higher-order factors of the Big Five in a multi-informant sample. Journal of personality and social psychology 91, 6 (2006), 1138.Google ScholarCross Ref
11. John M Digman. 1997. Higher-order factors of the Big Five. Journal of personality and social psychology 73, 6 (1997), 1246.Google ScholarCross Ref
12. Funda Durupinar, Mubbasir Kapadia, Susan Deutsch, Michael Neff, and Norman I Badler. 2016. PERFORM: Perceptual Approach for Adding OCEAN Personality to Human Motion Using Laban Movement Analysis. ACM Transactions on Graphics (TOG) 36, 1 (2016), 6.Google ScholarDigital Library
13. Paul Ekman. 1992. An argument for basic emotions. Cognition & emotion 6, 3–4 (1992), 169–200.Google Scholar
14. Paul Ekman and Wallace V Friesen. 1969. Nonverbal leakage and clues to deception. Psychiatry 32, 1 (1969), 88–106. Google ScholarCross Ref
15. Adrian Furnham. 1990. Language and personality. (1990).Google Scholar
16. Michael J Gielniak, C Karen Liu, and Andrea L Thomaz. 2013. Generating human-like motion for robots. The International Journal of Robotics Research 32, 11 (2013), 1275–1301.Google ScholarDigital Library
17. Tom Giraud, Florian Focone, Virginie Demulier, Jean Claude Martin, and Brice Isableu. 2015. Perception of Emotion and Personality through Full-Body Movement Qualities: A Sport Coach Case Study. ACM Transactions on Applied Perception (TAP) 13, 1 (2015), 2.Google Scholar
18. Lewis R Goldberg. 1990. An alternative” description of personality”: the big-five factor structure. Journal of personality and social psychology 59, 6 (1990), 1216.Google ScholarCross Ref
19. Samuel D Gosling, Peter J Rentfrow, and William B Swann. 2003. A very brief measure of the Big-Five personality domains. Journal of Research in personality 37, 6 (2003), 504–528.Google ScholarCross Ref
20. Stephen J Guy, Sujeong Kim, Ming C Lin, and Dinesh Manocha. 2011. Simulating heterogeneous crowd behaviors using personality trait theory. In Proceedings of the 2011 ACM SIGGRAPH/Eurographics symposium on computer animation. ACM, 43–52.Google ScholarDigital Library
21. Björn Hartmann, Maurizio Mancini, and Catherine Pelachaud. 2005. Implementing expressive gesture synthesis for embodied conversational agents. In gesture in human-Computer Interaction and Simulation. Springer, 188–199.Google Scholar
22. Jessica Hodgins, Sophie Jörg, Carol O’Sullivan, Sang Il Park, and Moshe Mahler. 2010. The saliency of anomalies in animated human characters. ACM Transactions on Applied Perception (TAP) 7, 4 (2010), 22.Google Scholar
23. Jessica K Hodgins, James FO Brien, and Jack Tumblin. 1998. Perception of human motion with different geometric models. Visualization and Computer Graphics, IEEE Transactions on 4, 4 (1998), 307–316.Google ScholarDigital Library
24. Ludovic Hoyet, Kenneth Ryall, Katja Zibrek, Hwangpil Park, Jehee Lee, Jessica Hodgins, and Carol O’Sullivan. 2013. Evaluating the distinctiveness and attractiveness of human motions on realistic virtual bodies. ACM Transactions on Graphics (TOG) 32, 6 (2013), 204.Google ScholarDigital Library
25. Eugene Hsu, Kari Pulli, and Jovan Popović. 2005. Style translation for human motion. In ACM Transactions on Graphics (TOG), Vol. 24. ACM, 1082–1089. Google ScholarDigital Library
26. Kerry L Jang, W John Livesley, Juko Ando, Shinji Yamagata, Atsunobu Suzuki, Alois Angleitner, Fritz Ostendorf, Rainer Riemann, and Frank Spinath. 2006. Behavioral genetics of the higher-order factors of the Big Five. Personality and individual Differences 41, 2 (2006), 261–272.Google Scholar
27. Adam Kendon. 2004. Gesture: Visible action as utterance. Cambridge University Press. Google ScholarCross Ref
28. Hanni Kiiski, Ludovic Hoyet, Brendan Cullen, Carol O’Sullivan, and Fiona N Newell. 2013. Perception and prediction of social intentions from human body motion. In Proceedings of the ACM Symposium on Applied Perception. ACM, 134–134. Google ScholarDigital Library
29. Mark Knapp, Judith Hall, and Terrence Horgan. 2013. Nonverbal communication in human interaction. Cengage Learning.Google Scholar
30. Markus Koppensteiner and Karl Grammer. 2010. Motion patterns in political speech and their influence on personality ratings. Journal of Research in Personality 44, 3 (2010), 374–379. Google ScholarCross Ref
31. Rudolf Laban and Lisa Ullmann. 1971. The mastery of movement. (1971).Google Scholar
32. Richard Lippa. 1998. The nonverbal display and judgment of extraversion, masculinity, femininity, and gender diagnosticity: A lens model analysis. Journal of Research in Personality 32, 1 (1998), 80–107. Google ScholarCross Ref
33. Kris Liu, Jackson Tolins, Jean Fox Tree, Michael Neff, and Marilyn Walker. 2015. Two Techniques for Assessing Virtual Agent Personality. (2015).Google Scholar
34. G Luck, S Saarikallio, B Burger, MR Thompson, and P Toiviainen. 2010. Effects of the Big Five and musical genre on music-induced movement. Journal of Research in Personality 44, 6 (2010), 714–720. Google ScholarCross Ref
35. François Mairesse and Marilyn Walker. 2007. PERSONAGE: Personality generation for dialogue. In Annual Meeting-Association For Computational Linguistics, Vol. 45. 496.Google Scholar
36. Rachel McDonnell, Sophie Jörg, Joanna McHugh, Fiona N Newell, and Carol O’Sullivan. 2009. Investigating the role of body shape on the perception of emotion. ACM Transactions on Applied Perception (TAP) 6, 3 (2009), 14.Google ScholarDigital Library
37. David McNeill. 1992. Hand and mind: What gestures reveal about thought. University of Chicago Press.Google Scholar
38. Albert Mehrabian. 1968. Some referents and measures of nonverbal behavior. Behavior Research Methods & Instrumentation 1, 6 (1968), 203–207. Google ScholarCross Ref
39. Laura P Naumann, Simine Vazire, Peter J Rentfrow, and Samuel D Gosling. 2009. Personality judgments based on physical appearance. Personality and Social Psychology Bulletin (2009).Google Scholar
40. Michael Neff. 2014. Lessons from the arts: what the performing arts literature can teach us about creating expressive character movement. In Nonverbal Communication in Virtual Worlds. ETC Press, 123–148.Google Scholar
41. Michael Neff, Pengcheng Luo, Yingying Wang, and Nicholas Toothman. 2017. Making an Impression: Flexible Generation of Gesture Form and Body Movement. Technical Report. University of California – Davis, Department of Computer Science.Google Scholar
42. Michael Neff, Nicholas Toothman, Robeson Bowmani, Jean E Fox Tree, and Marilyn A Walker. 2011. DonâĂŹt scratch! self-adaptors reflect emotional stability. In International Workshop on Intelligent Virtual Agents. Springer Berlin Heidelberg, 398–411.Google Scholar
43. Michael Neff, Yingying Wang, Rob Abbott, and Marilyn Walker. 2010. Evaluating the effect of gesture and language on personality perception in conversational agents. In Intelligent Virtual Agents. Springer, 222–235. Google ScholarCross Ref
44. Nikolaas N Oosterhof and Alexander Todorov. 2008. The functional basis of face evaluation. Proceedings of the National Academy of Sciences 105, 32 (2008), 11087–11092. Google ScholarCross Ref
45. Catherine Pelachaud, Norman I Badler, and Mark Steedman. 1996. Generating facial expressions for speech. Cognitive science 20, 1 (1996), 1–46. Google ScholarCross Ref
46. Miguel Pérez-Pereira and Gina Conti-Ramsden. 2013. Language development and social interaction in blind children. Psychology Press.Google Scholar
47. Byron Reeves and Clifford Nass. 1996. How people treat computers, television, and new media like real people and places. CSLI Publications and Cambridge university press.Google Scholar
48. Ronald E Riggio and Howard S Friedman. 1986. Impression formation: The role of expressive behavior. Journal of Personality and Social Psychology 50, 2 (1986), 421.Google ScholarCross Ref
49. Jon Sprouse. 2011. A validation of Amazon Mechanical Turk for the collection of acceptability judgments in linguistic theory. Behavior research methods 43, 1 (2011), 155–167. Google ScholarCross Ref
50. Constantin Stanislavski. 2013. Building a character. A&C Black.Google Scholar
51. Frank Thomas and Ollie Johnston. 1981. Disney animation: The illusion of life. Abbeville Press.Google Scholar
52. John C Thoresen, Quoc C Vuong, and Anthony P Atkinson. 2012. First impressions: Gait cues drive reliable trait judgements. Cognition 124, 3 (2012), 261–271.Google ScholarCross Ref
53. Edward L Thorndike. 1920. A constant error in psychological ratings. Journal of applied psychology 4, 1 (1920), 25–29.Google ScholarCross Ref
54. Jeroen Vuurens, Arjen P de Vries, and Carsten Eickhoff. 2011. How much spam can you take? an analysis of crowdsourcing results to increase accuracy. In Proc. ACM SIGIR Workshop on Crowdsourcing for Information Retrieval (CIRâĂŹ11). 21–26.Google Scholar
55. Marilyn A Walker, Janet E Cahn, and Stephen J Whittaker. 1997. Improvising linguistic style: Social and affective bases for agent personality. In Proceedings of the first international conference on Autonomous agents. ACM, 96–105.Google ScholarDigital Library
56. Yingying Wang, Jean E. Fox Tree, Marilyn Walker, and Michael Neff. 2016. Assessing the Impact of Hand Motion on Virtual Character Personality. ACM Trans. Appl. Percept. 13, 2, Article 9 (March 2016), 23 pages. Google ScholarDigital Library
57. Jerry S Wiggins. 1996. The five-factor model of personality: Theoretical perspectives. Guilford Press.Google Scholar
58. Richard Williams. 2009. The Animator’s Survival Kit: A Manual of Methods, Principles and Formulas for Classical, Computer, Games, Stop Motion and Internet Animators. Macmillan.Google Scholar
59. Junchao Xu, Joost Broekens, Koen Hindriks, and Mark A Neerincx. 2013. Mood expression through parameterized functional behavior of robots. IEEE.Google Scholar
60. William R Zwick and Wayne F Velicer. 1986. Comparison of five rules for determining the number of components to retain. Psychological bulletin 99, 3 (1986), 432.Google Scholar
