“Cognitive modeling: knowledge, reasoning and planning for intelligent characters” by Funge, Tu and Terzopoulos

Recent work in behavioral animation has taken impressive steps toward autonomous, self-animating characters for use in production animation and interactive games. It remains difficult, however, to direct autonomous characters to perform specific tasks. This paper addresses the challenge by introducing cognitive modeling. Cognitive models go beyond behavioral models in that they govern what a character knows, how that knowledge is acquired, and how it can be used to plan actions. To help build cognitive models, we develop the cognitive modeling language CML. Using CML, we can imbue a character with domain knowledge, elegantly specified in terms of actions, their preconditions and their effects, and then direct the character’s behavior in terms of goals. Our approach allows behaviors to be specified more naturally and intuitively, more succinctly and at a much higher level of abstraction than would otherwise be possible. With cognitively empowered characters, the animator need only specify a behavior outline or “sketch plan” and, through reasoning, the character will automatically work out a detailed sequence of actions satisfying the specification. We exploit interval methods to integrate sensing into our underlying theoretical framework, thus enabling our autonomous characters to generate action plans even in highly complex, dynamic virtual worlds. We demonstrate cognitive modeling applications in advanced character animation and automated cinematography.

1. J. Allen, J. Hendler, and A. Tate, editors. Readings in Planning. Morgan Kaufmann, 1990.
2. D. Arijon. Grammar of the Film Language. Communication Arts Books, Hastings House Publishers, New York, 1976.
3. N.I. Badler, C. Phillips, and D. Zeltzer. Simulating Humans. Oxford University Press, 1993.
4. J. Bates. The Role of Emotion in Believable Agents. Communications of the ACM, 37(7), 1994, 122-125.
5. J. Blinn. Where am I? What am I looking at? IEEE Computer Graphics and Applications, 8(4), 1988, 76-81.
6. B. Blumberg. Old Tricks, New Dogs: Ethology and Interactive Creatures. PhD thesis, MIT Media Lab, MIT, Cambridge, MA, 1996.
7. B.M. Blumberg and T. A. Galyean. Multi-level direction of autonomous creatures for real-time environments. P~vceedings of SIGGRAPH 95, Aug. 1995, 47-54.
8. J. Funge. CML compiler, www. cs. toronto, edu/-funge/cml, 1997.
9. J. Funge. Lifelike characters behind the camera. Lifelike Computer Characters ’98 Snowbird, UT, Oct. 1998.
10. J. Funge. Making Them Behave: Cognitive Models for Computer Animation. PhD Thesis, Department of Computer Science, University of Toronto, Toronto, Canada, 1998. Reprinted in SIGGRAPH 98 Course Notes #10, Orlando, Florida.
11. J. Funge. AI for Games and Animation: A Cognitive Modeling Applvach. A.K. Peters, 1999.
12. J. Funge. Representing knowledge within the situation calculus using intervalvalued epistemic fluents. Journal of Reliable Computing, 5(1), 1999.
13. B. Hayes-Roth, R. v. Gent, and D. Huber. Acting in character. In R. Trappl and P. Petta, editors, Creating Personalities for Synthetic Actors. Lecture Notes in CS No. 1195. Springer-Verlag: Berlin, 1997.
14. L. He, M. F. Cohen, and D. Salesin. The virtual cinematographer: A paradigm for automatic real-time camera control and directing. P~vceedings of SIGGRAPH 96, Aug. 1996, 217-224.
15. H. Levesque, R. Reiter, Y. Lesp6rance, F. Lin, and R. Scherl. Golog: A logic programming language for dynamic domains. Journal of Logic P1vgramming, 31, 1997, 59-84.
16. C. Pinhanez, K. Mase, and A. Bobick. Interval scripts: A design paradigm for story-based interactive systems P~vceedings of CHI’97, Mar. 1997.
17. N. Magnenat-Thalmann and D. Thalmann. Synthetic Actors in Computer- Generated Films. Springer-Verlag: Berlin, 1990.
18. J. McCarthy and P. Hayes. Some philosophical problems from the standpoint of artificial intelligence. In B. Meltzer and D. Michie, editors, Machine Intelligence 4, pages 463-502. Edinburgh University Press, Edinburgh, 1969.
19. K. Perlin and A. Goldberg. IMPROV: A system for scripting interactive actors in virtual worlds. P1vceedings of SIGGRAPH 96, Aug. 1996, 205-216.
20. R. Reiter. The frame problem in the situation calculus: A simple solution (sometimes) and a completeness result for goal regression. In V. Lifschitz, editor, Artificial Intelligence and Mathematical Theo~7 of Computation. Academic Press, 1991.
21. C. W. Reynolds. Flocks, herds, and schools: A distributed behavioral model. P1vceedings of SIGGRAPH 87, Jul. 1987, 25-34.
22. R. Scherl and H. Levesque. The frame problem and knowledge-producing actions. P~vceedings ofAAAI-93, AAAI Press, Menlo Park, CA, 1993.
23. J. Snyder. Interval analysis for computer graphics. P~vceedings of SIGGRAPH 92, Jul. 1992, 121-130.
24. X. Tu. Artificial animals for computer animation: Biomechanics, locomotion, perception and behavior: ACM Distinguished Dissertation Series, Springer- Verlag, Berlin, 1999.
25. X. Tu and D. Terzopoulos. Artificial fishes: Physics, locomotion, perception, behavior. P1vceedings of SIGGRAPH 94, Jul. 1994, 24-29.
26. J. Tupper. Graphing Equations with Generalized Interval Arithmetic. MSc Thesis, Department of Computer Science, University of Toronto, Toronto, Canada, 1996. See also GRAFEQ from Pedagoguery Software www. peda. com.