Abstract
The project is aimed at developing gesture prediction models which can be applied to humanoids such as virtual animated models to personify their movements. The project prototype will be based on a film character, whose moves and gesture semantics will be annotated manually. The gesture influencing social factors will be identified and an attribute representing them will be annotated for each dialogue. When this is applied on the machine prediction model designed in this project, prediction of the facial and body gestures will be made based on the person’s gesture behaviour. The models will be developed using supervised machine learning methods, such as the C4.5 algorithm, Naïve Bayes and Support Vector Machine.
Here is the short overview of the overall project : Virtual Actors- Presentation
Few references:
D. McNeil, Hand and Mind: What Gestures reveal about thought. The University of Chicago Press, 2009, p. 11.
K. R. Gibson and T. Ingold, Tools, Language and Cognition in Human Evolution. Cambridge University Press, 1993, p. 483.
U. of York, “AMADEUS,” 2003. [Online]. Available: http://www.cs.york.ac.uk/amadeus/.
K. M. Knutson, E. M. McClellan, and J. Grafman, “Observing social gestures: an fMRI study.” Experimental brain research. Experimentelle Hirnforschung. Expérimentation cérébrale, vol. 188, no. 2, pp. 18798, Jun. 2008.
R. B. Zajonc, “Feeling and thinking: Preferences need no inferences.”
R. W. Picard, “AFFECTIVE COMPUTING FOR HCI,” in Proceedings of HCI International, 1999.
M. Montaner, B. López, and J. L. de la Rosa, “Developing trust in recommender agents,” in Proceedings of the first international joint conference on Autonomous agents and multi-agent systems part 1 – AAMAS ’02, 2002, p.304.
V. Trehan and T. Y. Project, “Gesture Markup and an Analysis of Spontaneous Gestures,” Artificial Intelligence, vol. 802, 2003.
J. M. Pim, “Modelling and prediction of spontaneous gestures,” 2006.
S. K. Richmond, V. P., McCroskey, J. C., & Payne, “Nonverbal Behaviour in Interpersonal Relations.,” Englewood Cliffs, NJ, 1987.
M. L. Knapp, “Nonverbal Communication in Human Interaction,” Holt, New York: Rinehart and Winston., 1972.
L. A. at el. Malandro, Nonverbal Communication. Reading, U.K.: Addison Wesley., 1983.
D. McNeil, “Gesture and Thought,” Continuum, 2006.
R. L. Birdwhistell, Kinesics and Context: Essays on Body Motion Communication. University of Pennsylvania Press, 1970, p. 352.
J. C. Moreno Cabrera, “Speech and gesture: an international approach,” Language Sciences, vol. 33, no. 4, pp. 615 622, Jul. 2011.
B. M. DePaulo, “Nonverbal behaviour and self presentation.”
P. Ekman et al., “The nonverbal communication reader: Classic and contemporary readings (2nd ed.).”
D. A. Fisher, “Review of Human- Human Nonverbal Communication,” North York, Ontario, 1991.
For more information, contact: Sri Sri Perangur at University of York
http://www.cs.york.ac.uk/aig/seminars/12.php LinkedIn
Virtual Actors 