Saikiran Anasingaraju
Meng-Lin Wu
Nicoletta Adamo-Villani
ABSTRACT
We present an approach for achieving scalable authoring of digital learning activities, without sacrificing delivery eloquence. A computer animation character serves as an instructor avatar that not only speaks but also makes deictic, iconic and charisma gestures. The avatar is controlled via a text script, without the prerequisites of computer programming or animation expertise. Given a script for a problem, the system automatically generates scripts for additional instances of the problem, by adapting the targets of the deictic gestures, the speech, and the synchronization between speech and gestures. Starting from initial learning activities of a few minutes, the system can automatically generate hours of quality on-line learning activities. An evaluation by computer graphics, computer animation, and education research experts reveals that the automatically generated learning activities have animation quality that is comparable to that of the original activities.
- Adamo-Villani, N., and Wilbur, R. 2008. Two novel technologies for accessible math and science education. IEEE Multimedia Special Issue on Accessibility, 38--46. Google Scholar
Digital Library
- Annetta, L. A., and Holmes, S. 2006. Creating presence and community in a synchronous virtual learning environment using avatars. Intern. J. Instruct.Technol. Dist. Learn. 3, 27--43.Google Scholar
- Church, R. B., and Ayman-Nolley, S. 2008. The role of gesture when instruction is given by adults versus same-age peers. In Proceedings of the Jean Piaget Conference.Google Scholar
- Church, R., Ayman-Nolley, S., and Mahootian, S. 2004. The role of gesture in bilingual education: Does gesture enhance learning? International Journal of Bilingual Education and 7(4), 303--319.Google ScholarCross Ref
- Church, R., Garber, P., and Rogalski, K. 2007. The role of gesture in social communication and memory. Gesture 7, 137--157.Google ScholarCross Ref
- Cohen, R., and Otterbein, N. 1992. The mnemonic effect of speech gestures: Pantomimic and non-pantomimic gestures compared. European Journal of Cognitive Psychology 4, 113--139.Google ScholarCross Ref
- Cui, J., Adamo-Villani, N., and Popescu, V. 2014. Charismatic and eloquent instructor avatars with scriptable gesture. In Proceedings of Siggraph 2014 Talks. Google ScholarDigital Library
- Cutica, I., and Bucciarelli, M. 2008. The deep versus the shallow: Effects of co-speech gesture in learning from discourse. Cognitive Science 32, 921--935.Google ScholarCross Ref
- Davis, C., Kim, J., Kuratate, T., and Burnham, D. 2007. Making a thinking-talking head. In In: Proc. Of the International Conference on Auditory-Visual Speech Processing (AVSP 2007).Google Scholar
- Feyereisen, P. 2006. Further investigation on the mnemonic effect of gestures: Their meaning matters. European Journal of Cognitive Psychology 18, 185--205.Google ScholarCross Ref
- Galati, A., and Samuel, A. G. 2010. The role of speech-gesture congruency and delay in remembering action events. Language and Cognitive Processes.Google Scholar
- Holmes, J. 2007. Designing agents to support learning by explaining. In: Comput. Educ 48, 523--547. Google ScholarDigital Library
- Johnson, W., and Rickel, J. 1998. Steve: An animated pedagogical agent for procedural training in virtual environments. SIGART Bulletin 8, 16--21. Google ScholarDigital Library
- Johnson, W., Rickel, J., Stiles, R., and Munro, A. 1998. Integrating pedagogical agents into virtual environments. Presence: Teleoperators and Virtual Environments 7, 523--546. Google ScholarDigital Library
- Lab, V. C. Avatar authoring tool. http://vcl.iti.gr/avatar-authoring-tool/.Google Scholar
- Lester, J., Converse, S., Stone, B., Kahler, S., and Barlow, T. 1997. Animated pedagogical agents and problem-solving effectiveness: A large-scale empirical evaluation. In Proceedings of the eighth world conference on artificial intelligence in education, 23--30.Google Scholar
- Lester, J., Voerman, J., Towns, S., and Callaway, C. 1997. Cosmo: A life-like animated pedagogical agent with deictic believability. In In Notes of the IJCAI '97 Workshop on Animated Interface Agents: Making Them Intelligent, 61--70.Google Scholar
- Lester, J., Stone, B., and Stelling, G. 1999. Lifelike pedagogical agents for mixed-initiative problem solving in constructivist learning environments. In: User Modeling and User-Adapted Interaction 9(1-2), 1--44. Google ScholarDigital Library
- Lester, J., Towns, S., and FitzGerald, P. 1999. Achieving affective impact: Visual emotive communication in lifelike pedagogical agents. In: The International Journal of Artificial Intelligence in Education 10(3--4), 278--291.Google Scholar
- LLC, W. Avatar storytellers. http://www.avatarstorytellers.com/default.asp?iId=HILHG.Google Scholar
- Louwerse, M., Graesser, A., McNamara, D., and Lu, S. 2009. Embodied conversational agents as conversational partners. Applied Cognitive Psychology 23, 1244--1255.Google ScholarCross Ref
- Lusk, M. M., and Atkinson, R. K. 2007. Varying a pedagogical agents degree of embodiment under two visual search conditions. Applied Cognitive Psychology 21, 747--764.Google ScholarCross Ref
- Moreno, R., and Mayer, R. 2007. Interactive multimodal learning environments. In: Education. Psychol. Rev. 19, 309--326.Google ScholarCross Ref
- of Pennsylvania Linguistics Lab, U. Fave-align. http://fave.ling.upenn.edu/usingFAAValign.html.Google Scholar
- Pappas, C. Free authoring tools for elearning. http://elearningindustry.com/free-authoring-tools-for-elearning.Google Scholar
- Pappas, C. Html5 elearning authoring tools. http://elearningindustry.com/the-ultimate-list-of-html5-elearning-authoring-tools.Google Scholar
- 2008. Peta a pedagogical embodied teaching agent. In In: Proc. of PETRA08: 1st international conference on PErvasive Technologies Related to Assistive Environments. Google ScholarDigital Library
- Ping, R., and Goldin-Meadow, S. 2008. Hands in the air: Using ungrounded iconic gestures to teach children conservation of quantity. Developmental Psychology 44, 1277--1287.Google ScholarCross Ref
- Reithinger, N., Gebhard, P., Lckelt, M., Ndiaye, A., Pfleger, N., and Klesen, M. 2006. Virtualhuman - dialogic and emotional interaction with virtual characters. In In: Proc. of the Eighth International Conference on Multimodal Interfaces (ICMI 2006). Google ScholarDigital Library
- Rickel, J., and Johnson, W. 1999. Animated agents for procedural training in virtual reality: perception, cognition, and motor control. Applied Artificial Intelligence 13, 343--382.Google ScholarCross Ref
- Shulman, L. 1986. Pedagogical content knowledge (PCK).Google Scholar
- Singer, M., and Goldin-Meadow, S. 2005. Children learn when their teacher's gestures and speech differ. Psychological Science 16(2), 85--89.Google ScholarCross Ref
- Theonas, G., Hobbs, D., and Rigas, D. 2008. Employing virtual lecturers facial expressions in virtual educational environments. In: Intern. J. Virtual Real. 7, 31--44.Google Scholar
- Valenzeno, L., Alibali, M., and Klatzky, R. 2003. Teachers' gestures facilitate students' learning: A lesson in symmetry. Contemporary Educational Psychology 28(2), 187--204.Google ScholarCross Ref
- Williams, R. G., and Ware, J. E. 1977. An extended visit with dr. fox: Validity of student satisfaction with instruction ratings after repeated exposures to a lecturer. American Educational Research Journal 14, 449--457.Google ScholarCross Ref
Index Terms
- Digital learning activities delivered by eloquent instructor avatars: scaling with problem instance
Recommendations
University Student Perceptions of Effective E-learning Strategies Instructor Used in Blended Courses
ICCEE '09: Proceedings of the 2009 Second International Conference on Computer and Electrical Engineering - Volume 01Blended courses that include face-to-face and elearning have been offered in universities in Taiwan but very little research has been undertaken on university student perspectives of effective e-learning strategies. This paper explores student ...
Instructor presence in video lectures: Eye gaze matters, but not body orientation
AbstractThe instructor's on-screen presence, rather than just voice, has rapidly become a popular feature in video lectures. Eye gaze and body orientation are core indicators of an instructor's attentional focus in classroom settings, but it ...
Highlights- Learners viewing the video lectures with an instructor's guided gaze paid greater attention to the slides.
The Digital Learning Classroom: Improving English Language Learners' academic success in mathematics and reading using interactive whiteboard technology
This study presents the findings from the first-year evaluation of the Round Rock Independent School District's (ISD) Digital Learning Classroom project, an initiative focused on the improvement of English Language Learners' (ELL) learning using ...
Comments