Summary
Outlines the design and outcome of an experiment created to understand adding embodied to NPC agents in an immersive spoken-dialogue virtual environment affect learning, and learning a second language. Controls against less-rich embodied agents.
To Do
Analyse the observed interaction dialogue:
Understand and quantify vocabularly used in the interactions
Depict dialogue trees and calculate dialogue route probabilities
Contrast observed dialogue with the previously meta-analysed online teaching materials, and search for distinctions
Analyse the embodiment of the observed interactions:
Gesture
Spatial awareness
Develop/deploy a method to codify these aspects in relation to the dialogue trees
Develop a VR conversational agent informed by the above
Pre-experiment
To determine suitability of commerical ASR for experiement implementation: Speech recognition accuracy: comparative study between native and non-native Japanese speakers and ASR systems