Going beyond performance scores: Understanding cognitive–affective states in Kindergarteners and application of framework in classrooms

Abstract

Cognitive–affective states during learning or interactions with technologies are related to the mental effort of the learner and / or the cognitive load imposed by the system. Despite the growing research on the importance of understanding cognitive–affective states and their relationship to learning, measurement of such states during the learning process is still unclear. While most assessments of learning and usability evaluations with Kindergartners and primary schoolers focus on performance, self-reports and inferring from observable behaviours, they provide limited insights into the cognitive load and emotional state during learning or interaction that are essential for a holistic picture of learning. Through a study with 18 Kindergartners, we explore the feasibility of understanding cognitive–affective states associated with mental effort by triangulating the data obtained from observations, physiological markers, self-reports and performance as they performed tasks of varying mental effort. We present findings on the reliable markers within these sources across tasks. Results reveal that such a triangulation offers deeper insights into the cognitive–affective state of the learner. As a follow-up study, we explored the feasibility of employing this method in classrooms with 36 children between 11–13 years to understand the effect of interactivity on learning across three viewing conditions namely, screen, magic window and immersive virtual reality (VR) using Google Cardboard. Results confirmed the feasibility of running such studies and the additional value of employing a host of measures to evaluate the learning. We believe this work would be a step towards better understanding of the learning process, thereby facilitating instruction that is more aligned with the learner’s cognitive–affective architecture. Further, we believe that such methods have applicability in comprehensive usability / evaluation processes based on well-defined associations between child behaviour and child action.

Samantha Chan

Assistant Professor

I create wearable, AI and digital interfaces to enhance human cognition and memory at NTU Singapore.