An Explicit-Thinking LLM-Based Cognitive Apprenticeship Approach to Promote Students’ Metacognition, Higher Order Thinking Skills, and Learning Performance

Abstract

With the rapid development of generative artificial intelligence (AI), large language models (LLMs) have been increasingly applied in education. Although LLMs demonstrate considerable potential in supporting student learning, conventional LLMs tend to provide direct answers without explicitly articulating their reasoning processes. This hinders students’ ability to comprehend the underlying logic of problem solving, thereby limiting opportunities for metacognitive engagement and the development of higher order thinking skills. To address this issue, this study proposes a cognitive apprenticeship approach based on an explicit-thinking LLM that provides structured thinking support during LLM-based learning activities. By employing the modeling, coaching, and reflection mechanisms of cognitive apprenticeship, the approach guides students to internalize the LLM’s reasoning processes, thereby fostering their higher order thinking skills. A quasi-experimental design was adopted, involving 68 college students divided into experimental and control groups. Participants completed a writing-based learning task using either the explicit-thinking LLM or a conventional LLM, and the data were analyzed using a mixed-methods approach that included eye tracking. The results showed that, compared to the control group, the experimental group exhibited enhanced metacognitive regulation, demonstrated superior performance in both problem solving and critical thinking, and achieved better learning outcomes when they devoted greater attention to the reasoning process generated by the explicit-thinking LLM. This study suggests that the explicit-thinking LLM enhances students’ learning performance and higher order thinking by making reasoning processes more transparent. It further emphasizes the essential role of cultivating students’ critical and creative engagement with AI to effectively support the development of higher order thinking skills.