Abstract
Background
Forums in massive open online courses (MOOCs) enable written exchanges on course content; hence, they can potentially facilitate learners' cognitive engagement. Given the myriad ...of MOOC forum messages, this engagement is commonly analysed automatically through the linguistic features of the messages. Assessing linguistic features of learners' forum messages involves consideration of the learning tasks. MOOC forum discussion tasks, however, have not been previously considered.
Objective and Method
This study explores the effects of MOOC forum discussion tasks on learners' cognitive engagement. Based on the structure of observed learning outcomes (SOLO) taxonomy, we manually annotate distinct levels of cognitive engagement encouraged in forum discussion tasks and displayed by learners in messages starting discussions (i.e., thread starters). We study the linguistic features of thread starters in relation to the pedagogical design of the discussion tasks. Additionally, we use random‐forest modelling to identify the linguistic and task‐related features that help to categorise learners' cognitive engagement according to SOLO levels.
Results
Manual analysis showed that learners' thread starters mainly reflect surface SOLO levels and include few academic words and cohesive language. Random‐forest modelling showed that these linguistic features, together with the SOLO levels encouraged in the discussion tasks, played an important role in identification of learners' cognitive engagement.
Major Takeaways
Our results highlight the importance of the pedagogical design of MOOC forum tasks in helping learners engage cognitively. Our study also contributes to the empirical evidence that learners' linguistic choices can afford insights into the quality of their cognitive engagement.
Lay Description
What is currently known about this topic
Learners' cognitive engagement in massive open online courses (MOOCs) discussion forums mostly reflects surface‐level understanding.
The distinctive linguistic features of MOOC forum messages can, to some extent, reflect the quality of learners' cognitive engagement.
What this paper adds
We analysed the linguistic features of MOOC forum messages that start a discussion (i.e., thread starters) and studied these features in relation to the pedagogical design of the forum discussion tasks.
We found that learners strove to mobilise the cognitive processes expected in the forum discussion tasks. However, in some forums, learners' engagement might not have been aligned with the intended learning outcomes of the task.
Implications for practitioners
The learning design used in MOOC discussion forums needs to inform learners explicitly about their expected cognitive contributions.
To promote higher levels of cognitive engagement, MOOC instructors need to design forum discussion tasks that help learners structure their knowledge and make explicit connections between ideas.
Story questions have level of abstraction characteristics. In the story question, it can be seen that the students’ abstract extended level by changing the pattern questions according to the ...indicators of high –level mathematical thinking. This study aims to determine the ability of students to understand mathematical concepts in the SPLDV material using SOLO Taxonomy-based questions and student responses in working on these questions. When researchers did a teaching practice at a vocational high school in Cirebon district, they found that the students' ability to understand concepts was still low, this was confirmed by interviews with students that they did not understand SPLDV questions, especially in making mathematical models of a story problem. This research is located in one of the Vocational High Schools in Cirebon Regency. The subjects of this study were 21 class X students. The researcher used a descriptive method with a qualitative approach because the researcher wanted to find out more about how students understood mathematical concepts in the SPLDV material using SOLO Taxonomy-based questions. The results of this study were the students' ability to understand mathematical concepts in the SPLDV Material Using SOLO Taxonomy-based questions was still very low, namely 37.10% and the responses given by students were positive for the use of questions based on the use of SOLO Taxonomy-based questions.
In response to a call for more research on evaluator education, this paper explores the use of role-play as an in-class activity for students in a graduate course in evaluation. We describe the ...activity in detail and use the Structure of Observed Learning Outcomes taxonomy as a tool to describe the cognitive complexity of student responses in the activity. Using a collaborative autoethnographic approach, we found that the role-play activity provided the opportunity for students to exhibit knowledge of evaluation theories and for us to observe the complexity of their responses.
The emergence of mobile learning applications facilitates the pedagogical approach to developing students’ critical thinking. However, there is a scarcity of investigation on mobile learning ...applications’ impact on developing critical thinking as the learning outcome. Thus, this study reports the effect of a mobile learning application, ‘English with Noni’, designed to infuse critical thinking instruction in EFL classes on students’ critical thinking level by employing a sequential explanatory mixed-method approach. A quasi-experimental study was conducted to examine the critical thinking level of 65 students of a junior high school in Jakarta, Indonesia, by administering a post-test assessed using a SOLO rubric. Semi-structured interviews to explore students’ responses from using the ‘English with Noni’ application and class observation contributed to the qualitative findings. The quantitative result showed that the critical thinking level of the experimental group using this application improved significantly more than the controlled group did. The qualitative result suggested that the experimental group had positive responses to using it. They confirmed that it was interesting. They also admitted that it contributed to developing their critical thinking (i.e., predicting, providing reasons, expressing viewpoints, finding alternatives, and making conclusions), language skills (i.e., listening, reading, and writing), and sub-skill (vocabulary). The findings imply that critical thinking activities and learning affordances provided in the ‘English with Noni’ application is a potential tool to enhance students’ critical thinking infused in the EFL class, especially during the COVID-19 pandemic situation, by emphasizing self-regulated learning.
This study was conducted to determine the incorrect strategies developed by seventh-grade students to solve problems that require proportional reasoning and evaluate their solutions according to SOLO ...Taxonomy. This two-stage case study was conducted in a public school in the Central Black Sea region. The Proportional Reasoning Skill Test was administered to 33 seventh-grade students in the first stage. In the second stage, semi-structured interviews were held with 10 students by determining the 5 problems that students made mistakes in most. The students developed 5 different incorrect strategies when solving problems requiring proportional reasoning: additive relationships, data neglect, using numbers and no content, giving an emotional response, and failure to identify non-proportional situations. Students had difficulty identifying non-proportional situations and established additive relationships in problems requiring multiplicative relationships. Also, the levels of the participants were examined with the SOLO Taxonomy Rubric developed for proportional reasoning skills. Accordingly, the students with a high level of proportional reasoning were at abstract and relational structure levels, whereas those with moderate scores were at uni-structural and multi-structural levels. The students with low scores had low-level skills according to SOLO Taxonomy criteria.
This study aims to analyze the transformation of algebraic thinking and calculus of preservice the mathematics students based on SOLO taxonomy in solving differential equations problems. The research ...subjects were 86 students in the mathematics education study program. Subject selection uses purposive sampling (students who take courses in differential equations). Data were collected using problem-solving tests and interviews which were then analyzed using the descriptive qualitative method with the following stages: (1) transcribing test and interview data, (2) coding segmentation, (3) analyzing student thinking transformations, and (4) concluding. The results showed that the transformation of algebraic and calculus thinking was used by students at each level of thinking to solve problems. The higher the level of thinking achieved, the better and the maximum transformation of algebraic and calculus thinking used by students. These results indicate that students need to be well supported and facilitated in problem-solving to achieve higher levels of thinking, such as the relational and extended abstract levels.
The study was to assess the algebraic thinking levels of prospective basic education teachers using SOLO taxonomy. Sequential explanatory mixed methods design was used for the study. 250 Pre-service ...mathematics teachers from four selected colleges of education in the Eastern region of Ghana were purposely sampled for the study. The data were collected with the aid of super item test and unstructured interviews as instruments. Descriptive statistics (means and standard deviations) and analysis of variance were used to analyse the quantitative data whereas thematic analysis was employed to analyse the qualitative data. The study revealed that the pre-service teachers showed good algebraic thinking at uni-structural and multi-structural levels of the SOLO taxonomy, but performed abysmally at relational and extended abstract levels. The study recommended that Mathematics tutors at the Colleges of Education in Ghana should use the SOLO model for teaching and evaluation of their students. This would help improve pre-service teacher algebraic thinking levels early enough for preservice teachers’ overall progress in teaching mathematics after school.
This study was conducted to determine the incorrect strategies developed by seventh-grade students to solve problems that require proportional reasoning and evaluate their solutions according to SOLO ...Taxonomy. This two-stage case study was conducted in a public school in the Central Black Sea region. The Proportional Reasoning Skill Test was administered to 33 seventh-grade students in the first stage. In the second stage, semi-structured interviews were held with 10 students by determining the 5 problems that students made mistakes in most. The students developed 5 different incorrect strategies when solving problems requiring proportional reasoning: additive relationships, data neglect, using numbers and no content, giving an emotional response, and failure to identify non-proportional situations. Students had difficulty identifying non-proportional situations and established additive relationships in problems requiring multiplicative relationships. Also, the levels of the participants were examined with the SOLO Taxonomy Rubric developed for proportional reasoning skills. Accordingly, the students with a high level of proportional reasoning were at abstract and relational structure levels, whereas those with moderate scores were at uni-structural and multi-structural levels. The students with low scores had low-level skills according to SOLO Taxonomy criteria.