This study aimed to compare the Graded Response Model (GRM) and the Mixed-Graded Response Model (MixGRM) in terms of model data-fit and parameters and demonstrate the application of MixGRM on real ...data. In this context, this study is basic research based on the International Computer and Information Literacy Study in 2013 conducted with eighth-grade participants from Turkey. The data from a total of 2,356 students were used in the study. In testing the models, data was obtained from an 11-item Likert scale that measured the students' interest and enjoyment in using Information and Communication Technologies (ICTs). When the GRM- and MixGRM-based model data-fit results were compared, the model with the best fit was the MixGRM with four latent classes. Students who reported to enjoy using ICT and who had the highest computer and information literacy (CIL) score were found to be in the first latent class, those with least enjoyment or dislike and those with the lowest CIL score were in the fourth latency class. The findings show that reducing the heterogeneity of Mixed-Item Response Theory models in the dataset is a preferable model for research situations and that Turkish students are not yet prepared for life in the digital age.
The purpose of this study is to determine the best IRT model Rasch, 2PL, 3PL, 4PL and mixed IRT (2 and 3PL) for the science and technology subtest of the Transition from Basic Education to Secondary ...Education (TEOG) exam, which is carried out at national level, it is also aimed to predict the item parameters under the best model. This study is a basic research as it contributes to the information production which is fundamental for test development theories. The study group of the research is composed of 5000 students who were randomly selected from students who participated in TEOG exam in 2015. The analyses were carried out on 17 multiple choice items in TEOG science and technology subtest. When model fit indices were evaluated, the MixIRT model with two parameters and three latent classes was found to fit the data best. According to this model, when the difficulties and discrimination averages of the items are taken into account, it can be expressed that items are moderately difficult and discriminative for students in latent class-1; the items are considerably easy and able to slightly distinguish the students in latent class-2; the items are difficult to the students in the third latent class and they can slightly distinguish the students in this group.
The Short Mood and Feelings Questionnaire-Child Self Report (SMFQ-C; 13-item) was developed to assess depression among children and adolescents. The SMFQ-C is one of the widely used instruments due ...to its easy administration, open-access feature, and good psychometric properties. The present study attempted to investigate psychometric properties of the Turkish translated version of the SMFQ-C with a total of 428 children and adolescents, between ages 9 and 17. To analyze data, independent samples
t
-tests, ANOVA, Cronbach’s alpha statistics, Pearson’s correlations, and confirmatory factor analysis were utilized. Our study findings suggested that the test–retest reliability of the 13-item Turkish SMFQ-C was significant, and there were favorable evidences for both convergent and discriminant evidence. Confirmatory factor analysis supported that the Turkish version of the SMFQ-C has appropriate psychometric properties for utilization, including reasonably good fit of the model with a Cronbach’s alpha value of .89. Group comparison analyses revealed that female students and high school students scored significantly higher on the Turkish SMFQ-C. We concluded that the Turkish translated version of the SMFQ-C is a reliable and valid tool for rapid screening of depression among non-clinical, Turkish-speaking children and youth.
The aim of this study was to examine whether the time spent answering science and mathematics items by Turkish students participating in the Trends in International Mathematics and Science Study ...(TIMSS) at the 8th grade level showed a significant difference according to their proficiency levels, self-confidence, and the item characteristics. This study was correlational research to explore the relationship between the variables discussed. A total of 577 students who participated in the TIMSS 2019 study at the 8th grade level in Turkey and answered the common 24 (11 mathematics and 13 science) items in Booklets 1 and 2 constituted the study participants. In the data analysis, the Kruskal Wallis-H test, Mann-Whitney U test, and Latent Class Analysis were used. As a result, it was determined that the type of item and cognitive level had a significant relation to the item response times of students. The students were found to spend more time on open-ended items than multiple-choice items. On the other hand, the time spent on items in the applying level was significantly higher than the knowledge level. However, there was no significant difference between the time spent answering items in the applying level and reasoning level. It was observed that if the students' confidence level in science was high, the rate of correct answers was high, and they answered the items in a short amount of time. Students who were somewhat self-confident in mathematics were more successful in difficult mathematics items and spent less time answering the items.
This study tested the applicability of the theoretical Examination for Candidates of Driving License (ECODL) in Turkey as a computerized adaptive test (CAT). Firstly, various simulation conditions ...were tested for the live CAT through an item response theory-based calibrated item bank. The application of the simulated CAT was based on data from e-exams administered by the Ministry of National Education (MoNE). Results of the first stage of the study were used to determine the rules for starting, continuing, and terminating the live CAT exam for ECODL. Secondly, the live CAT exam was applied according to the results of the simulation. Candidate drivers (n = 280) who had taken the ECODL as an e-test participated in the second stage. Thirdly, the opinions of the individuals who took the computer-based test towards the computer-based testing application were mapped. In the termination rule of the CAT-based ECODL, testing with a fixed number of questions yielded the smallest estimated measurement error. We also found that when ECODL was implemented as CAT, it could reliably differentiate among testers in terms of competence of theoretical knowledge of driving and provide basis for accurate decisions regarding their proficiency. According to the findings obtained on the candidates’ opinions on the computer-based testing application, it was seen that they considered computer-based application more practical an easier in terms of testing.
This study compared the effectiveness of cluster analysis and latent class analysis in detecting fake responses in personality tests. A post-test control group design was employed involving 543 ...11th-grade students from eight different high schools in Şanlıurfa province during the 2021–2022 academic year. The experimental group was instructed to portray a positive personality profile on the test and provide deceptive responses, as their admission to a university program was contingent on this. Conversely, the control group was asked to represent themselves truthfully and provide honest responses. In this study, the initial focus was on assessing the validity and reliability of the scores obtained from the personality test. Subsequently, a comparison was made between the scores of the participants in the experimental and control groups for each sub-dimension of the personality test to determine if there was a significant difference. The findings revealed a significant difference in mean scores between the two groups, favoring the experimental group. Moreover, the results obtained from Cluster Analysis and Latent Class Analysis demonstrated that Latent Class Analysis outperformed Cluster Analysis in detecting fake respondents, exhibiting a lower error rate.
The aim of this study is to investigate the impact of online peer feedback in the Information Technologies and Software course on the improvement of collaborative problem-solving skills (CPS), which ...are considered essential skills for the 21st century. The impact of peer feedback on CPS was designed using a mixed-methods approach that combines quantitative and qualitative data in the research. The study employed a set of CPS tasks that were specifically designed to measure the target behaviors outlined in the 6th-grade Information Technologies and Software course curriculum. Additionally, the study made use of various instruments, including a peer feedback survey, a longitudinal rating scale for tracking the development of CPS, and a peer feedback interview protocol. As a result, a statistically significant difference was found between the CPS of the experimental and control groups. According to the results of the study, it can be expressed that the CPS and peer feedback skills of the students in the experimental group have improved and that they have a more positive attitude toward giving peer feedback and solving collaborative problems based on the results of the interview form.
The aim of this study is to investigate the impact of online peer feedback in the Information Technologies and Software course on the improvement of collaborative problem-solving skills (CPS), which are considered essential skills for the 21st century. The impact of peer feedback on CPS was designed using a mixed-methods approach that combines quantitative and qualitative data in the research. The study employed a set of CPS tasks that were specifically designed to measure the target behaviors outlined in the 6th-grade Information Technologies and Software course curriculum. Additionally, the study made use of various instruments, including a peer feedback survey, a longitudinal rating scale for tracking the development of CPS, and a peer feedback interview protocol. As a result, a statistically significant difference was found between the CPS of the experimental and control groups. According to the results of the study, it can be expressed that the CPS and peer feedback skills of the students in the experimental group have improved and that they have a more positive attitude toward giving peer feedback and solving collaborative problems based on the results of the interview form.