Akademska digitalna zbirka SLovenije - logo
(UL)
  • Learning analytics in formative assessment: case of usage rubrics for monitoring inter-rater reliability = Učne analitike v formativnem ocenjevanju: primer uporabe razširjenih ocenjevalnih shem za spremljanje zanesljivosti preverjanja znanja z več ocenjevalci
    Bregar, Lea ; Puhek, Miro ; Ašanin Gole, Pedja, 1966-
    In the paper we investigated rubrics as a tool for monitoring inter-rater reliability in formative assessment in online learning setting. Inter-rater reliability was tested at DOBA Business School ... where formative assessment is one of the pillars of quality support of online students. Pilot implementation of rubrics was tested for undergraduate online course with 183 students split into six study groups supported by six teaching assistants (raters) in two countries. Rubrics rating data, which were generated automatically during pilot implementation by Blackboard system enabled learning analytics investigation of inter-rater reliability by descriptive statistics, analysis of variance and post-hoc Bonferroni and Tukey tests. Statistical results demonstrate high level of assessment consistency among assessors and indicate reliability of their assessment. Results of statistical analysis were highlighted by qualitative analysis based on studentsʼ web survey and online interviews with assessors.
    Vrsta gradiva - članek, sestavni del
    Leto - 2018
    Jezik - angleški
    COBISS.SI-ID - 513042992