Massive open online courses (MOOCs) offer free education globally to anyone with a computer and internet access. Despite this democratization of learning, the massive enrollment in these courses ...makes it impractical for one instructor to assess every student's writing assignment. As a result, peer grading, often guided by a straightforward rubric, is the method of choice. While convenient, peer grading often falls short in terms of reliability and validity. In this study, we explore the feasibility of using large language models (LLMs) to replace peer grading in MOOCs. Specifically, we use two LLMs, GPT-4 and GPT-3.5, across three MOOCs: Introductory Astronomy, Astrobiology, and the History and Philosophy of Astronomy. To instruct LLMs, we use three different prompts based on the zero-shot chain-of-thought (ZCoT) prompting technique: (1) ZCoT with instructor-provided correct answers, (2) ZCoT with both instructor-provided correct answers and rubrics, and (3) ZCoT with instructor-provided correct answers and LLM-generated rubrics. Tested on 18 settings, our results show that ZCoT, when augmented with instructor-provided correct answers and rubrics, produces grades that are more aligned with those assigned by instructors compared to peer grading. Finally, our findings indicate a promising potential for automated grading systems in MOOCs, especially in subjects with well-defined rubrics, to improve the learning experience for millions of online learners worldwide.
Large Language Models As MOOCs Graders Golchin, Shahriar; Garuda, Nikhil; Impey, Christopher ...
arXiv (Cornell University),
03/2024
Paper, Journal Article
Open access
Massive open online courses (MOOCs) unlock the doors to free education for anyone around the globe with access to a computer and the internet. Despite this democratization of learning, the massive ...enrollment in these courses means it is almost impossible for one instructor to assess every student's writing assignment. As a result, peer grading, often guided by a straightforward rubric, is the method of choice. While convenient, peer grading often falls short in terms of reliability and validity. In this study, using 18 distinct settings, we explore the feasibility of leveraging large language models (LLMs) to replace peer grading in MOOCs. Specifically, we focus on two state-of-the-art LLMs: GPT-4 and GPT-3.5, across three distinct courses: Introductory Astronomy, Astrobiology, and the History and Philosophy of Astronomy. To instruct LLMs, we use three different prompts based on a variant of the zero-shot chain-of-thought (Zero-shot-CoT) prompting technique: Zero-shot-CoT combined with instructor-provided correct answers; Zero-shot-CoT in conjunction with both instructor-formulated answers and rubrics; and Zero-shot-CoT with instructor-offered correct answers and LLM-generated rubrics. Our results show that Zero-shot-CoT, when integrated with instructor-provided answers and rubrics, produces grades that are more aligned with those assigned by instructors compared to peer grading. However, the History and Philosophy of Astronomy course proves to be more challenging in terms of grading as opposed to other courses. Finally, our study reveals a promising direction for automating grading systems for MOOCs, especially in subjects with well-defined rubrics.
We present a new parametric lens model for the G165.7+67.0 galaxy cluster,
which was discovered with $Planck$ through its bright submillimeter flux,
originating from a pair of extraordinary dusty ...star-forming galaxies (DSFGs) at
$z\approx 2.2$. Using JWST and interferometric mm/radio observations, we
characterize the intrinsic physical properties of the DSFGs, which are
separated by only $\sim 1^{\prime\prime}$ (8 kpc) and a velocity difference
$\Delta V \lesssim 600~{\rm km}~{\rm s}^{-1}$ in the source plane, and thus
likely undergoing a major merger. Boasting intrinsic star formation rates ${\rm
SFR}_{\rm IR} = 320 \pm 70$ and $400 \pm 80~ M_\odot~{\rm yr}^{-1}$, stellar
masses ${\rm log}M_\star/M_\odot = 10.2 \pm 0.1$ and $10.3 \pm 0.1$, and dust
attenuations $A_V = 1.5 \pm 0.3$ and $1.2 \pm 0.3$, they are remarkably similar
objects. We perform spatially-resolved pixel-by-pixel SED fitting using
rest-frame near-UV to near-IR imaging from JWST/NIRCam for both galaxies,
resolving some stellar structures down to 100 pc scales. Based on their
resolved specific SFRs and $UVJ$ colors, both DSFGs are experiencing
significant galaxy-scale star formation events. If they are indeed interacting
gravitationally, this strong starburst could be the hallmark of gas that has
been disrupted by an initial close passage. In contrast, the host galaxy of the
recently discovered triply-imaged SN H0pe has a much lower SFR than the DSFGs,
and we present evidence for the onset of inside-out quenching and large column
densities of dust even in regions of low specific SFR. Based on the intrinsic
SFRs of the DSFGs inferred from UV through FIR SED modeling, this pair of
objects alone is predicted to yield an observable $1.1 \pm 0.2~{\rm
CCSNe~yr}^{-1}$, making this cluster field ripe for continued monitoring.
A Type Ia supernova (SN) at \(z=1.78\) was discovered in James Webb Space Telescope Near Infrared Camera imaging of the galaxy cluster PLCK G165.7+67.0 (G165; \(z = 0.35\)). The SN is situated 1.5-2 ...kpc from the host-galaxy nucleus and appears in three different locations as a result of gravitational lensing by G165. These data can yield a value for Hubble's constant using time delays from this multiply-imaged SN Ia that we call "SN H0pe." Over the cluster, we identified 21 image multiplicities, confirmed five of them using the Near-Infrared Spectrograph, and constructed a new lens model that gives a total mass within 600 kpc of (\(2.6 \pm 0.3) \times 10^{14}\) \(M_{\odot}\). The photometry uncovered a galaxy overdensity coincident with the SN host galaxy. NIRSpec confirmed six member galaxies, four of which surround the SN host galaxy with relative velocity \(\lesssim\)900 km s\(^{-1}\) and projected physical extent \(\lesssim\)33 kpc. This compact galaxy group is dominated by the SN host galaxy, which has a stellar mass of \((5.0 \pm 0.1) \times 10^{11}\) \(M_{\odot}\). The group members have specific star-formation rates of 2-260 Gyr\(^{-1}\) derived from the H\(\alpha\)-line fluxes corrected for stellar absorption, dust extinction, and slit losses. Another group centered on a strongly-lensed dusty star forming galaxy is at \(z=2.24\). The total (unobscured and obscured) SFR of this second galaxy group is estimated to be (\(\gtrsim\)100 \(M_{\odot}\) yr\(^{-1}\)), which translates to a supernova rate of \(\sim\)1 SNe yr\(^{-1}\), suggesting that regular monitoring of this cluster may yield additional SNe.
The massive galaxy cluster El Gordo (z=0.87) imprints multitudes of gravitationally lensed arcs onto James Webb Space Telescope (JWST) Near-Infrared Camera (NIRCam) images. Eight bands of NIRCam ...imaging were obtained in the ``Prime Extragalactic Areas for Reionization and Lensing Science'' (``PEARLS'') program. PSF-matched photometry across Hubble Space Telescope (HST) and NIRCam filters supplies new photometric redshifts. A new light-traces-mass lens model based on 56 image multiplicities identifies the two mass peaks and yields a mass estimate within 500 kpc of ~(7.0 +/- 0.30) x 10^14 Msun. A search for substructure in the 140 cluster members with spectroscopic redshifts confirms the two main mass components. The southeastern mass peak that contains the BCG is more tightly bound than the northwestern one. The virial mass within 1.7 Mpc is (5.1 +/- 0.60) x 10^14 Msun, lower than the lensing mass. A significant transverse velocity component could mean the virial mass is underestimated. We contribute one new member to the previously known z=4.32 galaxy group. Intrinsic (delensed) positions of the five secure group members span a physical extent of ~60 kpc. Thirteen additional candidates selected by spectroscopic/photometric constraints are small and faint with a mean intrinsic luminosity ~2.2 mag fainter than L*. NIRCam imaging admits a fairly wide range of brightnesses and morphologies for the group members, suggesting a more diverse galaxy population in this galaxy overdensity.
We present a new parametric lens model for the G165.7+67.0 galaxy cluster, which was discovered with \(Planck\) through its bright submillimeter flux, originating from a pair of extraordinary dusty ...star-forming galaxies (DSFGs) at \(z\approx 2.2\). Using JWST and interferometric mm/radio observations, we characterize the intrinsic physical properties of the DSFGs, which are separated by only \(\sim 1^{\prime\prime}\) (8 kpc) and a velocity difference \(\Delta V \lesssim 600~{\rm km}~{\rm s}^{-1}\) in the source plane, and thus likely undergoing a major merger. Boasting intrinsic star formation rates \({\rm SFR}_{\rm IR} = 320 \pm 70\) and \(400 \pm 80~ M_\odot~{\rm yr}^{-1}\), stellar masses \({\rm log}M_\star/M_\odot = 10.2 \pm 0.1\) and \(10.3 \pm 0.1\), and dust attenuations \(A_V = 1.5 \pm 0.3\) and \(1.2 \pm 0.3\), they are remarkably similar objects. We perform spatially-resolved pixel-by-pixel SED fitting using rest-frame near-UV to near-IR imaging from JWST/NIRCam for both galaxies, resolving some stellar structures down to 100 pc scales. Based on their resolved specific SFRs and \(UVJ\) colors, both DSFGs are experiencing significant galaxy-scale star formation events. If they are indeed interacting gravitationally, this strong starburst could be the hallmark of gas that has been disrupted by an initial close passage. In contrast, the host galaxy of the recently discovered triply-imaged SN H0pe has a much lower SFR than the DSFGs, and we present evidence for the onset of inside-out quenching and large column densities of dust even in regions of low specific SFR. Based on the intrinsic SFRs of the DSFGs inferred from UV through FIR SED modeling, this pair of objects alone is predicted to yield an observable \(1.1 \pm 0.2~{\rm CCSNe~yr}^{-1}\), making this cluster field ripe for continued monitoring.
Background:
India accounts for 13.3% of global disability-adjusted life years (DALYs) lost due to stroke with a relatively younger age of onset compared to the Western population. In India’s public ...healthcare system, many stroke patients seek care at tertiary-level government-funded medical colleges where an optimal level of stroke care is expected. However, there are no studies from India that have assessed the quality of stroke care, including infrastructure, imaging facilities, or the availability of stroke care units in medical colleges.
Aim:
This study aimed to understand the existing protocols and management of acute stroke care across 22 medical colleges in India, as part of the baseline assessment of the ongoing IMPETUS stroke study.
Methods:
A semi-structured quantitative pre-tested questionnaire, developed based on review of literature and expert discussion, was mailed to 22 participating sites of the IMPETUS stroke study. The questionnaire assessed comprehensively all components of stroke care, including human resources, emergency system, in-hospital care, and secondary prevention. A descriptive analysis of their status was undertaken.
Results:
In the emergency services, limited stroke helpline numbers, 3/22 (14%); prenotification system, 5/22 (23%); and stroke-trained physicians were available, 6/22 (27%). One-third of hospitals did not have on-call neurologists. Although non-contrast computed tomography (NCCT) was always available, 39% of hospitals were not doing computed tomography (CT) angiography and 13/22 (59%) were not doing magnetic resonance imaging (MRI) after routine working hours. Intravenous thrombolysis was being done in 20/22 (91%) hospitals, but 36% of hospitals did not provide it free of cost. Endovascular therapy was available only in 6/22 (27%) hospitals. The study highlighted the scarcity of multidisciplinary stroke teams, 8/22 (36%), and stroke units, 7/22 (32%). Lifesaving surgeries like hematoma evacuation, 11/22 (50%), and decompressive craniectomy, 9/22 (41%), were performed in limited numbers. The availability of occupational therapists, speech therapists, and cognitive rehabilitation was minimal.
Conclusion:
This study highlighted the current status of acute stroke management in publicly funded tertiary care hospitals. Lack of prenotification, limited number of stroke-trained physicians and neurosurgeons, relatively lesser provision of free thrombolytic agents, limited stroke units, and lack of rehabilitation services are areas needing urgent attention by policymakers and creation of sustainable education models for uniform stroke care by medical professionals across the country.
Full text
Available for:
NUK, OILJ, SAZU, UKNU, UL, UM, UPUK
