The Psychomotor Vigilance Test (PVT) is reported to be free of practice effects that can otherwise confound the effects of sleep loss and circadian misalignment on performance. This differentiates ...the PVT from more complex cognitive tests. To the best of our knowledge, no study has systematically investigated practice effects on the PVT across multiple outcome domains, depending on administration interval, and in ecologically more valid settings.
We administered a validated 3-minute PVT (PVT-B) 16 times in 45 participants (23 male, mean ± SD age 32.6 ± 7.3 years, range 25-54 years) with administration intervals of ≥10 days, ≤5 days, or 4 times per day. We investigated linear and logarithmic trends across repeated administrations in 10 PVT-B outcome variables.
The fastest 10% of response times (RT; plin = .0002), minimum RT (plog = .0010), and the slowest 10% of reciprocal RT (plog = .0124) increased while false starts (plog = 0.0050) decreased with repeated administration, collectively decreasing RT variability (plog = .0010) across administrations. However, the observed absolute changes were small (e.g., -0.03 false starts per administration, linear fit) and are probably irrelevant in practice. Test administration interval did not modify the effects of repeated administration on PVT-B performance (all p > .13 for interaction). Importantly, mean and median RT, response speed, and lapses, which are among the most frequently used PVT outcomes, did not change systematically with repeated administration.
PVT-B showed stable performance across repeated administrations. Combined with its high sensitivity, this corroborates the status of the PVT as the de facto gold standard measure of the neurobehavioral effects of sleep loss and circadian misalignment.
Maintaining optimal cognitive performance in astronauts during spaceflight is critical to crewmember safety and mission success. To investigate the combined effects of confinement, isolation, and ...sleep deprivation on cognitive performance during spaceflight, we administered the computerized neurobehavioral test battery "Cognition" to crew members of simulated spaceflight missions as part of NASA's ground-based Human Exploration Research Analog project. Cognition was administered to
= 32 astronaut-like subjects in four 1-week missions (campaign 1) and four 2 weeks missions (campaign 2), with four crewmembers per mission. In both campaigns, subjects performed significantly faster on Cognition tasks across time in mission without sacrificing accuracy, which is indicative of a learning effect. On an alertness and affect survey, subjects self-reported significant improvement in several affective domains with time in mission. During the sleep restriction challenge, subjects in campaign 1 were significantly less accurate on a facial emotion identification task during a night of partial sleep restriction. Subjects in campaign 2 were significantly slower and less accurate on psychomotor vigilance, and slower on cognitive throughput and motor praxis tasks during a night of total sleep deprivation. On the survey, subjects reported significantly worsening mood during the sleep loss challenge on several affective domains. These findings suggest that confinement and relative isolation of up to 2 weeks in this environment do not induce a significant negative impact on cognitive performance in any of the domains examined by Cognition, although the concurrent practice effect may have masked some of the mission's effects. Conversely, a night of total sleep deprivation significantly decreased psychomotor vigilance and cognitive throughput performance in astronaut-like subjects. This underscores the importance of using cognitive tests designed specifically for the astronaut population, and that survey a range of cognitive domains to detect the differential effects of the wide range of stressors common to the spaceflight environment.
BACKGROUND: Sustained high-level cognitive performance is of paramount importance for the success of space missions, which involve environmental, physiological, and psychological stressors that may ...affect brain functions. Despite subjective symptom reports of cognitive fluctuations
in spaceflight, the nature of neurobehavioral functioning in space has not been clarified.METHODS: We developed a computerized cognitive test battery (Cognition) that has sensitivity to multiple cognitive domains and was specifically designed for the high-performing astronaut
population. Cognition consists of 15 unique forms of 10 neuropsychological tests that cover a range of cognitive domains, including emotion processing, spatial orientation, and risk decision making. Cognition is based on tests known to engage specific brain regions as evidenced
by functional neuroimaging. Here we describe the first normative and acute total sleep deprivation data on the Cognition test battery as well as several efforts underway to establish the validity, sensitivity, feasibility, and acceptability of Cognition.RESULTS: Practice
effects and test-retest variability differed substantially between the 10 Cognition tests, illustrating the importance of normative data that both reflect practice effects and differences in stimulus set difficulty in the population of interest. After one night without sleep, medium
to large effect sizes were observed for 3 of the 10 tests addressing vigilant attention (Cohen's d = 1.00), cognitive throughput (d = 0.68), and abstract reasoning (d = 0.65).CONCLUSIONS: In addition to providing neuroimaging-based novel information on the effects of spaceflight
on a range of cognitive functions, Cognition will facilitate comparing the effects of ground-based analogues to spaceflight, increase consistency across projects, and thus enable meta-analyses.Basner M, Savitt A, Moore TM, Port AM, McGuire S, Ecker AJ, Nasrini J, Mollicone DJ, Mott
CM, McCann T, Dinges DF, Gur RC. Development and validation of the Cognition test battery for spaceflight. Aerosp Med Hum Perform. 2015; 86(11):942-952.
Category learning is often tested with similar images that have no significance outside of the experiment for the subjects. By contrast, in nature animals often need to generalize a behavioral ...response like "eat" across visually distinct stimuli, such as spiders and seeds. Forming functional categories like "food" and "predator" may require conceptual rather than purely perceptual generalization. We trained free-range chickens to classify images assigned to one of four categories based on putative functional significance: inanimate objects, predators, food, and non-competing vertebrates. Images were visually diverse within each category, discouraging classification by perceptual similarity alone. In Experiment 1, chickens classified 80 images into four categories. Chickens then generalized to 80 new exemplars in each of three successive generalization tests. In Experiment 2, chickens saw new types of images to test whether their generalization was perceptual or functional. For example, chickens saw images of skunks for the predator category after training with images of hawks and snakes. Chickens used the "predator" response with these new images for both predators and non-threatening vertebrates, but not for objects or food, and did not successfully generalize any category other than predator. In Experiment 3, chickens categorized fractals as "food," and three of four chickens categorized a range of vertebrates they had not previously encountered as "predators," suggesting that chickens did not see the images as representing real world objects and animals. These results highlight constraints on the use of computer-generated images to assess categorization of natural stimuli in chickens.
There is substantial evidence of group-specific behaviors in wild animals that are thought to be socially transmitted. Yet experimental studies with monkeys have reported conflicting evidence on the ...extent to which monkeys learn by observing their conspecifics. In this study, we tested the feasibility of using pre-recorded video demonstrations to investigate social learning from conspecifics in rhesus monkeys. With training, monkeys gradually learned to respond correctly following videos of a demonstrator, however, follow-up experiments revealed that this was not due to learning from the demonstrator monkey. In generalization tests with videos that were horizontally reversed, monkeys continued responding to the location they had associated with each video, rather than matching the new choice location shown in the mirrored video. When the task was changed to make location irrelevant, such that monkeys could choose correctly only by selecting the same image selected by the demonstrator in the video, observer monkeys did not exceed chance in 12,000 training trials. Because monkeys readily learn to follow nonsocial visual cues presented on a monitor to guide image choice, their inability to learn from a demonstrator here indicates substantial limitations in the capacity for social learning from videos. Furthermore, these findings encourage deeper consideration of what monkeys perceive when presented with video stimuli on computer screens.
To understand the health impact of long-duration spaceflight, one identical twin astronaut was monitored before, during, and after a 1-year mission onboard the International Space Station; his twin ...served as a genetically matched ground control. Longitudinal assessments identified spaceflight-specific changes, including decreased body mass, telomere elongation, genome instability, carotid artery distension and increased intima-media thickness, altered ocular structure, transcriptional and metabolic changes, DNA methylation changes in immune and oxidative stress-related pathways, gastrointestinal microbiota alterations, and some cognitive decline postflight. Although average telomere length, global gene expression, and microbiome changes returned to near preflight levels within 6 months after return to Earth, increased numbers of short telomeres were observed and expression of some genes was still disrupted. These multiomic, molecular, physiological, and behavioral datasets provide a valuable roadmap of the putative health risks for future human spaceflight.
Abstract
Study Objectives
The psychomotor vigilance test (PVT) is frequently used to measure behavioral alertness in sleep research on various software and hardware platforms. In contrast to many ...other cognitive tests, PVT response time (RT) shifts of a few milliseconds can be meaningful. It is, therefore, important to use calibrated systems, but calibration standards are currently missing. This study investigated the influence of system latency bias and its variability on two frequently used PVT performance metrics, attentional lapses (RTs ≥500 ms) and response speed, in sleep-deprived and alert participants.
Methods
PVT data from one acute total (N = 31 participants) and one chronic partial (N = 43 participants) sleep deprivation protocol were the basis for simulations in which response bias (±15 ms) and its variability (0–50 ms) were systematically varied and transgressions of predefined thresholds (i.e. ±1 for lapses, ±0.1/s for response speed) recorded.
Results
Both increasing bias and its variability caused deviations from true scores that were higher for the number of lapses in sleep-deprived participants and for response speed in alert participants. Threshold transgressions were typically rare (i.e. <5%) if system latency bias was less than ±5 ms and its standard deviation was ≤10 ms.
Conclusions
A bias of ±5 ms with a standard deviation of ≤10 ms could be considered maximally allowable margins for calibrating PVT systems for timing accuracy. Future studies should report the average system latency and its standard deviation in addition to adhering to published standards for administering and analyzing the PVT.
Abstract
Chronic sleep loss is associated with escalating declines in vigilant attention across days of sleep restriction. However, studies exceeding 2 weeks of chronic sleep loss are scarce, and the ...cognitive performance outcomes assessed are limited. We assessed the effects of 6 weeks of chronic sleep restriction on a range of cognitive domains in 15 high-performing individuals (38.5 ± 8.2 years, 6 women) confined to small space in groups of 4. Sleep opportunities were limited to 5 h on weekdays and 8 h on weekends. Individual sleep–wake patterns were recorded with actigraphy. Neurobehavioral performance was assessed in evenings with Cognition, a computerized battery of ten tests assessing a range of cognitive domains. There were some small to moderate effects of increasing sleep debt relative to pre-mission baseline, with decreases in accuracy across cognitive domains (standardized β = –0.121, p = 0.001), specifically on tests of spatial orientation (β = –0.289, p = 0.011) and vigilant attention (β = –0.688, p < 0.001), which were not restored by two nights of weekend recovery sleep. Cognitive and subjective decrements occurred despite occasional daytime napping in breach of study protocol, evening testing around the circadian peak, and access to caffeine before 14:00. Sensorimotor speed, spatial learning and memory, working memory, abstraction and mental flexibility, emotion identification, abstract reasoning, cognitive throughput, and risk decision making were not significantly affected by sleep debt. Taken together with modest lower subjective ratings of happiness and healthiness, these findings underline the importance of sufficient sleep, on both an acute and chronic basis, for performance in selected cognitive domains and subjective wellbeing in operationally relevant environments.
•We examine the roles of consensus and culture in children’s imitation of inefficient actions.•There were no cultural differences in imitation of a single model’s preference for an inefficient ...tool.•Chinese Americans were significantly more likely than Caucasian Americans to copy the inefficient choice of a consensus.•The results reflect each culture’s reliance on different modes of learning.•Caucasian Americans rely primarily on perceptual learning and Chinese Americans rely on social learning.
A significant body of work has demonstrated children’s imitative abilities when learning novel actions. Although some research has examined the role of cultural background in children’s imitation of inefficient actions, to our knowledge no research has explored how culture and conformity interact when engaging in imitation. In Study 1, 87 Caucasian American and Chinese American preschoolers were presented with either one model or three models performing an inefficient action. Whereas there were no cultural differences in imitation in the Single Model condition, Chinese Americans were significantly more likely to copy the model’s preference for an inefficient tool in the Consensus condition. Children’s tool choice was associated with their justification for their choice as well as their memory for the model’s action. Study 2 explored the impact of immigration status on the cultural differences in children’s tool choice by including 16 first-generation Caucasian American children. When comparing the findings with the rates from Study 1, both groups of Caucasian American preschoolers imitated at rates significantly lower than the Chinese American preschoolers. We suggest that the tool choices of Caucasian American children relate to a tendency to engage in a perceptually driven mode of learning, whereas the choices of the Chinese American children reflect a greater likelihood to use a socially driven mode.
Practice effects associated with the repeated administration of cognitive tests often confound true therapeutic or experimental effects. Alternate test forms help reduce practice effects, but ...generating stimulus sets with identical properties can be difficult. The main objective of this study was to disentangle practice and stimulus set effects for Cognition, a battery of 10 brief cognitive tests specifically designed for high-performing populations with 15 unique versions for repeated testing. A secondary objective was to investigate the effects of test-retest interval on practice effects.
The 15 versions of Cognition were administered in three groups of 15-16 subjects (total N = 46, mean±SD age 32.5 ± 7.2 years, range 25-54 years, 23 male) in a randomized but balanced fashion with administration intervals of ≥10 days, ≤5 days, or 4 times per day. Mixed effect models were used to investigate linear and logarithmic trends across repeated administrations in key speed and accuracy outcomes, whether these trends differed significantly between administration interval groups, and whether stimulus sets differed significantly in difficulty.
Protracted, non-linear practice effects well beyond the second administration were observed for most of the 10 Cognition tests both in accuracy and speed, but test-retest administration interval significantly affected practice effects only for 3 out of the 10 tests and only in the speed domain. Stimulus set effects were observed for the 6 Cognition tests that use unique sets of stimuli. Factors were established that allow for correcting for both practice and stimulus set effects.
Practice effects are pronounced and probably under-appreciated in cognitive testing. The correction factors established in this study are a unique feature of the Cognition battery that can help avoid masking practice effects, address noise generated by differences in stimulus set difficulty, and facilitate interpretation of results from studies with repeated assessments.
PDF
