MVPA-Light is a MATLAB toolbox for multivariate pattern analysis (MVPA). It provides native implementations of a range of classifiers (LDA, Logistic Regression, SVM, kernel FDA, Naive Bayes, ensemble ...methods) and regression models (ridge, kernel ridge), using modern optimization algorithms. High-level functions allow for the multivariate analysis of multi-dimensional data, including generalization (e.g. time x time) and searchlight analysis. The toolbox performs cross-validation, hyperparameter tuning, and nested preprocessing. It computes various classification and regression metrics and establishes their statistical significance. It is modular, easily extendable, and is shipped with sample data and example scripts. Furthermore, it offers interfaces for LIBSVM and LIBLINEAR as well as an integration into the FieldTrip neuroimaging toolbox.
In a visual oddball paradigm, attention to an event usually modulates the event-related potential (ERP). An ERP-based brain-computer interface (BCI) exploits this neural mechanism for communication. ...Hitherto, it was unclear to what extent the accuracy of such a BCI requires eye movements (overt attention) or whether it is also feasible for targets in the visual periphery (covert attention). Also unclear was how the visual design of the BCI can be improved to meet peculiarities of peripheral vision such as low spatial acuity and crowding.
Healthy participants (N = 13) performed a copy-spelling task wherein they had to count target intensifications. EEG and eye movements were recorded concurrently. First, (c)overt attention was investigated by way of a target fixation condition and a central fixation condition. In the latter, participants had to fixate a dot in the center of the screen and allocate their attention to a target in the visual periphery. Second, the effect of visual speller layout was investigated by comparing the symbol Matrix to an ERP-based Hex-o-Spell, a two-levels speller consisting of six discs arranged on an invisible hexagon.
We assessed counting errors, ERP amplitudes, and offline classification performance. There is an advantage (i.e., less errors, larger ERP amplitude modulation, better classification) of overt attention over covert attention, and there is also an advantage of the Hex-o-Spell over the Matrix. Using overt attention, P1, N1, P2, N2, and P3 components are enhanced by attention. Using covert attention, only N2 and P3 are enhanced for both spellers, and N1 and P2 are modulated when using the Hex-o-Spell but not when using the Matrix. Consequently, classifiers rely mainly on early evoked potentials in overt attention and on later cognitive components in covert attention.
Both overt and covert attention can be used to drive an ERP-based BCI, but performance is markedly lower for covert attention. The Hex-o-Spell outperforms the Matrix, especially when eye movements are not permitted, illustrating that performance can be increased if one accounts for peculiarities of peripheral vision.
•We provide a tutorial and evaluation of MNE-type and beamforming methods.•We highlight the importance of resolution matrix, point-spread and cross-talk.•We present intuitive resolution metrics to ...evaluate and compare methods.•We applied these tools to five MNE-type methods and two beamformers.•Point-spread localization error can be low but cross-talk is fundamentally limited.
The spatial resolution of EEG/MEG source estimates, often described in terms of source leakage in the context of the inverse problem, poses constraints on the inferences that can be drawn from EEG/MEG source estimation results. Software packages for EEG/MEG data analysis offer a large choice of source estimation methods but few tools to experimental researchers for methods evaluation and comparison. Here, we describe a framework and tools for objective and intuitive resolution analysis of EEG/MEG source estimation based on linear systems analysis, and apply those to the most widely used distributed source estimation methods such as L2-minimum-norm estimation (L2-MNE) and linearly constrained minimum variance (LCMV) beamformers. Within this framework it is possible to define resolution metrics that define meaningful aspects of source estimation results (such as localization accuracy in terms of peak localization error, PLE, and spatial extent in terms of spatial deviation, SD) that are relevant to the task at hand and can easily be visualized. At the core of this framework is the resolution matrix, which describes the potential leakage from and into point sources (point-spread and cross-talk functions, or PSFs and CTFs, respectively). Importantly, for linear methods these functions allow generalizations to multiple sources or complex source distributions. This paper provides a tutorial-style introduction into linear EEG/MEG source estimation and resolution analysis aimed at experimental (rather than methods-oriented) researchers. We used this framework to demonstrate how L2-MNE-type as well as LCMV beamforming methods can be evaluated in practice using software tools that have only recently become available for routine use. Our novel methods comparison includes PLE and SD for a larger number of methods than in similar previous studies, such as unweighted, depth-weighted and normalized L2-MNE methods (including dSPM, sLORETA, eLORETA) and two LCMV beamformers. The results demonstrate that some methods can achieve low and even zero PLE for PSFs. However, their SD as well as both PLE and SD for CTFs are far less optimal for all methods, in particular for deep cortical areas. We hope that our paper will encourage EEG/MEG researchers to apply this approach to their own tasks at hand.
Remembering is a reconstructive process, yet little is known about how the reconstruction of a memory unfolds in time in the human brain. Here, we used reaction times and EEG time-series decoding to ...test the hypothesis that the information flow is reversed when an event is reconstructed from memory, compared to when the same event is initially being perceived. Across three experiments, we found highly consistent evidence supporting such a reversed stream. When seeing an object, low-level perceptual features were discriminated faster behaviourally, and could be decoded from brain activity earlier, than high-level conceptual features. This pattern reversed during associative memory recall, with reaction times and brain activity patterns now indicating that conceptual information was reconstructed more rapidly than perceptual details. Our findings support a neurobiologically plausible model of human memory, suggesting that memory retrieval is a hierarchical, multi-layered process that prioritises semantically meaningful information over perceptual details.
•Random forest classifiers can predict spontaneous and stimulated SOs and spindle amplitudes.•Morphological wave features predicted the response of SOs and spindles to CLAS.•SO amplitude during the ...click is the main predictor for post-stimulus SO amplitude.•Prediction of spindle activity did not differ in accuracy for stimulated vs spontaneous data.
Large slow oscillations (SO, 0.5–2 Hz) characterise slow-wave sleep and are crucial to memory consolidation and other physiological functions. Manipulating slow oscillations may enhance sleep and memory, as well as benefitting the immune system. Closed-loop auditory stimulation (CLAS) has been demonstrated to increase the SO amplitude and to boost fast sleep spindle activity (11–16 Hz). Nevertheless, not all such stimuli are effective in evoking SOs, even when they are precisely phase locked. Here, we studied what factors of the ongoing activity patterns may help to determine what oscillations to stimulate to effectively enhance SOs or SO-locked spindle activity. Hence, we trained classifiers using the morphological characteristics of the ongoing SO, as measured by electroencephalography (EEG), to predict whether stimulation would lead to a benefit in terms of the resulting SO and spindle amplitude. Separate classifiers were trained using trials from spontaneous control and stimulated datasets, and we evaluated their performance by applying them to held-out data both within and across conditions. We were able to predict both when large SOs occurred spontaneously, and whether a phase-locked auditory click effectively enlarged them with good accuracy for predicting the SO trough (∼70%) and SO peak values (∼80%). Also, we were able to predict when stimulation would elicit spindle activity with an accuracy of ∼60%. Finally, we evaluate the importance of the various SO features used to make these predictions. Our results offer new insight into SO and spindle dynamics and may suggest techniques for developing future methods for online optimization of stimulation.
Generative Adversarial Networks (GANs) can synthesize brain images from image or noise input. So far, the gold standard for assessing the quality of the generated images has been human expert ...ratings. However, due to limitations of human assessment in terms of cost, scalability, and the limited sensitivity of the human eye to more subtle statistical relationships, a more automated approach towards evaluating GANs is required.
We investigated to what extent visual quality can be assessed using image quality metrics and we used group analysis and spatial independent components analysis to verify that the GAN reproduces multivariate statistical relationships found in real data. Reference human data was obtained by recruiting neuroimaging experts to assess real Magnetic Resonance (MR) images and images generated by a GAN. Image quality was manipulated by exporting images at different stages of GAN training.
Experts were sensitive to changes in image quality as evidenced by ratings and reaction times, and the generated images reproduced group effects (age, gender) and spatial correlations moderately well. We also surveyed a number of image quality metrics. Overall, Fréchet Inception Distance (FID), Maximum Mean Discrepancy (MMD) and Naturalness Image Quality Evaluator (NIQE) showed sensitivity to image quality and good correspondence with the human data, especially for lower-quality images (i.e., images from early stages of GAN training). However, only a Deep Quality Assessment (QA) model trained on human ratings was able to reproduce the subtle differences between higher-quality images.
We recommend a combination of group analyses, spatial correlation analyses, and both distortion metrics (FID, MMD, NIQE) and perceptual models (Deep QA) for a comprehensive evaluation and comparison of brain images produced by GANs.
•Generative modeling of gray-matter density maps of Magnetic Resonance Images (MRI).•Generative Adversarial Network (GAN) creates 3D maps.•Detection task and subjective rating task with neuroimaging experts.•Survey of image quality metrics Inception Score, MIS, FID, MMD, NIQE, BRISQUE.•Deep Quality Assessment model replicating perceptual quality ratings.
Inhibitory control requires precise regulation of activity and connectivity within multiple brain networks. Previous studies have typically evaluated age-related changes in regional activity or ...changes in interregional interactions. Instead, we test the hypothesis that activity and connectivity make distinct, complementary contributions to performance across the life span and the maintenance of successful inhibitory control systems. A representative sample of healthy human adults in a large, population-based life span cohort performed an integrated Stop-Signal (SS)/No-Go task during functional magnetic resonance imaging (
= 119; age range, 18-88 years). Individual differences in inhibitory control were measured in terms of the SS reaction time (SSRT), using the blocked integration method. Linear models and independent components analysis revealed that individual differences in SSRT correlated with both activity and connectivity in a distributed inhibition network, comprising prefrontal, premotor, and motor regions. Importantly, this pattern was moderated by age, such that the association between inhibitory control and connectivity, but not activity, differed with age. Multivariate statistics and out-of-sample validation tests of multifactorial functional organization identified differential roles of activity and connectivity in determining an individual's SSRT across the life span. We propose that age-related differences in adaptive cognitive control are best characterized by the joint consideration of multifocal activity and connectivity within distributed brain networks. These insights may facilitate the development of new strategies to support cognitive ability in old age.
The preservation of cognitive and motor control is crucial for maintaining well being across the life span. We show that such control is determined by both activity and connectivity within distributed brain networks. In a large, population-based cohort, we used a novel whole-brain multivariate approach to estimate the functional components of inhibitory control, in terms of their activity and connectivity. Both activity and connectivity in the inhibition network changed with age. But only the association between performance and connectivity, not activity, differed with age. The results suggest that adaptive control is best characterized by the joint consideration of multifocal activity and connectivity. These insights may facilitate the development of new strategies to maintain cognitive ability across the life span in health and disease.
Problematic internet use (PIU; otherwise known as Internet Addiction) is a growing problem in modern societies. There is scarce knowledge of the demographic variables and specific internet activities ...associated with PIU and a limited understanding of how PIU should be conceptualized. Our aim was to identify specific internet activities associated with PIU and explore the moderating role of age and gender in those associations.
We recruited 1749 participants aged 18 and above via media advertisements in an Internet-based survey at two sites, one in the US, and one in South Africa; we utilized Lasso regression for the analysis.
Specific internet activities were associated with higher problematic internet use scores, including general surfing (lasso β: 2.1), internet gaming (β: 0.6), online shopping (β: 1.4), use of online auction websites (β: 0.027), social networking (β: 0.46) and use of online pornography (β: 1.0). Age moderated the relationship between PIU and role-playing-games (β: 0.33), online gambling (β: 0.15), use of auction websites (β: 0.35) and streaming media (β: 0.35), with older age associated with higher levels of PIU. There was inconclusive evidence for gender and gender × internet activities being associated with problematic internet use scores. Attention-deficit hyperactivity disorder (ADHD) and social anxiety disorder were associated with high PIU scores in young participants (age ≤ 25, β: 0.35 and 0.65 respectively), whereas generalized anxiety disorder (GAD) and obsessive-compulsive disorder (OCD) were associated with high PIU scores in the older participants (age > 55, β: 6.4 and 4.3 respectively).
Many types of online behavior (e.g. shopping, pornography, general surfing) bear a stronger relationship with maladaptive use of the internet than gaming supporting the diagnostic classification of problematic internet use as a multifaceted disorder. Furthermore, internet activities and psychiatric diagnoses associated with problematic internet use vary with age, with public health implications.
•This is the first comprehensive exploration of various types of internet activities associated with maladaptive internet use.•A range of activities beyond online gaming contributes separately and uniquely to problematic internet use.•Specific internet activities are associated with more problems and that this relationship is influenced by age.
In neuroimaging, the difference between predicted brain age and chronological age, known as brain age delta, has shown its potential as a biomarker related to various pathological phenotypes. There ...is a frequently observed bias when estimating brain age delta using regression models. This bias manifests as an overestimation of brain age for young participants and an underestimation of brain age for older participants. Therefore, the brain age delta is negatively correlated with chronological age, which can be problematic when evaluating relationships between brain age delta and other age-associated variables. This paper proposes a novel bias correction method for regression models by introducing a skewed loss function to replace the normal symmetric loss function. The regression model then behaves differently depending on whether it makes overestimations or underestimations. Our approach works with any type of MR image and no specific preprocessing is required, as long as the image is sensitive to age-related changes. The proposed approach has been validated using three classic deep learning models, namely ResNet, VGG, and GoogleNet on publicly available neuroimaging aging datasets. It shows flexibility across different model architectures and different choices of hyperparameters. The corrected brain age delta from our approach then has no linear relationship with chronological age and achieves higher predictive accuracy than a commonly-used two-stage approach.
Emergency braking assistance has the potential to prevent a large number of car crashes. State-of-the-art systems operate in two stages. Basic safety measures are adopted once external sensors ...indicate a potential upcoming crash. If further activity at the brake pedal is detected, the system automatically performs emergency braking. Here, we present the results of a driving simulator study indicating that the driver's intention to perform emergency braking can be detected based on muscle activation and cerebral activity prior to the behavioural response. Identical levels of predictive accuracy were attained using electroencephalography (EEG), which worked more quickly than electromyography (EMG), and using EMG, which worked more quickly than pedal dynamics. A simulated assistance system using EEG and EMG was found to detect emergency brakings 130 ms earlier than a system relying only on pedal responses. At 100 km h(-1) driving speed, this amounts to reducing the braking distance by 3.66 m. This result motivates a neuroergonomic approach to driving assistance. Our EEG analysis yielded a characteristic event-related potential signature that comprised components related to the sensory registration of a critical traffic situation, mental evaluation of the sensory percept and motor preparation. While all these components should occur often during normal driving, we conjecture that it is their characteristic spatio-temporal superposition in emergency braking situations that leads to the considerable prediction performance we observed.
PDF
