Deep learning approaches have achieved breakthrough performance in various domains. However, the segmentation of raw eye-movement data into discrete events is still done predominantly either by hand ...or by algorithms that use hand-picked parameters and thresholds. We propose and make publicly available a small 1D-CNN in conjunction with a bidirectional long short-term memory network that classifies gaze samples as fixations, saccades, smooth pursuit, or noise, simultaneously assigning labels in windows of up to 1 s. In addition to unprocessed gaze coordinates, our approach uses different combinations of the speed of gaze, its direction, and acceleration, all computed at different temporal scales, as input features. Its performance was evaluated on a large-scale hand-labeled ground truth data set (GazeCom) and against 12 reference algorithms. Furthermore, we introduced a novel pipeline and metric for event detection in eye-tracking recordings, which enforce stricter criteria on the algorithmically produced events in order to consider them as potentially correct detections. Results show that our deep approach outperforms all others, including the state-of-the-art multi-observer smooth pursuit detector. We additionally test our best model on an independent set of recordings, where our approach stays highly competitive compared to literature methods.
When we follow a slowly moving target with our eyes, we perform smooth pursuit eye movements (SPEM). Previous investigations point to significantly and robustly reduced SPEM performance in the ...presence of a stationary background and at higher compared to lower target velocities. However, the reliability of these background and target velocity effects has not yet been investigated systematically.
To address this issue, 45 healthy participants (17 m, 28 f) took part in two experimental sessions 7 days apart. In each session, participants were instructed to follow a horizontal SPEM target moving sinusoidally between ±7.89° at three different target velocities, corresponding to frequencies of 0.2, 0.4 and 0.6 Hz. Each target velocity was presented once with and once without a stationary background, resulting in six blocks. The blocks were presented twice per session in order to additionally explore potential task length effects. To assess SPEM performance, velocity gain was calculated as the ratio of eye to target velocity.
In line with previous research, detrimental background and target velocity effects were replicated robustly in both sessions with large effect sizes. Good to excellent test-retest reliabilities were obtained at higher target velocities and in the presence of a stationary background, whereas lower reliabilities occurred with slower targets and in the absence of background stimuli. Target velocity and background effects resulted in largely good to excellent reliabilities.
These findings not only replicated robust experimental effects of background and target velocity at group level, but also revealed that these effects can be translated into reliable individual difference measures.
•Smooth pursuit performance is negatively affected by a structured background.•Smooth pursuit performance declines at higher target velocities.•Smooth pursuit background and target velocity effects are highly reliable.•Robust experimental effects can provide reliable individual difference measures.
The Tobii Eyex Controller is a new low-cost binocular eye tracker marketed for integration in gaming and consumer applications. The manufacturers claim that the system was conceived for natural eye ...gaze interaction, does not require continuous recalibration, and allows moderate head movements. The Controller is provided with a SDK to foster the development of new eye tracking applications. We review the characteristics of the device for its possible use in scientific research. We develop and evaluate an open source Matlab Toolkit that can be employed to interface with the EyeX device for gaze recording in behavioral experiments. The Toolkit provides calibration procedures tailored to both binocular and monocular experiments, as well as procedures to evaluate other eye tracking devices. The observed performance of the EyeX (i.e. accuracy < 0.6°, precision < 0.25°, latency < 50 ms and sampling frequency ≈55 Hz), is sufficient for some classes of research application. The device can be successfully employed to measure fixation parameters, saccadic, smooth pursuit and vergence eye movements. However, the relatively low sampling rate and moderate precision limit the suitability of the EyeX for monitoring micro-saccadic eye movements or for real-time gaze-contingent stimulus control. For these applications, research grade, high-cost eye tracking technology may still be necessary. Therefore, despite its limitations with respect to high-end devices, the EyeX has the potential to further the dissemination of eye tracking technology to a broad audience, and could be a valuable asset in consumer and gaming applications as well as a subset of basic and clinical research settings.
Neuronal control of fixation and fixational eye movements Krauzlis, Richard J.; Goffart, Laurent; Hafed, Ziad M.
Philosophical transactions of the Royal Society of London. Series B. Biological sciences,
04/2017, Letnik:
372, Številka:
1718
Journal Article
Recenzirano
Odprti dostop
Ocular fixation is a dynamic process that is actively controlled by many of the same brain structures involved in the control of eye movements, including the superior colliculus, cerebellum and ...reticular formation. In this article, we review several aspects of this active control. First, the decision to move the eyes not only depends on target-related signals from the peripheral visual field, but also on signals from the currently fixated target at the fovea, and involves mechanisms that are shared between saccades and smooth pursuit. Second, eye position during fixation is actively controlled and depends on bilateral activity in the superior colliculi and medio-posterior cerebellum; disruption of activity in these circuits causes systematic deviations in eye position during both fixation and smooth pursuit eye movements. Third, the eyes are not completely still during fixation but make continuous miniature movements, including ocular drift and microsaccades, which are controlled by the same neuronal mechanisms that generate larger saccades. Finally, fixational eye movements have large effects on visual perception. Ocular drift transforms the visual input in ways that increase spatial acuity; microsaccades not only improve vision by relocating the fovea but also cause momentary changes in vision analogous to those caused by larger saccades.
This article is part of the themed issue ‘Movement suppression: brain mechanisms for stopping and stillness’.
In the evaluation of smooth pursuit eye movements (SPEMs), recording the stimulus onset time is mandatory. In the laboratory, the stimulus onset time is recorded by electrical signal or programming, ...and video-oculography (VOG) and the visual stimulus are synchronized. Nevertheless, because the examiner must manually move the fixation target, recording the stimulus onset time is challenging in daily clinical practice. Thus, this study aimed to develop an algorithm for evaluating SPEMs while testing the nine-direction eye movements without recording the stimulus onset time using VOG and deep learning-based object detection (single-shot multibox detector), which can predict the location and types of objects in a single image. The algorithm of peak fitting-based detection correctly classified the directions of target orientation and calculated the latencies and gains within the normal range while testing the nine-direction eye movements in healthy individuals. These findings suggest that the algorithm of peak fitting-based detection has sufficient accuracy for the automatic evaluation of SPEM in clinical settings.
Humans can accurately estimate and track object motion, even if it accelerates. Research shows that humans exhibit superior estimation and tracking performance for descending (falling) than ascending ...(rising) objects. Previous studies presented ascending and descending targets along the gravitational and body axes in an upright posture. Thus, it is unclear whether humans rely on congruent information between the direction of the target motion and gravity or the direction of the target motion and longitudinal body axes. Two experiments were conducted to explore these possibilities. In Experiment 1, participants estimated the arrival time at a goal for both upward and downward motion of targets along the longitudinal body axis in the upright (both axes of target motion and gravity congruent) and supine (both axes incongruent) postures. In Experiment 2, smooth pursuit eye movements were assessed while tracking both targets in the same postures. Arrival time estimation and smooth pursuit eye movement performance were consistently more accurate for downward target motion than for upward motion, irrespective of posture. These findings suggest that the visual experience of seeing an object moving along an observer's leg side in everyday life may influence the ability to accurately estimate and track the descending object's motion.
(1) Background: The impairment of eye-hand coordination and smooth-pursuit eye movement caused by visual display terminal (VDT) operation is thought to impair daily living activities, for which no ...effective methods are currently known. On the other hand, various food ingredients, including astaxanthin, lutein, and zeaxanthin, are known to help improve the eye health of VDT operators. This study aimed to test the hypothesis that the combination of astaxanthin, lutein, and zeaxanthin can prevent the impairment of eye-hand coordination and smooth-pursuit eye movement caused by VDT operation. (2) Methods: We conducted a randomized, placebo-controlled, parallel-group clinical trial. Healthy subjects who regularly worked with VDTs were randomly assigned to the active and placebo groups. All of the subjects took soft capsules containing 6 mg of astaxanthin, 10 mg of lutein, and 2 mg of zeaxanthin or placebo soft capsules once daily for eight weeks. We evaluated the eye-hand coordination, smooth-pursuit eye movements, and macular pigment optical density (MPOD) at 0, two, four, and eight weeks after soft-capsule intake. (3) Results: The active group showed significantly improved eye-hand coordination after VDT operation at eight weeks. However, there was no clear improvement in the effect of the supplementation on smooth-pursuit eye movements. The active group also showed a significant increase in MPOD levels. (4) Conclusions: Consumption of a supplement containing astaxanthin, lutein, and zeaxanthin mitigates the decline of eye-hand coordination after VDT operation.
The pupillary light response is often assumed to be a reflex that is not susceptible to cognitive influences. In line with recent converging evidence, we show that this reflexive view is incomplete, ...and that the pupillary light response is modulated by covert visual attention: Covertly attending to a bright area causes a pupillary constriction, relative to attending to a dark area under identical visual input. This attention-related modulation of the pupillary light response predicts cuing effects in behavior, and can be used as an index of how strongly participants attend to a particular location. Therefore, we suggest that pupil size may offer a new way to continuously track the focus of covert visual attention, without requiring a manual response from the participant. The theoretical implication of this finding is that the pupillary light response is neither fully reflexive, nor under complete voluntary control, but is instead best characterized as a stereotyped response to a voluntarily selected target. In this sense, the pupillary light response is similar to saccadic and smooth pursuit eye movements. Together, eye movements and the pupillary light response maximize visual acuity, stabilize visual input, and selectively filter visual information as it enters the eye.
In the current study, we used abrupt-onset distractors similar and dissimilar in luminance to the target of a smooth pursuit eye-movement to test if abrupt-onset distractors capture attention in a ...top-down or bottom-up fashion while the eyes track a moving object. Abrupt onset distractors were presented at different positions relative to the current position of a pursuit target during the closed-loop phase of smooth pursuit. Across experiments, we varied the duration of the distractors, their motion direction, and task-relevance. We found that abrupt-onset distractors decreased the gain of horizontally directed smooth-pursuit eye-movements. This effect, however, was independent of the similarity in luminance between distractor and target. In addition, distracting effects on horizontal gain were the same, regardless of the exact duration and position of the distractors, suggesting that capture was relatively unspecific and short-lived (Experiments 1 and 2). This was different with distractors moving in a vertical direction, perpendicular to the horizontally moving target. In line with past findings, these distractors caused suppression of vertical gain (Experiment 3). Finally, making distractors task-relevant by asking observers to report distractor positions increased the pursuit gain effect of the distractors. This effect was also independent of target-distractor similarity (Experiment 4). In conclusion, the results suggest that a strong location signal exerted by the pursuit targets led to very brief and largely location-unspecific interference through the abrupt onsets and that this interference was bottom-up, implying that the control of smooth pursuit was independent of other target features besides its motion signal.
Abstract
We seek a neural circuit explanation for sensory-motor reaction times. In the smooth eye movement region of the frontal eye fields (FEFSEM), the latencies of pairs of neurons show ...trial-by-trial correlations that cause trial-by-trial correlations in neural and behavioral latency. These correlations can account for two-third of the observed variation in behavioral latency. The amplitude of preparatory activity also could contribute, but the responses of many FEFSEM neurons fail to support predictions of the traditional “ramp-to-threshold” model. As a correlate of neural processing that determines reaction time, the local field potential in FEFSEM includes a brief wave in the 5–15-Hz frequency range that precedes pursuit initiation and whose phase is correlated with the latency of pursuit in individual trials. We suggest that the latency of the incoming visual motion signals combines with the state of preparatory activity to determine the latency of the transient response that controls eye movement.
Impact statement
The motor cortex for smooth pursuit eye movements contributes to sensory-motor reaction time through the amplitude of preparatory activity and the latency of transient, visually driven responses.
PDF
