Markerless motion capture has the potential to perform movement analysis with reduced data collection and processing time compared to marker-based methods. This technology is now starting to be ...applied for clinical and rehabilitation applications and therefore it is crucial that users of these systems understand both their potential and limitations. This literature review aims to provide a comprehensive overview of the current state of markerless motion capture for both single camera and multi-camera systems. Additionally, this review explores how practical applications of markerless technology are being used in clinical and rehabilitation settings, and examines the future challenges and directions markerless research must explore to facilitate full integration of this technology within clinical biomechanics.
A scoping review is needed to examine this emerging broad body of literature and determine where gaps in knowledge exist, this is key to developing motion capture methods that are cost effective and practically relevant to clinicians, coaches and researchers around the world. Literature searches were performed to examine studies that report accuracy of markerless motion capture methods, explore current practical applications of markerless motion capture methods in clinical biomechanics and identify gaps in our knowledge that are relevant to future developments in this area.
Markerless methods increase motion capture data versatility, enabling datasets to be re-analyzed using updated pose estimation algorithms and may even provide clinicians with the capability to collect data while patients are wearing normal clothing. While markerless temporospatial measures generally appear to be equivalent to marker-based motion capture, joint center locations and joint angles are not yet sufficiently accurate for clinical applications. Pose estimation algorithms are approaching similar error rates of marker-based motion capture, however, without comparison to a gold standard, such as bi-planar videoradiography, the true accuracy of markerless systems remains unknown.
Current open-source pose estimation algorithms were never designed for biomechanical applications, therefore, datasets on which they have been trained are inconsistently and inaccurately labelled. Improvements to labelling of open-source training data, as well as assessment of markerless accuracy against gold standard methods will be vital next steps in the development of this technology.
Human movement researchers are often restricted to laboratory environments and data capture techniques that are time and/or resource intensive. Markerless pose estimation algorithms show great ...potential to facilitate large scale movement studies 'in the wild', i.e., outside of the constraints imposed by marker-based motion capture. However, the accuracy of such algorithms has not yet been fully evaluated. We computed 3D joint centre locations using several pre-trained deep-learning based pose estimation methods (OpenPose, AlphaPose, DeepLabCut) and compared to marker-based motion capture. Participants performed walking, running and jumping activities while marker-based motion capture data and multi-camera high speed images (200 Hz) were captured. The pose estimation algorithms were applied to 2D image data and 3D joint centre locations were reconstructed. Pose estimation derived joint centres demonstrated systematic differences at the hip and knee (~ 30-50 mm), most likely due to mislabeling of ground truth data in the training datasets. Where systematic differences were lower, e.g., the ankle, differences of 1-15 mm were observed depending on the activity. Markerless motion capture represents a highly promising emerging technology that could free movement scientists from laboratory environments but 3D joint centre locations are not yet consistently comparable to marker-based motion capture.
The ability to accurately and non-invasively measure 3D mass centre positions and their derivatives can provide rich insight into the physical demands of sports training and competition. This study ...examines a method for non-invasively measuring mass centre velocities using markerless human pose estimation and Kalman smoothing. Marker (Qualysis) and markerless (OpenPose) motion capture data were captured synchronously for sprinting and skeleton push starts. Mass centre positions and velocities derived from raw markerless pose estimation data contained large errors for both sprinting and skeleton pushing (mean ± SD = 0.127 ± 0.943 and -0.197 ± 1.549 m·s
, respectively). Signal processing methods such as Kalman smoothing substantially reduced the mean error (±SD) in horizontal mass centre velocities (0.041 ± 0.257 m·s
) during sprinting but the precision remained poor. Applying pose estimation to activities which exhibit unusual body poses (e.g., skeleton pushing) appears to elicit more erroneous results due to poor performance of the pose estimation algorithm. Researchers and practitioners should apply these methods with caution to activities beyond sprinting as pose estimation algorithms may not generalise well to the activity of interest. Retraining the model using activity specific data to produce more specialised networks is therefore recommended.
This study examined if occluded joint locations, obtained from 2D markerless motion capture (single camera view), produced 2D joint angles with reduced agreement compared to visible joints, and if 2D ...frontal plane joint angles were usable for practical applications. Fifteen healthy participants performed over-ground walking whilst recorded by fifteen marker-based cameras and two machine vision cameras (frontal and sagittal plane). Repeated measures Bland-Altman analysis illustrated that markerless standard deviation of bias and limits of agreement for the occluded-side hip and knee joint angles in the sagittal plane were double that of the camera-side (visible) hip and knee. Camera-side sagittal plane knee and hip angles were near or within marker-based error values previously observed. While frontal plane limits of agreement accounted for 35–46% of total range of motion at the hip and knee, Bland-Altman bias and limits of agreement (-4.6–1.6 ± 3.7–4.2˚) were actually similar to previously reported marker-based error values. This was not true for the ankle, where the limits of agreement (± 12˚) were still too high for practical applications. Our results add to previous literature, highlighting shortcomings of current pose estimation algorithms and labelled datasets. As such, this paper finishes by reviewing methods for creating anatomically accurate markerless training data using marker-based motion capture data.
Wearable sensors and motion capture technology are accepted instruments to measure spatiotemporal variables during punching performance and to study the externally observable effects of fatigue. This ...study aimed to develop a computational framework enabling three-dimensional inverse dynamics analysis through the tracking of punching kinematics obtained from inertial measurement units and uniplanar videography. The framework was applied to six elite male boxers performing a boxing-specific punch fatigue protocol. OpenPose was used to label left side upper-limb landmarks from which sagittal plane kinematics were computed. Custom-made inertial measurement units were embedded into the boxing gloves, and three-dimensional punch accelerations were analyzed using statistical parametric mapping to evaluate the effects of both fatigue and laterality. Tracking simulations of a sub-set of left-handed punches were formulated as optimal control problems and converted to nonlinear programming problems for solution with a trapezoid collocation method. The laterality analysis revealed the dominant side fatigued more than the non-dominant, while tracking simulations revealed shoulder abduction and elevation moments increased across the fatigue protocol. In future, such advanced simulation and analysis could be performed in ecologically valid contexts, whereby multiple inertial measurement units and video cameras might be used to model a more complete set of dynamics.
This study describes the development, evaluation and application of a computer vision and deep learning system capable of capturing sprinting and skeleton push start step characteristics and mass ...centre velocities (sled and athlete). Movement data were captured concurrently by a marker-based motion capture system and a custom markerless system. High levels of agreement were found between systems, particularly for spatial based variables (step length error 0.001 ± 0.012 m) while errors for temporal variables (ground contact time and flight time) were on average within ± 1.5 frames of the criterion measures. Comparisons of sprinting and pushing revealed decreased mass centre velocities as a result of pushing the sled but step characteristics were comparable to sprinting when aligned as a function of step velocity. There were large asymmetries between the inside and outside leg during pushing (e.g. 0.22 m mean step length asymmetry) which were not present during sprinting (0.01 m step length asymmetry). The observed asymmetries suggested that force production capabilities during ground contact were compromised for the outside leg. The computer vision based methods tested in this research provide a viable alternative to marker-based motion capture systems. Furthermore, they can be deployed into challenging, real world environments to non-invasively capture data where traditional approaches are infeasible.
Barbell hip thrust exercises have risen in popularity within the biomechanics and strength and conditioning literature over recent years, as a method of developing the hip extensor musculature. ...Biomechanical analysis of the hip thrust beyond electromyography is yet to be conducted. The aim of this study was therefore to perform the first comprehensive biomechanical analysis the barbell hip thrust. Nineteen resistance trained males performed three repetitions of the barbell hip thrust at 70% one-repetition maximum. Kinematic (250 Hz) and kinetic (1000 Hz) data were used to calculate angle, angular velocity, moment and power data at the ankle, knee, hip and pelvic-trunk joint during the lifting phase. Results highlighted that the hip thrust elicits significantly (p < 0.05) greater bilateral extensor demand at the hip joint in comparison with the knee and pelvic-trunk joints, whilst ankle joint kinetics were found to be negligible. Against contemporary belief, hip extensor moments were not found to be consistent throughout the repetition and instead diminished throughout the lifting phase. The current study provides unique insight to joint kinematics and kinetics of the barbell hip thrust, based on a novel approach, that offers a robust evidence base for practitioners to guide exercise selection.
Two-dimensional (2D) video is a common tool used during sports training and competition to analyze movement. In these videos, biomechanists determine key events, annotate joint centers, and calculate ...spatial, temporal, and kinematic parameters to provide performance reports to coaches and athletes. Automatic tools relying on computer vision and artificial intelligence methods hold promise to reduce the need for time-consuming manual methods.BACKGROUNDTwo-dimensional (2D) video is a common tool used during sports training and competition to analyze movement. In these videos, biomechanists determine key events, annotate joint centers, and calculate spatial, temporal, and kinematic parameters to provide performance reports to coaches and athletes. Automatic tools relying on computer vision and artificial intelligence methods hold promise to reduce the need for time-consuming manual methods.This study systematically analyzed the steps required to automate the video analysis workflow by investigating the applicability of a threshold-based event detection algorithm developed for 3D marker trajectories to 2D video data at four sampling rates; the agreement of 2D keypoints estimated by an off-the-shelf pose estimation model compared with gold-standard 3D marker trajectories projected to camera's field of view; and the influence of an offset in event detection on contact time and the sagittal knee joint angle at the key critical events of touch down and foot flat.OBJECTIVEThis study systematically analyzed the steps required to automate the video analysis workflow by investigating the applicability of a threshold-based event detection algorithm developed for 3D marker trajectories to 2D video data at four sampling rates; the agreement of 2D keypoints estimated by an off-the-shelf pose estimation model compared with gold-standard 3D marker trajectories projected to camera's field of view; and the influence of an offset in event detection on contact time and the sagittal knee joint angle at the key critical events of touch down and foot flat.Repeated measures limits of agreement were used to compare parameters determined by markerless and marker-based motion capture.METHODSRepeated measures limits of agreement were used to compare parameters determined by markerless and marker-based motion capture.Results highlighted that a minimum video sampling rate of 100 Hz is required to detect key events, and the limited applicability of 3D marker trajectory-based event detection algorithms when using 2D video. Although detected keypoints showed good agreement with the gold-standard, misidentification of key events-such as touch down by 20 ms resulted in knee compression angle differences of up to 20°.RESULTSResults highlighted that a minimum video sampling rate of 100 Hz is required to detect key events, and the limited applicability of 3D marker trajectory-based event detection algorithms when using 2D video. Although detected keypoints showed good agreement with the gold-standard, misidentification of key events-such as touch down by 20 ms resulted in knee compression angle differences of up to 20°.These findings emphasize the need for de novo accurate key event detection algorithms to automate 2D video analysis pipelines.CONCLUSIONThese findings emphasize the need for de novo accurate key event detection algorithms to automate 2D video analysis pipelines.
This study presented a fully automated deep learning based markerless motion capture workflow and evaluated its performance against marker-based motion capture during overground running, walking and ...counter movement jumping. Multi-view high speed (200 Hz) image data were collected concurrently with marker-based motion capture (criterion data), permitting a direct comparison between methods. Lower limb kinematic data for 15 participants were computed using 2D pose estimation, our 3D fusion process and OpenSim based inverse kinematics modelling. Results demonstrated high levels of agreement for lower limb joint angles, with mean differences ranging “0.1° − 10.5° for hip (3 DoF) joint rotations, and 0.7° − 3.9° for knee (1 DoF) and ankle (2 DoF) rotations. These differences generally fall within the documented uncertainties of marker-based motion capture, suggesting that our markerless approach could be used for appropriate biomechanics applications. We used an open-source, modular and customisable workflow, allowing for integration with other popular biomechanics tools such as OpenSim. By developing open-source tools, we hope to facilitate the democratisation of markerless motion capture technology and encourage the transparent development of markerless methods. This presents exciting opportunities for biomechanics researchers and practitioners to capture large amounts of high quality, ecologically valid data both in the laboratory and in the wild.
The backward double integration method uses one force plate and could calculate jump height for countermovement jumping, squat jumping and drop jumping by analysing the landing phase instead of the ...push-off phase. This study compared the accuracy and variability of the forward double integration (FDI), backwards double integration (BDI) and Flight Time + Constant (FT+C) methods, against the marker-based rigid-body modelling method. It was hypothesised that the jump height calculated using the BDI method would be equivalent to the FDI method, while the FT+C method would have reduced accuracy and increased variability during sub-maximal jumping compared to maximal jumping. Twenty-four volunteers performed five maximal and five sub-maximal countermovement jumps, while force plate and motion capture data were collected. The BDI method calculated equivalent mean jump heights compared to the FDI method, with only slightly higher variability (2-3 mm), and therefore can be used in situations where FDI cannot be employed. The FT+C method was able to account for reduced heel-lift distance, despite employing an anthropometrically scaled heel-lift constant. However, across both sub-maximal and maximal jumping, it had increased variability (1.1 cm) compared to FDI and BDI and should not be used when alternate methods are available.
PDF
