Advances in mobile technology have led to the emergence of the "smartphone", a new class of device with more advanced connectivity features that have quickly made it a constant presence in our lives. ...Smartphones are equipped with comparatively advanced computing capabilities, a global positioning system (GPS) receivers, and sensing capabilities (i.e., an inertial measurement unit (IMU) and more recently magnetometer and barometer) which can be found in wearable ambulatory monitors (WAMs). As a result, algorithms initially developed for WAMs that "count" steps (i.e., pedometers); gauge physical activity levels; indirectly estimate energy expenditure and monitor human movement can be utilised on the smartphone. These algorithms may enable clinicians to "close the loop" by prescribing timely interventions to improve or maintain wellbeing in populations who are at risk of falling or suffer from a chronic disease whose progression is linked to a reduction in movement and mobility. The ubiquitous nature of smartphone technology makes it the ideal platform from which human movement can be remotely monitored without the expense of purchasing, and inconvenience of using, a dedicated WAM. In this paper, an overview of the sensors that can be found in the smartphone are presented, followed by a summary of the developments in this field with an emphasis on the evolution of algorithms used to classify human movement. The limitations identified in the literature will be discussed, as well as suggestions about future research directions.
Left ventricular assist devices (LVADs) are mechanical pumps, which can be used to support heart failure (HF) patients as bridge to transplant and destination therapy. To automatically adjust the ...LVAD speed, a physiological control system needs to be designed to respond to variations of patient hemodynamics across a variety of clinical scenarios. These control systems require pressure feedback signals from the cardiovascular system. However, there are no suitable long-term implantable sensors available. In this study, a novel real-time deep convolutional neural network (CNN) for estimation of preload based on the LVAD flow was proposed. A new sensorless adaptive physiological control system for an LVAD pump was developed using the full dynamic form of model free adaptive control (FFDL-MFAC) and the proposed preload estimator to maintain the patient conditions in safe physiological ranges. The CNN model for preload estimation was trained and evaluated through 10-fold cross validation on 100 different patient conditions and the proposed sensorless control system was assessed on a new testing set of 30 different patient conditions across six different patient scenarios. The proposed preload estimator was extremely accurate with a correlation coefficient of 0.97, root mean squared error of 0.84 mmHg, reproducibility coefficient of 1.56 mmHg, coefficient of variation of 14.44%, and bias of 0.29 mmHg for the testing dataset. The results also indicate that the proposed sensorless physiological controller works similarly to the preload-based physiological control system for LVAD using measured preload to prevent ventricular suction and pulmonary congestion. This study shows that the LVADs can respond appropriately to changing patient states and physiological demands without the need for additional pressure or flow measurements.
The measurement of blood pressure (BP) is critical to the treatment and management of many medical conditions. High blood pressure is associated with many chronic disease conditions, and is a major ...source of mortality and morbidity around the world. For outpatient care as well as general health monitoring, there is great interest in being able to accurately and frequently measure BP outside of a clinical setting, using mobile or wearable devices. One possible solution is photoplethysmography (PPG), which is most commonly used in pulse oximetry in clinical settings for measuring oxygen saturation. PPG technology is becoming more readily available, inexpensive, convenient, and easily integrated into portable devices. Recent advances include the development of smartphones and wearable devices that collect pulse oximeter signals. In this article, we review (i) the state-of-the-art and the literature related to PPG signals collected by pulse oximeters, (ii) various theoretical approaches that have been adopted in PPG BP measurement studies, and (iii) the potential of PPG measurement devices as a wearable application. Past studies on changes in PPG signals and BP are highlighted, and the correlation between PPG signals and BP are discussed. We also review the combined use of features extracted from PPG and other physiological signals in estimating BP. Although the technology is not yet mature, it is anticipated that in the near future, accurate, continuous BP measurements may be available from mobile and wearable devices given their vast potential.
Any device which senses information such as shape, texture, softness, temperature, vibration or shear and normal forces, by physical contact or touch, can be termed a tactile sensor. The importance ...of tactile sensor technology was recognized in the 1980s, along with a realization of the importance of computers and robotics. Despite this awareness, tactile sensors failed to be strongly adopted in industrial or consumer markets. In this paper, previous expectations of tactile sensors have been reviewed and the reasons for their failure to meet these expectations are discussed. The evolution of different tactile transduction principles, state of art designs and fabrication methods, and their pros and cons, are analyzed. From current development trends, new application areas for tactile sensors have been proposed. Literature from the last few decades has been revisited, and areas which are not appropriate for the use of tactile sensors have been identified. Similarly, the challenges that this technology needs to overcome in order to find its place in the market have been highlighted.
Wearable biosensors for sweat-based analysis are gaining wide attention due to their potential use in personal health monitoring. Flexible wearable devices enable sweat analysis at the molecular ...level, facilitating noninvasive monitoring of physiological states via real-time monitoring of chemical biomarkers. Advances in sweat extraction technology, real-time biosensors, stretchable materials, device integration, and wireless digital technologies have led to the development of wearable sweat-biosensing devices that are light, flexible, comfortable, aesthetic, affordable, and informative. Herein, we summarize recent advances of sweat wearables from the aspects of sweat extraction, fabrication of stretchable biomaterials, and design of biosensing modules to enable continuous biochemical monitoring, which are essential for a biosensing device. Key chemical components of sweat, sweat capture methodologies, and considerations of flexible substrates for integrating real-time biosensors with electronics to bring innovations in the art of wearables are elaborated. The strategies and challenges involved in improving the wearable biosensing performance and the perspectives for designing sweat-based wearable biosensing devices are discussed.
Cell classification, especially that of white blood cells, plays a very important role in the field of diagnosis and control of major diseases. Compared to traditional optical microscopic imaging, ...hyperspectral imagery, combined with both spatial and spectral information, provides more wealthy information for recognizing cells. In this paper, a novel blood cell classification framework, which combines a modulated Gabor wavelet and deep convolutional neural network (CNN) kernels, named as MGCNN, is proposed based on medical hyperspectral imaging. For each convolutional layer, multi-scale and orientation Gabor operators are taken dot product with initial CNN kernels. The essence is to transform the convolutional kernels into the frequency domain to learn features. By combining characteristics of Gabor wavelets, the features learned by modulated kernels at different frequencies and orientations are more representative and discriminative. Experimental results demonstrate that the proposed model can achieve better classification performance than traditional CNNs and widely used support vector machine approaches, especially as training small-sample-size situations.
Heart failure (HF) is one of the most prevalent life-threatening cardiovascular diseases in which 6.5 million people are suffering in the USA and more than 23 million worldwide. Mechanical ...circulatory support of HF patients can be achieved by implanting a left ventricular assist device (LVAD) into HF patients as a bridge to transplant, recovery or destination therapy and can be controlled by measurement of normal and abnormal pulmonary arterial wedge pressure (PAWP). While there are no commercial long-term implantable pressure sensors to measure PAWP, real-time non-invasive estimation of abnormal and normal PAWP becomes vital. In this work, first an improved Harris Hawks optimizer algorithm called HHO+ is presented and tested on 24 unimodal and multimodal benchmark functions. Second, a novel fully Elman neural network (FENN) is proposed to improve the classification performance. Finally, four novel 18-layer deep learning methods of convolutional neural networks (CNNs) with multi-layer perceptron (CNN-MLP), CNN with Elman neural networks (CNN-ENN), CNN with fully Elman neural networks (CNN-FENN), and CNN with fully Elman neural networks optimized by HHO+ algorithm (CNN-FENN-HHO+) for classification of abnormal and normal PAWP using estimated HVAD pump flow were developed and compared. The estimated pump flow was derived by a non-invasive method embedded into the commercial HVAD controller. The proposed methods are evaluated on an imbalanced clinical dataset using 5-fold cross-validation. The proposed CNN-FENN-HHO+ method outperforms the proposed CNN-MLP, CNN-ENN and CNN-FENN methods and improved the classification performance metrics across 5-fold cross-validation with an average sensitivity of 79%, accuracy of 78% and specificity of 76%. The proposed methods can reduce the likelihood of hazardous events like pulmonary congestion and ventricular suction for HF patients and notify identified abnormal cases to the hospital, clinician and cardiologist for emergency action, which can diminish the mortality rate of patients with HF.
Given the aging population, healthcare systems need to be established to deal with health issues such as injurious falls. Wearable devices can be used to detect falls. However, most wearable devices ...are obtrusive, and patients generally do not like or may forget to wear them. In this study, we developed an unobtrusive monitoring system using infrared technology to unobtrusively detect locations and recognize human activities such as sitting, standing, walking, lying, and falling. We prototyped a system consisting of two 24×32 thermal array sensors and collected data from healthy young volunteers performing ten different scenarios. A supervised deep learning (DL)-based approach classified activities and detected locations from images. The performance of the DL approach was also compared with the machine learning (ML)-based methods. In addition, we fused the data of two sensors and formed a stereo system, which resulted in better performance compared to a single sensor. Furthermore, to detect critical activities such as falling and lying on floor, we performed a binary classification in which one class was falling plus lying on floor and another class was all the remaining activities. Using the DL-based algorithm on the stereo dataset to recognize activities, overall average accuracy and F1-score were achieved as 97.6%, and 0.935, respectively. These scores for location detection were 97.3%, and 0.927, respectively. These scores for binary classification were 97.9%, and 0.945, respectively. Our results suggest the proposed system recognized human activities, detected locations, and detected critical activities namely falling and lying on floor accurately.
Abstract Metal electrode materials used in active implantable devices are often associated with poor long-term stimulation and recording performance. Modification of these materials with conducting ...polymer coatings has been suggested as an approach for improving the neural tissue-electrode interface and increasing the effective lifetime of these implants. Neural interfaces ideally have intimate contact between the excitable tissue and the electrode to maintain signal quality and activation of neural cells. The outcomes of current research into conducting polymers as coatings has potential to enhance this tissue-material contact by increasing the electrode surface area and roughness as well as allowing delivery of bioactive signals to neural cells. However, challenges facing conducting polymers include poor electroactive stability and mechanical properties as well as control of the mobility, concentration and presentation of bioactive molecules. The impact of biological inclusions on polymer properties and their ongoing performance in neural prosthetics requires a greater understanding with future research aimed at controlling and optimising film characteristics for long-term performance. Optimising the electrode interface will require a trade-off between desired electrical, mechanical, chemical and biological properties.
The traditional differential diagnosis of membranous nephropathy (MN) mainly relies on clinical symptoms, serological examination and optical renal biopsy. However, there is a probability of false ...positives in the optical inspection results, and it is unable to detect the change of biochemical components, which poses an obstacle to pathogenic mechanism analysis. Microscopic hyperspectral imaging can reveal detailed component information of immune complexes, but the high dimensionality of microscopic hyperspectral image brings difficulties and challenges to image processing and disease diagnosis. In this paper, a novel classification framework, including spatial-spectral density peaks-based discriminant analysis (SSDP), is proposed for intelligent diagnosis of MN using a microscopic hyperspectral pathological dataset. SSDP constructs a set of graphs describing intrinsic structure of MHSI in both spatial and spectral domains by employing density peak clustering. In the process of graph embedding, low-dimensional features with important diagnostic information in the immune complex are obtained by compacting the spatial-spectral local intra-class pixels while separating the spectral inter-class pixels. For the MN recognition task, a support vector machine (SVM) is used to classify pixels in the low-dimensional space. Experimental validation data employ two types of MN that are difficult to distinguish with optical microscope, including primary MN and hepatitis B virus-associated MN. Experimental results show that the proposed SSDP achieves a sensitivity of 99.36%, which has potential clinical value for automatic diagnosis of MN.