A light-field 3-D display (LFD) reproduces light rays or wavefront as if there are real objects, and a perfect 3-D display that satisfies all the depth cues in human vision becomes possible. By ...reproducing both horizontal and vertical parallaxes, i.e., full-parallax, an LFD reconstructs a real or virtual image in 3-D space. A rich 3-D experience can be provided to viewers, and moreover, multiple viewers can share the same reproduced 3-D image. A technology called holographic stereogram (HS) is the integration of ray-based and wavefront-based methods, and has been applied to LFD. Hardcopy HS has already been commercialized. The technology of HS is helpful also for an interactive LFD; a full-parallax LFD using a projector and a holographic screen that modulates the directions of light rays is based on the principle of HS. In this case, accurate registration between the projected image and the holographic screen is necessary, and it is achieved by projecting some test patterns and capturing them with a calibration camera. As a full-parallax LFD can reproduce real images in midair between the screen and viewers, it is possible to realize interactive 3-D touch interface. If a user touches the 3-D real image floating in the air, the reproduced light is scattered by the user's fingertip. The scattered light is detected by a color image sensor placed behind the holographic screen, and can be employed to detect the user's touch. In this system, the reproduced 3-D images and the 3-D touch detection are associated with each other, and thus, we do not have to worry about the complicated registration between them. The identification of the user's interaction is simple, because the color information of the 3-D image can be used for this purpose. Some experimental results of the 3-D touch-sensing display are introduced, and possible applications of this technology are discussed as well.
Display omitted
•Precision medicine tailors therapy to a specific patient, using similar patient data.•In many cancer types, treatment and toxicity depend on the spatial disease spread.•However, ...there is a need for methodology to integrate spatial information similarity.•We present a method for patient comparison, based on disease spread to lymph nodes.•Our method partitions a 582 patient cohort into clinically meaningful groups.
Precision medicine seeks to tailor therapy to the individual patient, based on statistical correlates from patients who are similar to the one under consideration. These correlates can and should go beyond genetics, and in general, beyond tabular or array data that can be easily represented computationally and compared. For example, in many types of cancer, cancer treatment and toxicity depend in large measure on the spatial disease spread—e.g., metastasizes to regional lymph nodes in head and neck cancer. However, there is currently a lack of methodology for integrating spatial information when considering patient similarity. We present a novel modeling methodology for the comparison of cancer patients within a cohort, based on the spatial spread of the lymph nodes affected in each patient. The method uses a topological map, bigrams, and hierarchical clustering to group patients based on their similarity. We compare this approach against a nonspatial (categorical) similarity approach where patients are binned solely by their affected nodes. We present similarity results on a 582 head and neck cancer patient cohort, along with two visual abstractions for analysis of the results, and we present clinician feedback. Our novel methodology partitions a patient cohort into clinically meaningful groups more susceptible to treatment side-effects. Such spatially-aware similarity approaches can help maximize the effectiveness of each patient’s treatment.
Microfiber Mach-Zehnder interferometer (MMZI) is a widely used optical device. To solve the problems of large difference between the theoretical and experimental spectrum, low calculation efficiency, ...poor universality in spectrum calculation of MMZI, a fast and accurate calculation method for predicting the interference spectrum of MMZI used in liquid is proposed. In calculations, phase accumulated in transition region of the taper is considered to reach a good agreement between theoretical and experimental spectrum. To further improve the computational efficiency, dependence of the phase accumulation on wavelength is developed by linear fitting, and a non-linear fitting of difference of effective refractive index (∆neff) on fiber diameter, wavelength, temperature and salinity of the surrounding is obtained by the data from commercial software. In addition, a visual interface for displaying the predicted spectrum is established, by which one accurate spectral calculation can be realized within only two or three seconds. Finally, effects of LP03 mode and shape of transition region on transmission spectrum are discussed and the accuracy of this method is also verified by sensitivity. The calculation method demonstrated here provides an accurate and fast spectral prediction method for MMZI, and will afford important reference for sensor design and optimization.
Display omitted
•A prediction method of interference spectrum of MMZI operated in liquid is proposed. The FSR of the calculated and the experimental spectrum near the 1550-nm-wavelength is compared, it is found that the average relative error is 6.71 % and the minimum relative error is 1.84 %.•This work takes the MMZI with almost the same length of the transition and the waist region as the research object, and studies the calculation method of the interference spectrum of MMZI by combining theoretical simulation and experiment.•Dependence of the phase accumulation on wavelength is developed by linear fitting.•A non-linear fitting of the effective refractive index difference (∆neff) on fiber diameter, wavelength, temperature and salinity of the surrounding is obtained by the data from commercial software.•Discussing effects of higher order mode and influence of different taper shape on calculation result and the accuracy of this method is also verified by sensitivity.
Abstract
A human–machine interface (HMI)‐based visual interface along with an embedded system was developed to real‐time measure, display, and store the various tractor–implement performance ...parameters, that is, geoposition, depth, speed, slip, fuel consumption, draft, and power take‐off (PTO) torque. The developed system consists of various commercially available (global positioning system, rotary potentiometer, tension/compression load cell, Hall‐effect sensor, flow meter, and strain gauge) sensors/transducers to measure the performance parameters. A strain‐gauge‐based special type of transducer was also developed for measuring the PTO torque acting on the implement and the output of the transducer was transferred to the virtual interface‐based data acquisition system using radio frequency‐based modules. Along with the sensors, the developed system is composed of a microcontroller to process the data received from sensors, an HMI‐assisted smart touch screen to display the output, and a secure digital card module to store the processed data. The developed visual interface of the embedded system comprises multiple operator‐friendly touch screens and each screen was designed with a graphical user interface for the visual presentation of the tractor–implement performance parameters. The system was installed in the TAFE Samrat 4410 tractor and tested under various field operations. Sensors employed in the system were calibrated for obtaining precise measurement, and excellent linearity with a high correlation between actual and measured variables. Under various field operations (plowing and tillering), a maximum error of 15% (except PTO torque) was found between parameters measured with the developed system and manual/predicted measurement. The field results fortify the acceptable accuracy of the developed system. The developed system will be helpful for researchers or students to study the matching of tractor–implement combinations.
A human–robot hybrid cell is developed for flexible assembly in manufacturing through the collaboration between a human and a robot. The selected task is to assemble a few LEGO blocks (parts) into a ...final product following specified sequence and instructions. The task is divided into several subtasks. A two-level feedforward optimization strategy is developed that determines optimum subtask allocation between the human and the robot before the assembly starts. Human's trust in robot and robot's trust in human are considered, computational models of the trust are derived and real-time trust measurement and display methods are developed. A feedback approach is integrated into the feedforward subtask allocation in the form of subtask re-allocation if trust levels reduce to below specified thresholds. It is hypothesized that subtask re-allocation may help regain trust and maintain satisfactory performance. Experiment results prove that (i) the integrated (feedforward + feedback) optimum subtask allocation is effective to maintain satisfactory trust levels of human and robot that result in satisfactory human–robot interactions (HRI) and assembly performance, and (ii) consideration of two-way trust (human's trust in robot and robot's trust in human) produces better HRI and assembly performance than that produced when one-way trust (human's trust in robot) or no trust is considered.
•HUDs can improve driving performance and user-experience in automated vehicles.•HUDs with different sizes of fields of view evoke similar driving performance, cognitive load and user experience.•The ...amount of information presented in a HUD affects driving performance, usability and user experience.•Information enhancing higher levels of situational awareness improves driving performance.•Drivers prefer having information for enhancing lower levels of situational awareness..
This study aimed to identify which information should be displayed on a head-up display (HUD) in semi-automated vehicles to enable the driver to maintain better situational awareness during the manual operation of the vehicle. It further explored how does the size of the field of view of the HUD affects such information presentation, while taking into consideration user's personal preferences and opinions. Four head-up display interfaces were developed differing in the amount, frequency and field of view of visual information presentation, and were implemented in a simulated semi-automated vehicle. The HUDs were evaluated in a user-study with a within-subject design with 30 participants. The obtained results revealed that versions with smaller and larger field of view HUDsevoke similar driving performance, levels of cognitive load, user experience and perceived usability, suggesting that the HUD's field of view size does not have an overall significant effect on the driver's situational awareness. The results reveal that display of information, which can help with obtaining and maintaining higher situational awareness levels, contribute to better driving performance. Drivers on the other hand, prefer also display of information for lower situational awareness levels.
In this article, we propose a dataset named Wheelchair-OmniGaze and a method of estimating the gaze point of a wheelchair user that can cope with large head motion as the first step for understanding ...the intention of a wheelchair user. In the proposed method, the wheelchair user's face is observed by two remote cameras, called face cameras, mounted on the two front sides of the wheelchair, while a spherical camera with a 360° field of view, called a spherical scene camera, is mounted to the top rear to observe the surrounding scenes. A user's gaze point at the environment is determined by combining the facial information acquired by the face cameras with the spherical image acquired by the spherical scene camera. Concretely, a convolutional neural network-long short-term memory network is used to learn gaze points of the spherical image from the two face image sequences. Using two face cameras enables a user's face to be observed even for a large head motion. Using a spherical scene camera mounted on a wheelchair, the representation of a user's gaze points at a wheelchair-centered spherical camera coordinate can be obtained, which is independent of a user's head motion. The experimental results show that our method achieved competitive performance in comparison with the state-of-the-art method. Since our problem definition is different from the existing research, the experimental results of this article can be seen as a baseline for our built dataset.
Medical image analysis forms the basis of image-guided surgery (IGS) and many of its fundamental tasks. Driven by the growing number of medical imaging modalities, the research community of medical ...imaging has developed methods and achieved functionality breakthroughs. However, with the overwhelming pool of information in the literature, it has become increasingly challenging for researchers to extract context-relevant information for specific applications, especially when many widely used methods exist in a variety of versions optimized for their respective application domains. By being further equipped with sophisticated three-dimensional (3D) medical image visualization and digital reality technology, medical experts could enhance their performance capabilities in IGS by multiple folds. The goal of this narrative review is to organize the key components of IGS in the aspects of medical image processing and visualization with a new perspective and insights. The literature search was conducted using mainstream academic search engines with a combination of keywords relevant to the field up until mid-2022. This survey systemically summarizes the basic, mainstream, and state-of-the-art medical image processing methods as well as how visualization technology like augmented/mixed/virtual reality (AR/MR/VR) are enhancing performance in IGS. Further, we hope that this survey will shed some light on the future of IGS in the face of challenges and opportunities for the research directions of medical image processing and visualization.
Increasing demand due to the technological advancements and population expansion poses some issues in terms of environmental considerations and establishment of a sustainable market structure. In ...this context, the role of Peer-to-Peer (P2P) energy trading in system operation is examined in this paper under different case studies with four prosumer models which have different Energy Storage Systems (ESS), Photovoltaic (PV) systems and responsive demand such as Electric Vehicle (EV), and economic analysis is performed using the developed interface. An active market structure is created with an energy management system where energy can be bought and sold both through the P2P market operator and the distribution system operator, depending on the pricing in different time periods for household models. Through the use of mathematical modeling based on MILP, an optimal solution with the lowest possible cost is achieved amongst the parties. In this study, the amount of traded energy is observed according to both households and time indices with different domestic models and developed an optimization technique. The realization of bidirectional energy transfer of EVs, the importance of ESS, PV system and different domestic cases in terms of P2P energy trading is also examined. Additionally, the system’s benefits are demonstrated in advance to participants by verifying and visualizing the data via a system that accepts these cases as input and output.
PDF
