The booming haptic data significantly improve the users’ immersion during multimedia interaction. As a result, the study of a Haptic-based Interaction System has attracted the attention of the ...multimedia community. To construct such a system, a challenging task is the synchronization of multiple sensorial signals that is critical to the user experience. Despite audio-visual synchronization efforts, there is still a lack of a haptic-aware multimedia synchronization model. In this work, we propose a timestamp-independent synchronization for haptic–visual signal transmission. First, we exploit the sequential correlations during delivery and playback of a haptic–visual communication system. Second, we develop a key sample extraction of haptic signals based on the force feedback characteristics and a key frame extraction of visual signals based on deep-object detection. Third, we combine the key samples and frames to synchronize the corresponding haptic–visual signals. Without timestamps in the signal flow, the proposed method is still effective and more robust in complicated network conditions. Subjective evaluation also shows a significant improvement of user experience with the proposed method.
Spatial representation in the haptic domain has been shown to be prone to systematic errors. When participants are asked to make two bars haptically parallel, their performance deviates from what ...would be veridically parallel. This is hypothesized to be caused by the bias of the egocentric reference frame. Stimulating the use of an allocentric reference frame has previously been shown to improve performance in haptic parallelity matching. The aim of the current study was to investigate the influence of action video game experience on parallelity performance. We hypothesized that participants who extensively play action video games with a so-called ‘bird’s-eye view’ are likely to process spatial information more allocentrically, resulting in better performance in haptic parallelity matching. This was tested in two groups of male participants, 10 participants with extensive action video gaming experience (AVGPs) and 10 participants without or hardly any action video gaming experience (NAVGPs). Additionally, the effect of visual–haptic practice on haptic parallelity performance was tested. In the haptic blocks, blindfolded participants had to feel the orientation of a reference bar with their non-dominant hand and had to match this orientation on a test bar with their dominant hand. In subsequent visual–haptic blocks, they had full view of the set-up and visually paralleled both bars. As hypothesized, AVGPs performed significantly better in haptic blocks than NAVGPs. Visual–haptic practice resulted in significantly better performance in subsequent haptic blocks in both groups. These results suggest that playing action video games might enhance haptic spatial representation, although a causative relationship still needs to be established.
Haptic rendering for dental training system Wang, DangXiao; Zhang, YuRu; Wang, Yong ...
Science China. Information sciences,
03/2009, Letnik:
52, Številka:
3
Journal Article
Recenzirano
Immersion and interaction are two key features of virtual reality systems, which are especially important for medical applications. Based on the requirement of motor skill training in dental surgery, ...haptic rendering method based on triangle model is investigated in this paper. Multi-rate haptic rendering architecture is proposed to solve the contradiction between fidelity and efficiency requirements. Realtime collision detection algorithm based on spatial partition and time coherence is utilized to enable fast contact determination. Proxy-based collision response algorithm is proposed to compute surface contact point. Cutting force model based on piecewise contact transition model is proposed for dental drilling simulation during tooth preparation. Velocity-driven levels of detail haptic rendering algorithm is proposed to maintain high update rate for complex scenes with a large number of triangles. Hapticvisual collocated dental training prototype is established using half-mirror solution. Typical dental operations have been realized including dental caries exploration, detection of boundary within dental cross-section plane, and dental drilling during tooth preparation. The haptic rendering method is a fundamental technology to improve immersion and interaction of virtual reality training systems, which is useful not only in dental training, but also in other surgical training systems.
Tactile/haptic user interfaces have been becoming one of the important approaches to improve user experiences on various tabletops and tablets. This workshop proposes to bring researchers who are ...working or interested in the field together, and share their research experiences. In addition to tactile displays and tablets, the workshop focuses on haptic tangible user interfaces, fusion of visual and tactile/haptic feedback, and accessibility studies via tactile/haptic user interfaces. Through this workshop we plan to establish a working group for possible collaboration.
The neural correlates of cross-modal recognition memory were examined in 8-month-old infants by using event-related potentials. Testing began by having all Ss feel (but not see) an object for 60 s. ...Test trials then followed. Infants in Condition 1 received 15 presentations of a picture of the familiar object, followed by alternating pictures of that object and a novel object. Infants in Condition 2 received 15 presentations of a picture of the novel object, followed by the same test sequence as infants in Condition 1. Infants in Condition 3 were presented with 2 test trials during which looking times were recorded to pictures of the familiar and novel objects; they then received the same test sequence as infants in Conditions 1 and 2. Infants in Condition 4 were presented only with the same test sequence as infants in Conditions 1, 2, and 3. Only in Conditions 1 and 4 was a late positive slow wave invoked by the novel object (indicative of recognition memory), although infants in Condition 3 did show a significant looking preference for the novel object. These results are contrasted with previous studies examining the neural correlates of visual recognition memory.
Consistency between haptic display and visual display is an important requirement to construct high fidelity virtual reality systems. Spatial registration method for accurate collocated haptic-visual ...display based on half-silvered mirror is proposed in this paper. The registration accuracy is defined to be the distance between the virtual avatar and the haptic interface point with regard to the human eye coordinate system. Spatial registration algorithm combined offline calibration module with online measurement module is proposed based on registration of human's eye camera with OpenGL camera. High precision FARO Arm is utilized to calibrate the external and internal parameters in haptic and visual coordination systems. Sensitivity of errors on the registration precision is analyzed and optimal eye position is determined. Three kinds of experiments are carried out to validate the registration accuracy qualitatively and quantitatively.
PDF
