The explosive growth and widespread accessibility of community-contributed media content on the Internet have led to a surge of research activity in multimedia search. Approaches that apply text ...search techniques for multimedia search have achieved limited success as they entirely ignore visual content as a ranking signal. Multimedia search reranking, which reorders visual documents based on multimodal cues to improve initial text-only searches, has received increasing attention in recent years. Such a problem is challenging because the initial search results often have a great deal of noise. Discovering knowledge or visual patterns from such a noisy ranked list to guide the reranking process is difficult. Numerous techniques have been developed for visual search re-ranking. The purpose of this paper is to categorize and evaluate these algorithms. We also discuss relevant issues such as data collection, evaluation metrics, and benchmarking. We conclude with several promising directions for future research.
Jason Palmeri’s Remixing Composition: A History of Multimodal Writing Pedagogy challenges the longheld notion that the study and practice of composition has historically focused on words ...alone. Palmeri revisits many of the classic texts of composition theory from the 1960s, 1970s, and 1980s, closely examining how past compositionists responded to “new media.” He reveals that long before the rise of personal computers and the graphic web, compositionists employed analog multimedia technologies in the teaching of composition. Palmeri discovers these early scholars anticipated many of our current interests in composing with visual, audio, and video texts.
Using the concept of the remix, Palmeri outlines practical pedagogical suggestions for how writing teachers can build upon this heritage with digital activities, assignments, and curricula that meet the needs of contemporary students. He details a pluralist vision of composition pedagogy that explains the ways that writing teachers can synthesize expressivist, cognitive, and social-epistemic approaches.
Palmeri reveals an expansive history of now forgotten multimodal approaches to composing moving images and sounds and demonstrates how current compositionists can productively remix these past pedagogies to address the challenges and possibilities of the contemporary digital era. A strikingly original take on the recent history of composition, Remixing Composition is an important work for the future of writing instruction in a digital age.
Anomalous or unnormal multimedia medical devices are to yield anomaly network traffic and affect the diagnosis about medical issues. How to find anomaly network traffic is significantly important for ...normal applications of multimedia medical devices. This paper studies traffic anomaly detection problem in large-scale communication networks with multimedia medical devices. We employ empirical mode decomposition method and wavelet packet transform to propose an accurate detection method to capture it. Firstly, we use the wavelet packet transform to pre-treat network traffic. Network traffic is decomposed into multiple narrowband signals exhibiting more detailed features of network traffic. Secondly, the empirical mode decomposition method is utilized to divide these narrowband signals into the intrinsic mode function at different scales, in time and time-frequency domains. We calculate the spectral kurtosis value of the intrinsic mode function at these different scales to remove false components of the empirical mode decomposition. As a result, we can obtain new time and time-frequency signals which highlight the hidden nature of anomaly network traffic. Thirdly, we perform the reconstruction of empirical mode decompositions and wavelet packet transforms for the above time and time-frequency signals to attain a series of new time signals. Then we can find and diagnose abnormal network traffic. Simulation results show that our method is effective and promising.
Semantic communications could improve the transmission efficiency significantly by exploring the semantic information. In this paper, we make an effort to recover the transmitted speech signals in ...the semantic communication systems, which minimizes the error at the semantic level rather than the bit or symbol level. Particularly, we design a deep learning (DL)-enabled semantic communication system for speech signals, named DeepSC-S. In order to improve the recovery accuracy of speech signals, especially for the essential information, DeepSC-S is developed based on an attention mechanism by utilizing a squeeze-and-excitation (SE) network. The motivation behind the attention mechanism is to identify the essential speech information by providing higher weights to them when training the neural network. Moreover, in order to facilitate the proposed DeepSC-S for dynamic channel environments, we find a general model to cope with various channel conditions without retraining. Furthermore, we investigate DeepSC-S in telephone systems as well as multimedia transmission systems to verify the model adaptation in practice. The simulation results demonstrate that our proposed DeepSC-S outperforms the traditional communications in both cases in terms of the speech signals metrics, such as signal-to-distortion ration and perceptual evaluation of speech distortion. Besides, DeepSC-S is more robust to channel variations, especially in the low signal-to-noise (SNR) regime.
In recent years, with application of optimization technology and computer technology in the field of optimal design, it has become an essential course for mechanical students. How to effectively ...apply multimedia optimal methods to the optimal design course is the problem that we need to solve. The teaching mode of optimal design course is explored by multimedia software simulation analysis. The existing problems in the teaching of optimal design are introduced in this dissertation. And the case of the optimal design teaching according to the teaching method of multimedia software is realized. The finite element analysis of reducer and the application of genetic algorithm in it, for example, emphasize how multimedia simulation can be effectively applied to optimal design. We take the gear reducer as a case to carry out the modal analysis and gear meshing analysis and optimize its structure by using genetic algorithm. Making full use of multimedia software, combined with the course knowledge points and simulation software to cultivate the actual design and application capabilities, paying attention to the acquisition of optimization design methods, could improve the quality of optimization design personnel training. The results show that integrating multimedia simulation into optimization design teaching could be a good way to improve the practice of teaching and to promote knowledge learning and optimal design capabilities. It has a great significance for the development and application of optimal design based on multimedia.
Education is a sector that needs to go on to operate countinously as a means of student's activity and development in covid-19 pandemic. Multimedia is the best solution for managing PE class not to ...stop despite the social distancing issue. The aduance of technology in digitalization era isn't an obstacle to on going learning activities. Advance multimedia facility could surely be able to answer the problem arising in the society related to physical activity carried out as a form of learning. The efectiveness of multimedia learning can be seen from its trancendency to attract student's attention and interest as it combines the views, sound, and movement. So that learning takes place attractively and easily remembered by the students.
Mulsemedia—multiple sensorial media—makes possible the inclusion of layered sensory stimulation and interaction through multiple sensory channels. The recent upsurge in technology and wearables ...provides mulsemedia researchers a vehicle for potentially boundless choice. However, in order to build systems that integrate various senses, there are still some issues that need to be addressed. This review deals with mulsemedia topics that remain insufficiently explored by previous work, with a focus on the multi-multi (multiple media-multiple senses) perspective, where multiple types of media engage multiple senses. Moreover, it addresses the evolution of previously identified challenges in this area and formulates new exploration directions.
PDF
