Conference abstract · 21 Oct 2019
Conference abstractPublished 20 Jul 2017
Image to sound mapping and its processing techniques
Osaka University, Japan
Abstract
Select any words in the title or abstract, or press this and choose a sentence.
Sound spectrogram is useful to visually analyze time-varying characteristics of a sound. Since the sound spectrogram can be treated as an image, we can process the sound spectrogram by using image processing techniques. Such interesting techniques have been applied in music transcription, musical instruments sound separation, noise reduction and so on. Conversely, we can produce a sound signal from an image which is treated as a sound spectrogram. This technique is called as image to sound mapping. In the image to sound mapping, the most important parameters are spectral phase, playback time and frequency bandwidth. The spectral phase decides sound type or tone color. The playback time is the time for providing the single image, and frequency bandwidth decides each pitch of sinusoid to make the sound. Since the main purpose of the mapping sound is to bear the image as a sound, we should carefully make the mapping sound under a common condition with respect to these parameters. Addition to it, we should have some knowledge of a filtering effect for the mapping sound, because the sound is received at sensors after passing through a certain transfer function from a loudspeaker to the sensors. I focus on filtering or modifying a mapping sound from an image, and investigate its image-reconstruction capability. Firstly, we review image to sound mapping techniques. Secondly, for a mapping sound, we apply three basic operations of the signal processing, i.e., multiplication, delay, and addition. Thirdly, we discuss the basic filtering effects obtained from low-pass filters, high-pass filters, and band-pass filters. These processing results are intuitively acceptable. Then, we also investigate FIR and IIR echo effects. After that, some modulation effects such as amplitude modulation are discussed. Finally, on a sound to image mapping method, useful drawing techniques are presented.
Ask about this article
Answers come only from this article's title, abstract and keywords, each sentence pointing to where it comes from. Your question is sent to OpenAI to write the answer. Scholars Central does not store it.
Similar by topic
Conference abstract · 5 Jun 2017
The green image of processed food by MAPs raw material quality
Article · 26 Jun 2024
Innovations in Brain Mapping: Unveiling Techniques, Applications, and Future Directions in Neuroscience and Imaging
Mini review · 27 May 2024
Mapping Cellular Dynamics in Health and Disease: Exploring Molecular Imaging Techniques in Nuclear Medicine
Research article · 2016
Evaluation of Humeral Head Cartilage Using the Magnetic Resonance Imaging T1ρ Relaxation Time Mapping Technique: A Comparison between Young and Elderly Healthy People
Follow
New articles from what you follow go into your email digest, once you agree to alert emails.
- BylineArticles whose byline prints “Arata Kawamura”
