TY - GEN
T1 - Local visual microphones
T2 - 28th British Machine Vision Conference, BMVC 2017
AU - Shabani, Mohammad Amin
AU - Samadfam, Laleh
AU - Sadeghi, Mohammad Amin
N1 - Publisher Copyright:
© 2017. The copyright of this document resides with its authors.
PY - 2017
Y1 - 2017
N2 - Sound waves cause small vibrations in nearby objects. A few techniques exist in the literature that can extract sound from video. In this paper we study local vibration patterns at different image locations. We show that different locations in the image vibrate differently. We carefully aggregate local vibrations and produce a sound quality that improves state-of-the-art. We show that local vibrations could have a time delay because sound waves take time to travel through the air. We use this phenomenon to estimate sound direction. We also present a novel algorithm that speeds up sound extraction by two to three orders of magnitude and reaches real-time performance in a 20KHz video.
AB - Sound waves cause small vibrations in nearby objects. A few techniques exist in the literature that can extract sound from video. In this paper we study local vibration patterns at different image locations. We show that different locations in the image vibrate differently. We carefully aggregate local vibrations and produce a sound quality that improves state-of-the-art. We show that local vibrations could have a time delay because sound waves take time to travel through the air. We use this phenomenon to estimate sound direction. We also present a novel algorithm that speeds up sound extraction by two to three orders of magnitude and reaches real-time performance in a 20KHz video.
UR - http://www.scopus.com/inward/record.url?scp=85084012175&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:85084012175
T3 - British Machine Vision Conference 2017, BMVC 2017
BT - British Machine Vision Conference 2017, BMVC 2017
PB - BMVA Press
Y2 - 4 September 2017 through 7 September 2017
ER -