Dans fi̇gürleri̇ni̇n i̇şi̇tsel-görsel anali̇zi̇ i̇çi̇n i̇şi̇tsel özni̇teli̇kleri̇n deǧerlendi̇ri̇lmesi̇

Y. Demir*, F. Ofli, E. Erzin, Y. Yemez, Ve A.M. Tekalp

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

We present a framework for selecting best audio features for audiovisual analysis and synthesis of dance figures. Dance figures are performed synchronously with the musical rhythm. They can be analyzed through the audio spectra using spectral and rhythmic musical features. In the proposed audio feature evaluation system, dance figures are manually labeled over the video stream. The music segments, which correspond to labeled dance figures, are used to train hidden Markov model (HMM) structures to learn temporal spectrum patterns for the dance figures. The dance figure recognition performances of the HMM models for various spectral feature sets are evaluated. Audio features, which are maximizing dance figure recognition performances, are selected as the best audio features for the analyzed audiovisual dance recordings. In our evaluations, mel-scale cepstral coefficients (MFCC) with their first and second derivatives, spectral centroid, spectral flux and spectral roll-off are used as candidate audio features. Selection of the best audio features can be used towards analysis and synthesis of audio-driven body animation.

Original languageTurkish
Title of host publication2008 IEEE 16th Signal Processing, Communication and Applications Conference, SIU
DOIs
Publication statusPublished - 2008
Externally publishedYes
Event2008 IEEE 16th Signal Processing, Communication and Applications Conference, SIU - Aydin, Turkey
Duration: 20 Apr 200822 Apr 2008

Publication series

Name2008 IEEE 16th Signal Processing, Communication and Applications Conference, SIU

Conference

Conference2008 IEEE 16th Signal Processing, Communication and Applications Conference, SIU
Country/TerritoryTurkey
CityAydin
Period20/04/0822/04/08

Keywords

  • Audio-driven body animation
  • Audio-visual analysis

Cite this