Use este identificador para citar o ir al link de este elemento:
http://hdl.handle.net/1843/49361| Tipo: | Artigo de Periódico |
| Título: | A method for lexical tone classification in audio-visual speech |
| Autor(es): | João Vítor Possamai de Menezes Maria Mendes Cantoni Denis Burnham Adriano Vilela Barbosa |
| Resumen: | This work presents a method for lexical tone classification in audio-visual speech. The method is applied to a speech data set consisting of syllables and words produced by a female native speaker of Cantonese. The data were recorded in an audio-visual speech production experiment. The visual component of speech was measured by tracking the positions of active markers placed on the speaker's face, whereas the acoustic component was measured with an ordinary microphone. A pitch tracking algorithm is used to estimate F0 from the acoustic signal. A procedure for head motion compensation is applied to the tracked marker positions in order to separate the head and face motion components. The data are then organized into four signal groups: F0, Face, Head, Face+Head. The signals in each of these groups are parameterized by means of a polynomial approximation and then used to train an LDA (Linear Discriminant Analysis) classifier that maps the input signals into one of the output classes (the lexical tones of the language). One classifier is trained for each signal group. The ability of each signal group to predict the correct lexical tones was assessed by the accuracy of the corresponding LDA classifier. The accuracy of the classifiers was obtained by means of a k-fold cross validation method. The classifiers for all signal groups performed above chance, with F0 achieving the highest accuracy, followed by Face+Head, Face, and Head, respectively. The differences in performance between all signal groups were statistically significant. |
| Asunto: | Fala |
| Idioma: | eng |
| País: | Brasil |
| Editor: | Universidade Federal de Minas Gerais |
| Sigla da Institución: | UFMG |
| Departamento: | FALE - FACULDADE DE LETRAS |
| Tipo de acceso: | Acesso Aberto |
| Identificador DOI: | https://doi.org/10.20396/joss.v9i00.14960 |
| URI: | http://hdl.handle.net/1843/49361 |
| Fecha del documento: | 2020 |
| metadata.dc.url.externa: | https://econtents.bc.unicamp.br/inpec/index.php/joss/article/view/14960 |
| metadata.dc.relation.ispartof: | Journal of Speech Sciences |
| Aparece en las colecciones: | Artigo de Periódico |
archivos asociados a este elemento:
| archivo | Descripción | Tamaño | Formato | |
|---|---|---|---|---|
| A method for lexical tone classification in audio-visual speech.pdf | 394.82 kB | Adobe PDF | Visualizar/Abrir |
Los elementos en el repositorio están protegidos por copyright, con todos los derechos reservados, salvo cuando es indicado lo contrario.