Topic unit detection in spontaneous speech: measuring reliability using the kappa statistic.
Carregando...
Data
Título da Revista
ISSN da Revista
Título de Volume
Editor
Universidade Federal de Minas Gerais
Descrição
Tipo
Artigo de periódico
Título alternativo
Primeiro orientador
Membros da banca
Resumo
This paper deals with an inter-annotatoragreementtestinvolving the identificationof the information unit of topicas defined within the framework oftheLanguage into Act Theory(L-AcT). Fleiss’skappa statisticwas used to measure the agreementamong the four anno-tatorswho took partin the test.The dataused was sampledfromC-ORAL-BRASIL II, a spontaneous speech corpusof Brazilian Portuguese.The paper beginsbyoutliningof the theoretical underpinnings of L-AcT,dedicating special attention toaspects directly related tothe notion of Topic. Section 2presentsthepilot testanddiscussesmethodological and theoretical issues that were relevant for the designoftheprotocol that was eventually used in the actual test.Sections3and 4dealwiththe test, its protocol and results(the kappa coefficient for the general agreement was 0.79, whichby usual standards representsasub-stantialagreement).Section 5firstprovides abrief review of a fewstudiesconducted ac-cording to other frameworkswhichhave dealt withinter-annotatoragreement onthe an-notation of information structure categories. Finally,the errors observed in the test are analyzed qualitatively.
Abstract
Assunto
Linguística, Atos de fala (Linguistica)
Palavras-chave
Topic, Interrater agreement, Spontaneous speech, Information structure, Prosody
Citação
Departamento
Curso
Endereço externo
https://revistas.uam.es/chimera/article/view/12141