Picturebooks/narrativas infantis ilustradas: um estudo de relações semânticas verbo-visuais em textos originais e suas respectivas traduções com base na teoria sistêmico-funcional

Abstract

Drawing on systemic-functional linguistics (HALLIDAY e MATTHIESSEN, 2014) and on Visual Grammar (KRESS & VAN LEEUWEN, 2006), this thesis presents a methodology for analyzing the verbal-visual semantic relations (VVSR) and its implementation in a study of picturebooks originally published in English and their translations published in Brazil. The aim was to explore how the verbal and visual modes operate in bimodal complexes, and how the VVSR are established in these complexes, in both original texts (OT) and translated texts (TT). It was also of interest to elucidate issues on the constitutivity and ancillarity of the verbal texts when two semiotic systems operate together to realize meaning. The picturebooks selected to be part of the corpus were digitalized and prepared for manual annotation in electronic spreadsheets. The annotation was carried out based on the TRANSITIVITY functions, in the verbal text (HALLIDAY e MATTHIESSEN, 2014), and on the elements of the representational metafunction (KRESS e VAN LEEUWEN, 2006) in the visual text. The VVSR were annotated based in the logico-semantic relations postulated by Halliday e Matthiessen (2014). The categories frequency of ocurrence were counted by the spreadsheet software. The results point to similarities between the VVSR of OTs and TTs. There was a low occurrence of verbal and/or visual simplexes. In other words, the occurrence of SR between verbal text and visual text was the majority, a result that points to a representative feature of picturebooks. As far as the VVSR are concerned, in both OTs and TTs, there can be noted a correlation between the TRANSITIVITY functions (Participants, Processes, and Circumstances) and VVSR of Expansion, with low occurrence of Projection. Within Expansion, Extension is the most frequent relation, not only regarding the general data of all VV-SR, but also regarding the Processes. Elaboration is the most frequent VVSR concerning the Participants, and Enhancement was the most frequent in respect of the Circumstances. It was observed that Participants are elaborated in the verbal and visual texts, whereas the verbal text tends to extend the visual text through Processes, while the visual text tends to enhance the verbal text through Circumstances. Finally, in the matter of the constitutivity or ancillarity of the verbal text in the analyzed picturebooks, there are more occurrences in which the role of the verbal text is more constitutive.