MULTI-CHANNEL NATURE AND MULTIMODALITY OF PERCEPTION IN A SIMULTANEOUS INTERPRETER’S COGNITIVE ACTIVITY

Abstract

The article aims to develop a conceptual model of the mechanism to perceive multi-channel and multi-modal input in simultaneous translation. The originality of the study lies in the fact that simultaneous translation is considered as a translation phenomenon in the context of the cognitive and activity based approach. The findings indicate substantial transformation of the simultaneous translation cycle and, consequently, the conceptualization of the simultaneous translation process should necessarily include both audio-verbal and visual channels of perception.

References

1. Александрова Е. М., Берендяев М. В. и др. Перевод и локализация: опыт разработки профессионального стандарта. Красноярск: Сибирский федеральный ун-т, 2019. 190 с.
2. Конина А. А., Черниговская Т. В. Синхронный перевод как экстремальный вид когнитивных процессов (обзор экспериментальных исследований) // Вопросы психолингвистики. 2018. № 38. С. 178-204.
3. Chesterman A. Models of What Processes? // Describing Cognitive Processes in Translation / ed. by M. Ehrensberger-Dow et al. Amsterdam, PA: Benjamins, 2015. P. 7-20.
4. Diriker E. De-/Re-Contextualizing Conference Interpreting: Interpreters in the Ivory Tower? Amsterdam, PA: Benjamins, 2004. 223 p.
5. Gerver D. Empirical Studies of Simultaneous Interpretation: A Review and a Model // Translation, Application and Research / ed. by R.W. Brislin. N. Y.: Garden Press, 1976. P. 165-207.
6. Groh J. M., Werner-Reiss U. Visual and Auditory Integration // Encyclopedia of the Human Brain: in 4 vols. San Diego: Academic Press, 2015. Vol. 4. P. 739-752.
7. Hervais-Adelman A., Moser-Mercer B., Golestani N. Brain Functional Plasticity Associated with the Emergence of Expertise in Extreme Language Control // Neuroimage. 2015. № 114. P. 264-274.
8. Hidalgo-Barnes M., Massaro D. W. Read my lips: An animated face helps communicate musical lyrics // Psychomusicology. 2007. Vol. 19. № 2. P. 3-12.
9. Jesse A., Vrignaud N., Cohen M. M., Massaro D. W. The processing of information from multiple sources in simultaneous interpreting // Interpreting. 2001. Vol. 5 (2). P. 95-115.
10. Kade O. Kommunikationswissenschafthche Probleme der Übersetzung // Grundfragen der Ubersetzungswissenschaft. Beihefte zur Zeitschrift Fremdsprachen / hrsg. von A. Neubert. Leipzig: VEB Verlag Enzyklopädie, 1968. S. 3-20.
11. Levelt W. J. M. Monitoring and self-repair in speech // Cognition. 1983. № 14. P. 41-104.
12. Lu S. A., Wickens C. D., Prinet J. C., Hutchins S. D., Sarter N., Sebok A. Supporting interpretation management and multimodal interface design: Three meta-analyses of task performance as a function of interrupting task modality // Human Factors. 2013. № 55 (4). P. 697-724.
13. Lu S. A., Wickens C. D., Sarter N. B., Thomas L. C., Nicolic M. I., Sebok A. Redundancy gains in communication tasks: A comparison of auditory, visual, and redundant auditory-visual information presentation on NextGen flight decks // Proceedings of the Human Factors and Ergonomics Society 56th Annual Meeting. Cambridge, MA: MIT Press, 2012. P. 1476-1480.
14. Maragos P., Gros P., Katsamanis A., Papandreau G. Cross-modal integration for performance improving in multimedia: A review // Multimodal Processing and Interaction: Audio, Video, Text / ed. by P. Maragos, A. Potamianos, P. Gros. N. Y.: Springer, 2008. P. 3-48.
15. McGurk H., MacDonald J. Hearing lips and seeing voices // Nature. 1976. Vol. 264 (5588). P. 746-748.
16. Moreno R., Mayer R. E. Verbal redundancy in multimedia learning: When reading helps listening // Journal of Educational Psychology. 2002. Vol. 94. № 1. P. 156-163.
17. Schaffner C. Translation Research and Interpreting Research: Translation, Gaps, and Synergies. Clevedon, UK: Multilingual Matters, 2004. 136 p.
18. Seeber K. G. Cognitive approaches // Encyclopedia of Interpreting Studies. N. Y.: Routledge, 2015. P. 56-60.
19. Seeber K. G. Multimodal Processing in Simultaneous Interpreting // The Handbook of Translation and Cognition. John Wiley & Sons, Inc., 2017. P. 461-475.
20. Setton R. Simultaneous Interpretation: A Cognitive-Pragmatic Analysis. Amsterdam, PA: Benjamins, 1999. 399 p.
21. Steffensen S. V. Human interactivity: Problem-solving, solution-probing, and verbal patterns in the wild // Cognition beyond the Body: Interactivity and Human Thinking / ed. by S. J. Cowley, F. Vallée-Tourangeau. Dordrecht: Springer, 2013. Р. 195-221.
22. Toury G. Descriptive Translation Studies - and Beyond. Amsterdam, PA: Benjamins, 2012. 311 p.
23. Van Wassenhove V., Grant K. W., Poeppel D. Temporal window of integration in auditory-visual speech perception // Neuropsycologia. 2007. № 45. P. 598-607.
24. Wickens C. D. Processing resources in attention // Varieties of Attention / ed. by R. Parasuraman, R. Davies. N. Y.: Academic Рress, 1984. P. 63-101.

Author information

About this article

Publication history

• Received: July 4, 2019.
• Published: September 10, 2019.

Keywords

• теория перевода
• когнитивное переводоведение
• когнитивное событие
• визуальная информация
• обработка
• перевод
• theory of translation
• cognitive translation studies
• cognitive phenomenon
• visual information
• processing
• translation

Copyright

© 2019 The Author(s)
© 2019 Gramota Publishing, LLC

User license

Creative Commons Attribution 4.0 International (CC BY 4.0)