--

12 (1) 2022

The why-what-when-who-how of using captioned videos as an instructional aid in EAL classrooms: Theoretical perspectives and classroom implications


Author - Affiliation:
Trinh Thai Van Phuc - Simon Fraser University
Corresponding author: Trinh Thai Van Phuc - phuc_trinh@sfu.ca
Submitted: 13-02-2022
Accepted: 18-04-2022
Published: 21-06-2022

Abstract
This paper seeks to address how captioned videos are used as an instructional aid in classrooms of English as an additional language (EAL). The paper employs a narrative literature review to synthesize prior studies and reach pedagogical conclusions for utilizing the captioned videos. The results argue that captioned videos have pedagogical, cognitive, and psychological benefits to language teaching and learning with the awareness of some influential factors during instructional implementations. First, the paper elaborates on the roles of videos in language teaching and learning (Why), underlying theories of employing videos (How), and influential factors of utilizing the captions (When and Who), followed by an emphasis on captioning effects on language learning (What). Then, it discusses some classroom implications as concluding remarks.

Keywords
captioned videos; English as an Additional Language (EAL); multimedia learning; subtitled videos

Full Text:
PDF

Cite this paper as:

Trinh, P. T. V. (2022). The why-what-when-who-how of using captioned videos as an instructional aid in EAL classrooms: Theoretical perspectives and classroom implications. Ho Chi Minh City Open University Journal of Science – Social Sciences, 12(1), 50-62. doi:10.46223/HCMCOUJS.soci.en.12.1.2185.2022


References

Arndt, H. L., & Woore, R. (2018, October). Vocabulary learning from watching YouTube videos and reading blog posts. Language Learning & Technology, 22(3), 124-142. doi:10125/44660


Bal-Gezegin, B. (2014). An investigation of using video vs. audio for teaching vocabulary. Procedia - Social and Behavioral Sciences, 143, 450-457.  doi:10.1016/j.sbspro.2014.07.516


Berk, R. A. (2009). Multimedia teaching with video clips: TV, movies, YouTube, and mtvU in the college classroom. International Journal of Technology in Teaching and Learning, 5(1), 1-21.


Chandler, P., & Sweller, J. (1991). Cognitive load theory and the format of instruction. Cognition and Instruction, 8(4) 293-332.


Choi, J., & Yi, Y. (2016). Teachers’ integration of multimodality into classroom practices for English language learners. TESOL Journal, 7(2), 304-327. doi:10.1002/tesj.204


Chun, D. (2001). L2 reading on the web: Strategies for accessing information in hypermedia. Computer Assisted Language Learning, 14(5), 367-403. doi:10.1076/call.14.5.367.5775


Chun, D., & Plass, J. (1996). Effects of multimedia annotations on vocabulary acquisition. The Modern Language Journal, 80(2), 183-198. doi:10.2307/328635


Ciccone, A. (1995). Teaching with authentic video: Theory and practice. In F. Eckman, D. Highland, P. Lee, J. Milman & R. Weber (Eds.), Second language acquisition theory and pedagogy (pp. 203-218). Mahwah, NJ: Lawrence Erlbaum.


Cinganotto, L., & Cuccurullo, D. (2015). The role of videos in teaching and learning content in a foreign language. Journal of e-Learning and Knowledge Society, 11(2), 49-62.


Coniam, D. (2001). The use of audio or video comprehension as an assessment instrument in the certification of English language teachers: A case study. System, 29(1), 1-14.  doi:10.1016/S0346-251X(00)00057-9


D’Ydewalle, G., & Gielen, I. (1992). Attention allocation with overlapping sound, image, and text. In K. Rayner (Ed.), Eye movements and visual cognition: Scene perception and reading (pp. 415-427). New York, NY: Springer‐Verlag


Danan, M. (2004). Captioning and subtitling: Undervalued language learning strategies. META, 49(1), 67-77. doi:10.7202/009021ar


Danan, M. (2016). Enhancing listening with captions and transcripts: Exploring learner differences. Applied Language Learning, 26(2), 1-24.


Dang, Y. T. N. (2020, June). The potential for learning specialized vocabulary of university lectures and seminars through watching discipline-related TV programs: Insights from medical corpora. TESOL Quarterly, 54(2), 436-459.  doi:10.1002/tesq.552


Dressman, M. (2020). Multimodality and language learning. In M. Dressman & R. W. Sadler (Eds.), The handbook of informal language learning (pp. 39-55). Chichester, UK: Wiley-Blackwell.


Fehlman, R. (1996). Viewing film and television as whole language instruction. The English Journal, 85(2), 43-50.


Flynn, K. F. (1998). Bring language to life! Using video in your ESL/EFL Program. ESL Magazine, 1(2), 1-20.


Fukushima, T. (2002). Promotional video production in a foreign language course. Foreign Language Annals, 35(3), 349-355. doi:10.1111/j.1944-9720.2002.tb01860.x


Gass, S., Winke, P., Isbell, D. R., & Ahn, J. (2019). How captions help people learn languages: A working-memory, eye-tracking study. Language Learning & Technology, 23(2), 84-104. doi:10125/44684


Green, B. N., Johnson, C. D., & Adams, A. (2006). Writing narrative literature reviews for peer-reviewed journals: Secrets of the trade. Journal of Chiropractic Medicine, 5(3), 101-117. doi:10.1016/S0899-3467(07)60142-6


Hanley, J. E., Herron, C. A., & Cole, S. P. (1995). Using video as an advance organizer to a written passage in the FLES classroom. The Modern Language Journal, 79(1), 57-66.  doi:10.1111/j.1540-4781.1995.tb05416.x


Hartman, F. (1961). Single and multiple channel communication: A review of research and a proposed model. Audio Visual Communications Review, 9(6), 235-262.


Herrero, C., & Vanderschelden, I. (2019). Introduction. In C. Herrero & I. Vanderschelden (Eds.), Using film and media in the language classroom: Reflections on research-led teaching (pp. 14-20). Bristol, UK: Channel View Publications.


Herron, C., Corrie, C., Cole, S. P., & Dubreil, S. (1999). The effectiveness of a video-based curriculum in teaching culture. The Modern Language Journal, 83(4), 518-533.  doi:10.1111/0026-7902.00038


Herron, C., Dubreil, S., Corrie, C., & Cole, S. P. (2002). A classroom investigation: Can video improve intermediate-level French language students’ ability to learn about a foreign culture? The Modern Language Journal, 86(1), 36-53. doi:10.1111/1540-4781.00135


Hsu, W. (2013). The effects of audiovisual support on EFL learners’ productive vocabulary. ReCALL, 26(1), 67-79. doi:10.1017/S0958344013000220


Ito, Y. (1996). Communication between high school and college japanese language education: Implications from a survey on the use of video materials in the United States. Foreign Language Annals, 29(3), 463-479.


Ivone, F. M., & Renandya, W. A. (2022). Bringing extensive listening into the second language classroom. In M. Reed & T. Jone (Eds.), Listening in the classroom: Teaching students how to listen (pp. 157-170). Alexandria, Egypt and Virginia, USA: TESOL Press.


Kam, E. F., Liu, Y.-T., & Tseng, W.-T. (2020). Effects of modality preference and working memory capacity on captioned videos in enhancing L2 listening outcomes. ReCALL, 32(2), 213-230.  doi:10.1017/S0958344020000014


Kern, R., Ware, P., & Warschauer, M. (2016). Computer-mediated communication and language learning. In G. Hall (Ed.), The routledge handbook of english language teaching (pp. 542-555). London, UK: Routledge.


Kramsch, C. (2009). The embodied self. In C. Kramsch (Ed.), The multilingual subject (pp. 53-77). Oxford, UK: Oxford University Press.


Kruger, J. L. (2013). Subtitles in the classroom: Balancing the benefits of dual coding with the cost of increased cognitive load. Journal for Language Teaching, 47(1), 29-53. doi:10.10520/EJC143069


Ling, B., & Kettle, M. (2011). Rethinking comprehension and strategy use in second language listening instruction. TESOL in Context, 21(1), 5-22.


Mayer, R. E. (2009). The promise of multimedia learning. In R. E. Mayer (Ed.), Multimedia learning (2nd ed., pp. 03-27). New York, NY: Cambridge University Press.


Mayer, R. E., & Moreno, R. (1998). A split‐attention effect in multimedia learning: Evidence for dual processing systems in working memory. Journal of Educational Psychology, 90(2), 312-320.


Mayer, R. E., Lee, H., & Peebles, A. (2014). Multimedia learning in a second language: A cognitive load perspective. Applied Cognitive Psychology, 28(5), 653-660. doi:10.1002/acp.3050


Merkt, M., Weigand, S., Heier, A., & Schwan, S. (2011). Learning with videos vs. learning with print: The role of interactive features. Learning and Instruction, 21(6), 687-704.  doi:10.1016/j.learninstruc.2011.03.004


Muñoz, C. (2017). The role of age and proficiency in subtitle reading. An eyetracking study. System, 67, 77-86. doi:10.1016/j.system.2017.04.015


Nation, I. S. (2011, October). Research into practice: Vocabulary. Language Teaching, 44(4), 529-539. doi:10.1017/S0261444811000267


Nation, I. S. (2013). Learning vocabulary in another language (2nd ed.). Cambridge, UK: CUP.


Nguyen, C.-D., & Boers, F. (2019). The effect of content retelling on vocabulary uptake from a TED talk. TESOL Quarterly, 53(1), 5-29. doi:10.1002/tesq.441


Nguyen, H. D. (2020). Understanding EFL students’ use of listening strategies in watching English captioned movies. Vietnam Journal of Education, 4(2), 37-46. doi:10.52296/vje.2020.18


Norton, B., & Toohey, K. (2004). Critical pedagogies and language learning: An introduction. In B. Norton & K. Toohey (Eds.), Critical pedagogies and language learning (pp. 01-18). Cambridge, UK: Cambridge University Press.


Perez, M. M., & Rodgers, M. P. (2019). Video and language learning. The Language Learning Journal, 47(4), 403-406. doi:10.1080/09571736.2019.1629099


Peters, E. (2019). The effect of imagery and on-Screen text on foreign language vocabulary learning from audiovisual input. TESOL Quarterly, 53(4), 1008-1032. doi:10.1002/tesq.531


Peters, E., & Webb, S. (2018, September). Incidental vocabulary acquisition through viewing L2 television and factors that affect learning. Studies in Second Language Acquisition, 40(3), 551-577. doi:10.1017/S0272263117000407


Plotnikova, A. (2017). Intentional and incidental learning of English grammar through captioned video exposure (Unpublished master’s thesis). Barcelona, Spain: Universitat de Barcelona.


Rodgers, M. R., & Webb, S. (2017). The effects of captions on EFL learners’ comprehension of English-language television programs. CALICO Journal, 34(1), 20-38. doi:10.1558/cj.29522


Schulte, G. (1991). Murder in the classroom: An audiovisual alternative for intermediate level language instruction. Die Unterrichtspraxis/Teaching German, 24(2), 176-182.


Sherman, J. (2003). Using authentic video in the language classroom. Cambridge, UK: Cambridge University Press.


Spring, R. (2020). Can video-creation project work affect students’ oral proficiency? An analysis of fluency, complexity and accuracy. TESL-EJ, 24(2), 1-17.


Stein, P. (2004). Representation, rights, and resources: Multimodal pedagogies in the language and literacy classroom. In B. Norton & K. Toohey (Eds.), Critical pedagogies and language learning (pp. 95-115). Cambridge, UK: Cambridge University Press.


Stempleski, S., & Arcario, P. (1992). Video in second language teaching: using, selecting and producing video for the classroom. Alexandria, Egypt and Virginia, USA: TESOL Publications.


Stigler, J. W., Geller, E. H., & Givvin, K. B. (2015). Zaption: A platform to support teaching, and learning about teaching, with video. Journal of E-Learning and Knowledge Society, 11(2), 13-25.


Taylor, G. (2005). Perceived processing strategies for students watching captioned video. Foreign Language Annals, 38(3), 422-427. doi:10.1111/j.1944-9720.2005.tb02228.x


Toohey, K., Dagenais, D., & Schulze, E. (2012). Second language learners making video in three contexts. Language and Literacy, 14(2), 75-96. doi:10.20360/G2S59R


Truong, L. B., & Tran, L. T. (2014). Students’ intercultural development through language learning in Vietnamese tertiary education: A case study on the use of film as an innovative approach. Language and Intercultural Communication, 14(2), 207-225. doi:10.1080/14708477.2013.849717


Vanderplank, R. (1990). Paying attention to the words: Practical and theoretical problems in watching television programmes with uni-lingual (CEEFAX) sub-titles. System, 18(2), 221-234. doi:10.1016/0346-251X(90)90056-B


Vanderplank, R. (2016). Captioned media in foreign language learning and teaching. Subtitles for the deaf and hard-of-hearing as tools for lanuage learning. London, UK: Palgrave Macmillan.


Vanderplank, R. (2019). Video and informal language learning. In M. Dressman & R. W. Sadler (Eds.), The handbook of informal language learning (pp. 181-201). Chichester, UK: Wiley-Blackwell.


Watkins, J., & Wilkins, M. (2011). Using YouTube in the EFL classroom. Language Education in Asia, 2(1), 113-119.


Webb, S. (2015). Extensive viewing: Language learning through watching television. In D. Nunan & J. Richards (Eds.), Language learning beyond the classroom (pp. 159-168). London, UK: Routledge.


Weyers, J. (1999). The effect of authentic video on communicative competence. Modern Language Journal, 83(3), 339-349. doi:10.1111/0026-7902.00026


Winke, P., Gass, S., & Sydorenko, T. (2010). The effects of captioning videos used for foreign language listening activities. Language Learning & Technology, 14(1), 65-86.


Winke, P., Gass, S., & Sydorenko, T. (2013). Factors influencing the use of captions by foreign language learners: An eye‐tracking study. The Modern Language Journal, 97(1), 254-275.  doi:10.1111/j.1540-4781.2013.01432.x


Wisniewska, N., & Mora, J. C. (2020, July). Can captioned video benefit second language pronunciation? Studies in Second Language Acquisition, 42(3), 599-624.  doi:10.1017/S0272263120000029


Yang, P. (2020). The cognitive and psychological effects of Youtube video captions and subtitles on higher-level german language learners. In M. R. Freiermuth & N. Zarrinabadi (Eds.), Technology and the psychology of second language learners and users (pp. 83-111). Switzerland: Palgrave Macmillan.


Yeldham, M. (2018). Viewing L2 captioned videos: what’s in it for the listener? Computer Assisted Language Learning, 31(4), 367-389. doi:10.1080/09588221.2017.1406956


Zhang, L. J. (2016). Teaching reading and viewing to L2 learners. In W. A. Renandya & H. P. Widodo (Eds.), English language teaching today: Linking theory and practice (pp. 127-141). Switzerland: Springer International Publishing.



Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.