--

15(2)2025

Enhancing students’ subject-verb agreement skill by using CiCi artificial intelligence-based app: Embedded mixed-methods study


Author - Affiliation:
Magday, Jr. Dacusin William - Nueva Vizcaya State University, Nueva Vizcaya
Memita Fernandez Jerwin - Nueva Vizcaya State University, Nueva Vizcaya
Abon Tolloc Joel - Nueva Vizcaya State University, Nueva Vizcaya
Gumilet Galamay Gail - Nueva Vizcaya State University, Nueva Vizcaya
Cablinan Guitubon Alma Bella - Nueva Vizcaya State University, Nueva Vizcaya
Castro Tamondong Lhea - Nueva Vizcaya State University, Nueva Vizcaya
Gamurot Eliseo Jenny Grace - Nueva Vizcaya State University, Nueva Vizcaya
Tumaneng Bedoya Elson Boie - Nueva Vizcaya State University, Nueva Vizcaya
Corresponding author: Magday, Jr. Dacusin William - wmagday@ymail.com
Submitted: 13-01-2024
Accepted: 19-03-2024
Published: 18-10-2024

Abstract
In recent years, AI-based language learning apps have found their way into English as a Second Language (ESL) classrooms. This case study employing embedded mixed-method design investigates the effectiveness of the CiCi app for enhancing the subject-verb agreement skills of ESL learners from the Philippines. Through random sampling, 40 Grade 7 students, 20 in each group, participated in this study. The students in the experimental group underwent a 4-week intervention program, spending 100 minutes per week, integrating the CiCi App as a supplemental learning tool, while the students in the control group underwent the traditional instruction method of teaching subject-verb agreement, also with the same number of minutes. Aside from the pretest and posttest data of both groups, one-on-one interviews with the students from the experimental group and their teacher were also conducted to analyze their perceptions of the app. Results show that the app significantly improved students’ subject-verb agreement skills in the experimental group, with no significant improvement observed in the control group. The interview data revealed four themes: Offering Free Charge and User-Friendly Features, Making English Learning Fun, Providing Various SV Agreement Exercises, and Encouraging Collaborative Learning. Drawing on the findings, AI-powered educational resources, like CiCi, enable teachers to customize English classroom activities. The study contributes to understanding the role of technology in language learning and provides insights for educators seeking innovative teaching strategies.

Keywords
artificial intelligence; CiCi app; subject-verb agreement

Full Text:
PDF

References

Ahmad, T. (2020). Student perceptions on using cell phones as learning tools: Implications for mobile technology usage in Caribbean higher education institutions. PSU Research Review, 4 (1), 25-43. https://doi.org/10.1108/PRR-03-2018-0007


Alemi, M., Sarab, M. R. A., & Lari, Z. (2012). Successful learning of academic word list via MALL: Mobile assisted language learning. International Education Studies, 5(6), 99-109. https://doi.org/10.5539/ies.v5n6p99


Al-Emran M., Elsherif H., Shaalan K. (2016). Investigating attitudes towards the use of mobile learning in higher education. Computer Human Behavior, 56, 93-102. https://doi.org/10.1016/j.chb.2015.11.033


Alfitri, N., Arifmiboy, A., & Dewi, M. P. (2021). The students’ vocabulary acquisition addicted to playing online games. English Language and Pedagogy, 6(1), 33-44.


Atabek, O. (2020). Associations between emotional states, self-efficacy for and attitude towards using educational technology. International Journal of Progressive Education, 16(2), 175-194. https://doi.org/10.29329/ijpe.2020.241.12


Bachore, M. M. (2015). Language learning through mobile technologies: An opportunity for language learners and teachers. Journal of Education and Practice, 6(1), 50-53.


Baker, R. S. (2016). Stupid tutoring systems, intelligent humans. International Journal of Artificial Intelligence in Education 26(2), 600–614. https://doi.org/10.1007/s40593-016-0105-0


Briggs, N. (2018). Neural machine translation tools in the language learning classroom: Students’ use, perceptions, and analyses. The JALT CALL Journal, 14(1), 3-24.


Boonmoh, A., Jumpakate, T., & Karpklon, S. (2021). Teachers’ perceptions and experience in using technology for the classroom. Computer Assisted Language Learning Electronic Journal (CALL-EJ), 22(1). 1-24. http://callej.org/journal/22-1/Boonmoh-Jumpakate-Karpklon2021.pdf


Boonmoh, A., Jumpakate, T., & Karpklon, S. (2022). A close look at the use of technology by Thai teachers in secondary efl classrooms. Computer Assisted Language Learning Electronic Journal (CALL-EJ), 23(1), 78-107.


Cavaleri, M., & Dianati, S. (2016). You want me to check your grammar again? The usefulness of an online grammar checker as perceived by students. Journal of Academic Language and Learning, 10(1), 223-236.


Celik, I., Dindar, M., Muukkonen, H. et al. (2022). The promises and challenges of artificial intelligence for teachers: A systematic review of research. TechTrends, 1-15. https://doi.org/10.1007/s11528-022-00715-y


Chang, C.-K., & Hsu, C-K. (2011). A mobile-assisted synchronously collaborative translation-annotation system for English as a foreign language (EFL) reading comprehension. Computer Assisted Language Learning, 24(2), 155-180.


Che Mustaffa, N. U., & Sailin, S. N. (2022). A systematic review of mobile-assisted language learning research trends and practices in Malaysia. International Journal of Interactive Mobile Technologies, 16(5), 169–198. https://doi.org/10.3991/ijim.v16i05.28129


Chen, I.-J., & Chang C.-C. (2011). Content presentation modes in mobile listening tasks: English proficiency as a moderator. Computer Assisted Language Learning, 24(5), 451-470.


Chen, Y. L., & Hsu, C. C. (2020). Self-regulated mobile game-based English learning in a virtual reality environment. Computers & Education, 154(1). https://doi.org/10.1016/j.compedu.2020.103910


Chen, Z., Chen, W., Jia, J., & An, H. (2020). The effects of using mobile devices on language learning: A meta-analysis. Educational Technology Research and Development, 68(4), 1769–1789. https://doi.org/10.1007/s11423-020-09801-5


Cheng, S. C., Hwang, W. Y., Wu. S. Y., Shadiev, R., & Xie, C. H. (2010). A mobile device and online system with contextual familiarity and its effects on English learning on Campus. Educational Technology and Society, 13(3), 93-109.


Cici (2022). [Mobile application]. Retrieved June 29, 2023, from https://www.ciciai.com/chat/?guest_landing=1&login_source=chat_list_unlog&type=0


Correa, Y. R. (2015). Skype conference calls: A way to promote speaking skills in the teaching and learning of English. Profile, 17(1), 143-156.


Creswell, J. W., & Plano Clark, V. L. (2011). Designing and Conducting Mixed Methods Research. Sage Publications.


Crompton, H., Burke, D., & Gregory, K. (2017). The use of mobile learning in PK-12 education: A systematic review. Computers & Education, 110, 51-63. https://doi.org/10.1016/j.compedu.2017.03.013


Cymberknop, L., & Armentano, R. (2018). Active learning approach to enhance engineering education in Argentina: A case of study in signals and systems. Creative Education, 9(9), 1444-1456. https://doi.org/10.4236/ce.2018.99107.


Dewi, H. K., Putri, R. E., Rahim, N. A., Wardani, T. I., & Pandin, M. G. R. (2021). The use of AI (artificial intelligence) in English learning among university students: Case study in English department, Universitas Airlangga. SocArXiv. https://doi.org/10.31235/osf.io/x3qr6


Diniah, S. N. (2013). Teachers’ perception towards the use of English textbook in EFL classrooms (a descriptive study of EFL teachers at one Islamic senior high school in Cirebon). Journal of English and Education, 1(2), 72-82.


Elaish, M. M., Shuib, L., Ghani, N. A., & Yadegaridehkordi, E. (2019). Mobile English language learning (MELL): A literature review. Educational Review, 71(2), 257-276. https://doi.org/10.1080/00131911.2017.1382445


Fetters, M. D. (2016). Haven’t we always been doing mixed methods research? Lessons learned from the development of the horseless carriage. Journal of Mixed Methods Research, 10(1), 3–11. https://doi.org/10.1177/1558689815620883


Gilmore, A. (2007). Authentic materials and authenticity in foreign language learning. Language Teaching, 40(2), 97-118. https://doi.org/10.1017/S0261444807004144


Gilmore, A. (2011). “I prefer not to text”: developing Japanese leaners’ communicative competence with authentic materials. Language Teaching, 61(3), 786-819. https://doi.org/10.1111/j.1467-9922.2011.00634.x


Haristiani, N. and A. A. Danuwijaya. 2019. Gengobot: A chatbot-based grammar application on mobile instant messaging as language learning medium. Journal of Engineering Science and Technology 14(6), 3158-3173.


Hwang, G. J., & Wu, P. H. (2012). Advancements and trends in digital game-based learning research: A review of publications in selected journals from 2001 to 2010. British Journal of Educational Technology, 43(1), E6-E10. https://doi.org/10.1111/j.1467- 85352011. 01242.x


Hrastinski, S., Olofsson, A. D., Arkenback, C., Ekström, S., Ericsson, E., Fransson, G., et al. (2019). Critical imaginaries and reflections on artificial intelligence and robots in postdigital K-12 education. Postdigit Sci Educ, 1, 427-445. https://doi.org/10.1007/s42438-019-00046-x


Kannan, J., & Munday, P. (2018). New Trends in second language learning and teaching through the lens of ICT, networked learning, and artificial intelligence. Círculo de Lingüística Aplicada a la Comunicación, 76(2), 13–30. https://doi.org/10.5209/CLAC.62495


Karnjanapun, S. (2015). Nakhon ratchasima teachers’ using of smartphones in English language teaching. In S. Carliner, C. Fulford & N. Ostashewski (Eds.), Proceedings of EdMedia 2015-World Conference on Educational Media and Technology (pp. 944-950). Montreal, Quebec, Canada: Association for the Advancement of Computing in Education (AACE). Retrieved June 8, 2022 from https://www.learntechlib.org/primary/p/151364/.


Kim, N. J., & Kim, M. K. (2022) Teacher’s perceptions of using an artificial intelligence-based educational tool for scientific writing. Frontiers in Education 7, 1-14. https://doi.org/10.3389/feduc.2022.755914


Kim, H. S., Kim, N. Y. & Cha, Y. (2021). Is it beneficial to use AI chatbots to improve learners’ speaking performance? The Journal of Asia TEFL 18(1), 161-178.


Kim, N.-Y., Y. Cha and H.-S. Kim. 2019. Future English learning: Chatbots and artificial intelligence. Multimedia Assisted Language Learning 22(3), 32-53.


Li, J., Link, S., & Hegelheimer, V. (2015). Rethinking the role of automated writing evaluation (AWE) feedback in ESL writing instruction. Journal of Second Language Writing, 27(1), 1-18. https://doi.org/10.1016/j.jslw.2014.10.004


Li, Z., and Hegelheimer, V. (2013). Mobile-assisted grammar exercises: effects on self-editing in L2 writing. Language Learning Technology, 17(2), 135–156


Luckin, R., Holmes, W., Griffiths, M. & Forcier, L. B. (2016). Intelligence Unleashed: An argument for AI in Education. Pearson.


Lyons, S. (2016). A survey of the use of mobile technology and translation tools by students at secondary school in Thailand. Payap University Journal, 26(1), 35-57. https://doi.org/10.14456/pyuj.2016.1


Magday, W. D., & Pramoolsook, I. (2021). Exploring teaching demonstrations in the teaching journals: A case of Filipino pre-service teachers. Language Related Journal, 12(5), 171-200. https://doi.org/10.29252/LRR.12.5.7


Mahmood, K. (2011). Conformity to quality characteristics of textbooks: the illusion of textbook evaluation in Pakistan. Journal of Research and Reflections in Education, 5(2), 170-190.


Marc V., & Rees, K. V. (2009). Literary education curriculum and institutional contexts: Textbook content and teachers’ textbook usage in Dutch literary education, 1968-2000. Poetics, 37(1), 74-97.


Miangah, T. M., & Nazarat, A. (2012). Mobile Assisted Language Learning. International Journal of Distributed and Parallel Systems, 3(1), 309-319.


Mundy, M. A., Kupczynski, L., & Kee, R. (2012). Teacher’s perceptions of technology use in the schools. Sage Open, 2(1), 1-8. https://doi.org/10.1177/2158244012440813


Moore, P. V. (2019). Book review: Jerry kaplan “Artificial intelligence: What everyone needs to know.” Organization Studies, 40, 466-470.


Nami, F. (2020). Educational smartphone apps for language learning in higher education: students’ choices and perceptions. Australasian Journal of Educational Technology, 5, 82-95.


Neuendorf, K. A. (2002). The content analysis guidebook. Sage.


Nowell, L.S., Norris, J.M., White, D.E., & Moules, N.J. (2017). Thematic Analysis: Striving to Meet the Trustworthiness Criteria. International Journal of Qualitative Methods, 16, 1-13. https://doi.org/10.1177/1609406917733847


O’Neill, R., & Russell, A. M. T. (2019). Stop! Grammar time: University students’ perceptions of the automated feedback program Grammarly. Australasian Journal of Educational Technology, 35(1), 42-56. https://doi.org/10.14742/ajet.3795


Olivia, S. W. (2020). Teachers’ perception on the use of English textbooks in teaching English. Jambi-English Language Teaching Journal, 5(1), 11-21.


Papadakis, S. (2021). Advances in mobile learning educational research (A.M.L.E.R.): Mobile learning as an educational reform. Advances in Mobile Learning Educational Research, 1(1), 1-4.


Park, Y. C. (2022). Learner experiences during the design-based research process for a problem-based instructional design course. Journal of Educational Technology Systems, 50(4), 448-472. https://doi.org/10.1177/00472395211073679


Pelgrum W.J. (2021). Obstacles to the integration of AI in education: results from a worldwide educational assessment. Computers & Education, 37(1), 163-178.


Phan, P., Wright, M., & Lee, S. H. (2017). Of robots, artificial intelligence, and work. Academy of Management Perspectives, 31(4), 253-255.


Piaget, J. (1964). Cognitive development in children development and learning. Journal of Research in Science Teaching, 2, 176-186.


Rahmati, J., Izadpanah, S. & Shahnavaz, A. (2021). A meta-analysis on educational technology in English language teaching. Language Testing in Asia 11(7), 1-20. https://doi.org/10.1186/s40468-021-00121-w


Riasati, M. J., & Zare, D. (2010). Textbook evaluation: EFL teachers’ perspectives on “new interchange”. Studies in Literature and Language, 1(8), 54-60.


Saekhow, J., & Cheewaviriyanon, C. (2021). Effects of online-media training integrated with active learning on the development of 21st century skills for teachers in Ranong province, Thailand. IJAEDU-International E-Journal of Advances in Education, 7(20), 117-121. http://ijaedu.ocerintjournals.org/en/download/articlefile/1880155


Sakamoto, J., & Tsuruta, Y. (2017). A study on the impact of explanation of effectiveness of self-learning in English through the Internet on learner’s awareness and behavior. Journal of Jsee, 65(3), 349-353.


Sánchez-Prieto, J. C., Cruz-Benito, J., Therón Sánchez, R., & García Peñalvo, F. J. (2020). Assessed by machines: Development of a TAM-based tool to measure ai-based assessment acceptance among students. International Journal of Interactive Multimedia and Artificial Intelligence, 6(4), 80–86. https://doi.org/10.9781/ijimai.2020.11.009


Schuetz, S. & Venkatesh, V. (2020). The Rise of human machines: How cognitive computing systems challenge assumptions of user-system interaction. Journal of the Association for Information Systems, 21(2), 460-482.


Shadiev, R., & Yang, M. (2020). Review of studies on technology-enhanced language learning and teaching. Sustainability, 12(2), 524-546. https://doi.org/10.3390/su12020524.


Shahrol, S., Sulaiman, M., Samingan, H., & Mohamed, H. (2020). A systematic literature review on teaching and learning English using mobile technology. International Journal of Information and Education Technology, 10(9), 709-714. https://doi.org/10.18178/ijiet.2020.10.9.1447


Smale, W. T., Hutcheson, R., & Russo, C. J. (2021). Cell phones, student rights, and school safety: finding the right balance. Canadian Journal of Educational Administration and Policy, 195, 49-64. https://doi.org/10.7202/1075672ar


Stephen, B., Galloway, S., & Burt, G. (2017). Self-learning load characteristic models for smart appliances. IEEE Transactions on Smart Grid, 5(5), 2432–2439.


Topal, A. D., Eren, C. D., & Geçer, A. K. (2021). Chatbot application in a 5th grade science course. Education and Information Technologies, 26, 6241-6265. https://doi.org/10.1007/s10639-021-10627-8


Troussas, C., Virvou, M., & Alepis, E. (2014). Collaborative learning: Group interaction in an intelligent mobile-assisted multiple language learning system. Informatics in Education 13(2), 279-292. https://doi.org/10.15388/infedu.2014.17


Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes. Harvard University Press.


Wang X, Chen J, Zhang T. (2021). Facilitating English grammar learning by a personalized mobile-assisted system with a self-regulated learning mechanism. Front Psychol, 12(1), 1-30. https://doi.org/10.3389/fpsyg.2021.624430


Zhang, Z., & Hyland, K. (2018). Student engagement with teacher and automated feedback on L2 writing. Assessing Writing, 36(1), 90-102. https://doi.org/10.1016/j.asw.2018.02.004


Zhu, D. (2017). Analysis of the application of artificial intelligence in college English teaching. Advances in Intelligent Systems Research, 134, 235-237. https://doi.org/10.2991/caai-17.2017.52



DOI: https://doi.org/10.46223/HCMCOUJS.soci.en.15.2.3184.2025
Creative Commons License
© The Author(s) 2025. This is an open access publication under CC BY NC licence.