--

14 (1) 2024

Enhancing face-to-face evaluation using alternative optical mark recognition: A case study from the University of Cabuyao’s college of education


Author - Affiliation:
Ronnel Pumares Cuerdo - University of Cabuyao, Laguna
Lyra Xyza Llagas Sinfuego - DepEd-City Schools Division of Cabuyao, Laguna
Corresponding author: Ronnel Pumares Cuerdo - ronnelcuerdo@gmail.com
Submitted: 14-08-2023
Accepted: 23-10-2023
Published: 29-02-2024

Abstract
Technology is defined as the use of scientific knowledge to solve practical problems. However, educators’ initiatives to integrate technology have been mostly prohibitively expensive. In this context, researchers proposed the automation of one of the most important processes but highly repetitive tasks among educators, the processing of student test results. The aim was to determine the alignment with evaluation standards and the acceptability of a cost-effective alternative. This study utilized a mixed-method approach, specifically concurrent triangulation. Quantitative and qualitative data were gathered concurrently, and then compared and combined the results to get a comprehensive understanding of the topic. Quantitatively, it involved the use of mean, standard deviation, t-test, and Cohen’s d to evaluate Alternative Optical Mark Recognition (AOMR) according to the required educators’ evaluation standards and its impact on reducing educators’ clerical workload. Qualitatively, semi-structured interviews and thematic analysis were employed to elucidate educators’ perspectives regarding the use of AOMR and the broader integration of technology as a whole. Results showed a one-hundred-thirty times efficiency compared to the manual process without losing the accuracy and reliability of data. Participants underscored the positive effect of AOMR in diminishing the labor-intensive nature of a crucial yet arduous clerical task for educators. Additionally, participants also emphasized unexpected benefits, including email results distribution, backup e-copies of sheets, ease of data management, class record integration, and automated student ranking. These findings offer valuable insights into the challenges surrounding the integration of technology in educational contexts in general, shedding light on the advantages of AOMR in the evaluation of student test results, in particular.

Keywords
alternative optical mark recognition; Evalbee; integrating automation; student test evaluation; technology in education

Full Text:
PDF

Cite this paper as:

Cuerdo, R. P., & Sinfuego, L. X. L. (2024). Enhancing face-to-face evaluation using alternative optical mark recognition: A case study from the University of Cabuyao’s college of education. Ho Chi Minh City Open University Journal of Science – Social Sciences, 14(1), 118-132. doi:10.46223/HCMCOUJS.soci.en.14.1.2905.2024


References

Anderson, J., & Lee, R. (2018). The future of well-being in a tech-saturated world. Retrieved May 10, 2023, from Pew Research Center website: https://assets.pewresearch.org/wp%20content/uploads/sites/14/2018/04/14154552/PI_2018.04.17_Future-of-Well-Being_FINAL.pdf


Cabigas, L. M. (2019). Who let the teachers out: Exploring the main factors contributing to teacher attrition in Philippine schools. Retrieved May 10, 2023, from https://www.academia.edu/39721541/Who_Let_the_Teachers_Out_Exploring_the_Main_Factors_which_Contribute_to_Teacher_Attrition_in_Philippine_Schools


Calaguas, N. P., & Consunji, P. P. (2022). Mobile optical mark recognition application as a non-inferior alternative to manual marking for lower- and middle-income countries. PSU Journal of Advanced Studies, 5, 10-19.


Catalan, J. A. (2017). A framework for automated multiple-choice exam scoring with digital image and assorted processing using readily available software. Manila, Philippines: De La Salle University.


Commission on Higher Education. (2022). CHED memorandum order no. 16, series of 2022. “Update on onsite learning in higher education”. Retrieved May 10, 2023, from https://ched.gov.ph/2022-ched-memorandum-orders/


Cuerdo, R. P. (2021). Effectiveness of automation in evaluating test results using alternative Optical Mark Recognition (OMR) (Master’s thesis). Laguna State Polytechnic University, Los Baños, Laguna, Philippines. 


Cuerdo, R. P., Ison, M. J. B., & Oñate, C. D. T. (2021). Effectiveness of automation in evaluating test results using evalbee as an alternative Optical Mark Recognition (OMR): A quantitative-evaluative approach from a Philippine public school. International Journal of Theory and Application in Elementary and Secondary School Education, 3(2), 61-75. doi:10.31098/ijtaese.v3i2.661


David, C., Albert, J. R., & Vizmanos, J. F. (2019). Pressures on public school teachers and implications on quality. Retrieved May 10, 2023, from https://pidswebs.pids.gov.ph/CDN/ PUBLICATIONS/pidspn1901.pdf


Department of Education. (2016). DO 55, s. 2016 - Policy guidelines on the national assessment of student learning for the K to 12 basic education program. Retrieved May 10, 2023, from Department of Education website: https://www.deped.gov.ph/2016/06/30/do-55-s-2016-policy-guidelines-on-the-national-assessment-of-student-learning-for-the-k-to-12-basic-education-program/


Department of Education. (2020). DO 31, s. 2020 - Interim guidelines for assessment and grading in light of the basic education learning continuity plan. Retrieved May 10, 2023, from Department of Education website: https://www.deped.gov.ph/2020/10/02/october-2-2020-do-031-s-2020-interim-guidelines-for-assessment-and-grading-in-light-of-the-basic-education-learning-continuity-plan/


Desideri, L., Witte, L., Chattat, R., & Hoogerwerf, E.-J. (2019). AAATE 2019 Conference - Global challenges in assistive technology: Research, policy & practice. Technology and Disability, 31(1), 5-6. doi:10.3233/TAD-190003


EvalBee. (n.d.). An intelligent OMR Answer sheet scanner. Retrieved May 10, 2023, from Evalbee website: https://evalbee.com/privacy-policy


Galgo, J. J., & Balbaguio, R. C. (2022). Utilization of EvalBee application in improving learners’ performance assessment recording. International Journal of Open-access, Interdisciplinary & New Educational Discoveries of ETCOR Educational Research Center, 1(3), 124-129.


Gonella, F., Almeida, C. M. V. B., Fiorentino, G., Handayani, K., Spanò, F., Testoni, R., & Zucaro, A. (2019). Is technology optimism justified? A discussion towards a comprehensive narrative. Journal of Cleaner Production, 223, 456-465. doi:10.1016/j.jclepro.2019.03.126


Google Play Terms of Service. (n.d.). (2023) Play.google.com. Retrieved May 10, 2023, from https://play.google.com/intl/en-us_us/about/play-terms/index.html


Groover, M. P. (2023). Automation. Retrieved May 10, 2023, from Encyclopedia Britannica website: https://www.britannica.com/technology/automation


Joaquin, J. J., Biana, H. T., & Dacela, M. A. (2020). The Philippine higher education sector in the time of Covid-19. Frontiers in Education, 5. doi:10.3389/feduc.2020.576371


Palanas, D. M., Alinsod, A. A., & Capunitan, P. M. (2019). Digital assessment: Empowering 21st century teachers in analyzing student’s performance in Calamba City. JPAIR Institutional Research Journal, 13(1), 1-14.


Philippine Statistics Authority. (2020). Labor Turnover Statistics: third and fourth quarters of 2019. Retrieved May 10, 2023, from Philippine Statistics Authority website: https://psa.gov.ph/statistics/labor-turnover-survey/node/162870


Republic of the Philippines. (n.d.).  R.A. 4670 Magna carta for public school teachers. Senate of the Philippines Legislative Reference Bureau. Retrieved May 10, 2023, from Issuances-Library.senate.gov.ph website: https://issuances-library.senate.gov.ph/subject/magna-carta-public-school-teachers-ra-4670


Sahin, S., & Ilkin, S. (2018). Flexible and efficient mobile optical mark recognition. Journal of Electronic Imaging, 27(3). doi:10.1117/1.JEI.27.3.033007


Statista. (2023). Number of smartphone users in the Philippines from 2019 to 2028. Retrieved May 10, 2023, from Statista website: https://www.statista.com/statistics/467186/forecast-of-smartphone-users-in-the-philippines/


Techopedia. (2023). What is automation? - Definition from Techopedia. Retrieved May 10, 2023, from Techopedia website: https://www.techopedia.com/definition/32099/automation


Tomczyk, Ł., Jáuregui, V. C., de La Higuera Amato, C. A., Muñoz, D., Arteaga, M., Oyelere, S. S., & Porta, M. (2020). Are teachers techno-optimists or techno-pessimists? A pilot comparison among teachers in Bolivia, Brazil, the Dominican Republic, Ecuador, Finland, Poland, Turkey, and Uruguay. Educational Information Technology, 26(6), 2715-2741. doi:10.1007/s10639-020-10380-4


Virtus, L. M. (2019). Performance mapping of Optical Mark Recognition (OMR) machines in the division of Batangas City: Basis for program enhancement. International Journal of Advanced Research and Publications, 3(9), 2456-9992.


Vydra, S., & Klievink, B. (2019). Techno-optimism and policy-pessimism in the public sector big data debate. Government Information Quarterly, 36(4), Article 101383. doi:10.1016/j.giq.2019.05.010



Creative Commons License
© The Author(s) 2024. This is an open access publication under CC BY NC licence.