Detecting spelling errors in Vietnamese administrative document using large language models Author - Affiliation: Huan The Phung - Thai Nguyen University of Information and Communication Technology, Thai Nguyen , Vietnam Nghia Van Luong - Pham Van Dong University, Quang Ngai , Vietnam Corresponding author: Huan The Phung - pthuan@ictu.edu.vn DOI:10.46223/HCMCOUJS.tech.en.14.1.3141.2024 Submitted: 22-12-2023 Accepted: 02-02-2024 Published: 05-03-2024

Abstract

In the context of the emergence of more and more administrative documents, the need to ensure accuracy and improve the quality of these documents becomes increasingly important. This research focuses on applying advanced language models to detect spelling errors in administrative documents. Specifically, in this study, a new method using a language model based on the Transformers architecture is proposed to automatically detect and correct common spelling errors in administrative documents. This method combines the model’s ability to understand context and grammar to identify words or phrases that are likely to be misspelled. The proposed method is tested on a dataset containing real administrative documents, and the experimental results show that the proposed model is capable of detecting spelling errors with significant performance, helping to improve accuracy. and improve the quality of administrative documents. This research not only contributes to improving the quality of administrative documents but also opens up new research directions in applying language models to issues related to natural language processing in the field of administration.