Conference Paper2023Cited by 2

BaTEClaCor: A Novel Dataset for Bangla Text Error Classification and Correction

N Oshin, S Hoque, M Fahim, A A Ali, MA Amin, AKMM Rahman

1st Workshop on Bangla Language Processing in conjunction with EMNLP

Association of Computational Linguistics, pp. 124-135

DOI: 10.18653/v1/2023.banglalp-1.14Open AccessURL

Abstract

In the context of the dynamic realm of Bangla communication, online users are often prone to bending the language or making errors due to various factors. We attempt to detect, categorize, and correct those errors by employing several machine learning and deep learning models. To contribute to the preservation and authenticity of the Bangla language, we introduce a meticulously categorized organic dataset encompassing 10,000 authentic Bangla comments from a commonly used social media platform. Through rigorous comparative analysis of distinct models, our study highlights BanglaBERT’s superiority in error-category classification and underscores the effectiveness of BanglaT5 for text correction. BanglaBERT achieves accuracy of 79.1% and 74.1% for binary and multiclass error-category classification while the BanglaBERT is fine-tuned and tested with our proposed dataset. Moreover, BanglaT5 achieves the best Rouge-L score (0.8459) when BanglaT5 is fine-tuned and tested with our corrected ground truths. Beyond algorithmic exploration, this endeavor represents a significant stride in enhancing the quality of digital discourse in the Bangla-speaking community, fostering linguistic precision and coherence in online interactions. The dataset and code is available at https://github.com/SyedT1/BaTEClaCor.

Keywords

  • text error correction
  • BanglaBERT
  • social media comments
  • Bengali language
  • fine-tuning

References

  1. 1.Jakubův, Jan, Chvalovský, Karel, Goertzel, Zarathustra, Kaliszyk, Cezary, Olšák, Mirek, Piotrowski, Bartosz, Schulz, Stephan, Suda, Martin, Urban, Josef. (2023). Exploiting Generative AI to Scale up Intelligent Tutoring Systems. DROPS (Schloss Dagstuhl – Leibniz Center for Informatics)[10.4230/lipics.itp.2023.19]
  2. 2.Yoon Kim. (2014). Convolutional Neural Networks for Sentence Classification. , 1746–1751[10.3115/v1/d14-1181]
  3. 3.Abhik Bhattacharjee, Tahmid Hasan, Wasi Ahmad, Kazi Samin Mubasshir, Md Saiful Islam, Anindya Iqbal, M. Sohel Rahman, Rifat Shahriyar. (2022). BanglaBERT: Language Model Pretraining and Benchmarks for Low-Resource Language Understanding Evaluation in Bangla. Findings of the Association for Computational Linguistics: NAACL 2022, 1318–1327[10.18653/v1/2022.findings-naacl.98]
  4. 4.Seyyed Mohammad Hossein Dadgar, Mohammad Shirzad Araghi, Morteza Mastery Farahani. (2016). A novel text mining approach based on TF-IDF and Support Vector Machine for news classification. , 112–116[10.1109/icetech.2016.7569223]
  5. 5.Nilam Nur Amir Sjarif, Nurulhuda Firdaus Mohd Azmi, Suriayati Chuprat, Haslina Md Sarkan, Yazriwati Yahya, Suriani Mohd Sam. (2019). SMS Spam Message Detection using Term Frequency-Inverse Document Frequency and Random Forest Algorithm. Procedia Computer Science, 161, 509–515[10.1016/j.procs.2019.11.150]
  6. 6.Zhang Qi. (2020). The Text Classification of Theft Crime Based on TF-IDF and XGBoost Model. , 1241–1246[10.1109/icaica50127.2020.9182555]
  7. 7.M. F. Mridha, Md. Abdul Hamid, Md. Mashod Rana, Md. Eyaseen Arafat Khan, Md. Masud Ahmed, Mohammad Tipu Sultan. (2019). Semantic Error Detection and Correction in Bangla Sentence. , 184–189[10.1109/iciev.2019.8858522]
  8. 8.Tanni Mittra, Sadia Nowrin, Linta Islam, Deepak Chandra Roy. (2019). A Bangla Spell Checking Technique to Facilitate Error Correction in Text Entry Environment. 2019 1st International Conference on Advances in Science, Engineering and Robotics Technology (ICASERT), 18, 1–6[10.1109/icasert.2019.8934461]
  9. 9.Anonymous. (2023). BSpell: A CNN-Blended BERT Based Bengali Spell Checker. Zenodo (CERN European Organization for Nuclear Research)[10.5281/zenodo.8176653]
  10. 10.Shahgir, H. A. Z. Sameen, Sayeed, Khondker Salman. (2023). Bangla Grammatical Error Detection Using T5 Transformer Model. arXiv (Cornell University)[10.48550/arxiv.2303.10612]

Cited By

  1. 1.Parishmita Sinha, Anup Kumer Shil, Ameya Debnath. (2025). Bangla Advice Text Classification: A Novel Dataset and Comparative Study of Machine Learning and Deep Learning Models. , 5116–5121[10.1109/iccit68739.2025.11491558]
  2. 2.Anik Mahmud Shanto, Hasan Murad. (2025). Bn-Grammarly: A Dataset for Bengali Grammatical Error Correction. , 2843–2848[10.1109/iccit68739.2025.11491660]
← All publications