Conference Paper2025

Enhancing Bangla Cyberbullying Detection with Data Augmentation: A Performance Evaluation

MD Mohaymen Ul Anam, Ajwad Abrar, Maheen Mashrur Haque, Jahanggir Hossain Setu, Ashraful Islam, M Ashraful Amin

2025 IEEE 23rd Student Conference on Research and Development (SCOReD)

IEEE, pp. 1-6

  • Peace, Justice and Strong Institutions — Relevance: 79%

Abstract

Cyberbullying is a growing concern in digital communication, particularly in low-resource languages such as Bangla, where the lack of labeled data poses a challenge for automated detection systems. This study evaluates how data augmentation improves Bangla cyberbullying detection by addressing class imbalance in the Bangla Online Comments dataset (44,001 samples). We developed an augmented dataset by applying synonym replacement, random swap, back-translation, and paraphrasing techniques, expanding the dataset with 6,081 additional samples. A comparative evaluation is conducted using traditional machine learning models (Support Vector Machine (SVM), Random Forest, eXtreme Gradient Boosting (XGBoost)), deep learning architectures (Bidirectional Long Short-Term Memory (BiLSTM)), and transformer-based models (BanglaBERT). The experimental setup considers both binary and multiclass classification performance. Experimental results show that data augmentation improved overall multiclass accuracy by up to 2%, while substantially enhancing F1 scores for minority classes such as threat (21.88% to 69.19%) and religious (71.65% to 73.83%). Among all models, BiLSTM achieved the highest performance, reaching 80.39% accuracy in multiclass and 86.65% in binary classification. While overall accuracy gains are modest, significant F1-score improvements for underrepresented classes demonstrate augmentation’s efficacy in addressing imbalance. This study contributes to the growing field of NLP for low-resource languages by providing insight into augmentation techniques for text classification. Additionally, we identified certain limitations in existing Bangla data augmentation techniques, which may affect the quality and diversity of generated samples.

Keywords

  • back-translation
  • cyberbullying detection
  • Bengali language
  • BiLSTM
  • paraphrase
  • data augmentation
  • multi-class text classification
  • BanglaBERT
  • class imbalance
  • synonym replacement

CCDS Authors

Ashraful Islam, PhD
Ashraful Islam

Ashraful Islam, PhD

  • Center Director, CCDS
  • Director, HCI Wing

Assistant Professor

Department of Computer Science and Engineering

Independent University, Bangladesh (IUB)

Published at

CHI, UIST, UbiComp, IJCNN, ICIP, HCII, ICDMW, BLP, IEEE Internet of Things Journal, JMIR, JMIR Human Factors, JMIR Formative Research, IEEE Access, Smart Agricultural Technology, Diabetes Research and Clinical Practice, PLOS ONE

Research Interests

Human-Computer Interaction, AI for Social Good, AI for Public Health, AI for Impact

Prof. M Ashraful Amin, PhD
M Ashraful Amin, PhD

Prof. M Ashraful Amin, PhD

  • Founder Director, CCDS
  • Director, AI/ML, HCI & DS Wings

Professor

+1 more affiliation

Department of Information Sciences and Technology

George Mason University, USA

Published at

ACL, CHI, UbiComp, ECAI, WACV, PAKDD, IJCNN, ICPR, ICIP, HCII, CLEF, BLP, Scientific Reports, JMIR, IEEE Access, Smart Agricultural Technology, Frontiers in Computational Neuroscience, Diabetes Research and Clinical Practice, PLOS ONE

Research Interests

Machine Learning, Cognitive & Vision Science, Cybernetics, Surveillance & Security, ICT in Education, Health, & Agriculture, Human-Computer Interaction, Internet of Things, Robotics

References

  1. 1.Candice Bentéjac, Anna Csörgő, Gonzalo Martínez-Muñoz. (2020). A comparative analysis of gradient boosting algorithms. Artificial Intelligence Review, 54(3), 1937–1967[10.1007/s10462-020-09896-5]
  2. 2.Philipp Probst, Marvin N. Wright, Anne‐Laure Boulesteix. (2019). Hyperparameters and tuning strategies for random forest. Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery, 9(3)[10.1002/widm.1301]
  3. 3.Jan N. van Rijn, Frank Hutter. (2018). Hyperparameter Importance Across Datasets. , 2367–2376[10.1145/3219819.3220058]
  4. 4.Xuchu Jiang, Chao Song, Yucheng Xu, Ying Li, Yili Peng. (2022). Research on sentiment classification for netizens based on the BERT-BiLSTM-TextCNN model. PeerJ Computer Science, 8, e1005[10.7717/peerj-cs.1005]
  5. 5.Sayan Putatunda, Kiran Rama. (2019). A Modified Bayesian Optimization based Hyper-Parameter Tuning Approach for Extreme Gradient Boosting. , 1–6[10.1109/icinpro47689.2019.9092025]
  6. 6.Fatema Tuj Johora Faria, Laith H. Baniata, Sangwoo Kang. (2024). Investigating the Predominance of Large Language Models in Low-Resource Bangla Language over Transformer Models for Hate Speech Detection: A Comparative Analysis. Mathematics, 12(23), 3687[10.3390/math12233687]
  7. 7.Damien A. Dablain, Nitesh V. Chawla. (2024). Data Augmentation's Effect on Machine Learning Models when Learning with Imbalanced Data. , 1–10[10.1109/dsaa61799.2024.10722815]
  8. 8.Ajwad Abrar, Farzana Tabassum, Sabbir Ahmed. (2024). Performance Evaluation of Large Language Models in Bangla Consumer Health Query Summarization. , 2748–2753[10.1109/iccit64611.2024.11022034]
  9. 9.Md. Khalid Syfullah, Rohul Amin, Md. Manirujjaman, Md. Mahadi Hasan, Md. Ragib Abid, Saad Ahmed. (2024). Detecting and Understanding Cyberbullying in Bengali: An Explainable AI Approach. , 1–7[10.1109/compas60761.2024.10797170]
  10. 10.T Dhakshnamoorthi, M Giriraj, S Gokul, K Vanitha. (2024). Improving Cyberbullying Detection Accuracy with Advanced Machine Learning Models. , 1–5[10.1109/csitss64042.2024.10817024]
  11. 11.Ananta Yudiarso, Anastasia Jesseline, Stefani Lusia Litmantoro. (2024). Cyberbullying in Social Media. Journal of Health and Behavioral Science, 6(3)[10.35508/jhbs.v6i3.18675]
  12. 12.Aifa Faruque, Hossen A Mustafa. (2024). A Semi-Supervised Approach for Identifying Cyberbullying Text in Bangla Language. , 628–633[10.1109/iceeict62016.2024.10534433]
  13. 13.Saraswati Patil, Shubhan Punde, Prince Sahani, Abhinav Salve. (2024). Multi-Model Ensemble Approach for Enhanced Cyberbullying Detection Across Diverse Categories. , 195–202[10.1109/icicnis64247.2024.10823191]