Conference Paper2025

Generative Data Augmentation for Improving Semantic Classification

Shadman Rohan, Mahmud Elahi Akhter, Ibraheem Muhammad Moosa, Nabeel Mohammed, Amin Ahsan Ali, Akmmahbubur Rahman

Proceedings of the Second Workshop on Bangla Language Processing (BLP-2025)

Association for Computational Linguistics, pp. 347-356

Abstract

We study sentence-level generative data augmentation for Bangla semantic classification across four public datasets and three pretrained model families (BanglaBERT, XLM-Indic, mBERT).We evaluate two widely used, reproducible techniquesparaphrasing (mT5-based) and round-trip backtranslation (BnEnBn)and analyze their impact under realistic class imbalance.Overall, augmentation often helps, but gains are tightly coupled to label quality: paraphrasing typically outperforms backtranslation and yields the most consistent improvements for the monolingual model, whereas multilingual encoders benefit less and can be more sensitive to noisy minority-class expansions.A key empirical observation is that the neutral class appears to be a major source of annotation noise, which degrades decision boundaries and can cap the benefits of augmentation even when positive/negative classes are clean and polarized.We provide practical guidance for Bangla sentiment pipelines: (i) use simple sentence-level augmentation to rebalance classes when labels are reliable; (ii) allocate additional curation and higher interannotator agreement targets to the neutral class.Our results indicate when augmentation helps and suggest that data qualitynot model choice alonecan become the limiting factor.

Keywords

  • generative data augmentation
  • paraphrase
  • noisy annotations
  • multilingual BERT
  • class imbalance
  • BanglaBERT
  • multilingual pretrained models
  • label quality

CCDS Authors

Shadman Rohan
Shadman Rohan

Shadman Rohan

  • Research Assistant, CCDS

Published at

CHI, BEA, BLP

Research Interests

Machine Learning, Natural Language Processing

Amin Ahsan Ali, PhD
Amin Ahsan Ali, PhD

Amin Ahsan Ali, PhD

  • Director, AI/ML Wing

Professor

Department of Computer Science and Engineering

Independent University, Bangladesh

Published at

ACL, CHI, UbiComp, ECCV, IJCAI, ECAI, WACV, IPSN, PAKDD, LREC, IJCNN, ICPR, ICIP, BEA, BLP, ICMLA, Scientific Reports, Scientific Data, Pattern Recognition, Information Sciences, Ad Hoc Networks, Drug and Alcohol Dependence, PLOS ONE

Research Interests

Artificial Intelligence, Machine Learning