Conference Paper2026

Pre-Development Evaluation of a Conversational User Interface for English Learning among Bangladeshi University Students

Deawan Rakin Ahamed Remal, Sinthia Chowdhury, Jahanggir Hossain Setu, Ashraful Islam, M Ashraful Amin

2026 International Conference on Advanced Computing Technologies (ICACT)

IEEE, pp. 1-8

Abstract

Developing functional Artificial Intelligence-powered English-learning systems requires natural language processing (NLP) infrastructure, automatic speech recognition (ASR) for local accents, and financial resources that remain unevenly available across institutions in the Global South. This imbalance creates a structural early-stage research paradox: researchers cannot meaningfully evaluate a Conversational User Interface (CUI) without building, yet cannot justify building one without prior evidence of learner acceptance. We address this paradox with a sequential exploratory mixed-methods design in two purposively sampled phases with Bangladeshi university students. A needs assessment (N = 15) of semi-structured interviews underwent reflexive thematic analysis, surfacing eight interconnected themes. These themes were synthesized into a single, customisable low-fidelity prototype with features, including tone, visual markers, bilingual support, and pronunciation guidance. A perception evaluation (N = 37, purposive sampling) combined five-point likert ratings with semi-structured interviews. Aggregate ratings were positive but heterogeneous (e.g., Clarity M = 3.94, SD = 1.12; Trust M = 3.29, SD = 0.91). We derive seven design recommendations for early-stage formative research. The study presents a pre-deployment evaluation pipeline that translates formative findings into a coherent, customisable design concept and generates design insights before functional system development.

Keywords

  • conversational interfaces
  • English language learning
  • needs assessment
  • low-fidelity prototypes
  • learner acceptance
  • trust in AI
  • formative assessment
  • Global South
  • design guidelines

CCDS Authors

Ashraful Islam, PhD
Ashraful Islam

Ashraful Islam, PhD

  • Center Director, CCDS
  • Director, HCI Wing

Published at

CHI, UIST, UbiComp, IJCNN, ICIP, HCII, ICDMW, BLP, ICMLA, Scientific Data, Pattern Recognition, IEEE Internet of Things Journal, JMIR, JMIR Human Factors, JMIR Formative Research, IEEE Access, Smart Agricultural Technology, Diabetes Research and Clinical Practice, PLOS ONE

Prof. M Ashraful Amin, PhD
M Ashraful Amin, PhD

Prof. M Ashraful Amin, PhD

  • Founder Director, CCDS
  • Director, AI/ML, HCI & DS Wings

Published at

ACL, CHI, UbiComp, ECAI, WACV, PAKDD, LREC, IJCNN, ICPR, ICIP, HCII, CLEF, BLP, ICMLA, Scientific Reports, Pattern Recognition, JMIR, IEEE Access, Smart Agricultural Technology, Frontiers in Computational Neuroscience, Diabetes Research and Clinical Practice, PLOS ONE

References

  1. 1.Weixin Liang, Girmaw Abebe Tadesse, Daniel Ho, L. Fei-Fei, Matei Zaharia, Ce Zhang, James Zou. (2022). Advances, challenges and opportunities in creating data for trustworthy AI. Nature Machine Intelligence, 4(8), 669–677[10.1038/s42256-022-00516-1]
  2. 2.Jinming Du, Ben Kei Daniel. (2024). Transforming language education: A systematic review of AI-powered chatbots for English as a foreign language speaking practice. Computers and Education Artificial Intelligence, 6, 100230[10.1016/j.caeai.2024.100230]
  3. 3.Yong Cao, Li Zhou, Seolhwa Lee, Laura Cabello, Min Chen, Daniel Hershcovich. (2023). Assessing Cross-Cultural Alignment between ChatGPT and Human Societies: An Empirical Study. Workshop on Cross-Cultural Considerations in NLP (C3NLP), 53–67[10.18653/v1/2023.c3nlp-1.7]
  4. 4.Mohammad Mosiur Rahman, Md Shaiful Islam, Abdul Karim, Takad Ahmed Chowdhury, Muhammad Mushfiqur Rahman, Prodhan Mahbub Ibna Seraj, Manjet Kaur Mehar Singh. (2019). English language teaching in Bangladesh today: Issues, outcomes and implications. Language Testing in Asia, 9(1), 9[10.1186/s40468-019-0085-8]
  5. 5.Yan Li, Xinyan Zhou, Hong-biao Yin, Thomas K. F. Chiu. (2025). Design language learning with artificial intelligence (AI) chatbots based on activity theory from a systematic review. Smart Learning Environments, 12(1), 24[10.1186/s40561-025-00379-0]
  6. 6.Aiqin Shi, Faren Huo, Guanhua Hou. (2021). Effects of Design Aesthetics on the Perceived Value of a Product. Frontiers in Psychology, 12, 670800[10.3389/fpsyg.2021.670800]
  7. 7.Elin Ericsson, Sylvana Sofkova Hashemi, Johan Lundin. (2023). Fun and frustrating: Students’ perspectives on practising speaking English with virtual humans. Cogent Education, 10(1), 2170088[10.1080/2331186x.2023.2170088]
  8. 8.Nomfundo Gladys Khoza, Freda van der Walt. (2025). A systematic review on AI-enhanced pedagogies in higher education in the Global South. Frontiers in Education, 10, 1667884[10.3389/feduc.2025.1667884]
  9. 9.Amrita Ganguly, Nafisa Mehjabin, Aqdas Malik, Aditya Johri. (2025). Conversational AI agents in education: an umbrella review of current utilization, challenges, and future directions for ethical and responsible use. AI and Ethics, 6(1), 72[10.1007/s43681-025-00916-0]
  10. 10.Mohammad (Matt) Namvarpour, Afsaneh Razi. (2025). The Art of Talking Machines: A Comprehensive Literature Review of Conversational User Interfaces. ACM Conference on Conversational User Interfaces (CUI), 1–18[10.1145/3719160.3736621]
  11. 11.Georgia Channing, Avijit Ghosh. (2026). AI for scientific discovery is a social problem. Patterns, 7(3), 101497[10.1016/j.patter.2026.101497]
  12. 12.Yanbin Huang, Phadet Kakham. (2026). The impacts of AI conversational agents on EFL learners' oral proficiency and foreign language speaking anxiety. Frontiers in Education, 11, 1799269[10.3389/feduc.2026.1799269]
  13. 13.Rahul R. Divekar, Haley Lepp, Pravin Chopade, Aaron Albin, Daniel Brenner, Vikram Ramanarayanan. (2021). Conversational Agents in Language Education: Where They Fit and Their Research Challenges. Communications in computer and information science, 272–279[10.1007/978-3-030-90179-0_35]
  14. 14.Jean-Michel Latulippe, Riadh Ladhari. (2026). Chatbot Adoption: A Systematic Literature Review. Journal of theoretical and applied electronic commerce research, 21(4), 98[10.3390/jtaer21040098]
  15. 15.Noor Syamimi Binti Zawawi, Siti Balqis Binti Abdul Aziz, Amirun Hariz Bin Azmi, Amirul Shafiq Bin Abdul Razak, Nurul Syahirah Binti Mohamad Nasir, Mohammad Radzi bin Manap, Mohammad Radzi bin Manap. (2025). The Impact of English Proficiency in Enhancing Employment Opportunities Among University Students. International Journal of Research and Innovation in Social Science, 9(22), 321–327[10.47772/ijriss.2025.922ileiid0031]
  16. 16.Md Rashed Khan Milon, Tamanna Mohammed Ali. (2023). From Language Movement to Language Policy: A Critical Examination of English in Bangladeshi Tertiary Education. ICRRD Quality Index Research Journal, 4(4)[10.53272/icrrd.v4i4.1]
  17. 17.Kashpia Afroz Mridula, Wahid bin Ahsan. (2025). Bridging the English Proficiency Gap: The Higher Education Challenges of Bangla-Medium Students in Bangladesh. Userhub Journal[10.58947/journal.svfz89]
  18. 18.Adi Isma, Amrang Amrang, Ridwan Ridwan, Rusdiah Rusdiah. (2025). Examining the Link Between English Proficiency and Academic Performance Among EFL Undergraduate Students. Journal of Teaching and Education for Scholars, 2(1), 24–33[10.59065/jotes.v2i1.198]
  19. 19.Neelma Bhatti, Timothy L. Stelter, Scott McCrickard, Aisling Kelliher. (2021). Conversational User Interfaces As Assistive Interlocutors For Young Children’s Bilingual Language Acquisition. ACM International Conference on Interactive Media Experiences, 208–211[10.1145/3452918.3465498]
  20. 20.Yulia Hapsari, Esti Junining, Devinta Puspita Ratri. (2017). THE NEED OF ENGLISH AT HIGHER EDUCATION. Indonesian EFL Journal, 3(1), 31[10.25134/ieflj.v3i1.651]
  21. 21.Monther M. Elaish, Ahmed Al-Azawei, Elaheh Yadegaridehkordi, Mahmood H. Hussein, Gwo-Jen Hwang, Bootheina Majoul, Lynda Ouchaouka, Saad Alaaraj. (2026). A comparative study of students’ adoption and usage of mobile learning in developing countries: Tunisia, Morocco, and Libya. Educational Technology Research and Development, 74(2), 1187–1220[10.1007/s11423-026-10613-2]
  22. 22.S M Asif Rahman. (2024). Language Policy and English Education in Bangladesh: A Critical Analysis. International Journal of Research and Innovation in Social Science, VIII(I), 1925–1932[10.47772/ijriss.2024.801140]
  23. 23.(2015). THEMATIC ANALYSIS. SAGE Publications Ltd eBooks[10.4135/9781412986281.n339]
  24. 24.Peter Buxmann, Thomas Hess, Jason Bennett Thatcher. (2020). AI-Based Information Systems. Business & Information Systems Engineering, 63(1), 1–4[10.1007/s12599-020-00675-8]