Conference Paper2023

Initial Development and Performance Evaluation of a Bengali Voice-Operated Virtual Assistant for Personal Computer Control

R. M. Quiah, S. Akter, S. Ahmed, M. M. Rahman, S. A. Alam, A. Islam

2023 IEEE 64th International Scientific Conference on Information Technology and Management Science of Riga Technical University (ITMS)

IEEE, pp. 1-6

  • Reduced Inequalities — Relevance: 82%
DOI: 10.1109/itms59786.2023.10317730URL

Abstract

This paper presents the preliminary development and performance evaluation of a personal computer assistant designed for voice-operated interaction in Bengali. A bespoke phonetic grammar has been devised to map Bengali phonemes onto English representations, and an algorithm has been developed to mitigate the confusion of the machine in recognizing the same type of phonetics in the language, which helps to enhance the precision in comprehending Bengali commands. The system integrates the Microsoft speech synthesizer to articulate speech in Bengali, which facilitates the expansive human-computer interaction capabilities of the system, particularly for visually impaired individuals who face challenges in text-based computer interactions. The applications of this system extend among Bengali speakers and hold potential utility within rural regions of Bangladesh. The system also aims to replace the traditional mouse and keyboard for users with their own voice commands in their native language. Upon successful implementation of the system, it achieved 92.5% accuracy in the noise-free environment and 76.4% accuracy in the noisy environment with the help of 10 Bangladeshi individuals, including both males and females.

Keywords

  • Speech recognition
  • Speech synthesis
  • assistive technology for visually impaired
  • Bengali language
  • Human-Computer Interaction
  • phoneme mapping
  • low-resource languages
  • rural Bangladesh

References

  1. 1.Julia Hirschberg, Christopher D. Manning. (2015). Advances in natural language processing. Science, 349(6245), 261–266[10.1126/science.aaa8685]
  2. 2.Jack FitzGerald, Shankar Ananthakrishnan, Konstantine Arkoudas, Davide Bernardi, Abhishek Bhagia, Claudio Delli Bovi, Jin Cao, Rakesh Chada, Amit Chauhan, Luoxin Chen, Anurag Dwarakanath, Satyam Dwivedi, Turan Gojayev, Karthik Gopalakrishnan, Thomas Gueudre, Dilek Hakkani-Tur, Wael Hamza, Jonathan J. Hüser, Kevin Martin Jose, Haidar Khan, Beiye Liu, Jianhua Lu, Alessandro Manzotti, Pradeep Natarajan, Karolina Owczarzak, Gokmen Oz, Enrico Palumbo, Charith Peris, Chandana Satya Prakash, Stephen Rawls, Andy Rosenbaum, Anjali Shenoy, Saleh Soltan, Mukund Harakere Sridhar, Lizhen Tan, Fabian Triefenbach, Pan Wei, Haiyang Yu, Shuai Zheng, Gokhan Tur, Prem Natarajan. (2022). Alexa Teacher Model. Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 2893–2902[10.1145/3534678.3539173]
  3. 3.Chen Yan, Xiaoyu Ji, Kai Wang, Qinhong Jiang, Zizhi Jin, Wenyuan Xu. (2022). A Survey on Voice Assistant Security: Attacks and Countermeasures. ACM Computing Surveys, 55(4), 1–36[10.1145/3527153]
  4. 4.Saadman Shahid Chowdhury, Atiar Talukdar, Ashik Mahmud, Tanzilur Rahman. (2018). Domain Specific Intelligent Personal Assistant with Bilingual Voice Command Processing. , 0731–0734[10.1109/tencon.2018.8650203]
  5. 5.Dipankar Gupta, Emam Hossain, Mohammad Shahadat Hossain, Karl Andersson, Sazzad Hossain. (2019). A Digital Personal Assistant using Bangla Voice Command Recognition and Face Detection. , 116–121[10.1109/raaicon48939.2019.47]
  6. 6.Md. Wahidur Rahman, Rahabul Islam, Md. Mahmodul Hasan, Shisir Mia, Mohammad Motiur Rahman. (2020). IoT Based Smart Assistant for Blind Person and Smart Home Using the Bengali Language. SN Computer Science, 1(5)[10.1007/s42979-020-00317-6]
  7. 7.Yousuf Hossain, Ishan Arefin Hossain, Mridul Banik, Ishan Arefin Hossain, Amitabha Chakrabarty. (2018). Embedded System based Bangla Intelligent Social Virtual Robot with Sentiment Analysis. , 322–327[10.1109/iciev.2018.8641023]
  8. 8.Md. Rakibuz Sultan, Md Moinul Hoque, Farah Ulfath Heeya, Iftiquar Ahmed, Md. Redwanul Ferdouse, Shikder Mejbah Ahmed Mubin. (2021). Adrisya Sahayak: A Bangla Virtual Assistant for Visually Impaired. 2021 2nd International Conference on Robotics, Electrical and Signal Processing Techniques (ICREST), 597–602[10.1109/icrest51555.2021.9331080]
  9. 9.Rajan Saha Raju, Prithwiraj Bhattacharjee, Arif Ahmad, Mohammad Shahidur Rahman. (2019). A Bangla Text-to-Speech System using Deep Neural Networks. , 1–5[10.1109/icbslp47725.2019.202055]
  10. 10.Nafis Sadeq, Shafayat Ahmed, Sudipta Saha Shubha, Md. Nahidul Islam, Muhammad Abdullah Adnan. (2020). Bangla Voice Command Recognition in end-to-end System Using Topic Modeling based Contextual Rescoring. , 7894–7898[10.1109/icassp40776.2020.9053970]
  11. 11.Shehan Irteza Pranto, Rahad Arman Nabid, Ahnaf Mozib Samin, Nabeel Mohammed, Farhana Sarker, Mohammad Nurul Huda, Khondaker A. Mamun. (2021). Human-Robot Interaction in Bengali language for Healthcare Automation integrated with Speaker Recognition and Artificial Conversational Entity. , 13–16[10.1109/iceee54059.2021.9718797]
  12. 12.Shehan Irteza Pranto, Rahad Arman Nabid, Ahnaf Mozib Samin, Nabeel Mohammed, Farhana Sarker, Mohammad Nurul Huda, Khondaker A. Mamun. (2021). AIMS TALK: Intelligent Call Center Support in Bangla Language with Speaker Authentication. , 1–6[10.1109/etcce54784.2021.9689831]
← All publications