An Automated System in ATM Booth Using Face Encoding and Emotion Recognition Process

Abstract

Keywords

• Emotion recognition
• automated teller machines
• FER2013 dataset
• convolutional neural networks
• face encoding
• banking transactions
• facial expression recognition
• card authentication

CCDS Authors

Ashraful Islam, PhD

Ashraful Islam, PhD

• Center Director, CCDS
• Director, HCI Wing

Assistant Professor

Department of Computer Science and Engineering

Independent University, Bangladesh (IUB)

Published at

CHI, UIST, UbiComp, IJCNN, ICIP, HCII, ICDMW, BLP, IEEE Internet of Things Journal, JMIR, JMIR Human Factors, JMIR Formative Research, IEEE Access, Smart Agricultural Technology, Diabetes Research and Clinical Practice, PLOS ONE

Research Interests

Human-Computer Interaction, AI for Social Good, AI for Public Health, AI for Impact

Eshtiak Ahmed

Eshtiak Ahmed

• Collaborator, HCI Wing

Doctoral Researcher

Gamification Group

Tampere University, Finland

Published at

UbiComp, ICIP, HCII, IEEE Access

Research Interests

Human-Computer Interaction, Human-Robot Interaction, Gamification and Assistive Technologies

References

1. 1.Imane Lasri, Anouar Riad Solh, Mourad El Belkacemi. (2019). Facial Emotion Recognition of Students using Convolutional Neural Network. , 1–6[10.1109/icds47004.2019.8942386]
2. 2.Masum Shah Junayed, Afsana Ahsan Jeny, Syeda Tanjila Atik, Nafis Neehal, Asif Karim, Sami Azam, Bharanidharan Shanmugam. (2019). AcneNet - A Deep CNN Based Classification Approach for Acne Classes. , 203–208[10.1109/icts.2019.8850935]
3. 3.Anis-Ul-Islam Rafid, Amit Raha Niloy, Atiqul Islam Chowdhury, Nusrat Sharmin. (2020). A Brief Review on Different Driver’s Drowsiness Detection Techniques. International Journal of Image Graphics and Signal Processing, 12(3), 41–50[10.5815/ijigsp.2020.03.05]
4. 4.Anna D. Sergeeva, A. V. Savin, Victoria A. Sablina, Olga V. Melnik. (2019). Emotion Recognition from Micro-Expressions: Search for the Face and Eyes. , 2, 1–4[10.1109/meco.2019.8760029]
5. 5.Anmol Uppal, Shweta Tyagi, Rishi Kumar, Seema Sharma. (2019). Emotion recognition and drowsiness detection using Python. , 464–469[10.1109/confluence.2019.8776617]
6. 6.Moulay Smail Bouzakraoui, Abdelalim Sadiq, Abdessamad Youssfi Alaoui. (2019). Appreciation of Customer Satisfaction Through Analysis Facial Expressions and Emotions Recognition. , 1–5[10.1109/icocs.2019.8930761]
7. 7.Laduona Dai, Joost Broekens, Khiet P. Truong. (2019). Real-time pain detection in facial expressions for health robotics. , 277–283[10.1109/aciiw.2019.8925192]
8. 8.Irawan Dwi Wahyono, Djoko Saryono, Muhammad Ashar, Khoirudin Asfani, Sunarti Sunarti. (2019). Face Emotional Detection using Computational Intelligence based Ubiquitous Computing. 2019 International Seminar on Application for Technology of Information and Communication (iSemantic), 1, 389–393[10.1109/isemantic.2019.8884320]
9. 9.Abdoul Matine Ousmane, Tahirou Djara, Faizath Jedida Zoumarou W., Antoine Vianou. (2019). Automatic recognition system of emotions expressed through the face using machine learning: Application to police interrogation simulation. , 1–4[10.1109/biosmart.2019.8734245]
10. 10.Filip Filipović, Marijana Despotović‐Zrakić, Božidar Radenković, B.R. Jovanić, Lazar Živojinović. (2019). An Application of Artificial Intelligence for Detecting Emotions in Neuromarketing. , 49–494[10.1109/ic-aiai48757.2019.00016]
11. 11.I. Gusti Ngurah Made Kris Raya, Agung Nugroho Jati, Randy Erfa Saputra. (2017). Analysis realization of Viola-Jones method for face detection on CCTV camera based on embedded system. , 2, 1–5[10.1109/robionetics.2017.8203427]
12. 12.Alexandra M. Cadayona, Nicole Meredith S. Cerilla, Darla Monica M. Jurilla, Ariel Kelly D. Balan, Joel C. De Goma. (2019). Emotional State Classification: An Additional Step in Emotion Classification through Face Detection. 2019 IEEE 6th International Conference on Industrial Engineering and Applications (ICIEA), 667–671[10.1109/iea.2019.8715171]
13. 13.Oliver Roesler, David Suendermann‐Oeft. (2019). Towards Visual Behavior Detection in Human-Machine Conversations. , 36–39[10.1109/iciev.2019.8858547]
14. 14.(2018). 2018 International Conference on Artificial Intelligence Applications and Innovations (IC-AIAI). [10.1109/ic-aiai46012.2018]

Cited By

1. 1.Abrar Fahim, Mehedi Hasan, Muhtasim Alam Chowdhury. (2021). Smart parking systems: comprehensive review based on various aspects. Heliyon, 7(5), e07050[10.1016/j.heliyon.2021.e07050]
2. 2.F.M. Javed Mehedi Shamrat, Sovon Chakraborty, Md. Masum Billah, Md. Al Jubair, Md Saidul Islam, Rumesh Ranjan. (2021). Face Mask Detection using Convolutional Neural Network (CNN) to reduce the spread of Covid-19. 2021 5th International Conference on Trends in Electronics and Informatics (ICOEI), 1231–1237[10.1109/icoei51242.2021.9452836]
3. 3.Deepanita Baidya, Umme Umaima, Md Nazrul Islam, F. M. Javed Mehedi Shamrat, Anik Pramanik, Md. Sadekur Rahman. (2022). A Deep Prediction of Chronic Kidney Disease by Employing Machine Learning Method. 2022 6th International Conference on Trends in Electronics and Informatics (ICOEI), 1305–1310[10.1109/icoei53556.2022.9776876]
4. 4.F.M. Javed Mehedi Shamrat, Md. Al Jubair, Md. Masum Billah, Sovon Chakraborty, Md. Alauddin, Rumesh Ranjan. (2021). A Deep Learning Approach for Face Detection using Max Pooling. 2021 5th International Conference on Trends in Electronics and Informatics (ICOEI), 760–764[10.1109/icoei51242.2021.9452896]
5. 5.Rida Zahra, Afifa Shehzadi, Muhammad Imran Sharif, Asif Karim, Sami Azam, Friso De Boer, Mirjam Jonkman, Mehwish Mehmood. (2023). Camera-based interactive wall display using hand gesture recognition. Intelligent Systems with Applications, 19, 200262[10.1016/j.iswa.2023.200262]
6. 6.Yasmeen ELsayed, Ashraf ELSayed, Mohamed A. Abdou. (2023). An automatic improved facial expression recognition for masked faces. Neural Computing and Applications, 35(20), 14963–14972[10.1007/s00521-023-08498-w]
7. 7.Si Thu Aung, Mehedi Hassan, Mark Brady, Zubaer Ibna Mannan, Sami Azam, Asif Karim, Sadika Zaman, Yodchanan Wongsawat. (2022). Entropy-Based Emotion Recognition from Multichannel EEG Signals Using Artificial Neural Network. Computational Intelligence and Neuroscience, 2022, 1–13[10.1155/2022/6000989]
8. 8.Shumukh M. Aljuaid, Arshiya S. Ansari. (2021). Automated Teller Machine Authentication Using Biometric. Computer Systems Science and Engineering, 41(3), 1009–1025[10.32604/csse.2022.020785]
9. 9.Md Abdullah Al Nasim, Atiqul Islam Chowdhury, Jannatun Naeem Muna, Faisal Muhammad Shah. (2021). An Automated Approach for the Recognition of Bengali License Plates. 2021 International Conference on Electronics, Communications and Information Technology (ICECIT), 1–4[10.1109/icecit54077.2021.9641214]
10. 10.Rashiduzzaman Shakil, Bonna Akter, Fahad Faisal, Tahmid Rashik Chowdhury, Tonmoy Roy, Ankit Khater. (2022). A Promising Prediction of Diabetes Using a Deep Learning Approach. 2022 6th International Conference on Computing Methodologies and Communication (ICCMC), 923–927[10.1109/iccmc53470.2022.9753763]
11. 11.Anis-Ul-Islam Rafid, Atiqul Islam Chowdhury, Amit Raha Niloy, Nusrat Sharmin. (2021). A Deep Learning Based Approach for Real-time Driver Drowsiness Detection. , 1–5[10.1109/iceeict53905.2021.9667944]
12. 12.Lei Zhou, Chuanlin Liu, Amit Yadav, Sami Azam, Asif Karim. (2024). An image quality assessment method based on edge extraction and singular value for blurriness. Machine Vision and Applications, 35(3)[10.1007/s00138-024-01522-6]
13. 13.Ankita Guleria, Kewal Krishan, Vishal Sharma, Tanuj Kanchan. (2024). Global adoption of facial recognition technology with special reference to India—Present status and future recommendations. Medicine Science and the Law, 64(3), 236–244[10.1177/00258024241227717]
14. 14.Shammy Shikder Shanta, Md. Sham-E-Ansari, Atiqul Islam Chowdhury, Mohammad Munem Shahriar, Md. Khairul Hasan. (2021). A Comparative Analysis of Different Approach for Basic Emotions Recognition from Speech. 2021 International Conference on Electronics, Communications and Information Technology (ICECIT), 1–4[10.1109/icecit54077.2021.9641208]
15. 15.F. M. Javed Mehedi Shamrat, Sovon Chakraborty, Md. Shakil Moharram, Tonmoy Roy, Masudur Rahman, Biraj Saha Aronya. (2022). A Transfer Learning Approach for Face Recognition Using Average Pooling and MobileNetV2. Lecture notes on data engineering and communications technologies, 531–541[10.1007/978-981-16-9416-5_38]
16. 16.Laksha B. S, Krishnavani M. (2024). FaceSecure ATM: Enhanced Transaction Security with Haar Cascade Facial Detection. , 2190–2194[10.1109/icaccs60874.2024.10717033]
17. 17.Cuddapah Anitha, John E P, K. Kathiresan, N.J Krishnakumar., V. Karthik, J. Sasidevi. (2022). Retracted: Emotion Identification and Detection from Multichannel EEG Signals Using Artificial Neural Network. , 2070–2074[10.1109/ic3i56241.2022.10073039]
18. 18.F.M. Javed Mehedi Shamrat, Shohag Kumar Bhowmik, Mst. Fahmida Muntasim, Tafsirul Islam Nibir, Tahmid Rashik Chowdhury, Sittal Thapa. (2021). Comparative Analysis of Human Face Recognition Using SURF and Neural Network Methods. 2021 2nd International Conference on Smart Electronics and Communication (ICOSEC), 8, 984–988[10.1109/icosec51865.2021.9591722]
19. 19.Sana Inayath, Srinivas Kanakala. (2023). Detection of Chronic Kidney Disease Using Machine Learning Algorithms. , 12, 825–832[10.1109/icac3n60023.2023.10541795]
20. 20.Felci Christina A, Addlin Vini V N, K Sherin, A R Dharshika Kelin. (2025). ATM Transaction Using Facial Detection. , 1–6[10.1109/icdsaai65575.2025.11011854]
21. 21.Sintayehu Zekarias Esubalew, Ashenafi Kifleyohans Birhanu, Fikir Awoke Fantahun. (2023). Classification and Detection of Prohibited Objects in X-Ray Baggage Security Images. Communications in computer and information science, 277–296[10.1007/978-3-031-31327-1_16]
22. 22.Md. Touhidul Islam. (2023). Practices of Artificial Intelligence (Ai) to Improve the Business in Bangladesh. SSRN Electronic Journal[10.2139/ssrn.4467146]