Conference Paper2020Cited by 23

An Automated System in ATM Booth Using Face Encoding and Emotion Recognition Process

Atiqul Islam Chowdhury, Mohammad Munem Shahriar, Ashraful Islam, Eshtiak Ahmed, Asif Karim, Mohammad Rezwanul Islam

2020 2nd International Conference on Image Processing and Machine Vision

ACM, pp. 57–62

DOI: 10.1145/3421558.3421567URL

Abstract

Nowadays, the banking transaction system is more flexible than the previous one. When the banking sector introduces the ATM booth to us, it was a step ahead to ease the human effort. Here, ATM booth is an automated teller machine that gives out money to the consumer by inserting a card in it. All ATM booths support both credit and debit cards for the transaction, and this has saved everyone's time. But still, there are some certain situations, i.e., forgetting the card authentication details for a transaction can ruin a consumer's day. For this reason, this paper has tried to propose a system that will help everyone regarding this situation. This proposed system is about face encoding process with an emotion recognition test for making transactions faster and accurate, based on Convolutional Neural Network (CNN). However, normal card transactions can still be possible besides using the proposed system. FER2013 dataset was used for training and then tested the model using our own sample images. The result shows that the proposed system can correctly separate ‘Happy’ faces from other emotional faces and allow the transaction to proceed.

Keywords

  • Emotion recognition
  • automated teller machines
  • FER2013 dataset
  • convolutional neural networks
  • face encoding
  • banking transactions
  • facial expression recognition
  • card authentication

CCDS Authors

Ashraful Islam, PhD
Ashraful Islam

Ashraful Islam, PhD

  • Center Director, CCDS
  • Director, HCI Wing

Published at

CHI, UIST, UbiComp, IJCNN, ICIP, HCII, ICDMW, BLP, Pattern Recognition, IEEE Internet of Things Journal, JMIR, JMIR Human Factors, JMIR Formative Research, IEEE Access, Smart Agricultural Technology, Diabetes Research and Clinical Practice, PLOS ONE

Eshtiak Ahmed
Eshtiak Ahmed

Eshtiak Ahmed

  • Collaborator, HCI Wing

  • Doctoral Researcher

    Gamification Group

    Tampere University, Finland

Published at

UbiComp, ICIP, HCII, IEEE Access

References

  1. 1.Imane Lasri, Anouar Riad Solh, Mourad El Belkacemi. (2019). Facial Emotion Recognition of Students using Convolutional Neural Network. , 1–6[10.1109/icds47004.2019.8942386]
  2. 2.Masum Shah Junayed, Afsana Ahsan Jeny, Syeda Tanjila Atik, Nafis Neehal, Asif Karim, Sami Azam, Bharanidharan Shanmugam. (2019). AcneNet - A Deep CNN Based Classification Approach for Acne Classes. , 203–208[10.1109/icts.2019.8850935]
  3. 3.Anis-Ul-Islam Rafid, Amit Raha Niloy, Atiqul Islam Chowdhury, Nusrat Sharmin. (2020). A Brief Review on Different Driver’s Drowsiness Detection Techniques. International Journal of Image Graphics and Signal Processing, 12(3), 41–50[10.5815/ijigsp.2020.03.05]
  4. 4.Anna D. Sergeeva, A. V. Savin, Victoria A. Sablina, Olga V. Melnik. (2019). Emotion Recognition from Micro-Expressions: Search for the Face and Eyes. , 2, 1–4[10.1109/meco.2019.8760029]
  5. 5.Anmol Uppal, Shweta Tyagi, Rishi Kumar, Seema Sharma. (2019). Emotion recognition and drowsiness detection using Python. , 464–469[10.1109/confluence.2019.8776617]
  6. 6.Moulay Smail Bouzakraoui, Abdelalim Sadiq, Abdessamad Youssfi Alaoui. (2019). Appreciation of Customer Satisfaction Through Analysis Facial Expressions and Emotions Recognition. , 1–5[10.1109/icocs.2019.8930761]
  7. 7.Laduona Dai, Joost Broekens, Khiet P. Truong. (2019). Real-time pain detection in facial expressions for health robotics. , 277–283[10.1109/aciiw.2019.8925192]
  8. 8.Irawan Dwi Wahyono, Djoko Saryono, Muhammad Ashar, Khoirudin Asfani, Sunarti Sunarti. (2019). Face Emotional Detection using Computational Intelligence based Ubiquitous Computing. 2019 International Seminar on Application for Technology of Information and Communication (iSemantic), 1, 389–393[10.1109/isemantic.2019.8884320]
  9. 9.Abdoul Matine Ousmane, Tahirou Djara, Faizath Jedida Zoumarou W., Antoine Vianou. (2019). Automatic recognition system of emotions expressed through the face using machine learning: Application to police interrogation simulation. , 1–4[10.1109/biosmart.2019.8734245]
  10. 10.Filip Filipović, Marijana Despotović‐Zrakić, Božidar Radenković, B.R. Jovanić, Lazar Živojinović. (2019). An Application of Artificial Intelligence for Detecting Emotions in Neuromarketing. , 49–494[10.1109/ic-aiai48757.2019.00016]
  11. 11.I. Gusti Ngurah Made Kris Raya, Agung Nugroho Jati, Randy Erfa Saputra. (2017). Analysis realization of Viola-Jones method for face detection on CCTV camera based on embedded system. , 2, 1–5[10.1109/robionetics.2017.8203427]
  12. 12.Alexandra M. Cadayona, Nicole Meredith S. Cerilla, Darla Monica M. Jurilla, Ariel Kelly D. Balan, Joel C. De Goma. (2019). Emotional State Classification: An Additional Step in Emotion Classification through Face Detection. 2019 IEEE 6th International Conference on Industrial Engineering and Applications (ICIEA), 667–671[10.1109/iea.2019.8715171]
  13. 13.Oliver Roesler, David Suendermann‐Oeft. (2019). Towards Visual Behavior Detection in Human-Machine Conversations. , 36–39[10.1109/iciev.2019.8858547]
  14. 14.(2018). 2018 International Conference on Artificial Intelligence Applications and Innovations (IC-AIAI). [10.1109/ic-aiai46012.2018]

Cited By

  1. 1.Abrar Fahim, Mehedi Hasan, Muhtasim Alam Chowdhury. (2021). Smart parking systems: comprehensive review based on various aspects. Heliyon, 7(5), e07050[10.1016/j.heliyon.2021.e07050]
  2. 2.Deepanita Baidya, Umme Umaima, Md Nazrul Islam, F. M. Javed Mehedi Shamrat, Anik Pramanik, Md. Sadekur Rahman. (2022). A Deep Prediction of Chronic Kidney Disease by Employing Machine Learning Method. International Conference on Trends in Electronics and Informatics (ICOEI), 1305–1310[10.1109/icoei53556.2022.9776876]
  3. 3.F.M. Javed Mehedi Shamrat, Sovon Chakraborty, Md. Masum Billah, Md. Al Jubair, Md Saidul Islam, Rumesh Ranjan. (2021). Face Mask Detection using Convolutional Neural Network (CNN) to reduce the spread of Covid-19. International Conference on Trends in Electronics and Informatics (ICOEI), 1231–1237[10.1109/icoei51242.2021.9452836]
  4. 4.F.M. Javed Mehedi Shamrat, Md. Al Jubair, Md. Masum Billah, Sovon Chakraborty, Md. Alauddin, Rumesh Ranjan. (2021). A Deep Learning Approach for Face Detection using Max Pooling. International Conference on Trends in Electronics and Informatics (ICOEI), 760–764[10.1109/icoei51242.2021.9452896]
  5. 5.Rida Zahra, Afifa Shehzadi, Muhammad Imran Sharif, Asif Karim, Sami Azam, Friso De Boer, Mirjam Jonkman, Mehwish Mehmood. (2023). Camera-based interactive wall display using hand gesture recognition. Intelligent Systems with Applications, 19, 200262[10.1016/j.iswa.2023.200262]
  6. 6.Yasmeen ELsayed, Ashraf ELSayed, Mohamed A. Abdou. (2023). An automatic improved facial expression recognition for masked faces. Neural Computing and Applications, 35(20), 14963–14972[10.1007/s00521-023-08498-w]
  7. 7.Si Thu Aung, Mehedi Hassan, Mark Brady, Zubaer Ibna Mannan, Sami Azam, Asif Karim, Sadika Zaman, Yodchanan Wongsawat. (2022). Entropy-Based Emotion Recognition from Multichannel EEG Signals Using Artificial Neural Network. Computational Intelligence and Neuroscience, 2022, 1–13[10.1155/2022/6000989]
  8. 8.Rashiduzzaman Shakil, Bonna Akter, Fahad Faisal, Tahmid Rashik Chowdhury, Tonmoy Roy, Ankit Khater. (2022). A Promising Prediction of Diabetes Using a Deep Learning Approach. International Conference on Computing Methodologies and Communication (ICCMC), 923–927[10.1109/iccmc53470.2022.9753763]
  9. 9.Lei Zhou, Chuanlin Liu, Amit Yadav, Sami Azam, Asif Karim. (2024). An image quality assessment method based on edge extraction and singular value for blurriness. Machine Vision and Applications, 35(3)[10.1007/s00138-024-01522-6]
  10. 10.Anis-Ul-Islam Rafid, Atiqul Islam Chowdhury, Amit Raha Niloy, Nusrat Sharmin. (2021). A Deep Learning Based Approach for Real-time Driver Drowsiness Detection. International Conference on Electrical Engineering and Information Communication Technology, 1–5[10.1109/iceeict53905.2021.9667944]
  11. 11.Shumukh M. Aljuaid, Arshiya S. Ansari. (2021). Automated Teller Machine Authentication Using Biometric. Computer Systems Science and Engineering, 41(3), 1009–1025[10.32604/csse.2022.020785]
  12. 12.Md Abdullah Al Nasim, Atiqul Islam Chowdhury, Jannatun Naeem Muna, Faisal Muhammad Shah. (2021). An Automated Approach for the Recognition of Bengali License Plates. 2021 International Conference on Electronics, Communications and Information Technology (ICECIT), 1–4[10.1109/icecit54077.2021.9641214]
  13. 13.Ankita Guleria, Kewal Krishan, Vishal Sharma, Tanuj Kanchan. (2024). Global adoption of facial recognition technology with special reference to India—Present status and future recommendations. Medicine Science and the Law, 64(3), 236–244[10.1177/00258024241227717]
  14. 14.Shammy Shikder Shanta, Md. Sham-E-Ansari, Atiqul Islam Chowdhury, Mohammad Munem Shahriar, Md. Khairul Hasan. (2021). A Comparative Analysis of Different Approach for Basic Emotions Recognition from Speech. 2021 International Conference on Electronics, Communications and Information Technology (ICECIT), 1–4[10.1109/icecit54077.2021.9641208]
  15. 15.F. M. Javed Mehedi Shamrat, Sovon Chakraborty, Md. Shakil Moharram, Tonmoy Roy, Masudur Rahman, Biraj Saha Aronya. (2022). A Transfer Learning Approach for Face Recognition Using Average Pooling and MobileNetV2. Lecture notes on data engineering and communications technologies, 531–541[10.1007/978-981-16-9416-5_38]
  16. 16.Lamima Tabassum Ava, Asif Karim, Md. Mehedi Hassan, Fahad Faisal, Sami Azam, A S M Farhan Al Haque, Sadika Zaman. (2023). Intelligent Identification of Hate Speeches to address the increased rate of Individual Mental Degeneration. Procedia Computer Science, 219, 1527–1537[10.1016/j.procs.2023.01.444]
  17. 17.Laksha B. S, Krishnavani M. (2024). FaceSecure ATM: Enhanced Transaction Security with Haar Cascade Facial Detection. International Conference on Advanced Computing and Communication Systems (ICACCS), 2190–2194[10.1109/icaccs60874.2024.10717033]
  18. 18.Cuddapah Anitha, John E P, K. Kathiresan, N.J Krishnakumar., V. Karthik, J. Sasidevi. (2022). Retracted: Emotion Identification and Detection from Multichannel EEG Signals Using Artificial Neural Network. International Conference on Contemporary Computing and Informatics (IC3I), 2070–2074[10.1109/ic3i56241.2022.10073039]
  19. 19.Sana Inayath, Srinivas Kanakala. (2023). Detection of Chronic Kidney Disease Using Machine Learning Algorithms. International Conference on Advances in Computing, Communication Control and Networking (ICAC3N), 12, 825–832[10.1109/icac3n60023.2023.10541795]
  20. 20.F.M. Javed Mehedi Shamrat, Shohag Kumar Bhowmik, Mst. Fahmida Muntasim, Tafsirul Islam Nibir, Tahmid Rashik Chowdhury, Sittal Thapa. (2021). Comparative Analysis of Human Face Recognition Using SURF and Neural Network Methods. International Conference on Smart Electronics and Communication (ICOSEC), 8, 984–988[10.1109/icosec51865.2021.9591722]
  21. 21.Felci Christina A, Addlin Vini V N, K Sherin, A R Dharshika Kelin. (2025). ATM Transaction Using Facial Detection. International Conference on Data Science, Agents & Artificial Intelligence (ICDSAAI), 1–6[10.1109/icdsaai65575.2025.11011854]
  22. 22.Sintayehu Zekarias Esubalew, Ashenafi Kifleyohans Birhanu, Fikir Awoke Fantahun. (2023). Classification and Detection of Prohibited Objects in X-Ray Baggage Security Images. Communications in computer and information science, 277–296[10.1007/978-3-031-31327-1_16]
  23. 23.Md. Touhidul Islam. (2023). Practices of Artificial Intelligence (Ai) to Improve the Business in Bangladesh. SSRN Electronic Journal[10.2139/ssrn.4467146]
← All publications