TrueRate: Operationalizing Sentiment Analysis for Accurate Smartphone App Rating Inference

Keywords

• Sentiment analysis
• DeBERTa
• BERT
• online customer reviews
• star rating prediction
• online reviews
• app reviews
• usability evaluation

CCDS Authors

Ashraful Islam, PhD

Ashraful Islam, PhD

• Center Director, CCDS
• Director, HCI Wing

Assistant Professor

Department of Computer Science and Engineering

Independent University, Bangladesh (IUB)

Published at

CHI, UIST, UbiComp, IJCNN, ICIP, HCII, ICDMW, BLP, IEEE Internet of Things Journal, JMIR, JMIR Human Factors, JMIR Formative Research, IEEE Access, Smart Agricultural Technology, Diabetes Research and Clinical Practice, PLOS ONE

Research Interests

Human-Computer Interaction, AI for Social Good, AI for Public Health, AI for Impact

AKM Mahbubur Rahman, PhD

AKM Mahbubur Rahman, PhD

• Director, DS & IPT Wings

Associate Professor

Department of Computer Science and Engineering

Independent University, Bangladesh

Published at

CHI, ECCV, WACV, PAKDD, LREC, IJCNN, ICPR, ICIP, HCII, BEA, Scientific Reports, Information Sciences

Prof. M Ashraful Amin, PhD

Prof. M Ashraful Amin, PhD

• Founder Director, CCDS
• Director, AI/ML, HCI & DS Wings

Professor

+1 more affiliation

Department of Information Sciences and Technology

George Mason University, USA

Published at

ACL, CHI, UbiComp, ECAI, WACV, PAKDD, IJCNN, ICPR, ICIP, HCII, CLEF, BLP, Scientific Reports, JMIR, IEEE Access, Smart Agricultural Technology, Frontiers in Computational Neuroscience, Diabetes Research and Clinical Practice, PLOS ONE

Research Interests

Machine Learning, Cognitive & Vision Science, Cybernetics, Surveillance & Security, ICT in Education, Health, & Agriculture, Human-Computer Interaction, Internet of Things, Robotics

References

1. 1.Prokopia Vlachogianni, Nikolaos Tselios. (2021). Perceived usability evaluation of educational technology using the System Usability Scale (SUS): A systematic review. Journal of Research on Technology in Education, 54(3), 392–409[10.1080/15391523.2020.1867938]
2. 2.Shivaji Alaparthi, Manit Mishra. (2021). BERT: a sentiment analysis odyssey. Journal of Marketing Analytics, 9(2), 118–126[10.1057/s41270-021-00109-8]
3. 3.Andrea Papenmeier, Dagmar Kern, Gwenn Englebienne, Christin Seifert. (2022). It’s Complicated: The Relationship between User Trust, Model Accuracy and Explanations in AI. ACM Transactions on Computer-Human Interaction, 29(4), 1–33[10.1145/3495013]
4. 4.Saima Sadiq, Muhammad Umer, Saleem Ullah, Seyedali Mirjalili, Vaibhav Rupapara, Michele Nappi. (2021). Discrepancy detection between actual user reviews and numeric ratings of Google App store using deep learning. Expert Systems with Applications, 181, 115111[10.1016/j.eswa.2021.115111]
5. 5.Yao Cai, Weimao Ke, Eric Cui, Fei Yu. (2021). A deep recommendation model of cross-grained sentiments of user reviews and ratings. Information Processing & Management, 59(2), 102842[10.1016/j.ipm.2021.102842]
6. 6.Andy Crabtree. (2025). H is for human and how (not) to evaluate qualitative research in HCI. Human-Computer Interaction, 1–24[10.1080/07370024.2025.2475743]
7. 7.Basem H. Ahmed, Ayman S. Ghabayen. (2020). Review rating prediction framework using deep learning. Journal of Ambient Intelligence and Humanized Computing, 13(7), 3423–3432[10.1007/s12652-020-01807-4]
8. 8.Felix Putze, Susanne Putze, Merle Sagehorn, Christopher Micek, Erin T. Solovey. (2022). Understanding HCI Practices and Challenges of Experiment Reporting with Brain Signals: Towards Reproducibility and Reuse. ACM Transactions on Computer-Human Interaction, 29(4), 1–43[10.1145/3490554]
9. 9.Rahul Aralikatte, Giriprasad Sridhara, Neelamadhav Gantayat, Senthil Mani. (2018). Fault in your stars. , 57–66[10.1145/3152494.3152500]
10. 10.Andrea Papenmeier, Dagmar Kern, Daniel Hienert, Yvonne Kammerer, Christin Seifert. (2022). How Accurate Does It Feel? – Human Perception of Different Types of Classification Mistakes. CHI Conference on Human Factors in Computing Systems, 1–13[10.1145/3491102.3501915]
11. 11.Turki Aljrees, Muhammad Umer, Oumaima Saidani, Latifah Almuqren, Abid Ishaq, Shtwai Alsubai, Ala’ Abdulmajid Eshmawi, Imran Ashraf. (2024). Contradiction in text review and apps rating: prediction using textual features and transfer learning. PeerJ Computer Science, 10, e1722[10.7717/peerj-cs.1722]
12. 12.Azade Asadi Damavandi, Louisa Ha. (2024). e–WOM and app stores in Iran: how online reviews influence purchase intention of paid mobile apps. Journal of Islamic marketing, 15(12), 3649–3665[10.1108/jima-02-2024-0069]
13. 13.Nahed Alowidi, Reem Alnanih, Nahed Alsaleh. (2024). Hybrid Deep Learning Approach for Automating App Review Classification: Advancing Usability Metrics Classification with an Aspect-Based Sentiment Analysis Framework. Computers, materials & continua/Computers, materials & continua (Print), 82(1), 949–976[10.32604/cmc.2024.059351]
14. 14.Djarot Hindarto. (2023). Comparison of RNN Architectures and Non-RNN Architectures in Sentiment Analysis. SinkrOn, 8(4), 2537–2546[10.33395/sinkron.v8i4.13048]
15. 15.Lin Sun, Yuting He, Feng Fu. (2025). Impact of online negative and positive reviews on app innovation. PLoS ONE, 20(5), e0323205[10.1371/journal.pone.0323205]
16. 16.J. M. Sadik-Ul Islam Smaron, Yousra Tabassum, M.M. Simoon, Zara Rahman, Lishan Rafid, Ashraful Islam. (2023). A Comparative Overview of Local Mobile Financial Services Smartphone Apps Available in Bangladesh. , 1–6[10.1109/itms59786.2023.10317677]
17. 17.Jiarui Ye, Reetam Biswas, Nilamadhab Mishra. (2024). DeBERTa-Based Social Media Sentiment Analysis: A Cryptocurrency Case Study. , 1–5[10.1109/icec59683.2024.10837213]
18. 18.Mst. Tamanna Akter. (2025). The AI-Driven Future of Mobile Finance: Understanding User Perceptions in Bangladesh. Bangladesh Journal of MIS, 11(1), 47[10.61606/bjmis.v11n1a3]
19. 19.Ahmad Aulia Zakiyal Fikri, Hafidz Ridho. (2025). Identification of Inconsistent Reviews and Ratings on Apps Using Sentiment Analysis: Case Study on Indonesian Digital Media Platform. Metris Jurnal Sains dan Teknologi, 26(01), 39–50[10.25170/metris.v26i01.6779]