Book Chapter2025Cited by 1

Optimizing Software Release Management with GPT-Enabled Log Anomaly Detection

Jahanggir Hossain Setu, Md. Shazzad Hossain, Nabarun Halder, Ashraful Islam, M. Ashraful Amin

Pattern Recognition

Springer Nature Switzerland, pp. 351-365, ISBN: 9783031781650

DOI: 10.1007/978-3-031-78166-7_23URL

Keywords

  • log anomaly detection
  • software release management
  • word embeddings
  • sentence embeddings
  • sequence labeling
  • online anomaly detection
  • CatBoost
  • BERT comparison
  • system reliability
  • HDFS logs

CCDS Authors

Nabarun Halder
Nabarun Halder

Nabarun Halder

  • Research Assistant, CCDS

Published at

UbiComp, IJCNN, HCII, Pattern Recognition, IEEE Access

Ashraful Islam, PhD
Ashraful Islam

Ashraful Islam, PhD

  • Center Director, CCDS
  • Director, HCI Wing

Published at

CHI, UIST, UbiComp, IJCNN, ICIP, HCII, ICDMW, BLP, Pattern Recognition, IEEE Internet of Things Journal, JMIR, JMIR Human Factors, JMIR Formative Research, IEEE Access, Smart Agricultural Technology, Diabetes Research and Clinical Practice, PLOS ONE

Prof. M Ashraful Amin, PhD
M Ashraful Amin, PhD

Prof. M Ashraful Amin, PhD

  • Founder Director, CCDS
  • Director, AI/ML, HCI & DS Wings

Published at

ACL, CHI, UbiComp, ECAI, WACV, PAKDD, IJCNN, ICPR, ICIP, HCII, CLEF, BLP, Scientific Reports, Pattern Recognition, JMIR, IEEE Access, Smart Agricultural Technology, Frontiers in Computational Neuroscience, Diabetes Research and Clinical Practice, PLOS ONE

References

  1. 1.Xu Zhang, Yong Xu, Qingwei Lin, Bo Qiao, Hongyu Zhang, Yingnong Dang, Chunyu Xie, Xinsheng Yang, Qian Cheng, Ze Li, Junjie Chen, Xiaoting He, Randolph Yao, Jian-Guang Lou, Murali Chintalapati, Furao Shen, Dongmei Zhang. (2019). Robust log-based anomaly detection on unstable log data. ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE), 807–817[10.1145/3338906.3338931]
  2. 2.Sheraz Naseer, Yasir Saleem, Shehzad Khalid, Muhammad Khawar Bashir, Jihun Han, Muhammad Munwar Iqbal, Kijun Han. (2018). Enhanced Network Anomaly Detection Based on Deep Neural Networks. IEEE Access, 6, 48231–48246[10.1109/access.2018.2863036]
  3. 3.Haixuan Guo, Shuhan Yuan, Xintao Wu. (2021). LogBERT: Log Anomaly Detection via BERT. International Joint Conference on Neural Networks (IJCNN), 1–8[10.1109/ijcnn52387.2021.9534113]
  4. 4.Jieming Zhu, Shilin He, Pinjia He, Jinyang Liu, Michael R. Lyu. (2023). Loghub: A Large Collection of System Log Datasets for AI-driven Log Analytics. Proceedings/Proceedings - International Symposium on Software Reliability Engineering, 355–366[10.1109/issre59848.2023.00071]
  5. 5.Van-Hoang Le, Hongyu Zhang. (2022). Log-based anomaly detection with deep learning. ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion), 1356–1367[10.1145/3510003.3510155]
  6. 6.Sasho Nedelkoski, Jasmin Bogatinovski, Alexander Acker, Jorge Cardoso, Odej Kao. (2020). Self-Attentive Classification-Based Anomaly Detection in Unstructured Logs. Proceedings, 1196–1201[10.1109/icdm50108.2020.00148]
  7. 7.Zumin Wang, Jiyu Tian, Hui Fang, Liming Chen, Jing Qin. (2021). LightLog: A lightweight temporal convolutional network for log anomaly detection on the edge. Computer Networks, 203, 108616[10.1016/j.comnet.2021.108616]
  8. 8.Jin Wang, Changqing Zhao, Shiming He, Yu Gu, Osama Alfarraj, Ahed Abugabah. (2021). LogUAD: Log Unsupervised Anomaly Detection Based on Word2Vec. Computer Systems Science and Engineering, 41(3), 1207–1222[10.32604/csse.2022.022365]
  9. 9.Shaohan Huang, Yi Liu, Carol Fung, He Wang, Hailong Yang, Zhongzhi Luan. (2023). Improving Log-Based Anomaly Detection by Pre-Training Hierarchical Transformers. IEEE Transactions on Computers, 72(9), 2656–2667[10.1109/tc.2023.3257518]
  10. 10.Chunkai Zhang, Xinyu Wang, Hongye Zhang, Jiahua Zhang, Hanyu Zhang, Chuanyi Liu, Peiyi Han. (2022). LayerLog: Log sequence anomaly detection based on hierarchical semantics. Applied Soft Computing, 132, 109860[10.1016/j.asoc.2022.109860]
  11. 11.Jinfu Fan, Linqing Huang, Chaoyu Gong, Yang You, Min Gan, Zhongjie Wang. (2024). KMT-PLL: K-Means Cross-Attention Transformer for Partial Label Learning. IEEE Transactions on Neural Networks and Learning Systems, 36(2), 2789–2800[10.1109/tnnls.2023.3347792]
  12. 12.Qimin Cao, Yinrong Qiao, Zhong Lyu. (2017). Machine learning to detect anomalies in web log analysis. IEEE International Conference on Computer and Communications (ICCC), 519–523[10.1109/compcomm.2017.8322600]
  13. 13.Zhenfei Zhao, Weina Niu, Xiaosong Zhang, Runzi Zhang, Zhenqi Yu, Cheng Huang. (2021). Trine: Syslog anomaly detection with three transformer encoders in one generative adversarial network. Applied Intelligence, 52(8), 8810–8819[10.1007/s10489-021-02863-9]
  14. 14.Weibin Meng, Federico Zaiter, Yuzhe Zhang, Ying Liu, Shenglin Zhang, Shimin Tao, Yichen Zhu, Tao Han, Yongpeng Zhao, En Wang, Yuzhi Zhang, Dan Pei. (2023). LogSummary: Unstructured Log Summarization for Software Systems. IEEE Transactions on Network and Service Management, 20(3), 3803–3815[10.1109/tnsm.2023.3236994]
  15. 15.Guangba Yu, Pengfei Chen, Pairui Li, Tianjun Weng, Haibing Zheng, Yuetang Deng, Zibin Zheng. (2023). LogReducer: Identify and Reduce Log Hotspots in Kernel on the Fly. ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion), 1763–1775[10.1109/icse48619.2023.00151]
  16. 16.Min Li, Mengjie Sun, Gang Li, Delong Han, Mingle Zhou. (2023). MDFULog: Multi-Feature Deep Fusion of Unstable Log Anomaly Detection Model. Applied Sciences, 13(4), 2237[10.3390/app13042237]
  17. 17.Retno Kusumaningrum, Selvi Fitria Khoerunnisa, Khadijah Khadijah, Muhammad Syafrudin. (2024). Exploring Community Awareness of Mangrove Ecosystem Preservation through Sentence-BERT and K-Means Clustering. Information, 15(3), 165[10.3390/info15030165]
  18. 18.Iqbal Santosa, Rahmat Mulyana. (2023). The IT Services Management Architecture Design for Large and Medium-sized Companies based on ITIL 4 and TOGAF Framework. JOIV International Journal on Informatics Visualization, 7(1), 30[10.30630/joiv.7.1.1590]
  19. 19.Sean Kauffman. (2022). Log analysis and system monitoring with nfer. Science of Computer Programming, 225, 102909[10.1016/j.scico.2022.102909]
  20. 20.Muhammad Abbas, Ali Hamayouni, Mahshid H. Moghadam, Mehrdad Saadatmand, Per E. Strandberg. (2023). Making Sense of Failure Logs in an Industrial DevOps Environment. Advances in intelligent systems and computing, 217–226[10.1007/978-3-031-28332-1_25]
  21. 21.Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N.Gomez, Lukasz Kaiser, Illia Polosukhin. (2025). Attention Is All You Need. , 30, 5998–6008[10.65215/2q58a426]

Cited By

  1. 1.Xin Ji, Le Zhang, Wenya Zhang, Fang Peng, Yifan Mao, Xingchuang Liao, Kui Zhang. (2025). LEMAD: LLM-Empowered Multi-Agent System for Anomaly Detection in Power Grid Services. Electronics, 14(15), 3008[10.3390/electronics14153008]
← All publications