Journal Article2023Cited by 47

A Survey on Dimensionality Reduction Techniques for Time-series Data

Mohsena Ashraf, Farzana Anowar, Jahanggir H Setu, Atiqul I Chowdhury, Eshtiak Ahmed, Ashraful Islam, Abdullah Al-Mamun

IEEE Access

IEEE, Vol. 11, pp. 42909-42923, ISBN: 2169-3536

DOI: 10.1109/access.2023.3269693Open AccessURL

Abstract

Data analysis in modern times involves working with large volumes of data, including time-series data. This type of data is characterized by its high dimensionality, enormous volume, and the presence of both noise and redundant features. However, the "curse of dimensionality" often causes issues for learning approaches, which can fail to capture the temporal dependencies present in time-series data. To address this problem, it is essential to reduce dimensionality while preserving the intrinsic properties of temporal dependencies. This will help to avoid lower learning and predictive performances. This study presents twelve different dimensionality reduction algorithms that are specifically suited for working with time-series data and fall into different categories, such as supervision, linearity, time and memory complexity, hyper-parameters, and drawbacks.

Keywords

  • Dimensionality reduction
  • Time series
  • temporal dependencies
  • Curse of dimensionality
  • linear dimensionality reduction
  • supervised dimensionality reduction
  • time series clustering
  • feature redundancy

CCDS Authors

Farzana Anowar, PhD
Farzana Anowar, PhD

Farzana Anowar, PhD

  • Collaborator, HCI Wing

Senior Data Analytics Specialist

+1 more affiliation

Government of Saskatchewan, Canada

Published at

HCII, IEEE Access

Research Interests

Machine Learning, Deep Learning, Data Science, Artificial Intelligence, Pattern Recognition

Eshtiak Ahmed
Eshtiak Ahmed

Eshtiak Ahmed

  • Collaborator, HCI Wing

Doctoral Researcher

Gamification Group

Tampere University, Finland

Published at

UbiComp, ICIP, HCII, IEEE Access

Research Interests

Human-Computer Interaction, Human-Robot Interaction, Gamification and Assistive Technologies

Ashraful Islam, PhD
Ashraful Islam

Ashraful Islam, PhD

  • Center Director, CCDS
  • Director, HCI Wing

Assistant Professor

Department of Computer Science and Engineering

Independent University, Bangladesh (IUB)

Published at

CHI, UIST, UbiComp, IJCNN, ICIP, HCII, ICDMW, BLP, IEEE Internet of Things Journal, JMIR, JMIR Human Factors, JMIR Formative Research, IEEE Access, Smart Agricultural Technology, Diabetes Research and Clinical Practice, PLOS ONE

Research Interests

Human-Computer Interaction, AI for Social Good, AI for Public Health, AI for Impact

References

  1. 1.Sam T. Roweis, Lawrence K. Saul. (2000). Nonlinear Dimensionality Reduction by Locally Linear Embedding. Science, 290(5500), 2323–2326[10.1126/science.290.5500.2323]
  2. 2.Joshua B. Tenenbaum, Vin de Silva, John Langford. (2000). A Global Geometric Framework for Nonlinear Dimensionality Reduction. Science, 290(5500), 2319–2323[10.1126/science.290.5500.2319]
  3. 3.Rakesh Agrawal, Christos Faloutsos, Arun Swami. (1993). Efficient similarity search in sequence databases. Lecture notes in computer science, 69–84[10.1007/3-540-57301-1_5]
  4. 4.Kin-Pong Chan, Ada Wai-Chee Fu. (1999). Efficient time series matching by wavelets. , 126–133[10.1109/icde.1999.754915]
  5. 5.Michel Verleysen, Damien François. (2005). The Curse of Dimensionality in Data Mining and Time Series Prediction. Lecture notes in computer science, 758–770[10.1007/11494669_93]
  6. 6.Leilei Cao, Kok Seng Chua, W. K. Chong, H. P. Lee, Q. Gu. (2003). A comparison of PCA, KPCA and ICA for dimensionality reduction in support vector machine. Neurocomputing, 55(1-2), 321–336[10.1016/s0925-2312(03)00433-8]
  7. 7.Kilian Q. Weinberger, Fei Sha, Lawrence K. Saul. (2004). Learning a kernel matrix for nonlinear dimensionality reduction. , 106[10.1145/1015330.1015345]
  8. 8.Yi-Leh Wu, Divyakant Agrawal, Amr El Abbadi. (2000). A comparison of DFT and DWT based similarity search in time-series databases. , 488–495[10.1145/354756.354857]
  9. 9.Yingwei Zhang. (2008). Enhanced statistical analysis of nonlinear processes using KPCA, KICA and SVM. Chemical Engineering Science, 64(5), 801–811[10.1016/j.ces.2008.10.012]
  10. 10.Lawrence K. Saul, Sam T. Roweis. (2001). An Introduction to Locally Linear Embedding.
  11. 11.Pimwadee Chaovalit, Aryya Gangopadhyay, George Karabatis, Zhiyuan Chen. (2011). Discrete wavelet transform-based time series analysis and mining. ACM Computing Surveys, 43(2), 1–37[10.1145/1883612.1883613]
  12. 12.Blake Shaw, Tony Jebara. (2009). Structure preserving embedding. , 937–944[10.1145/1553374.1553494]
  13. 13.Christopher K. I. Williams. (2002). On a Connection between Kernel PCA and Metric Multidimensional Scaling. Machine Learning, 46(1-3), 11–19[10.1023/a:1012485807823]
  14. 14.Carmelo Cassisi, P. Montalto, Marco Aliotta, Andrea Cannata, Alfredo Pulvirenti. (2012). Similarity Measures and Dimensionality Reduction Techniques for Time Series Data Mining. InTech eBooks[10.5772/49941]
  15. 15.Antti Juvonen, Tuomo Sipola, Timo Hämäläinen. (2015). Online anomaly detection using dimensionality reduction techniques for HTTP log analysis. Computer Networks, 91, 46–56[10.1016/j.comnet.2015.07.019]
  16. 16.Yan Huang, Gang Kou. (2014). A kernel entropy manifold learning approach for financial data analysis. Decision Support Systems, 64, 31–42[10.1016/j.dss.2014.04.004]
  17. 17.Kilian Q. Weinberger, Benjamin Packer, Lawrence K. Saul. (2005). Nonlinear Dimensionality Reduction by Semidefinite Programming and Kernel Matrix Factorization..
  18. 18.Yan‐Fang Sang. (2012). A Practical Guide to Discrete Wavelet Decomposition of Hydrologic Time Series. Water Resources Management, 26(11), 3345–3365[10.1007/s11269-012-0075-4]
  19. 19.Jing Chen, Yang Liu. (2011). Locally linear embedding: a survey. Artificial Intelligence Review, 36(1), 29–48[10.1007/s10462-010-9200-z]
  20. 20.Kunlun Hu, Jingqi Yuan. (2008). Multivariate statistical process control based on multiway locality preserving projections. Journal of Process Control, 18(7-8), 797–807[10.1016/j.jprocont.2007.11.002]
  21. 21.Gagan Sidhu, Nasimeh Asgarian, Russell Greiner, Matthew Brown. (2012). Kernel Principal Component Analysis for dimensionality reduction in fMRI-based diagnosis of ADHD. Frontiers in Systems Neuroscience, 6, 74[10.3389/fnsys.2012.00074]
  22. 22.H. Muhammad Asraf, M. T. Nooritawati, M. S. B. Shah Rizam. (2012). A Comparative Study in Kernel-Based Support Vector Machine of Oil Palm Leaves Nutrient Disease. Procedia Engineering, 41, 1353–1359[10.1016/j.proeng.2012.07.321]
  23. 23.Xiaofei He, Deng Cai, Wanli Min. (2005). Statistical and computational analysis of locality preserving projection. , 281–288[10.1145/1102351.1102387]
  24. 24.Mathieu Fauvel, Jocelyn Chanussot, Jón Atli Benediktsson. (2006). Kernel Principal Component Analysis for Feature Reduction in Hyperspectrale Images Analysis. , 238–241[10.1109/norsig.2006.275232]
  25. 25.Donald B. Percival. (2008). Analysis of Geophysical Time Series Using Discrete Wavelet Transforms: An Overview. Lecture notes in earth sciences, 61–79[10.1007/978-3-540-78938-3_4]
  26. 26.Qiang Wang, Vasileios Megalooikonomou. (2007). A dimensionality reduction technique for efficient time series similarity analysis. Information Systems, 33(1), 115–132[10.1016/j.is.2007.07.002]
  27. 27.Ronald R. Coifman, Matthew J. Hirn. (2013). Diffusion maps for changing data. Applied and Computational Harmonic Analysis, 36(1), 79–107[10.1016/j.acha.2013.03.001]
  28. 28.Haoran Li, Li Xiong, Lucila Ohno‐Machado, Xiaoqian Jiang. (2014). Privacy Preserving RBF Kernel Support Vector Machine. BioMed Research International, 2014, 1–10[10.1155/2014/827371]
  29. 29.Xiaoqing Weng, Junyi Shen. (2008). Classification of multivariate time series using locality preserving projections. Knowledge-Based Systems, 21(7), 581–587[10.1016/j.knosys.2008.03.027]
  30. 30.Yuan-Jui Liu, Tao Chen, Yuan Yao. (2014). Nonlinear process monitoring and fault isolation using extended maximum variance unfolding. Journal of Process Control, 24(6), 880–891[10.1016/j.jprocont.2014.04.004]
  31. 31.Nitika Sharma, Kriti Saroha. (2015). Study of dimension reduction methodologies in data mining. , 133–137[10.1109/ccaa.2015.7148359]
  32. 32.Hoo-Chang Shin, Matthew Orton, David J. Collins, Simon Doran, Martin O. Leach. (2011). Autoencoder in Time-Series Analysis for Unsupervised Tissues Characterisation in a Large Unlabelled Medical Image Dataset. , 259–264[10.1109/icmla.2011.38]
  33. 33.Yinsheng Qu, Bao‐Ling Adam, Mark Thornquist, John D. Potter, Mary Lou Thompson, Yutaka Yasui, John W. Davis, Paul F. Schellhammer, Lisa H. Cazares, MaryAnn Clements, George L. Wright, Ziding Feng. (2003). Data Reduction Using a Discrete Wavelet Transform in Discriminant Analysis of Very High Dimensionality Data. Biometrics, 59(1), 143–151[10.1111/1541-0420.00017]
  34. 34.Filipe Aires, A. Chédin, Jean‐Pierre Nadal. (2000). Independent component analysis of multivariate time series: Application to the tropical SST variability. Journal of Geophysical Research Atmospheres, 105(D13), 17437–17455[10.1029/2000jd900152]
  35. 35.Hailin Li. (2013). Asynchronism-based principal component analysis for time series data mining. Expert Systems with Applications, 41(6), 2842–2850[10.1016/j.eswa.2013.10.019]
  36. 36.Wenzhao Lian, Ronen Talmon, Hitten P. Zaveri, Lawrence Carin, Ronald R. Coifman. (2015). Multivariate time-series analysis and diffusion maps. Signal Processing, 116, 13–28[10.1016/j.sigpro.2015.04.003]
  37. 37.Akira Hayashi, Yuko Mizuhara, Nobuo Suematsu. (2005). Embedding Time Series Data for Classification. Lecture notes in computer science, 356–365[10.1007/11510888_35]
  38. 38.Danyang Cao, Yuan Tian, Donghui Bai. (2015). Time Series Clustering Method Based on Principal Component Analysis. Advances in engineering research/Advances in Engineering Research[10.2991/icimm-15.2015.163]
  39. 39.Howard Grubb, Andrew T. Walden. (1997). <b>Characterizing seismic time series using the discrete wavelet transform</b>. Geophysical Prospecting, 45(2), 183–205[10.1046/j.1365-2478.1997.00346.x]
  40. 40.Carina Becker, Roland Fried. (2003). Sliced Inverse Regression for High-dimensional Time Series. Studies in classification, data analysis, and knowledge organization, 3–11[10.1007/978-3-642-55721-7_1]
  41. 41.Amod Jog, Aniruddha Joshi, Sharat Chandran, Anant Madabhushi. (2009). CLASSIFYING AYURVEDIC PULSE SIGNALS VIA CONSENSUS LOCALLY LINEAR EMBEDDING. , 388–395[10.5220/0001554903880395]
  42. 42.Francesca Fallucchi, Fabio Massimo Zanzottto. (2009). Singular Value Decomposition for Feature Selection in Taxonomy Learning. , 82–87
  43. 43.Chao Shao, Houkuan Huang. (2005). Improvement of Data Visualization Based on ISOMAP. Lecture notes in computer science, 534–543[10.1007/11579427_54]
  44. 44.Carlotta Orsenigo, Carlo Vercellis. (2013). Dimensionality Reduction via Isomap with Lock-Step and Elastic Measures for Time Series Gene Expression Classification. Lecture notes in computer science, 92–103[10.1007/978-3-642-37189-9_9]
  45. 45.Eamonn Keogh. (2002). Indexing and Mining Time Series.. Brazilian Symposium on Databases, 9
  46. 46.Quanzhong Liu, Yang Zhang, Zhengguo Hu. (2008). Extracting Decision Rules from Sigmoid Kernel. Lecture notes in computer science, 294–304[10.1007/978-3-540-88192-6_28]
  47. 47.V. Chinde, Liang Cao, Umesh Vaidya, Simon Laflamme. (2015). Spectral diffusion map approach for structural health monitoring of wind turbine blades. , 92, 5806–5811[10.1109/acc.2015.7172249]
  48. 48.L.J. Sciacca, Robin J. Evans. (1995). Multidimensional Inverse Problems in Ultrasonic Imaging. Control and dynamic systems, 1–48[10.1016/s0090-5267(05)80037-4]
  49. 49.Guangrong Tong, Siwei Li. (2015). Construction and Application Research of Isomap-RVM Credit Assessment Model. Mathematical Problems in Engineering, 2015, 1–7[10.1155/2015/197258]
  50. 50.Jonathon Shlens. (2014). A Tutorial on Principal Component Analysis. arXiv (Cornell University)[10.48550/arxiv.1404.1100]
  51. 51.Mikhail Belkin, Partha Niyogi. (2003). Laplacian Eigenmaps for Dimensionality Reduction and Data Representation. Neural Computation, 15(6), 1373–1396[10.1162/089976603321780317]
  52. 52.Mikhail Belkin, Partha Niyogi. (2002). Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering. The MIT Press eBooks, 585–592[10.7551/mitpress/1120.003.0080]
  53. 53.Xiaofei He, Partha Niyogi. (2003). Locality Preserving Projections. , 16, 153–160
  54. 54.Tak-chung Fu. (2010). A review on time series data mining. Engineering Applications of Artificial Intelligence, 24(1), 164–181[10.1016/j.engappai.2010.09.007]
  55. 55.Pierre Baldi. (2011). Autoencoders, Unsupervised Learning, and Deep Architectures. , 37–49
  56. 56.Boaz Nadler, Stéphane Lafon, Ronald R. Coifman, Ioannis G. Kevrekidis. (2006). Diffusion maps, spectral clustering and reaction coordinates of dynamical systems. Applied and Computational Harmonic Analysis, 21(1), 113–127[10.1016/j.acha.2005.07.004]
  57. 57.H. Hoffmann. (2006). Kernel PCA for novelty detection. Pattern Recognition, 40(3), 863–874[10.1016/j.patcog.2006.07.009]
  58. 58.Miguel A. Bessa, Ramin Bostanabad, Zeliang Liu, Anqi Hu, Daniel W. Apley, Cate Brinson, Wei-Hao Chen, Wing Kam Liu. (2017). A framework for data-driven analysis of materials under uncertainty: Countering the curse of dimensionality. Computer Methods in Applied Mechanics and Engineering, 320, 633–667[10.1016/j.cma.2017.03.037]
  59. 59.Xiaowei Geng, Dongyuan Zhan, Zhuoping Zhou. (2005). Supervised Nonlinear Dimensionality Reduction for Visualization and Classification. IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics), 35(6), 1098–1107[10.1109/tsmcb.2005.850151]
  60. 60.M. Sifuzzaman, M. R. Islam, M. Z. Ali. (2014). Application of wavelet transform and its advantages compared to fourier transform.
  61. 61.Guifang Liu, Huaiqian Bao, Baokun Han. (2018). A Stacked Autoencoder-Based Deep Neural Network for Achieving Gearbox Fault Diagnosis. Mathematical Problems in Engineering, 2018, 1–10[10.1155/2018/5105709]
  62. 62.Dariusz Komorowski, S. Pietraszek. (2015). The Use of Continuous Wavelet Transform Based on the Fast Fourier Transform in the Analysis of Multi-channel Electrogastrography Recordings. Journal of Medical Systems, 40(1), 10[10.1007/s10916-015-0358-4]
  63. 63.Tom Howley, Michael G. Madden, Marie-Louise O’Connell, Alan G. Ryder. (2007). The Effect of Principal Component Analysis on Machine Learning Accuracy with High Dimensional Spectral Data. , 209–222[10.1007/1-84628-224-1_16]
  64. 64.Bo Li, Yan-Rui Li, Xiaolong Zhang. (2018). A survey on Laplacian eigenmaps based manifold learning methods. Neurocomputing, 335, 336–351[10.1016/j.neucom.2018.06.077]
  65. 65.Iosif Lazaridis, Sharad Mehrotra. (2004). Capturing sensor-generated time series with quality guarantees. , 429–440[10.1109/icde.2003.1260811]
  66. 66.G. Baudat, F. Anouar. (2002). Kernel-based methods and function approximation. , 2, 1244–1249[10.1109/ijcnn.2001.939539]
  67. 67.Stephen L. France, J. Douglas Carroll. (2010). Two-Way Multidimensional Scaling: A Review. IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews), 41(5), 644–661[10.1109/tsmcc.2010.2078502]
  68. 68.Michał Lewandowski, Jesús Martínez del Rincón, Dimitrios Makris, Jean‐Christophe Nebel. (2010). Temporal Extension of Laplacian Eigenmaps for Unsupervised Dimensionality Reduction of Time Series. , 161–164[10.1109/icpr.2010.48]
  69. 69.Zhiyong Wang, Binbin He. (2011). Locality perserving projections algorithm for hyperspectral image dimensionality reduction. , 1–4[10.1109/geoinformatics.2011.5980790]
  70. 70.Carlos Lima, Upmanu Lall, Tony Jebara, Anthony G. Barnston. (2009). Statistical Prediction of ENSO from Subsurface Sea Temperature Using a Nonlinear Dimensionality Reduction. Journal of Climate, 22(17), 4501–4519[10.1175/2009jcli2524.1]
  71. 71.Jing Wang, Wenshuang Ge, Jinglin Zhou, Haiyan Wu, Qibing Jin. (2016). Fault isolation based on residual evaluation and contribution analysis. Journal of the Franklin Institute, 354(6), 2591–2612[10.1016/j.jfranklin.2016.09.002]
  72. 72.Tuomo Sipola, Tapani Ristaniemi, Amir Averbuch. (2014). Gear classification and fault detection using a diffusion map framework. Pattern Recognition Letters, 53, 53–61[10.1016/j.patrec.2014.10.019]
  73. 73.John A. Lee, Cédric Archambeau, Michel Verleysen. (2003). Locally Linear Embedding versus Isotop. , 527–534
  74. 74.Feng Liu, Weijie Zhang, Suicheng Gu. (2016). Local linear Laplacian eigenmaps: A direct extension of LLE. Pattern Recognition Letters, 75, 30–35[10.1016/j.patrec.2016.03.003]
  75. 75.Yuehai Wang, Yong-zheng YAN, Qinyong Wang. (2016). Wavelet-Based Feature Extraction in Fault Diagnosis for Biquad High-Pass Filter Circuit. Mathematical Problems in Engineering, 2016, 1–13[10.1155/2016/5682847]
  76. 76.Wei Lin, Jianhua Z. Huang, Tucker McElroy. (2018). Time Series Seasonal Adjustment Using Regularized Singular Value Decomposition. Journal of Business and Economic Statistics, 38(3), 487–501[10.1080/07350015.2018.1515081]
  77. 77.Venkatesh Chinde, Liang Cao, Umesh Vaidya, Simon Laflamme. (2016). Damage detection on mesosurfaces using distributed sensor network and spectral diffusion maps. Measurement Science and Technology, 27(4), 045110[10.1088/0957-0233/27/4/045110]
  78. 78.Suchismit Mahapatra, Varun Chandola. (2017). S-Isomap++: Multi manifold learning from streaming data. , 290, 716–725[10.1109/bigdata.2017.8257987]
  79. 79.Vincent Choqueuse, Pierre Granjon, Adel Belouchrani, François Auger, Mohamed Benbouzid. (2019). Monitoring of Three-Phase Signals Based on Singular-Value Decomposition. IEEE Transactions on Smart Grid, 10(6), 6156–6166[10.1109/tsg.2019.2898118]
  80. 80.Dekai Wu, Weifeng Su, Marine Carpuat. (2004). A kernel PCA method for superior word sense disambiguation. , 637–es[10.3115/1218955.1219036]
  81. 81.Karol Pąk. (2007). Basic Properties of the Rank of Matrices over a Field. Formalized Mathematics, 15(4)[10.2478/v10037-007-0024-5]
  82. 82.Mario Frank, Joachim M. Buhmann. (2011). Selecting the rank of truncated SVD by maximum approximation capacity. , 1036–1040[10.1109/isit.2011.6033687]
  83. 83.Meng Tian, Wenjian Wang. (2017). Some sets of orthogonal polynomial kernel functions. Applied Soft Computing, 61, 742–756[10.1016/j.asoc.2017.08.010]
  84. 84.Chihang Wei, Junghui Chen, Zhihuan Song. (2016). Developments of two supervised maximum variance unfolding algorithms for process classification. Chemometrics and Intelligent Laboratory Systems, 159, 31–44[10.1016/j.chemolab.2016.09.009]
  85. 85.Fei Zhang, Shengyue Zong, Zhi Ling. (2017). Fault diagnosis using kernel principal component analysis for hot strip mill. The Journal of Engineering, 2017(9), 527–535[10.1049/joe.2017.0190]
  86. 86.Vanel Steve Siyou Fotso, Engelbert Mephu Nguifo, Philippe Vaslin. (2018). Grasp heuristic for time series compression with piecewise aggregate approximation. RAIRO - Operations Research, 53(1), 243–259[10.1051/ro/2018089]
  87. 87.Jingpei Dan, Weiren Shi, Fangyan Dong, Kaoru Hirota. (2013). Piecewise Trend Approximation: A Ratio-Based Time Series Representation. Abstract and Applied Analysis, 2013, 1–7[10.1155/2013/603629]
  88. 88.Alexandre Gramfort, Maureen Clerc. (2007). Low Dimensional Representations of MEG/EEG Data Using Laplacian Eigenmaps. [10.1109/nfsi-icfbi.2007.4387717]
  89. 89.Feng Zhao, Islem Rekik, Seong–Whan Lee, Jing Liu, Junying Zhang, Dinggang Shen. (2019). Two‐Phase Incremental Kernel PCA for Learning Massive or Online Datasets. Complexity, 2019(1)[10.1155/2019/5937274]
  90. 90.Beibei Yao, Jia Su, Lifeng Wu, Yong Guan. (2017). Modified Local Linear Embedding Algorithm for Rolling Element Bearing Fault Diagnosis. Applied Sciences, 7(11), 1178[10.3390/app7111178]
  91. 91.Asma Fejjari, Karim Saheb Ettabaâ, Ouajdi Korbaa. (2018). Modified Graph-Based Algorithm for Efficient Hyperspectral Feature Extraction. Communications in computer and information science, 87–95[10.1007/978-3-030-00840-6_10]
  92. 92.Václav Matz, M. Kreidl, Radislav Šmíd. (2004). Signal-to-Noise Ratio Improvement based on the Discrete Wavelet Transform in Ultrasonic Defectoscopy. Acta Polytechnica, 44(4)[10.14311/606]
  93. 93.Ioannis Liabotis, Babis Theodoulidis, Mohamad Saraaee. (2006). Improving Similarity Search in Time Series Using Wavelets. International Journal of Data Warehousing and Mining, 2(2), 55–81[10.4018/jdwm.2006040103]
  94. 94.Gajanan Gawde, Jyoti D. Pawar. (2017). Shape based time series reduction using PCA. , 1–4[10.1109/iciiecs.2017.8275897]
  95. 95.Ibgtc Bowala, M. Fernando. (2017). A novel model for Time-Series Data Clustering Based on piecewise SVD and BIRCH for Stock Data Analysis on Hadoop Platform. Advances in Science Technology and Engineering Systems Journal, 2(3), 855–864[10.25046/aj0203106]
  96. 96.Abdolrahman Khoshrou, Andre B. Dorsman, Eric J. Pauwels. (2017). SVD-based visualisation and approximation for time series data in smart energy systems. , 1–6[10.1109/isgteurope.2017.8260303]
  97. 97.Christina Bogner, Holger Lange, Henning Meesenburg, Michael Hauhs. (2011). Characteristic patterns and processes from non-linear analysis of soil water and streamwater time series in the forested catchment Lange Bramke, Harz Mountains, Germany.
  98. 98.Fabián Pedregosa, Gaël Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Müller, Andreas, Nothman, Joel, Louppe, Gilles, Peter Prettenhofer, Ron J. Weiss, Vincent Dubourg, Jake Vanderplas, Alexandre Passos, David Cournapeau, Matthieu Brucher, Matthieu Perrot, Édouard Duchesnay. (2012). Scikit-learn: Machine Learning in Python. arXiv (Cornell University)[10.48550/arxiv.1201.0490]
  99. 99.Quan Wang. (2012). Kernel Principal Component Analysis and its Applications in Face Recognition and Active Shape Models. arXiv (Cornell University)[10.48550/arxiv.1207.3538]
  100. 100.Ronald R. Coifman, Stéphane Lafon. (2006). Diffusion maps. Applied and Computational Harmonic Analysis, 21(1), 5–30[10.1016/j.acha.2006.04.006]
  101. 101.Michael Greenacre, Patrick J. F. Groenen, Trevor Hastie, Alfonso Iodice D’Enza, Angelos Markos, Elena Tuzhilina. (2022). Principal component analysis. Nature Reviews Methods Primers, 2(1)[10.1038/s43586-022-00184-w]
  102. 102.Farzana Anowar, Samira Sadaoui, Bassant Selim. (2021). Conceptual and empirical comparison of dimensionality reduction algorithms (PCA, KPCA, LDA, MDS, SVD, LLE, ISOMAP, LE, ICA, t-SNE). Computer Science Review, 40, 100378[10.1016/j.cosrev.2021.100378]
  103. 103.Kilian Q. Weinberger, Lawrence K. Saul. (2006). Unsupervised Learning of Image Manifolds by Semidefinite Programming. International Journal of Computer Vision, 70(1), 77–90[10.1007/s11263-005-4939-z]
  104. 104.Nico Verbeeck, Richard M. Caprioli, Raf Van de Plas. (2019). Unsupervised machine learning for exploratory data analysis in imaging mass spectrometry. Mass Spectrometry Reviews, 39(3), 245–291[10.1002/mas.21602]
  105. 105.Tung Kieu, Bin Yang, Chenjuan Guo, Christian S. Jensen. (2019). Outlier Detection for Time Series with Recurrent Autoencoder Ensembles. , 2725–2732[10.24963/ijcai.2019/378]
  106. 106.VennaJarkko, PeltonenJaakko, NyboKristian, AidosHelena, KaskiSamuel. (2010). Information Retrieval Perspective to Nonlinear Dimensionality Reduction for Data Visualization. Journal of Machine Learning Research[10.5555/1756006.1756019]
  107. 107.Mengmeng Li, Haofeng Wang, Lifang Yang, You Liang, Zhigang Shang, Hong Wan. (2020). Fast hybrid dimensionality reduction method for classification based on feature selection and grouped feature extraction. Expert Systems with Applications, 150, 113277[10.1016/j.eswa.2020.113277]
  108. 108.Andrey Osadchiy, A. I. Kamenev, V. V. Saharov, Sergei Chernyi. (2021). Signal Processing Algorithm Based on Discrete Wavelet Transform. Designs, 5(3), 41[10.3390/designs5030041]
  109. 109.Leo Torres, Kevin S Chan, Tina Eliassi-Rad. (2020). GLEE: Geometric Laplacian Eigenmap Embedding. Journal of Complex Networks, 8(2)[10.1093/comnet/cnaa007]
  110. 110.Jersson X. Leon‐Medina, Maribel Anaya, Francesc Pozo, Diego Alexander Tibaduiza Burgos. (2020). Nonlinear Feature Extraction Through Manifold Learning in an Electronic Tongue Classification Task. Sensors, 20(17), 4834[10.3390/s20174834]
  111. 111.Tianjian Lu, Yifan Chen, Blake A. Hechtman, Tao Wang, John R. Anderson. (2021). Large-Scale Discrete Fourier Transform on TPUs. IEEE Access, 9, 93422–93432[10.1109/access.2021.3092312]
  112. 112.Yongguang Zhai, Nan Wang, Lifu Zhang, Lei Hao, Caihong Hao. (2020). Automatic Crop Classification in Northeastern China by Improved Nonlinear Dimensionality Reduction for Satellite Image Time Series. Remote Sensing, 12(17), 2726[10.3390/rs12172726]
  113. 113.Mahwish Yousaf, Tanzeel U. Rehman, Jing Li. (2020). An Extended Isomap Approach for Nonlinear Dimension Reduction. SN Computer Science, 1(3)[10.1007/s42979-020-00179-y]
  114. 114.Junpei Mita, C. Ganesh Babu, M. Gowri Shankar. (2021). Performance Analysis of Dimensionality Reduction using PCA, KPCA and LLE for ECG Signals. IOP Conference Series Materials Science and Engineering, 1084(1), 012005[10.1088/1757-899x/1084/1/012005]
  115. 115.Edwin Lughofer, Ramin Nikzad‐Langerodi. (2019). Robust Generalized Fuzzy Systems Training From High-Dimensional Time-Series Data Using Local Structure Preserving PLS. IEEE Transactions on Fuzzy Systems, 28(11), 2930–2943[10.1109/tfuzz.2019.2945535]
  116. 116.Fayed Awdah M Alshammri, Jiazhu Pan. (2021). Moving dynamic principal component analysis for non-stationary multivariate time series. Computational Statistics, 36(3), 2247–2287[10.1007/s00180-021-01081-8]
  117. 117.Pattreeya Tanisaro, Gunther Heidemann. (2019). Dimensionality Reduction for Visualization of Time Series and Trajectories. Lecture notes in computer science, 246–257[10.1007/978-3-030-20205-7_21]
  118. 118.Lamyaa Al-Omairi, Jemal Abawajy, Morshed Chowdhury, Tahsien Al‐Quraishi. (2020). An empirical analysis of graph‐based linear dimensionality reduction techniques. Concurrency and Computation Practice and Experience, 33(5)[10.1002/cpe.5990]
  119. 119.Hailin Li, Chunpei Lin, Xiaoji Wan, Zhengxin Li. (2019). Feature Representation and Similarity Measure Based on Covariance Sequence for Multivariate Time Series. IEEE Access, 7, 67018–67026[10.1109/access.2019.2915602]
  120. 120.M. Bertero, Patrizia Boccacci. (2020). Singular value decomposition (SVD). , 220–246[10.1201/9780367806941-11]
  121. 121.Saul Lawrence K., Weinberger Kilian Q., Sha Fei, Jihun Ham, Lee Daniel D.. (2006). Spectral Methods for Dimensionality Reduction. The MIT Press eBooks, 292–308[10.7551/mitpress/9780262033589.003.0016]
  122. 122.Umberto Michelucci. (2022). An Introduction to Autoencoders. arXiv (Cornell University)[10.48550/arxiv.2201.03898]
  123. 123.Benyamin Ghojogh, Maria N. Samad, Sayema Asif Mashhadi, Tania Kapoor, Wahab Ali, Fakhri Karray, Mark Crowley. (2019). Feature Selection and Feature Extraction in Pattern Analysis: A\n Literature Review. arXiv (Cornell University)[10.48550/arxiv.1905.02845]
  124. 124.Neda Tavakoli, Sima Siami‐Namini, Mahdi Adl Khanghah, Fahimeh Mirza Soltani, Akbar Siami Namin. (2020). Clustering Time Series Data through Autoencoder-based Deep Learning Models. arXiv (Cornell University)[10.48550/arxiv.2004.07296]
  125. 125.Guillaume Richard, Benoît Grossin, Guillaume Germaine, Georges Hébrail, Anne De Moliner. (2020). Autoencoder-based time series clustering with energy applications. arXiv (Cornell University)[10.48550/arxiv.2002.03624]
  126. 126.Filippo Maria Bianchi, Lorenzo Livi, Karl Øyvind Mikalsen, Michael Kampffmeyer, Robert Jenssen. (2018). Learning representations for multivariate time series with missing data\n using Temporal Kernelized Autoencoders. arXiv (Cornell University)[10.48550/arxiv.1805.03473]
  127. 127.Nikita Pospelov, Alina Tetereva, Olga Martynova, K. V. Anokhin. (2020). The Laplacian eigenmaps dimensionality reduction of fMRI data for discovering stimulus-induced changes in the resting-state brain activity. bioRxiv (Cold Spring Harbor Laboratory)[10.1101/2020.12.10.419861]
  128. 128.Mohammed Elhenawy, Mahmoud Masoud, Glaser, Sebastian, Andry Rakotonirainy. (2019). Topological Stability: a New Algorithm for Selecting The Nearest Neighbors in Non-Linear Dimensionality Reduction Techniques. arXiv (Cornell University)[10.48550/arxiv.1911.05312]
  129. 129.William W. S. Wei. (2019). Factor analysis of multivariate time series. Wiley series in probability and statistics, 163–202[10.1002/9781119502951.ch5]
  130. 130.Aritra Dutta, Jingwei Liang, Xin Li. (2021). An Adaptive Rank Continuation Algorithm for General Weighted Low-rank Recovery. arXiv (Cornell University)[10.48550/arxiv.2101.00749]

Cited By

  1. 1.Shafi Ullah Khan, Sana Ullah Jan, Insoo Koo. (2023). Robust Epileptic Seizure Detection Using Long Short-Term Memory and Feature Fusion of Compressed Time–Frequency EEG Images. Sensors, 23(23), 9572[10.3390/s23239572]
  2. 2.Soohyun Kim, Youngghyu Sun, Seongwoo Lee, Joonho Seon, Byungsun Hwang, Jeongho Kim, Jeongho Kim, Jinwook Kim, Jinwook Kim, Kyounghun Kim, Jinyoung Kim, Jinyoung Kim. (2024). Data-Driven Approaches for Energy Theft Detection: A Comprehensive Review. Energies, 17(12), 3057[10.3390/en17123057]
  3. 3.Dazi Li, Yurui Zhu, Zhihuan Song, Hamid Reza Karimi. (2024). A novel label-aware global graph construction method and spiking-coded graph neural network for intelligent process fault diagnosis. Neurocomputing, 611, 128707[10.1016/j.neucom.2024.128707]
  4. 4.Rida Zaheer, Muhammad Kashif Hanif, Muhammad Umer Sarwar, Ramzan Talib. (2025). Evaluating the Effectiveness of Dimensionality Reduction on Machine Learning Algorithms in Time Series Forecasting. IEEE Access, 13, 50493–50510[10.1109/access.2025.3551741]
  5. 5.Elise Jonsson, Andrijana Todorović, Malgorzata Blicharska, Andreina Francisco, Thomas Grabs, Janez Sušnik, Claudia Teutschbein. (2024). An introduction to data-driven modelling of the water-energy-food-ecosystem nexus. Environmental Modelling & Software, 181, 106182[10.1016/j.envsoft.2024.106182]
  6. 6.Clayton Cooper, Jianjing Zhang, Y.B. Guo, Robert X. Gao. (2025). Surface roughness prediction in machining using two-stage domain-incremental learning with input dimensionality expansion. Journal of Manufacturing Systems, 80, 503–510[10.1016/j.jmsy.2025.03.014]
  7. 7.Jahanggir Hossain Setu, Nabarun Halder, Ashraful Islam, M. Ashraful Amin. (2025). RSTHFS: A Rough Set Theory-Based Hybrid Feature Selection Method for Phishing Website Classification. IEEE Access, 13, 68820–68830[10.1109/access.2025.3561237]
  8. 8.Michael Loki, Agnes Mindila, Wilson Cheruiyot. (2024). Hyper‐Parameter Optimization of Kernel Functions on Multi‐Class Text Categorization: A Comparative Evaluation. Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery, 15(1)[10.1002/widm.1572]
  9. 9.Hang Duong Thi, Kha Hoang Manh, Vu Trinh Anh, Trang Pham Thi Quynh, Tuyen Nguyen Viet. (2023). Dimensionality Reduction with Truncated Singular Value Decomposition and K-Nearest Neighbors Regression for Indoor Localization. International Journal of Advanced Computer Science and Applications, 14(10)[10.14569/ijacsa.2023.0141034]
  10. 10.Shafi Ullah Khan, Sana Ullah Jan, In Soo Koo. (2023). Robust Epileptic Seizure Detection using LSTM and Feature Fusion from Compressed Time-Frequency EEG Images. Preprints.org[10.20944/preprints202310.0860.v1]
  11. 11.Ana Almeida, Pedro Rito, Susana Brás, Filipe Cabral Pinto, Susana Sargento. (2024). A machine learning approach to forecast 5G metrics in a commercial and operational 5G platform: 5G and mobility. Computer Communications, 228, 107974[10.1016/j.comcom.2024.107974]
  12. 12.A. Anjali, Vrijendra Singh, Jitendra Kumar. (2025). GSSX: golden-section-based symbolic representation for reducing time series dimensionality. International Journal of Data Science and Analytics, 20(6), 5537–5554[10.1007/s41060-025-00780-5]
  13. 13.Xin Weng, Jun Fu, Jiayu Ye, Ruifen Hu, Jieyu Yin, Bowen Zhao, Ruo He. (2025). OdorNet: A lightweight odor recognition method for TinyML in handheld electronic noses using spatiotemporal pseudo-images. Sensors and Actuators B Chemical, 444, 138393[10.1016/j.snb.2025.138393]
  14. 14.Romulo Gonçalves Lins, Tiago Nascimento de Freitas, Ricardo Gaspar. (2025). Methodology for Commercial Vehicle Mechanical Systems Maintenance: Data-Driven and Deep-Learning-Based Prediction. IEEE Access, 13, 33799–33812[10.1109/access.2025.3543600]
  15. 15.Sai Sree Koneru, Jake Cho. (2024). Bridging the Gap: A Comparative Analysis of ICS and IT Datasets for IDS Evaluation. , 300–304[10.1109/fllm63129.2024.10852471]
  16. 16.Vitoria Guardieiro, Felipe Inagaki de Oliveira, Harish Doraiswamy, Luis Gustavo Nonato, Claudio Silva. (2024). TopoMap++: A Faster and More Space Efficient Technique to Compute Projections with Topological Guarantees. IEEE Transactions on Visualization and Computer Graphics, 31(1), 229–239[10.1109/tvcg.2024.3456365]
  17. 17.Nunna Joseph Mlyahilu, Evgenia Novikova. (2025). Graph Construction Approaches for Graph Neural Networks-Based Anomaly Detection in Time Series. , 144–147[10.1109/scm66446.2025.11060448]
  18. 18.Feifan Pu, Jianqiu Xu. (2025). TSQ: An Optimized Framework for Efficiently Answering Time Series Queries. Data Science and Engineering, 10(2), 296–313[10.1007/s41019-024-00273-8]
  19. 19.Dominic Sanderson, Tatiana Kalganova. (2025). Identifying Suitability for Data Reduction in Imbalanced Time-Series Datasets. AI, 6(5), 98[10.3390/ai6050098]
  20. 20.Héctor Izquierdo-Sanz, Sergio Morell-Monzó, Enrique Moltó. (2026). Leveraging Sentinel-2 Temporal Resolution for Accurate Identification of Crops in Highly Fragmented Agricultural Landscapes. Remote Sensing, 18(3), 460[10.3390/rs18030460]
  21. 21.Ana Almeida, Pedro Rito, Susana Brás, Filipe Cabral Pinto, Susana Sargento. (2024). A Machine Learning Approach to Forecast 5G Data in a Commercial and Operational 5G Platform*. , 113–120[10.23919/wons60642.2024.10449577]
  22. 22.Xintong Li, Xiaofeng Liu, Xu Zhou, Xu Zhou, Xiang Zhang, Xiaoqin Zhou, Xiaoqin Zhou. (2025). Comparative Analysis of Channel Selection Methods for EEG-Based Emotion Recognition: Balancing Accuracy and Efficiency. Lecture notes in computer science, 47–60[10.1007/978-981-96-3297-8_5]
  23. 23.Zhangguang Kang, Fiona Fui-Hoon Nah, Keng Leng Siau. (2024). A Computational Aesthetic Design Science Study on Online Video Based on Triple-Dimensional Multimodal Analysis. Lecture notes in computer science, 68–79[10.1007/978-3-031-76821-7_6]
  24. 24.Manauwar Hussain, Suwaiba Mateen, Ahteshamul Haque. (2025). Data Collection and Pre‐processing. , 105–135[10.1002/9781394270804.ch4]
  25. 25.Xuechen Zhang, Peng Wu. (2024). Improving the Performance of OPTICS on Short Text Clustering by IsoKernel and UMAP. , 1470–1474[10.1109/icsp62122.2024.10743203]
  26. 26.Yashuang Mu, Tian Liu, Wenqiang Zhang, Hongyue Guo, Lidong Wang, Xiaodong Liu. (2025). A Distributed Information Granulation Method for Time Series Clustering. Concurrency and Computation Practice and Experience, 37(4-5)[10.1002/cpe.8395]
  27. 27.Mizuki Emmei, Naoki Okami, Takanori Fujiwara, Naohisa Sakamoto, Jorji Nonaka. (2025). Visual Analytics for Multivariate Time-Series Data Using Interactive Dimensionality Reduction Methods. , 392–398[10.1109/pacificvis64226.2025.00048]
  28. 28.Francisco Jaume‐Guazzini, Vladimir López, Aitana Grasso‐Cladera, Josefina Mattoli‐Sanchez, María E. Moneta, Cristóbal Moënne‐Loccoz, Francisco J. Parada. (2025). Perception of Attachment Security, Neurodynamics of Emotion Recognition, and Social Skills in Late Childhood and Early Adolescence: A Multilinear Modeling Study. Psychophysiology, 62(2), e70008[10.1111/psyp.70008]
  29. 29.Duc Khoi Nguyen, Thi Hang Duong, Le Cuong Nguyen, Manh Kha Hoang. (2024). Performance Enhancement of Wi-Fi Fingerprinting-based Indoor Positioning using Truncated Singular Value Decomposition and LSTM Model. International Journal of Advanced Computer Science and Applications, 15(5)[10.14569/ijacsa.2024.0150529]
  30. 30.P. Toofani Movaghar, A. Taflanidis. (2025). Surrogate-based seismic risk assessment leveraging supervised data-driven feature extraction for the excitation characterization. [10.23967/icossar.2025.080]
  31. 31.Á. Sára Németh, Gergely Makan, Szabolcs Baglyas, András Lorx, Chung-Wai Chow, Joyce K. Y. Wu, Ronald J. Dandurand, Zoltán Hantos, György Kalmár. (2025). Pattern Recognition in Intra-Breath Oscillometry Measurements. IEEE Access, 13, 143781–143799[10.1109/access.2025.3598615]
  32. 32.Yao Wang, Yuan Cheng, Ling Ding, Wan Huang, C. Q. Jiang, Shumei Cui, Jie Xu. (2026). Online Characteristics Prediction for Permanent Magnet Traction Motors Based on Electromagnetic-Thermal Coupling Reduced-Order Model. IEEE Transactions on Transportation Electrification, 12(2), 3879–3892[10.1109/tte.2026.3652950]
  33. 33.Emanuela Mitreva, Desislava Paneva-Marinova, Vladimir Georgiev, Alexandra Nikolova, Radoslav Pavlov. (2026). A Hybrid Approach for Personalized and Intelligent Content Recommendation in Digital Libraries. Applied Sciences, 16(6), 2756[10.3390/app16062756]
  34. 34.Dat Le, Sutharshan Rajasegarar, Wei Luo, Thanh Thi Nguyen, Maia Angelova. (2025). Australian Real Estate Market Price Prediction with Entropy Clustering and Sentiment-Based Deep Neural Framework. Communications in computer and information science, 132–146[10.1007/978-981-96-6966-0_10]
  35. 35.Yiru Jiao, Sander van Cranenburgh, Simeon Calvert, Hans van Lint. (2025). Structure-preserving contrastive learning for spatial time series. Artificial Intelligence for Transportation, 3-4, 100031[10.1016/j.ait.2025.100031]
  36. 36.Thanh Do Van, Hai Nguyen Minh. (2024). Kernel-Based Dimension Reduction Method for Time Series Nowcasting. IEEE Access, 12, 173223–173242[10.1109/access.2024.3491499]
  37. 37.Milica Zukanović, Aleksa Radosavčević, Ana Poledica, Pavle Milošević, Ivan Luković. (2025). Evaluating Effectiveness of Nonlinear Dimensionality Reduction in Hedge Funds’ Returns Forecasting. Annals of Computer Science and Information Systems, 43, 411–416[10.15439/2025f3970]
  38. 38.Theodoros Dimitriou, Emmanouil Skondras, Christos Hitiris, Cleopatra Gkola, Ioannis S. Papapanagiotou, Dimitrios J. Vergados, Constantinos Vergopoulos, Stratos Koumantakis, Angelos Michalas, Dimitrios D. Vergados. (2023). Ship Engine Data Analysis for the Application of Machine Learning Algorithms. , 43, 1–6[10.1109/seeda-cecnsm61561.2023.10470590]
  39. 39.Fahris Mumtaza Ahsan, Igi Ardiyanto, Sunu Wibirama. (2025). A Systematic Literature Review of Semi-Supervised Learning on Time-Series Data. , 303–309[10.1109/icdsg67714.2025.11381355]
  40. 40.Jan Rems, Nacira Agram. (2024). Deep learning for conditional McKean-Vlasov Jump diffusions. SSRN Electronic Journal[10.2139/ssrn.4760864]
  41. 41.Guangwei Zu, Ben Wang, Jing Meng, Xinghua Dong, Tao Hong. (2026). A Multi-Layer Spatio-Temporal Learning and Optimization Framework for Line-Loss-Oriented Distribution Networks. Energies, 19(7), 1702[10.3390/en19071702]
  42. 42.Masana Khosa, S. Schmidt, Anna Sergeevna Bosman, Daniel Wilke. (2026). Spectral signatures of principal components for feature clarity on principal component frequency interaction. SSRN Electronic Journal[10.2139/ssrn.6394786]
  43. 43.Dasari Shivakumar, Cota Navin Gupta, Budhaditya Hazra. (2026). Long-range correlations in alpha-band of electroencephalogram: a nonlinear embedding and detrended fluctuation analysis. Frontiers in Neuroinformatics, 20, 1823408[10.3389/fninf.2026.1823408]
  44. 44.Emanuela Mitreva, Desislava Paneva-Marinova, Vladimir Georgiev, Alexandra Nikolova. (2026). A Multi-component Similarity Measure for Personalized Content Discovery in Periodical Digital Library Collections. Lecture notes in networks and systems, 357–371[10.1007/978-3-032-26211-0_22]
  45. 45.Xiaoping Guo, Juntao Li, Yuan Li. (2025). Differential fusion of multi-latent-layer temporal features for industrial process fault classification. Transactions of the Institute of Measurement and Control[10.1177/01423312251379132]
  46. 46.Seema Pal, Nitin Singh, Niraj Kumar Chaudhary, Shraddha Sharma. (2026). Comparative Analysis of Dimensionality Reduction Methods for Optimizing Load Profiling in Smart Meter Data. Lecture notes in electrical engineering, 479–492[10.1007/978-981-95-3853-9_41]
  47. 47.Chiho Haruta, Nobutaka Ono. (2026). Element selection approach to deep-neural-network-based speech enhancement for small devices under complexity constraints. Nippon Onkyo Gakkaishi/Acoustical science and technology/Nihon Onkyo Gakkaishi, 47(4), 303–313[10.1250/ast.e25.62]
← All publications