AUTOENCODER NEURAL NETWORK FOR UNIVARIATE TIME SERIES EMBEDDING
DOI:
https://doi.org/10.34185/1991-7848.itmm.2024.01.048Keywords:
time series analysis, time series embedding, dimensionality reduction, autoencoder, neural network, time series modeling, Takens’s theorem.Abstract
The problem of time series embedding is a universal one. It is the main prerequisite when it comes to modeling of dynamical processes using systems of autonomous ordinary differential equations (ODEs) because they have hard requirements for the dimensionality of the problem. One-dimensional ODE can only exhibit 3 types of behavior while two-dimensional ODE can exhibit 9. This is why it is important to increase the dimensionality of the problem before starting the modeling to allow for wider range of possible behaviors in the final model. One way to increase the dimensionality is to delay-embed the time series data but this approach can be extended to allow the use of an autoencoder neural network that would associate a higher-dimensional vector to each point in the time series and will allow the modeling to be performed in higher dimension.
References
Broomhead D.S. and King G. P. (1986). Extracting qualitative dynamics from experimental data. Physica D: Nonlinear Phenomena, Volume 20 (2-3), Pages 217-236. https://doi.org/10.1016/0167-2789(86)90031-X.
Gupta, V. and Mittal, M. (2019). QRS Complex Detection Using STFT, Chaos Analysis, and PCA in Standard and Real-Time ECG Databases. J. Inst. Eng. India Ser. B 100, 489–497. https://doi.org/10.1007/s40031-019-00398-9
Takens, F. (1981). Detecting strange attractors in turbulence. In: Rand, D., Young, LS. (eds) Dynamical Systems and Turbulence, Warwick 1980. Lecture Notes in Mathematics, vol 898. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0091924




