Molecular spectral line data preprocessing container load grouping prediction algorithm based on EMD-LSTM

Abstract

Unbalanced allocation of container resources in cluster environments is an urgent problem to be solved. Aiming at container load prediction and resource allocation strategy, this paper designs an astronomical data processing container load grouping prediction algorithm based on empirical mode decomposition-long short-term memory network, and proposes an adaptive recommendation value generation algorithm based on predicted load information, which can automatically allocate container computing resources according to the degree of load fluctuation. The load prediction accuracy is verified using simulated data and real astronomical observation data. The experimental results show that the algorithm proposed in this paper has higher prediction accuracy than the triple index method and the single long short-term memory network model. In the real-time preprocessing test of astronomical data, the recommendation value generation algorithm proposed in this paper can effectively improve the utilization efficiency of computing resources compared with the default strategy.