Static Poisson’s ratio(vs)is crucial for determining geomechanical properties in petroleum applications,namely sand production.Some models have been used to predict vs;however,the published models were limited to spe...Static Poisson’s ratio(vs)is crucial for determining geomechanical properties in petroleum applications,namely sand production.Some models have been used to predict vs;however,the published models were limited to specific data ranges with an average absolute percentage relative error(AAPRE)of more than 10%.The published gated recurrent unit(GRU)models do not consider trend analysis to show physical behaviors.In this study,we aim to develop a GRU model using trend analysis and three inputs for predicting n s based on a broad range of data,n s(value of 0.1627-0.4492),bulk formation density(RHOB)(0.315-2.994 g/mL),compressional time(DTc)(44.43-186.9 μs/ft),and shear time(DTs)(72.9-341.2μ s/ft).The GRU model was evaluated using different approaches,including statistical error an-alyses.The GRU model showed the proper trends,and the model data ranges were wider than previous ones.The GRU model has the largest correlation coefficient(R)of 0.967 and the lowest AAPRE,average percent relative error(APRE),root mean square error(RMSE),and standard deviation(SD)of 3.228%,1.054%,4.389,and 0.013,respectively,compared to other models.The GRU model has a high accuracy for the different datasets:training,validation,testing,and the whole datasets with R and AAPRE values were 0.981 and 2.601%,0.966 and 3.274%,0.967 and 3.228%,and 0.977 and 2.861%,respectively.The group error analyses of all inputs show that the GRU model has less than 5% AAPRE for all input ranges,which is superior to other models that have different AAPRE values of more than 10% at various ranges of inputs.展开更多
Aerial threat assessment is a crucial link in modern air combat, whose result counts a great deal for commanders to make decisions. With the consideration that the existing threat assessment methods have difficulties ...Aerial threat assessment is a crucial link in modern air combat, whose result counts a great deal for commanders to make decisions. With the consideration that the existing threat assessment methods have difficulties in dealing with high dimensional time series target data, a threat assessment method based on self-attention mechanism and gated recurrent unit(SAGRU) is proposed. Firstly, a threat feature system including air combat situations and capability features is established. Moreover, a data augmentation process based on fractional Fourier transform(FRFT) is applied to extract more valuable information from time series situation features. Furthermore, aiming to capture key characteristics of battlefield evolution, a bidirectional GRU and SA mechanisms are designed for enhanced features.Subsequently, after the concatenation of the processed air combat situation and capability features, the target threat level will be predicted by fully connected neural layers and the softmax classifier. Finally, in order to validate this model, an air combat dataset generated by a combat simulation system is introduced for model training and testing. The comparison experiments show the proposed model has structural rationality and can perform threat assessment faster and more accurately than the other existing models based on deep learning.展开更多
An accurate prediction of earth pressure balance(EPB)shield moving performance is important to ensure the safety tunnel excavation.A hybrid model is developed based on the particle swarm optimization(PSO)and gated rec...An accurate prediction of earth pressure balance(EPB)shield moving performance is important to ensure the safety tunnel excavation.A hybrid model is developed based on the particle swarm optimization(PSO)and gated recurrent unit(GRU)neural network.PSO is utilized to assign the optimal hyperparameters of GRU neural network.There are mainly four steps:data collection and processing,hybrid model establishment,model performance evaluation and correlation analysis.The developed model provides an alternative to tackle with time-series data of tunnel project.Apart from that,a novel framework about model application is performed to provide guidelines in practice.A tunnel project is utilized to evaluate the performance of proposed hybrid model.Results indicate that geological and construction variables are significant to the model performance.Correlation analysis shows that construction variables(main thrust and foam liquid volume)display the highest correlation with the cutterhead torque(CHT).This work provides a feasible and applicable alternative way to estimate the performance of shield tunneling.展开更多
Short-term load forecasting(STLF)plays a crucial role in the smart grid.However,it is challenging to capture the long-time dependence and the nonlinear relationship due to the comprehensive fluctuations of the electri...Short-term load forecasting(STLF)plays a crucial role in the smart grid.However,it is challenging to capture the long-time dependence and the nonlinear relationship due to the comprehensive fluctuations of the electrical load.In this paper,an STLF model based on gated recurrent unit and multi-head attention(GRU-MA)is proposed to address the aforementioned problems.The proposed model accommodates the time series and nonlinear relationship of load data through gated recurrent unit(GRU)and exploits multi-head attention(MA)to learn the decisive features and long-term dependencies.Additionally,the proposed model is compared with the support vector regression(SVR)model,the recurrent neural network and multi-head attention(RNN-MA)model,the long short-term memory and multi-head attention(LSTM-MA)model,the GRU model,and the temporal convolutional network(TCN)model using the public dataset of the Global Energy Forecasting Competition 2014(GEFCOM2014).The results demonstrate that the GRU-MA model has the best prediction accuracy.展开更多
In order to effectively solve the problems of low accuracy and large amount of calculation of current human behavior recognition,a behavior recognition algorithm based on squeeze-and-excitation network(SENet) combined...In order to effectively solve the problems of low accuracy and large amount of calculation of current human behavior recognition,a behavior recognition algorithm based on squeeze-and-excitation network(SENet) combined with 3 D Inception network(I3 D) and gated recurrent unit(GRU) network is proposed.The algorithm first expands the Inception module to three-dimensional,and builds a network based on the three-dimensional module,and expands SENet to three-dimensional,making it an attention mechanism that can pay attention to the three-dimensional channel.Then SENet is introduced into the 13 D network,named SE-I3 D,and SENet is introduced into the CRU network,named SE-GRU.And,SE-13 D and SE-GRU are merged,named SE-13 D-GRU.Finally,the network uses Softmax to classify the results in the UCF-101 dataset.The experimental results show that the SE-I3 D-GRU network achieves a recognition rate of 93.2% on the UCF-101 dataset.展开更多
Accurate wind speed prediction has been becoming an indispensable technology in system security,wind energy utilization,and power grid dispatching in recent years.However,it is an arduous task to predict wind speed du...Accurate wind speed prediction has been becoming an indispensable technology in system security,wind energy utilization,and power grid dispatching in recent years.However,it is an arduous task to predict wind speed due to its variable and random characteristics.For the objective to enhance the performance of forecasting short-term wind speed,this work puts forward a hybrid deep learning model mixing time series decomposition algorithm and gated recurrent unit(GRU).The time series decomposition algorithm combines the following two parts:(1)the complete ensemble empirical mode decomposition with adaptive noise(CEEMDAN),and(2)wavelet packet decomposition(WPD).Firstly,the normalized wind speed time series(WSTS)are handled by CEEMDAN to gain pure fixed-frequency components and a residual signal.The WPD algorithm conducts the second-order decomposition to the first component that contains complex and high frequency signal of raw WSTS.Finally,GRU networks are established for all the relevant components of the signals,and the predicted wind speeds are obtained by superimposing the prediction of each component.Results from two case studies,adopting wind data from laboratory and wind farm,respectively,suggest that the related trend of the WSTS can be separated effectively by the proposed time series decomposition algorithm,and the accuracy of short-time wind speed prediction can be heightened significantly mixing the time series decomposition algorithm and GRU networks.展开更多
Deep learning based recommendation methods, such as the recurrent neural network based recommendation method(RNNRec) and the gated recurrent unit(GRU) based recommendation method(GRURec), are proposed to solve the pro...Deep learning based recommendation methods, such as the recurrent neural network based recommendation method(RNNRec) and the gated recurrent unit(GRU) based recommendation method(GRURec), are proposed to solve the problem of time heterogeneous feedback recommendation. These methods out-perform several state-of-the-art methods. However, in RNNRec and GRURec, action vectors and item vectors are shared among users. The different meanings of the same action for different users are not considered. Similarly, different user preference for the same item is also ignored. To address this problem, the models of RNNRec and GRURec are modified in this paper. In the proposed methods, action vectors and item vectors are transformed into the user space for each user firstly, and then the transformed vectors are fed into the original neural networks of RNNRec and GRURec. The transformed action vectors and item vectors represent the user specified meaning of actions and the preference for items, which makes the proposed method obtain more accurate recommendation results. The experimental results on two real-life datasets indicate that the proposed method outperforms RNNRec and GRURec as well as other state-of-the-art approaches in most cases.展开更多
Based on a comparative analysis of the Long Short-Term Memory(LSTM)and Gated Recurrent Unit(GRU)networks,we optimize the structure of the GRU network and propose a new modulation recognition method based on feature ex...Based on a comparative analysis of the Long Short-Term Memory(LSTM)and Gated Recurrent Unit(GRU)networks,we optimize the structure of the GRU network and propose a new modulation recognition method based on feature extraction and a deep learning algorithm.High-order cumulant,Signal-to-Noise Ratio(SNR),instantaneous feature,and the cyclic spectrum of signals are extracted firstly,and then input into the Convolutional Neural Network(CNN)and the parallel network of GRU for recognition.Eight modulation modes of communication signals are recognized automatically.Simulation results show that the proposed method can achieve high recognition rate at low SNR.展开更多
The squelch problem of ultra-short wave communication under non-stationary noise and low Signal-to-Noise Ratio(SNR)in a complex electromagnetic environment is still challenging.To alleviate the problem,we proposed a s...The squelch problem of ultra-short wave communication under non-stationary noise and low Signal-to-Noise Ratio(SNR)in a complex electromagnetic environment is still challenging.To alleviate the problem,we proposed a squelch algorithm for ultra-short wave communication based on a deep neural network and the traditional energy decision method.The proposed algorithm first predicts the speech existence probability using a three-layer Gated Recurrent Unit(GRU)with the speech banding spectrum as the feature.Then it gets the final squelch result by combining the strength of the signal energy and the speech existence probability.Multiple simulations and experiments are done to verify the robustness and effectiveness of the proposed algorithm.We simulate the algorithm in three situations:the typical Amplitude Modulation(AM)and Frequency Modulation(FM)in the ultra-short wave communication under different SNR environments,the non-stationary burst-like noise environments,and the real received signal of the ultra-short wave radio.The experimental results show that the proposed algorithm performs better than the traditional squelch methods in all the simulations and experiments.In particular,the false alarm rate of the proposed squelch algorithm for non-stationary burst-like noise is significantly lower than that of traditional squelch methods.展开更多
基金The authors thank the Yayasan Universiti Teknologi PETRONAS(YUTP FRG Grant No.015LC0-428)at Universiti Teknologi PETRO-NAS for supporting this study.
文摘Static Poisson’s ratio(vs)is crucial for determining geomechanical properties in petroleum applications,namely sand production.Some models have been used to predict vs;however,the published models were limited to specific data ranges with an average absolute percentage relative error(AAPRE)of more than 10%.The published gated recurrent unit(GRU)models do not consider trend analysis to show physical behaviors.In this study,we aim to develop a GRU model using trend analysis and three inputs for predicting n s based on a broad range of data,n s(value of 0.1627-0.4492),bulk formation density(RHOB)(0.315-2.994 g/mL),compressional time(DTc)(44.43-186.9 μs/ft),and shear time(DTs)(72.9-341.2μ s/ft).The GRU model was evaluated using different approaches,including statistical error an-alyses.The GRU model showed the proper trends,and the model data ranges were wider than previous ones.The GRU model has the largest correlation coefficient(R)of 0.967 and the lowest AAPRE,average percent relative error(APRE),root mean square error(RMSE),and standard deviation(SD)of 3.228%,1.054%,4.389,and 0.013,respectively,compared to other models.The GRU model has a high accuracy for the different datasets:training,validation,testing,and the whole datasets with R and AAPRE values were 0.981 and 2.601%,0.966 and 3.274%,0.967 and 3.228%,and 0.977 and 2.861%,respectively.The group error analyses of all inputs show that the GRU model has less than 5% AAPRE for all input ranges,which is superior to other models that have different AAPRE values of more than 10% at various ranges of inputs.
基金supported by the National Natural Science Foundation of China (6202201562088101)+1 种基金Shanghai Municipal Science and Technology Major Project (2021SHZDZX0100)Shanghai Municip al Commission of Science and Technology Project (19511132101)。
文摘Aerial threat assessment is a crucial link in modern air combat, whose result counts a great deal for commanders to make decisions. With the consideration that the existing threat assessment methods have difficulties in dealing with high dimensional time series target data, a threat assessment method based on self-attention mechanism and gated recurrent unit(SAGRU) is proposed. Firstly, a threat feature system including air combat situations and capability features is established. Moreover, a data augmentation process based on fractional Fourier transform(FRFT) is applied to extract more valuable information from time series situation features. Furthermore, aiming to capture key characteristics of battlefield evolution, a bidirectional GRU and SA mechanisms are designed for enhanced features.Subsequently, after the concatenation of the processed air combat situation and capability features, the target threat level will be predicted by fully connected neural layers and the softmax classifier. Finally, in order to validate this model, an air combat dataset generated by a combat simulation system is introduced for model training and testing. The comparison experiments show the proposed model has structural rationality and can perform threat assessment faster and more accurately than the other existing models based on deep learning.
基金funded by“The Pearl River Talent Recruitment Program”of Guangdong Province in 2019(Grant No.2019CX01G338)the Research Funding of Shantou University for New Faculty Member(Grant No.NTF19024-2019).
文摘An accurate prediction of earth pressure balance(EPB)shield moving performance is important to ensure the safety tunnel excavation.A hybrid model is developed based on the particle swarm optimization(PSO)and gated recurrent unit(GRU)neural network.PSO is utilized to assign the optimal hyperparameters of GRU neural network.There are mainly four steps:data collection and processing,hybrid model establishment,model performance evaluation and correlation analysis.The developed model provides an alternative to tackle with time-series data of tunnel project.Apart from that,a novel framework about model application is performed to provide guidelines in practice.A tunnel project is utilized to evaluate the performance of proposed hybrid model.Results indicate that geological and construction variables are significant to the model performance.Correlation analysis shows that construction variables(main thrust and foam liquid volume)display the highest correlation with the cutterhead torque(CHT).This work provides a feasible and applicable alternative way to estimate the performance of shield tunneling.
基金supported by the National Natural Science Foundation of China(61771258)。
文摘Short-term load forecasting(STLF)plays a crucial role in the smart grid.However,it is challenging to capture the long-time dependence and the nonlinear relationship due to the comprehensive fluctuations of the electrical load.In this paper,an STLF model based on gated recurrent unit and multi-head attention(GRU-MA)is proposed to address the aforementioned problems.The proposed model accommodates the time series and nonlinear relationship of load data through gated recurrent unit(GRU)and exploits multi-head attention(MA)to learn the decisive features and long-term dependencies.Additionally,the proposed model is compared with the support vector regression(SVR)model,the recurrent neural network and multi-head attention(RNN-MA)model,the long short-term memory and multi-head attention(LSTM-MA)model,the GRU model,and the temporal convolutional network(TCN)model using the public dataset of the Global Energy Forecasting Competition 2014(GEFCOM2014).The results demonstrate that the GRU-MA model has the best prediction accuracy.
基金Supported by the Shaanxi Province Key Research and Development Project(No.2021 GY-280)the Natural Science Foundation of Shaanxi Province(No.2021JM-459)the National Natural Science Foundation of China(No.61772417,61634004,61602377).
文摘In order to effectively solve the problems of low accuracy and large amount of calculation of current human behavior recognition,a behavior recognition algorithm based on squeeze-and-excitation network(SENet) combined with 3 D Inception network(I3 D) and gated recurrent unit(GRU) network is proposed.The algorithm first expands the Inception module to three-dimensional,and builds a network based on the three-dimensional module,and expands SENet to three-dimensional,making it an attention mechanism that can pay attention to the three-dimensional channel.Then SENet is introduced into the 13 D network,named SE-I3 D,and SENet is introduced into the CRU network,named SE-GRU.And,SE-13 D and SE-GRU are merged,named SE-13 D-GRU.Finally,the network uses Softmax to classify the results in the UCF-101 dataset.The experimental results show that the SE-I3 D-GRU network achieves a recognition rate of 93.2% on the UCF-101 dataset.
基金This work was supported in part by the National Key Research and Development Project of China(No.2019YFE0105300)the National Natural Science Foundation of China(No.61972443)the Hunan Provincial Key Research and Development Project of China(No.2022WK2006).
文摘Accurate wind speed prediction has been becoming an indispensable technology in system security,wind energy utilization,and power grid dispatching in recent years.However,it is an arduous task to predict wind speed due to its variable and random characteristics.For the objective to enhance the performance of forecasting short-term wind speed,this work puts forward a hybrid deep learning model mixing time series decomposition algorithm and gated recurrent unit(GRU).The time series decomposition algorithm combines the following two parts:(1)the complete ensemble empirical mode decomposition with adaptive noise(CEEMDAN),and(2)wavelet packet decomposition(WPD).Firstly,the normalized wind speed time series(WSTS)are handled by CEEMDAN to gain pure fixed-frequency components and a residual signal.The WPD algorithm conducts the second-order decomposition to the first component that contains complex and high frequency signal of raw WSTS.Finally,GRU networks are established for all the relevant components of the signals,and the predicted wind speeds are obtained by superimposing the prediction of each component.Results from two case studies,adopting wind data from laboratory and wind farm,respectively,suggest that the related trend of the WSTS can be separated effectively by the proposed time series decomposition algorithm,and the accuracy of short-time wind speed prediction can be heightened significantly mixing the time series decomposition algorithm and GRU networks.
基金supported by the National Natural Science Foundation of China(61403350)。
文摘Deep learning based recommendation methods, such as the recurrent neural network based recommendation method(RNNRec) and the gated recurrent unit(GRU) based recommendation method(GRURec), are proposed to solve the problem of time heterogeneous feedback recommendation. These methods out-perform several state-of-the-art methods. However, in RNNRec and GRURec, action vectors and item vectors are shared among users. The different meanings of the same action for different users are not considered. Similarly, different user preference for the same item is also ignored. To address this problem, the models of RNNRec and GRURec are modified in this paper. In the proposed methods, action vectors and item vectors are transformed into the user space for each user firstly, and then the transformed vectors are fed into the original neural networks of RNNRec and GRURec. The transformed action vectors and item vectors represent the user specified meaning of actions and the preference for items, which makes the proposed method obtain more accurate recommendation results. The experimental results on two real-life datasets indicate that the proposed method outperforms RNNRec and GRURec as well as other state-of-the-art approaches in most cases.
基金partially supported by Major Scientific and Technological Achievements Transformation Project of Heilongjiang Province in 2019(No.CG20A007)。
文摘Based on a comparative analysis of the Long Short-Term Memory(LSTM)and Gated Recurrent Unit(GRU)networks,we optimize the structure of the GRU network and propose a new modulation recognition method based on feature extraction and a deep learning algorithm.High-order cumulant,Signal-to-Noise Ratio(SNR),instantaneous feature,and the cyclic spectrum of signals are extracted firstly,and then input into the Convolutional Neural Network(CNN)and the parallel network of GRU for recognition.Eight modulation modes of communication signals are recognized automatically.Simulation results show that the proposed method can achieve high recognition rate at low SNR.
文摘The squelch problem of ultra-short wave communication under non-stationary noise and low Signal-to-Noise Ratio(SNR)in a complex electromagnetic environment is still challenging.To alleviate the problem,we proposed a squelch algorithm for ultra-short wave communication based on a deep neural network and the traditional energy decision method.The proposed algorithm first predicts the speech existence probability using a three-layer Gated Recurrent Unit(GRU)with the speech banding spectrum as the feature.Then it gets the final squelch result by combining the strength of the signal energy and the speech existence probability.Multiple simulations and experiments are done to verify the robustness and effectiveness of the proposed algorithm.We simulate the algorithm in three situations:the typical Amplitude Modulation(AM)and Frequency Modulation(FM)in the ultra-short wave communication under different SNR environments,the non-stationary burst-like noise environments,and the real received signal of the ultra-short wave radio.The experimental results show that the proposed algorithm performs better than the traditional squelch methods in all the simulations and experiments.In particular,the false alarm rate of the proposed squelch algorithm for non-stationary burst-like noise is significantly lower than that of traditional squelch methods.
