The safe and reliable operation of lithium-ion batteries necessitates the accurate prediction of remaining useful life(RUL).However,this task is challenging due to the diverse ageing mechanisms,various operating condi...The safe and reliable operation of lithium-ion batteries necessitates the accurate prediction of remaining useful life(RUL).However,this task is challenging due to the diverse ageing mechanisms,various operating conditions,and limited measured signals.Although data-driven methods are perceived as a promising solution,they ignore intrinsic battery physics,leading to compromised accuracy,low efficiency,and low interpretability.In response,this study integrates domain knowledge into deep learning to enhance the RUL prediction performance.We demonstrate accurate RUL prediction using only a single charging curve.First,a generalisable physics-based model is developed to extract ageing-correlated parameters that can describe and explain battery degradation from battery charging data.The parameters inform a deep neural network(DNN)to predict RUL with high accuracy and efficiency.The trained model is validated under 3 types of batteries working under 7 conditions,considering fully charged and partially charged cases.Using data from one cycle only,the proposed method achieves a root mean squared error(RMSE)of 11.42 cycles and a mean absolute relative error(MARE)of 3.19%on average,which are over45%and 44%lower compared to the two state-of-the-art data-driven methods,respectively.Besides its accuracy,the proposed method also outperforms existing methods in terms of efficiency,input burden,and robustness.The inherent relationship between the model parameters and the battery degradation mechanism is further revealed,substantiating the intrinsic superiority of the proposed method.展开更多
In order to prevent possible casualties and economic loss, it is critical to accurate prediction of the Remaining Useful Life (RUL) in rail prognostics health management. However, the traditional neural networks is di...In order to prevent possible casualties and economic loss, it is critical to accurate prediction of the Remaining Useful Life (RUL) in rail prognostics health management. However, the traditional neural networks is difficult to capture the long-term dependency relationship of the time series in the modeling of the long time series of rail damage, due to the coupling relationship of multi-channel data from multiple sensors. Here, in this paper, a novel RUL prediction model with an enhanced pulse separable convolution is used to solve this issue. Firstly, a coding module based on the improved pulse separable convolutional network is established to effectively model the relationship between the data. To enhance the network, an alternate gradient back propagation method is implemented. And an efficient channel attention (ECA) mechanism is developed for better emphasizing the useful pulse characteristics. Secondly, an optimized Transformer encoder was designed to serve as the backbone of the model. It has the ability to efficiently understand relationship between the data itself and each other at each time step of long time series with a full life cycle. More importantly, the Transformer encoder is improved by integrating pulse maximum pooling to retain more pulse timing characteristics. Finally, based on the characteristics of the front layer, the final predicted RUL value was provided and served as the end-to-end solution. The empirical findings validate the efficacy of the suggested approach in forecasting the rail RUL, surpassing various existing data-driven prognostication techniques. Meanwhile, the proposed method also shows good generalization performance on PHM2012 bearing data set.展开更多
In recent years,intelligent data-driven prognostic methods have been successfully developed,and good machinery health assessment performance has been achieved through explorations of data from multiple sensors.However...In recent years,intelligent data-driven prognostic methods have been successfully developed,and good machinery health assessment performance has been achieved through explorations of data from multiple sensors.However,existing datafusion prognostic approaches generally rely on the data availability of all sensors,and are vulnerable to potential sensor malfunctions,which are likely to occur in real industries especially for machines in harsh operating environments.In this paper,a deep learning-based remaining useful life(RUL)prediction method is proposed to address the sensor malfunction problem.A global feature extraction scheme is adopted to fully exploit information of different sensors.Adversarial learning is further introduced to extract generalized sensor-invariant features.Through explorations of both global and shared features,promising and robust RUL prediction performance can be achieved by the proposed method in the testing scenarios with sensor malfunctions.The experimental results suggest the proposed approach is well suited for real industrial applications.展开更多
Accurate estimation of the remaining useful life(RUL)of lithium-ion batteries is critical for their large-scale deployment as energy storage devices in electric vehicles and stationary storage.A fundamental understand...Accurate estimation of the remaining useful life(RUL)of lithium-ion batteries is critical for their large-scale deployment as energy storage devices in electric vehicles and stationary storage.A fundamental understanding of the factors affecting RUL is crucial for accelerating battery technology development.However,it is very challenging to predict RUL accurately because of complex degradation mechanisms occurring within the batteries,as well as dynamic operating conditions in practical applications.Moreover,due to insignificant capacity degradation in early stages,early prediction of battery life with early cycle data can be more difficult.In this paper,we propose a hybrid deep learning model for early prediction of battery RUL.The proposed method can effectively combine handcrafted features with domain knowledge and latent features learned by deep networks to boost the performance of RUL early prediction.We also design a non-linear correlation-based method to select effective domain knowledge-based features.Moreover,a novel snapshot ensemble learning strategy is proposed to further enhance model generalization ability without increasing any additional training cost.Our experimental results show that the proposed method not only outperforms other approaches in the primary test set having a similar distribution as the training set,but also generalizes well to the secondary test set having a clearly different distribution with the training set.The PyTorch implementation of our proposed approach is available at https://github.com/batteryrul/battery_rul_early_prediction.展开更多
Remaining useful life(RUL)prediction is one of the most crucial components in prognostics and health management(PHM)of aero-engines.This paper proposes an RUL prediction method of aero-engines considering the randomne...Remaining useful life(RUL)prediction is one of the most crucial components in prognostics and health management(PHM)of aero-engines.This paper proposes an RUL prediction method of aero-engines considering the randomness of failure threshold.Firstly,a random-coefficient regression(RCR)model is used to model the degradation process of aeroengines.Then,the RUL distribution based on fixed failure threshold is derived.The prior parameters of the degradation model are calculated by a two-step maximum likelihood estimation(MLE)method and the random coefficient is updated in real time under the Bayesian framework.The failure threshold in this paper is defined by the actual degradation process of aeroengines.After that,a expectation maximization(EM)algorithm is proposed to estimate the underlying failure threshold of aeroengines.In addition,the conditional probability is used to satisfy the limitation of failure threshold.Then,based on above results,an analytical expression of RUL distribution of aero-engines based on the RCR model considering random failure threshold(RFT)is derived in a closed-form.Finally,a case study of turbofan engine is used to demonstrate the effectiveness and superiority of the RUL prediction method and the parameters estimation method of failure threshold proposed.展开更多
Remaining useful life(RUL) prediction is one of the most crucial elements in prognostics and health management(PHM). Aiming at the imperfect prior information, this paper proposes an RUL prediction method based on a n...Remaining useful life(RUL) prediction is one of the most crucial elements in prognostics and health management(PHM). Aiming at the imperfect prior information, this paper proposes an RUL prediction method based on a nonlinear random coefficient regression(RCR) model with fusing failure time data.Firstly, some interesting natures of parameters estimation based on the nonlinear RCR model are given. Based on these natures,the failure time data can be fused as the prior information reasonably. Specifically, the fixed parameters are calculated by the field degradation data of the evaluated equipment and the prior information of random coefficient is estimated with fusing the failure time data of congeneric equipment. Then, the prior information of the random coefficient is updated online under the Bayesian framework, the probability density function(PDF) of the RUL with considering the limitation of the failure threshold is performed. Finally, two case studies are used for experimental verification. Compared with the traditional Bayesian method, the proposed method can effectively reduce the influence of imperfect prior information and improve the accuracy of RUL prediction.展开更多
As the fundamental and key technique to ensure the safe and reliable operation of vital systems,prognostics with an emphasis on the remaining useful life(RUL)prediction has attracted great attention in the last decade...As the fundamental and key technique to ensure the safe and reliable operation of vital systems,prognostics with an emphasis on the remaining useful life(RUL)prediction has attracted great attention in the last decades.In this paper,we briefly discuss the general idea and advances of various prognostics and RUL prediction methods for machinery,mainly including data-driven methods,physics-based methods,hybrid methods,etc.Based on the observations fromthe state of the art,we provide comprehensive discussions on the possible opportunities and challenges of prognostics and RUL prediction of machinery so as to steer the future development.展开更多
Supercapacitors are appealing energy storage devices for their promising features like high power density,outstanding cycling stability,and a quick charge–discharge cycle.The exceptional life cycle and ultimate power...Supercapacitors are appealing energy storage devices for their promising features like high power density,outstanding cycling stability,and a quick charge–discharge cycle.The exceptional life cycle and ultimate power capability of supercapacitors are needed in the transportation and renewable energy generation sectors.Hence,predicting the capacitance and lifecycle of supercapacitors is significant for selecting the suitable material and planning replacement intervals for supercapacitors.In addition,system failures can be better addressed by accurately forecasting the lifecycle of SCs.Recently,the use of machine learning for performance prediction of energy storage materials has drawn increasing attention from researchers globally because of its superiority in prediction accuracy,time efficiency,and costeffectiveness.This article presents a detailed review of the progress and advancement of ML techniques for the prediction of capacitance and remaining useful life(RUL)of supercapacitors.The review starts with an introduction to supercapacitor materials and ML applications in energy storage devices,followed by workflow for ML model building for supercapacitor materials.Then,the summary of machine learning applications for the prediction of capacitance and RUL of different supercapacitor materials including EDLCs(carbon based materials),pesudocapacitive(oxides and composites)and hybrid materials is presented.Finally,the general perspective for future directions is also presented.展开更多
Though the lithium-ion battery is universally applied,the reliability of lithium-ion batteries remains a challenge due to various physicochemical reactions,electrode material degradation,and even thermal runaway.Accur...Though the lithium-ion battery is universally applied,the reliability of lithium-ion batteries remains a challenge due to various physicochemical reactions,electrode material degradation,and even thermal runaway.Accurate estimation and prediction of battery health conditions are crucial for battery safety management.In this paper,an end-cloud collaboration method is proposed to approach the track of battery degradation process,integrating end-side empirical model with cloud-side data-driven model.Based on ensemble learning methods,the data-driven model is constructed by three base models to obtain cloud-side highly accurate results.The double exponential decay model is utilized as an empirical model to output highly real-time prediction results.With Kalman filter,the prediction results of end-side empirical model can be periodically updated by highly accurate results of cloud-side data-driven model to obtain highly accurate and real-time results.Subsequently,the whole framework can give an accurate prediction and tracking of battery degradation,with the mean absolute error maintained below 2%.And the execution time on the end side can reach 261μs.The proposed end-cloud collaboration method has the potential to approach highly accurate and highly real-time estimation for battery health conditions during battery full life cycle in architecture of cyber hierarchy and interactional network.展开更多
As the central component of rotating machine,the performance reliability assessment and remaining useful lifetime prediction of bearing are of crucial importance in condition-based maintenance to reduce the maintenanc...As the central component of rotating machine,the performance reliability assessment and remaining useful lifetime prediction of bearing are of crucial importance in condition-based maintenance to reduce the maintenance cost and improve the reliability.A prognostic algorithm to assess the reliability and forecast the remaining useful lifetime(RUL) of bearings was proposed,consisting of three phases.Online vibration and temperature signals of bearings in normal state were measured during the manufacturing process and the most useful time-dependent features of vibration signals were extracted based on correlation analysis(feature selection step).Time series analysis based on neural network,as an identification model,was used to predict the features of bearing vibration signals at any horizons(feature prediction step).Furthermore,according to the features,degradation factor was defined.The proportional hazard model was generated to estimate the survival function and forecast the RUL of the bearing(RUL prediction step).The positive results show that the plausibility and effectiveness of the proposed approach can facilitate bearing reliability estimation and RUL prediction.展开更多
The remaining useful life(RUL)estimation of bearings is critical for ensuring the reliability of mechanical systems.Owing to the rapid development of deep learning methods,a multitude of data-driven RUL estimation app...The remaining useful life(RUL)estimation of bearings is critical for ensuring the reliability of mechanical systems.Owing to the rapid development of deep learning methods,a multitude of data-driven RUL estimation approaches have been proposed recently.However,the following problems remain in existing methods:1)Most network models use raw data or statistical features as input,which renders it difficult to extract complex fault-related information hidden in signals;2)for current observations,the dependence between current states is emphasized,but their complex dependence on previous states is often disregarded;3)the output of neural networks is directly used as the estimated RUL in most studies,resulting in extremely volatile prediction results that lack robustness.Hence,a novel prognostics approach is proposed based on a time-frequency representation(TFR)subsequence,three-dimensional convolutional neural network(3DCNN),and Gaussian process regression(GPR).The approach primarily comprises two aspects:construction of a health indicator(HI)using the TFR-subsequence-3DCNN model,and RUL estimation based on the GPR model.The raw signals of the bearings are converted into TFR-subsequences by continuous wavelet transform and a dislocated overlapping strategy.Subsequently,the 3DCNN is applied to extract the hidden spatiotemporal features from the TFR-subsequences and construct HIs.Finally,the RUL of the bearings is estimated using the GPR model,which can also define the probability distribution of the potential function and prediction confidence.Experiments on the PRONOSTIA platform demonstrate the superiority of the proposed TFR-subsequence-3DCNN-GPR approach.The use of degradation-related spatiotemporal features in signals is proposed herein to achieve a highly accurate bearing RUL prediction with uncertainty quantification.展开更多
Accurate estimation of the remaining useful life(RUL)and health state for rollers is of great significance to hot rolling production.It can provide decision support for roller management so as to improve the productiv...Accurate estimation of the remaining useful life(RUL)and health state for rollers is of great significance to hot rolling production.It can provide decision support for roller management so as to improve the productivity of the hot rolling process.In addition,the RUL prediction for rollers is helpful in transitioning from the current regular maintenance strategy to conditional-based maintenance.Therefore,a new method that can extract coarse-grained and fine-grained features from batch data to predict the RUL of the rollers is proposed in this paper.Firstly,a new deep learning network architecture based on recurrent neural networks that can make full use of the extracted coarsegrained fine-grained features to estimate the heath indicator(HI)is developed,where the HI is able to indicate the health state of the roller.Following that,a state-space model is constructed to describe the HI,and the probabilistic distribution of RUL can be estimated by extrapolating the HI degradation model to a predefined failure threshold.Finally,application to a hot strip mill is given to verify the effectiveness of the proposed methods using data collected from an industrial site,and the relatively low RMSE and MAE values demonstrate its advantages compared with some other popular deep learning methods.展开更多
Nonlinearity and implicitness are common degradation features of the stochastic degradation equipment for prognostics.These features have an uncertain effect on the remaining useful life(RUL)prediction of the equipmen...Nonlinearity and implicitness are common degradation features of the stochastic degradation equipment for prognostics.These features have an uncertain effect on the remaining useful life(RUL)prediction of the equipment.The current data-driven RUL prediction method has not systematically studied the nonlinear hidden degradation modeling and the RUL distribution function.This paper uses the nonlinear Wiener process to build a dual nonlinear implicit degradation model.Based on the historical measured data of similar equipment,the maximum likelihood estimation algorithm is used to estimate the fixed coefficients and the prior distribution of a random coefficient.Using the on-site measured data of the target equipment,the posterior distribution of a random coefficient and actual degradation state are step-by-step updated based on Bayesian inference and the extended Kalman filtering algorithm.The analytical form of the RUL distribution function is derived based on the first hitting time distribution.Combined with the two case studies,the proposed method is verified to have certain advantages over the existing methods in the accuracy of prediction.展开更多
Remaining useful life(RUL)prediction is an advanced technique for system maintenance scheduling.Most of existing RUL prediction methods are only interested in the precision of RUL estimation;the adverse impact of over...Remaining useful life(RUL)prediction is an advanced technique for system maintenance scheduling.Most of existing RUL prediction methods are only interested in the precision of RUL estimation;the adverse impact of overestimated RUL on maintenance scheduling is not of concern.In this work,an RUL estimation method with risk-averse adaptation is developed which can reduce the over-estimation rate while maintaining a reasonable under-estimation level.The proposed method includes a module of degradation feature selection to obtain crucial features which reflect system degradation trends.Then,the latent structure between the degradation features and the RUL labels is modeled by a support vector regression(SVR)model and a long short-term memory(LSTM)network,respectively.To enhance the prediction robustness and increase its marginal utility,the SVR model and the LSTM model are integrated to generate a hybrid model via three connection parameters.By designing a cost function with penalty mechanism,the three parameters are determined using a modified grey wolf optimization algorithm.In addition,a cost metric is proposed to measure the benefit of such a risk-averse predictive maintenance method.Verification is done using an aero-engine data set from NASA.The results show the feasibility and effectiveness of the proposed RUL estimation method and the predictive maintenance strategy.展开更多
The key to failure prevention for aero-engine lies in performance prediction and the exhaust gas temperature margin(EGTM)is used as the most important degradation parameter to obtain the operating performance of the a...The key to failure prevention for aero-engine lies in performance prediction and the exhaust gas temperature margin(EGTM)is used as the most important degradation parameter to obtain the operating performance of the aero-engine.Because of the complex environment interference,EGTM always has strong randomness,and the state space based degradation model can identify the noisy observation from the true degradation state,which is more close to the actual situations.Therefore,a state space model based on EGTM is established to describe the degradation path and predict the remaining useful life(RUL).As one of the most effective methods for both linear state estimation and parameter estimation,Kalman filter(KF)is applied.Firstly,with EGTM degradation data,state space model approach is used to set up a state space model for aero-engine.Secondly,RUL of aero-engine is analyzed,and expected RUL and distribution of RUL are determined.Finally,the sate space model and KF algorithm are applied to an example of CFM-56aero-engine.The expected RUL is predicted,and corresponding probability density distribution(PDF)and cumulative distribution function(CDF)are given.The result indicates that the accuracy of RUL prediction reaches 7.76%ahead 580 flight cycles(FC),which is more accurate than linear regression,and therefore shows the validity and rationality of the proposed method.展开更多
The remaining useful life(RUL)of a system is generally predicted by utilising the data collected from the sensors that continuously monitor different indicators.Recently,different deep learning(DL)techniques have been...The remaining useful life(RUL)of a system is generally predicted by utilising the data collected from the sensors that continuously monitor different indicators.Recently,different deep learning(DL)techniques have been used for RUL prediction and achieved great success.Because the data is often time-sequential,recurrent neural network(RNN)has attracted significant interests due to its efficiency in dealing with such data.This paper systematically reviews RNN and its variants for RUL prediction,with a specific focus on understanding how different components(e.g.,types of optimisers and activation functions)or parameters(e.g.,sequence length,neuron quantities)affect their performance.After that,a case study using the well-studied NASA’s C-MAPSS dataset is presented to quantitatively evaluate the influence of various state-of-the-art RNN structures on the RUL prediction performance.The result suggests that the variant methods usually perform better than the original RNN,and among which,Bi-directional Long Short-Term Memory generally has the best performance in terms of stability,precision and accuracy.Certain model structures may fail to produce valid RUL prediction result due to the gradient vanishing or gradient exploring problem if the parameters are not chosen appropriately.It is concluded that parameter tuning is a crucial step to achieve optimal prediction performance.展开更多
In this paper,a novel remaining useful life prediction approach considering fault effects is proposed.The Wiener process is used to construct the degradation process of single performance characteristic with the fault...In this paper,a novel remaining useful life prediction approach considering fault effects is proposed.The Wiener process is used to construct the degradation process of single performance characteristic with the fault effects.The first passage time based remaining useful life distribution is calculated by assuming fault occurrence moment is a random variable and follows a certain distribution.Expectation maximization algorithm is employed to estimate model parameters,where the fault occurrence moment is considered as a missing data.Finally,a Copula function is used to describe the dependence between the multiple performance characteristics and derive joint remaining useful life(RUL)distribution of product with the fault effects.The effectiveness of the proposed approach is verified by the experiments of turbofan engines.展开更多
Accurate remaining useful life(RUL)prediction is important in industrial systems.It prevents machines from working under failure conditions,and ensures that the industrial system works reliably and efficiently.Recentl...Accurate remaining useful life(RUL)prediction is important in industrial systems.It prevents machines from working under failure conditions,and ensures that the industrial system works reliably and efficiently.Recently,many deep learning based methods have been proposed to predict RUL.Among these methods,recurrent neural network(RNN)based approaches show a strong capability of capturing sequential information.This allows RNN based methods to perform better than convolutional neural network(CNN)based approaches on the RUL prediction task.In this paper,we question this common paradigm and argue that existing CNN based approaches are not designed according to the classic principles of CNN,which reduces their performances.Additionally,the capacity of capturing sequential information is highly affected by the receptive field of CNN,which is neglected by existing CNN based methods.To solve these problems,we propose a series of new CNNs,which show competitive results to RNN based methods.Compared with RNN,CNN processes the input signals in parallel so that the temporal sequence is not easily determined.To alleviate this issue,a position encoding scheme is developed to enhance the sequential information encoded by a CNN.Hence,our proposed position encoding based CNN called PE-Net is further improved and even performs better than RNN based methods.Extensive experiments are conducted on the C-MAPSS dataset,where our PE-Net shows state-of-the-art performance.展开更多
In the Prognostics and Health Management(PHM),remaining useful life(RUL)is very important and utilized to ensure the reliability and safety of the operation of complex mechanical systems.Recently,unscented Kalman filt...In the Prognostics and Health Management(PHM),remaining useful life(RUL)is very important and utilized to ensure the reliability and safety of the operation of complex mechanical systems.Recently,unscented Kalman filtering(UKF)has been applied widely in the RUL estimation.For a degradation system,the relationship between its monitored measurements and its degradation states is assumed to be nonlinear in the conventional UKF.However,in some special degradation systems,their monitored measurements have a linear relation with their degradation states.For these special problems,it may bring estimation errors to use the UKF method directly.Besides,many uncertain factors can result in the fluctuations of the estimated results,which may have a bad influence on the RUL estimation method.As a result,a robust RUL estimation approach is proposed in this paper to reduce the errors and randomness of estimation results for this kind of degradation problems.Firstly,an improved unscented Kalman filtering is established utilizing the Kalman filtering(KF)method and a linear adaptive strategy.The linear adaptive strategy is used to adjust its noise term adaptively.Then,the robust RUL estimation is realized by the improved UKF.At last,three problems are investigated to demonstrate the effectiveness of the proposed method.展开更多
As an important and necessary part in the intelligent battery management systems(BMS),the prognostics and remaining useful life(RUL)estimation for lithium-ion batteries attach more and more attractions.Especially,the ...As an important and necessary part in the intelligent battery management systems(BMS),the prognostics and remaining useful life(RUL)estimation for lithium-ion batteries attach more and more attractions.Especially,the data-driven approaches use only the monitoring data and historical data to model the performance degradation and assess the health status,that makes these methods flexible and applicable in actual lithium-ion battery applications.At first,the related concepts and definitions are introduced.And the degradation parameters identification and extraction is presented,as the health indicator and the foundation of RUL prediction for the lithium-ion batteries.Then,data-driven methods used for lithium-ion battery RUL estimation are summarized,in which several statistical and machine learning algorithms are involved.Finally,the future trend for battery prognostics and RUL estimation are forecasted.展开更多
基金the financial support from the National Natural Science Foundation of China(52207229)the financial support from the China Scholarship Council(202207550010)。
文摘The safe and reliable operation of lithium-ion batteries necessitates the accurate prediction of remaining useful life(RUL).However,this task is challenging due to the diverse ageing mechanisms,various operating conditions,and limited measured signals.Although data-driven methods are perceived as a promising solution,they ignore intrinsic battery physics,leading to compromised accuracy,low efficiency,and low interpretability.In response,this study integrates domain knowledge into deep learning to enhance the RUL prediction performance.We demonstrate accurate RUL prediction using only a single charging curve.First,a generalisable physics-based model is developed to extract ageing-correlated parameters that can describe and explain battery degradation from battery charging data.The parameters inform a deep neural network(DNN)to predict RUL with high accuracy and efficiency.The trained model is validated under 3 types of batteries working under 7 conditions,considering fully charged and partially charged cases.Using data from one cycle only,the proposed method achieves a root mean squared error(RMSE)of 11.42 cycles and a mean absolute relative error(MARE)of 3.19%on average,which are over45%and 44%lower compared to the two state-of-the-art data-driven methods,respectively.Besides its accuracy,the proposed method also outperforms existing methods in terms of efficiency,input burden,and robustness.The inherent relationship between the model parameters and the battery degradation mechanism is further revealed,substantiating the intrinsic superiority of the proposed method.
文摘In order to prevent possible casualties and economic loss, it is critical to accurate prediction of the Remaining Useful Life (RUL) in rail prognostics health management. However, the traditional neural networks is difficult to capture the long-term dependency relationship of the time series in the modeling of the long time series of rail damage, due to the coupling relationship of multi-channel data from multiple sensors. Here, in this paper, a novel RUL prediction model with an enhanced pulse separable convolution is used to solve this issue. Firstly, a coding module based on the improved pulse separable convolutional network is established to effectively model the relationship between the data. To enhance the network, an alternate gradient back propagation method is implemented. And an efficient channel attention (ECA) mechanism is developed for better emphasizing the useful pulse characteristics. Secondly, an optimized Transformer encoder was designed to serve as the backbone of the model. It has the ability to efficiently understand relationship between the data itself and each other at each time step of long time series with a full life cycle. More importantly, the Transformer encoder is improved by integrating pulse maximum pooling to retain more pulse timing characteristics. Finally, based on the characteristics of the front layer, the final predicted RUL value was provided and served as the end-to-end solution. The empirical findings validate the efficacy of the suggested approach in forecasting the rail RUL, surpassing various existing data-driven prognostication techniques. Meanwhile, the proposed method also shows good generalization performance on PHM2012 bearing data set.
基金supported by the National Science Fund for Distinguished Young Scholars of China(52025056)Fundamental Research Funds for the Central Universities(xzy012022062)。
文摘In recent years,intelligent data-driven prognostic methods have been successfully developed,and good machinery health assessment performance has been achieved through explorations of data from multiple sensors.However,existing datafusion prognostic approaches generally rely on the data availability of all sensors,and are vulnerable to potential sensor malfunctions,which are likely to occur in real industries especially for machines in harsh operating environments.In this paper,a deep learning-based remaining useful life(RUL)prediction method is proposed to address the sensor malfunction problem.A global feature extraction scheme is adopted to fully exploit information of different sensors.Adversarial learning is further introduced to extract generalized sensor-invariant features.Through explorations of both global and shared features,promising and robust RUL prediction performance can be achieved by the proposed method in the testing scenarios with sensor malfunctions.The experimental results suggest the proposed approach is well suited for real industrial applications.
基金supported by Agency for Science,Technology and Research(A*STAR)under the Career Development Fund(C210112037)。
文摘Accurate estimation of the remaining useful life(RUL)of lithium-ion batteries is critical for their large-scale deployment as energy storage devices in electric vehicles and stationary storage.A fundamental understanding of the factors affecting RUL is crucial for accelerating battery technology development.However,it is very challenging to predict RUL accurately because of complex degradation mechanisms occurring within the batteries,as well as dynamic operating conditions in practical applications.Moreover,due to insignificant capacity degradation in early stages,early prediction of battery life with early cycle data can be more difficult.In this paper,we propose a hybrid deep learning model for early prediction of battery RUL.The proposed method can effectively combine handcrafted features with domain knowledge and latent features learned by deep networks to boost the performance of RUL early prediction.We also design a non-linear correlation-based method to select effective domain knowledge-based features.Moreover,a novel snapshot ensemble learning strategy is proposed to further enhance model generalization ability without increasing any additional training cost.Our experimental results show that the proposed method not only outperforms other approaches in the primary test set having a similar distribution as the training set,but also generalizes well to the secondary test set having a clearly different distribution with the training set.The PyTorch implementation of our proposed approach is available at https://github.com/batteryrul/battery_rul_early_prediction.
基金supported by the National Natural Science Foundation of China(61703410,61873175,62073336,61873273,61773386,61922-089)the Basic Research Plan of Shaanxi Natural Science Foundation of China(2022JM-376).
文摘Remaining useful life(RUL)prediction is one of the most crucial components in prognostics and health management(PHM)of aero-engines.This paper proposes an RUL prediction method of aero-engines considering the randomness of failure threshold.Firstly,a random-coefficient regression(RCR)model is used to model the degradation process of aeroengines.Then,the RUL distribution based on fixed failure threshold is derived.The prior parameters of the degradation model are calculated by a two-step maximum likelihood estimation(MLE)method and the random coefficient is updated in real time under the Bayesian framework.The failure threshold in this paper is defined by the actual degradation process of aeroengines.After that,a expectation maximization(EM)algorithm is proposed to estimate the underlying failure threshold of aeroengines.In addition,the conditional probability is used to satisfy the limitation of failure threshold.Then,based on above results,an analytical expression of RUL distribution of aero-engines based on the RCR model considering random failure threshold(RFT)is derived in a closed-form.Finally,a case study of turbofan engine is used to demonstrate the effectiveness and superiority of the RUL prediction method and the parameters estimation method of failure threshold proposed.
基金supported by National Natural Science Foundation of China (61703410,61873175,62073336,61873273,61773386,61922089)。
文摘Remaining useful life(RUL) prediction is one of the most crucial elements in prognostics and health management(PHM). Aiming at the imperfect prior information, this paper proposes an RUL prediction method based on a nonlinear random coefficient regression(RCR) model with fusing failure time data.Firstly, some interesting natures of parameters estimation based on the nonlinear RCR model are given. Based on these natures,the failure time data can be fused as the prior information reasonably. Specifically, the fixed parameters are calculated by the field degradation data of the evaluated equipment and the prior information of random coefficient is estimated with fusing the failure time data of congeneric equipment. Then, the prior information of the random coefficient is updated online under the Bayesian framework, the probability density function(PDF) of the RUL with considering the limitation of the failure threshold is performed. Finally, two case studies are used for experimental verification. Compared with the traditional Bayesian method, the proposed method can effectively reduce the influence of imperfect prior information and improve the accuracy of RUL prediction.
基金The work in Section III was supported by the National Science Foundation of China(NSFC)(Nos.52025056,52005387)the work in Section IV was supported by the National Science Foundation of China(NSFC)(Nos.62233017,62073336).
文摘As the fundamental and key technique to ensure the safe and reliable operation of vital systems,prognostics with an emphasis on the remaining useful life(RUL)prediction has attracted great attention in the last decades.In this paper,we briefly discuss the general idea and advances of various prognostics and RUL prediction methods for machinery,mainly including data-driven methods,physics-based methods,hybrid methods,etc.Based on the observations fromthe state of the art,we provide comprehensive discussions on the possible opportunities and challenges of prognostics and RUL prediction of machinery so as to steer the future development.
基金Shivaji University,Kolhapur for financial assistance through Research Strengthening Scheme。
文摘Supercapacitors are appealing energy storage devices for their promising features like high power density,outstanding cycling stability,and a quick charge–discharge cycle.The exceptional life cycle and ultimate power capability of supercapacitors are needed in the transportation and renewable energy generation sectors.Hence,predicting the capacitance and lifecycle of supercapacitors is significant for selecting the suitable material and planning replacement intervals for supercapacitors.In addition,system failures can be better addressed by accurately forecasting the lifecycle of SCs.Recently,the use of machine learning for performance prediction of energy storage materials has drawn increasing attention from researchers globally because of its superiority in prediction accuracy,time efficiency,and costeffectiveness.This article presents a detailed review of the progress and advancement of ML techniques for the prediction of capacitance and remaining useful life(RUL)of supercapacitors.The review starts with an introduction to supercapacitor materials and ML applications in energy storage devices,followed by workflow for ML model building for supercapacitor materials.Then,the summary of machine learning applications for the prediction of capacitance and RUL of different supercapacitor materials including EDLCs(carbon based materials),pesudocapacitive(oxides and composites)and hybrid materials is presented.Finally,the general perspective for future directions is also presented.
基金financially supported by the National Natural Science Foundation of China(No.52102470)。
文摘Though the lithium-ion battery is universally applied,the reliability of lithium-ion batteries remains a challenge due to various physicochemical reactions,electrode material degradation,and even thermal runaway.Accurate estimation and prediction of battery health conditions are crucial for battery safety management.In this paper,an end-cloud collaboration method is proposed to approach the track of battery degradation process,integrating end-side empirical model with cloud-side data-driven model.Based on ensemble learning methods,the data-driven model is constructed by three base models to obtain cloud-side highly accurate results.The double exponential decay model is utilized as an empirical model to output highly real-time prediction results.With Kalman filter,the prediction results of end-side empirical model can be periodically updated by highly accurate results of cloud-side data-driven model to obtain highly accurate and real-time results.Subsequently,the whole framework can give an accurate prediction and tracking of battery degradation,with the mean absolute error maintained below 2%.And the execution time on the end side can reach 261μs.The proposed end-cloud collaboration method has the potential to approach highly accurate and highly real-time estimation for battery health conditions during battery full life cycle in architecture of cyber hierarchy and interactional network.
基金Project(61174115)supported by the National Natural Science Foundation of ChinaProject(L2013001)supported by Scientific Research Program of Liaoning Provincial Education Department,China
文摘As the central component of rotating machine,the performance reliability assessment and remaining useful lifetime prediction of bearing are of crucial importance in condition-based maintenance to reduce the maintenance cost and improve the reliability.A prognostic algorithm to assess the reliability and forecast the remaining useful lifetime(RUL) of bearings was proposed,consisting of three phases.Online vibration and temperature signals of bearings in normal state were measured during the manufacturing process and the most useful time-dependent features of vibration signals were extracted based on correlation analysis(feature selection step).Time series analysis based on neural network,as an identification model,was used to predict the features of bearing vibration signals at any horizons(feature prediction step).Furthermore,according to the features,degradation factor was defined.The proportional hazard model was generated to estimate the survival function and forecast the RUL of the bearing(RUL prediction step).The positive results show that the plausibility and effectiveness of the proposed approach can facilitate bearing reliability estimation and RUL prediction.
基金Supported by National Key Research and Development Project of China(Grant No.2020YFB2007700)State Key Laboratory of Tribology Initiative Research Program(Grant No.SKLT2020D21)+2 种基金National Natural Science Foundation of China(Grant No.51975309)Shaanxi Provincial Natural Science Foundation of China(Grant No.2019JQ-712)Young Talent Fund of University Association for Science and Technology in Shaanxi(Grant No.20170511).
文摘The remaining useful life(RUL)estimation of bearings is critical for ensuring the reliability of mechanical systems.Owing to the rapid development of deep learning methods,a multitude of data-driven RUL estimation approaches have been proposed recently.However,the following problems remain in existing methods:1)Most network models use raw data or statistical features as input,which renders it difficult to extract complex fault-related information hidden in signals;2)for current observations,the dependence between current states is emphasized,but their complex dependence on previous states is often disregarded;3)the output of neural networks is directly used as the estimated RUL in most studies,resulting in extremely volatile prediction results that lack robustness.Hence,a novel prognostics approach is proposed based on a time-frequency representation(TFR)subsequence,three-dimensional convolutional neural network(3DCNN),and Gaussian process regression(GPR).The approach primarily comprises two aspects:construction of a health indicator(HI)using the TFR-subsequence-3DCNN model,and RUL estimation based on the GPR model.The raw signals of the bearings are converted into TFR-subsequences by continuous wavelet transform and a dislocated overlapping strategy.Subsequently,the 3DCNN is applied to extract the hidden spatiotemporal features from the TFR-subsequences and construct HIs.Finally,the RUL of the bearings is estimated using the GPR model,which can also define the probability distribution of the potential function and prediction confidence.Experiments on the PRONOSTIA platform demonstrate the superiority of the proposed TFR-subsequence-3DCNN-GPR approach.The use of degradation-related spatiotemporal features in signals is proposed herein to achieve a highly accurate bearing RUL prediction with uncertainty quantification.
基金the Natural Science Foundation of China(NSFC)(61873024,61773053)the China Central Universities of USTB(FRF-TP-19-049A1Z)the National Key RD Program of China(2017YFB0306403)。
文摘Accurate estimation of the remaining useful life(RUL)and health state for rollers is of great significance to hot rolling production.It can provide decision support for roller management so as to improve the productivity of the hot rolling process.In addition,the RUL prediction for rollers is helpful in transitioning from the current regular maintenance strategy to conditional-based maintenance.Therefore,a new method that can extract coarse-grained and fine-grained features from batch data to predict the RUL of the rollers is proposed in this paper.Firstly,a new deep learning network architecture based on recurrent neural networks that can make full use of the extracted coarsegrained fine-grained features to estimate the heath indicator(HI)is developed,where the HI is able to indicate the health state of the roller.Following that,a state-space model is constructed to describe the HI,and the probabilistic distribution of RUL can be estimated by extrapolating the HI degradation model to a predefined failure threshold.Finally,application to a hot strip mill is given to verify the effectiveness of the proposed methods using data collected from an industrial site,and the relatively low RMSE and MAE values demonstrate its advantages compared with some other popular deep learning methods.
基金supported by the National Defense Foundation of China(7160118371901216)the China Postdoctoral Science Foundation(2017M623415)
文摘Nonlinearity and implicitness are common degradation features of the stochastic degradation equipment for prognostics.These features have an uncertain effect on the remaining useful life(RUL)prediction of the equipment.The current data-driven RUL prediction method has not systematically studied the nonlinear hidden degradation modeling and the RUL distribution function.This paper uses the nonlinear Wiener process to build a dual nonlinear implicit degradation model.Based on the historical measured data of similar equipment,the maximum likelihood estimation algorithm is used to estimate the fixed coefficients and the prior distribution of a random coefficient.Using the on-site measured data of the target equipment,the posterior distribution of a random coefficient and actual degradation state are step-by-step updated based on Bayesian inference and the extended Kalman filtering algorithm.The analytical form of the RUL distribution function is derived based on the first hitting time distribution.Combined with the two case studies,the proposed method is verified to have certain advantages over the existing methods in the accuracy of prediction.
基金support by Natural Science Foundation of China(61873122)。
文摘Remaining useful life(RUL)prediction is an advanced technique for system maintenance scheduling.Most of existing RUL prediction methods are only interested in the precision of RUL estimation;the adverse impact of overestimated RUL on maintenance scheduling is not of concern.In this work,an RUL estimation method with risk-averse adaptation is developed which can reduce the over-estimation rate while maintaining a reasonable under-estimation level.The proposed method includes a module of degradation feature selection to obtain crucial features which reflect system degradation trends.Then,the latent structure between the degradation features and the RUL labels is modeled by a support vector regression(SVR)model and a long short-term memory(LSTM)network,respectively.To enhance the prediction robustness and increase its marginal utility,the SVR model and the LSTM model are integrated to generate a hybrid model via three connection parameters.By designing a cost function with penalty mechanism,the three parameters are determined using a modified grey wolf optimization algorithm.In addition,a cost metric is proposed to measure the benefit of such a risk-averse predictive maintenance method.Verification is done using an aero-engine data set from NASA.The results show the feasibility and effectiveness of the proposed RUL estimation method and the predictive maintenance strategy.
文摘The key to failure prevention for aero-engine lies in performance prediction and the exhaust gas temperature margin(EGTM)is used as the most important degradation parameter to obtain the operating performance of the aero-engine.Because of the complex environment interference,EGTM always has strong randomness,and the state space based degradation model can identify the noisy observation from the true degradation state,which is more close to the actual situations.Therefore,a state space model based on EGTM is established to describe the degradation path and predict the remaining useful life(RUL).As one of the most effective methods for both linear state estimation and parameter estimation,Kalman filter(KF)is applied.Firstly,with EGTM degradation data,state space model approach is used to set up a state space model for aero-engine.Secondly,RUL of aero-engine is analyzed,and expected RUL and distribution of RUL are determined.Finally,the sate space model and KF algorithm are applied to an example of CFM-56aero-engine.The expected RUL is predicted,and corresponding probability density distribution(PDF)and cumulative distribution function(CDF)are given.The result indicates that the accuracy of RUL prediction reaches 7.76%ahead 580 flight cycles(FC),which is more accurate than linear regression,and therefore shows the validity and rationality of the proposed method.
基金Supported by U.K.EPSRC Platform Grant(Grant No.EP/P027121/1).
文摘The remaining useful life(RUL)of a system is generally predicted by utilising the data collected from the sensors that continuously monitor different indicators.Recently,different deep learning(DL)techniques have been used for RUL prediction and achieved great success.Because the data is often time-sequential,recurrent neural network(RNN)has attracted significant interests due to its efficiency in dealing with such data.This paper systematically reviews RNN and its variants for RUL prediction,with a specific focus on understanding how different components(e.g.,types of optimisers and activation functions)or parameters(e.g.,sequence length,neuron quantities)affect their performance.After that,a case study using the well-studied NASA’s C-MAPSS dataset is presented to quantitatively evaluate the influence of various state-of-the-art RNN structures on the RUL prediction performance.The result suggests that the variant methods usually perform better than the original RNN,and among which,Bi-directional Long Short-Term Memory generally has the best performance in terms of stability,precision and accuracy.Certain model structures may fail to produce valid RUL prediction result due to the gradient vanishing or gradient exploring problem if the parameters are not chosen appropriately.It is concluded that parameter tuning is a crucial step to achieve optimal prediction performance.
基金supported by General Program of National Natural Science Foundation of China(61773080)China Central Universities Foundation(2019CDYGZD001)+1 种基金Scientific Reserve Talent Programs of Chongqing University(cqu2018CDHB1B04)Graduate Research and Innovation Foundation of Chongqing(CYB20065)。
文摘In this paper,a novel remaining useful life prediction approach considering fault effects is proposed.The Wiener process is used to construct the degradation process of single performance characteristic with the fault effects.The first passage time based remaining useful life distribution is calculated by assuming fault occurrence moment is a random variable and follows a certain distribution.Expectation maximization algorithm is employed to estimate model parameters,where the fault occurrence moment is considered as a missing data.Finally,a Copula function is used to describe the dependence between the multiple performance characteristics and derive joint remaining useful life(RUL)distribution of product with the fault effects.The effectiveness of the proposed approach is verified by the experiments of turbofan engines.
基金supported by National Research Foundation of Singapore,AME Young Individual Research Grant(A2084c0167)。
文摘Accurate remaining useful life(RUL)prediction is important in industrial systems.It prevents machines from working under failure conditions,and ensures that the industrial system works reliably and efficiently.Recently,many deep learning based methods have been proposed to predict RUL.Among these methods,recurrent neural network(RNN)based approaches show a strong capability of capturing sequential information.This allows RNN based methods to perform better than convolutional neural network(CNN)based approaches on the RUL prediction task.In this paper,we question this common paradigm and argue that existing CNN based approaches are not designed according to the classic principles of CNN,which reduces their performances.Additionally,the capacity of capturing sequential information is highly affected by the receptive field of CNN,which is neglected by existing CNN based methods.To solve these problems,we propose a series of new CNNs,which show competitive results to RNN based methods.Compared with RNN,CNN processes the input signals in parallel so that the temporal sequence is not easily determined.To alleviate this issue,a position encoding scheme is developed to enhance the sequential information encoded by a CNN.Hence,our proposed position encoding based CNN called PE-Net is further improved and even performs better than RNN based methods.Extensive experiments are conducted on the C-MAPSS dataset,where our PE-Net shows state-of-the-art performance.
基金supported by the National Key R&D Program of China(Grant No.2018YFB1701400)the National Science Fund for Distinguished Young Scholars(Grant No.51725502)the Foundation for Innovative Research Groups of the National Natural Science Foundation of China(Grant No.51621004).
文摘In the Prognostics and Health Management(PHM),remaining useful life(RUL)is very important and utilized to ensure the reliability and safety of the operation of complex mechanical systems.Recently,unscented Kalman filtering(UKF)has been applied widely in the RUL estimation.For a degradation system,the relationship between its monitored measurements and its degradation states is assumed to be nonlinear in the conventional UKF.However,in some special degradation systems,their monitored measurements have a linear relation with their degradation states.For these special problems,it may bring estimation errors to use the UKF method directly.Besides,many uncertain factors can result in the fluctuations of the estimated results,which may have a bad influence on the RUL estimation method.As a result,a robust RUL estimation approach is proposed in this paper to reduce the errors and randomness of estimation results for this kind of degradation problems.Firstly,an improved unscented Kalman filtering is established utilizing the Kalman filtering(KF)method and a linear adaptive strategy.The linear adaptive strategy is used to adjust its noise term adaptively.Then,the robust RUL estimation is realized by the improved UKF.At last,three problems are investigated to demonstrate the effectiveness of the proposed method.
基金supported partly by National Natural Science Foundation of China(Grant No.61301205)Research Fund for the Doctoral Program of Higher Education of China(Grant No.20112302120027)+1 种基金Natural Scientific Research Innovation Foundation in Harbin Institute of Technology(Grant No.HIT.NSRIF.2014017)China Scholarship Council.,2155-0875/Copyright C 2010 Binary Information Press July 2010
文摘As an important and necessary part in the intelligent battery management systems(BMS),the prognostics and remaining useful life(RUL)estimation for lithium-ion batteries attach more and more attractions.Especially,the data-driven approaches use only the monitoring data and historical data to model the performance degradation and assess the health status,that makes these methods flexible and applicable in actual lithium-ion battery applications.At first,the related concepts and definitions are introduced.And the degradation parameters identification and extraction is presented,as the health indicator and the foundation of RUL prediction for the lithium-ion batteries.Then,data-driven methods used for lithium-ion battery RUL estimation are summarized,in which several statistical and machine learning algorithms are involved.Finally,the future trend for battery prognostics and RUL estimation are forecasted.
