A method to detect traffic dangers based on visual attention model of sparse sampling was proposed. The hemispherical sparse sampling model was used to decrease the amount of calculation which increases the detection ...A method to detect traffic dangers based on visual attention model of sparse sampling was proposed. The hemispherical sparse sampling model was used to decrease the amount of calculation which increases the detection speed. Bayesian probability model and Gaussian kernel function were applied to calculate the saliency of traffic videos. The method of multiscale saliency was used and the final saliency was the average of all scales, which increased the detection rates extraordinarily. The detection results of several typical traffic dangers show that the proposed method has higher detection rates and speed, which meets the requirement of real-time detection of traffic dangers.展开更多
A new landing region selection algorithm for an unmanned helicopter is proposed based on an attention model.Different from the original attention model,some properties of the possible safe landing regions（e.g.,depth,...A new landing region selection algorithm for an unmanned helicopter is proposed based on an attention model.Different from the original attention model,some properties of the possible safe landing regions（e.g.,depth,regional color and motion features）are included in the selection algorithm.Furthermore,regional color and motion features are fused directly into the saliency map because these features do not have the ＂central-peripheral＂property.Experimental results validate the feasibility and efficiency of this approach.展开更多
A worthy text summarization should represent the fundamental content of the document.Recent studies on computerized text summarization tried to present solutions to this challenging problem.Attention models are employ...A worthy text summarization should represent the fundamental content of the document.Recent studies on computerized text summarization tried to present solutions to this challenging problem.Attention models are employed extensively in text summarization process.Classical attention techniques are utilized to acquire the context data in the decoding phase.Nevertheless,without real and efficient feature extraction,the produced summary may diverge from the core topic.In this article,we present an encoder-decoder attention system employing dual attention mechanism.In the dual attention mechanism,the attention algorithm gathers main data from the encoder side.In the dual attentionmodel,the system can capture and producemore rational main content.The merging of the two attention phases produces precise and rational text summaries.The enhanced attention mechanism gives high score to text repetition to increase phrase score.It also captures the relationship between phrases and the title giving them higher score.We assessed our proposed model with or without significance optimization using ablation procedure.Our model with significance optimization achieved the highest performance of 96.7%precision and the least CPU time among other models in both training and sentence extraction.展开更多
With the rapid development of the Internet globally since the 21st century,the amount of data information has increased exponentially.Data helps improve people’s livelihood and working conditions,as well as learning ...With the rapid development of the Internet globally since the 21st century,the amount of data information has increased exponentially.Data helps improve people’s livelihood and working conditions,as well as learning efficiency.Therefore,data extraction,analysis,and processing have become a hot issue for people from all walks of life.Traditional recommendation algorithm still has some problems,such as inaccuracy,less diversity,and low performance.To solve these problems and improve the accuracy and variety of the recommendation algorithms,the research combines the convolutional neural networks(CNN)and the attention model to design a recommendation algorithm based on the neural network framework.Through the text convolutional network,the input layer in CNN has transformed into two channels:static ones and non-static ones.Meanwhile,the self-attention system focuses on the system so that data can be better processed and the accuracy of feature extraction becomes higher.The recommendation algorithm combines CNN and attention system and divides the embedding layer into user information feature embedding and data name feature extraction embedding.It obtains data name features through a convolution kernel.Finally,the top pooling layer obtains the length vector.The attention system layer obtains the characteristics of the data type.Experimental results show that the proposed recommendation algorithm that combines CNN and the attention system can perform better in data extraction than the traditional CNN algorithm and other recommendation algorithms that are popular at the present stage.The proposed algorithm shows excellent accuracy and robustness.展开更多
The social engineering cyber-attack is where culprits mislead the users by getting the login details which provides the information to the evil server called phishing.The deep learning approaches and the machine learn...The social engineering cyber-attack is where culprits mislead the users by getting the login details which provides the information to the evil server called phishing.The deep learning approaches and the machine learning are compared in the proposed system for presenting the methodology that can detect phishing websites via Uniform Resource Locator(URLs)analysis.The legal class is composed of the home pages with no inclusion of login forms in most of the present modern solutions,which deals with the detection of phishing.Contrarily,the URLs in both classes from the login page due,considering the representation of a real case scenario and the demonstration for obtaining the rate of false-positive with the existing approaches during the legal login pages provides the test having URLs.In addition,some model reduces the accuracy rather than training the base model and testing the latest URLs.In addition,a feature analysis is performed on the present phishing domains to identify various approaches to using the phishers in the campaign.A new dataset called the MUPD dataset is used for evaluation.Lastly,a prediction model,the Dense forward-backwards Long Short Term Memory(LSTM)model(d−FBLSTM),is presented for combining the forward and backward propagation of LSMT to obtain the accuracy of 98.5%on the initiated login URL dataset.展开更多
In the present technological world,surveillance cameras generate an immense amount of video data from various sources,making its scrutiny tough for computer vision specialists.It is difficult to search for anomalous e...In the present technological world,surveillance cameras generate an immense amount of video data from various sources,making its scrutiny tough for computer vision specialists.It is difficult to search for anomalous events manually in thesemassive video records since they happen infrequently and with a low probability in real-world monitoring systems.Therefore,intelligent surveillance is a requirement of the modern day,as it enables the automatic identification of normal and aberrant behavior using artificial intelligence and computer vision technologies.In this article,we introduce an efficient Attention-based deep-learning approach for anomaly detection in surveillance video(ADSV).At the input of the ADSV,a shots boundary detection technique is used to segment prominent frames.Next,The Lightweight ConvolutionNeuralNetwork(LWCNN)model receives the segmented frames to extract spatial and temporal information from the intermediate layer.Following that,spatial and temporal features are learned using Long Short-Term Memory(LSTM)cells and Attention Network from a series of frames for each anomalous activity in a sample.To detect motion and action,the LWCNN received chronologically sorted frames.Finally,the anomaly activity in the video is identified using the proposed trained ADSV model.Extensive experiments are conducted on complex and challenging benchmark datasets.In addition,the experimental results have been compared to state-ofthe-artmethodologies,and a significant improvement is attained,demonstrating the efficiency of our ADSV method.展开更多
The movement of pedestrians involves temporal continuity,spatial interactivity,and random diversity.As a result,pedestrian trajectory prediction is rather challenging.Most existing trajectory prediction methods tend t...The movement of pedestrians involves temporal continuity,spatial interactivity,and random diversity.As a result,pedestrian trajectory prediction is rather challenging.Most existing trajectory prediction methods tend to focus on just one aspect of these challenges,ignoring the temporal information of the trajectory and making too many assumptions.In this paper,we propose a recurrent attention and interaction(RAI)model to predict pedestrian trajectories.The RAI model consists of a temporal attention module,spatial pooling module,and randomness modeling module.The temporal attention module is proposed to assign different weights to the input sequence of a target,and reduce the speed deviation of different pedestrians.The spatial pooling module is proposed to model not only the social information of neighbors in historical frames,but also the intention of neighbors in the current time.The randomness modeling module is proposed to model the uncertainty and diversity of trajectories by introducing random noise.We conduct extensive experiments on several public datasets.The results demonstrate that our method outperforms many that are state-ofthe-art.展开更多
Dear Editor, The process of relapse involves firm or aberrant memories of environmental cues associated with drug craving or addiction. To date, it is not known where these memories are stored in the brain, what kind...Dear Editor, The process of relapse involves firm or aberrant memories of environmental cues associated with drug craving or addiction. To date, it is not known where these memories are stored in the brain, what kinds of regulatory biological factors or molecules are involved, nor why it is so difficult to stop addiction psychologically. Currently, rodent animal models, such as the self-administration and conditioning place preference / aversion paradigm are still widely used in the studies of drug withdrawal syndromes or drug-associate memories. However, the differences between humans and rodents--particularly in terms of genetics, and pathology and pharmacology--have significantly limited the application of further studies on this topic. Essentially, rodents lack the longterm or life-time memories humans possess and lose their drug-associated memory only after a few weeks of withdrawal.展开更多
In this paper,we summarize recent progresses made in deep learning based acoustic models and the motivation and insights behind the surveyed techniques.We first discuss models such as recurrent neural networks(RNNs) a...In this paper,we summarize recent progresses made in deep learning based acoustic models and the motivation and insights behind the surveyed techniques.We first discuss models such as recurrent neural networks(RNNs) and convolutional neural networks(CNNs) that can effectively exploit variablelength contextual information,and their various combination with other models.We then describe models that are optimized end-to-end and emphasize on feature representations learned jointly with the rest of the system,the connectionist temporal classification(CTC) criterion,and the attention-based sequenceto-sequence translation model.We further illustrate robustness issues in speech recognition systems,and discuss acoustic model adaptation,speech enhancement and separation,and robust training strategies.We also cover modeling techniques that lead to more efficient decoding and discuss possible future directions in acoustic model research.展开更多
Video summarization is applied to reduce redundancy and developa concise representation of key frames in the video, more recently, video summaries have been used through visual attention modeling. In these schemes,the...Video summarization is applied to reduce redundancy and developa concise representation of key frames in the video, more recently, video summaries have been used through visual attention modeling. In these schemes,the frames that stand out visually are extracted as key frames based on humanattention modeling theories. The schemes for modeling visual attention haveproven to be effective for video summaries. Nevertheless, the high cost ofcomputing in such techniques restricts their usability in everyday situations.In this context, we propose a method based on KFE (key frame extraction)technique, which is recommended based on an efficient and accurate visualattention model. The calculation effort is minimized by utilizing dynamicvisual highlighting based on the temporal gradient instead of the traditionaloptical flow techniques. In addition, an efficient technique using a discretecosine transformation is utilized for the static visual salience. The dynamic andstatic visual attention metrics are merged by means of a non-linear weightedfusion technique. Results of the system are compared with some existing stateof-the-art techniques for the betterment of accuracy. The experimental resultsof our proposed model indicate the efficiency and high standard in terms ofthe key frames extraction as output.展开更多
Major chronic diseases such as Cardiovascular Disease(CVD),diabetes,and cancer impose a significant burden on people and healthcare systems around the globe.Recently,Deep Learning(DL)has shown great potential for the ...Major chronic diseases such as Cardiovascular Disease(CVD),diabetes,and cancer impose a significant burden on people and healthcare systems around the globe.Recently,Deep Learning(DL)has shown great potential for the development of intelligentmobile Health(mHealth)interventions for chronic diseases that could revolutionize the delivery of health care anytime,anywhere.The aimof this study is to present a systematic review of studies that have used DL based on mHealth data for the diagnosis,prognosis,management,and treatment of major chronic diseases and advance our understanding of the progress made in this rapidly developing field.Type 2 Diabetes Mellitus(T2DMs)is a regular chronic disorder that is caused by the secretion of insulin,which leads to serious death-related issues and the most complicated ones.Coronary Heart Disease(CHD)is the most frequent issue related to T2DM patients.The major concern is recognizing the high possibility of CHD complications,yet the model is not available to identify it.This work introduces a deep learning technique that can predict heart disease effectively using a hybrid model,which integrates DNNs(Deep Neural Networks)with a Multi-Head Attention Model called MADNN.The scheme canbedesignedtoautomatically learnthe best-quality features fromElectronic Health Records(EHRs),and effectively combine heterogeneous and time-sequencedmedical data for predicting the risk of CVD.The analysis is done using the Kaggle dataset.The outcomes prove that the MADNN has improved accuracy by about 95%and indicates the precise accuracy is higher for the disease compared with SVM,CNN and ANN.展开更多
The current life-prediction models for lithium-ion batteries have several problems, such as the construction of complex feature structures, a high number of feature dimensions, and inaccurate prediction results. To ov...The current life-prediction models for lithium-ion batteries have several problems, such as the construction of complex feature structures, a high number of feature dimensions, and inaccurate prediction results. To overcome these problems, this paper proposes a deep-learning model combining an autoencoder network and a long short-term memory network. First, this model applies the characteristics of the autoencoder to reduce the dimensionality of the high-dimensional features extracted from the battery data set and realize the fusion of complex time-domain features, which overcomes the problems of redundant model information and low computational efficiency. This model then uses a long short-term memory network that is sensitive to time-series data to solve the long-path dependence problem in the prediction of battery life. Lastly, the attention mechanism is used to give greater weight to features that have a greater impact on the target value, which enhances the learning effect of the model on the long input sequence. To verify the efficacy of the proposed model, this paper uses NASA's lithium-ion battery cycle life data set.展开更多
Text classification is a classic task innatural language process(NLP).Convolutional neural networks(CNNs)have demonstrated its effectiveness in sentence and document modeling.However,most of existing CNN models are ap...Text classification is a classic task innatural language process(NLP).Convolutional neural networks(CNNs)have demonstrated its effectiveness in sentence and document modeling.However,most of existing CNN models are applied to the fixed-size convolution filters,thereby unable to adapt different local interdependency.To address this problem,a deep global-attention based convolutional network with dense connections(DGA-CCN)is proposed.In the framework,dense connections are applied to connect each convolution layer to each of the other layers which can accept information from all previous layers and get multiple sizes of local information.Then the local information extracted by the convolution layer is reweighted by deep global-attention to obtain a sequence representation with more valuable information of the whole sequence.A series of experiments are conducted on five text classification benchmarks,and the experimental results show that the proposed model improves upon the state of-the-art baselines on four of five datasets,which can show the effectiveness of our model for text classification.展开更多
A novel structure based on channel-wise attention mechanism is presented in this paper.With the proposed structure embedded,an efficient classification model that accepts multi-lead electrocardiogram(ECG)as input is c...A novel structure based on channel-wise attention mechanism is presented in this paper.With the proposed structure embedded,an efficient classification model that accepts multi-lead electrocardiogram(ECG)as input is constructed.One-dimensional convolutional neural networks(CNNs)have proven to be effective in pervasive classification tasks,enabling the automatic extraction of features while classifying targets.We implement the residual connection and design a structure which can learn the weights from the information contained in different channels in the input feature map during the training process.An indicator named mean square deviation is introduced to monitor the performance of a particular model segment in the classification task on the two out of five ECG classes.The data in the MIT-BIH arrhythmia database is used and a series of control experiments is conducted.Utilizing both leads of the ECG signals as input to the neural network classifier can achieve better classification results than those from using single channel inputs in different application scenarios.Models embedded with the channel-wise attention structure always achieve better scores on sensitivity and precision than the plain Resnet models.The proposed model exceeds most of the state-of-the-art models in ventricular ectopic beats(VEB)classification performance and achieves competitive scores for supraventricular ectopic beats(SVEB).Adopting more lead ECG signals as input can increase the dimensions of the input feature maps,helping to improve both the performance and generalization of the network model.Due to its end-to-end characteristics,and the extensible intrinsic for multi-lead heart diseases diagnosing,the proposed model can be used for the realtime ECG tracking of ECG waveforms for Holter or wearable devices.展开更多
Multivariate time series with missing values are common in a wide range of applications,including energy data.Existing imputation methods often fail to focus on the temporal dynamics and the cross-dimensional correlat...Multivariate time series with missing values are common in a wide range of applications,including energy data.Existing imputation methods often fail to focus on the temporal dynamics and the cross-dimensional correlation simultaneously.In this paper we propose a two-step method based on an attention model to impute missing values in multivariate energy time series.First,the underlying distribution of the missing values in the data is learned.This information is then further used to train an attention based imputation model.By learning the distribution prior to the imputation process,the model can respond flexibly to the specific characteristics of the underlying data.The developed model is applied to European energy data,obtained from the European Network of Transmission System Operators for Electricity.Using different evaluation metrics and benchmarks,the conducted experiments show that the proposed model is preferable to the benchmarks and is able to accurately impute missing values.展开更多
基金Project(50808025)supported by the National Natural Science Foundation of ChinaProject(20090162110057)supported by the Doctoral Fund of Ministry of Education of China
文摘A method to detect traffic dangers based on visual attention model of sparse sampling was proposed. The hemispherical sparse sampling model was used to decrease the amount of calculation which increases the detection speed. Bayesian probability model and Gaussian kernel function were applied to calculate the saliency of traffic videos. The method of multiscale saliency was used and the final saliency was the average of all scales, which increased the detection rates extraordinarily. The detection results of several typical traffic dangers show that the proposed method has higher detection rates and speed, which meets the requirement of real-time detection of traffic dangers.
基金Supported by Aeronautical Science Foundation of China(20130542025)
文摘A new landing region selection algorithm for an unmanned helicopter is proposed based on an attention model.Different from the original attention model,some properties of the possible safe landing regions（e.g.,depth,regional color and motion features）are included in the selection algorithm.Furthermore,regional color and motion features are fused directly into the saliency map because these features do not have the ＂central-peripheral＂property.Experimental results validate the feasibility and efficiency of this approach.
文摘A worthy text summarization should represent the fundamental content of the document.Recent studies on computerized text summarization tried to present solutions to this challenging problem.Attention models are employed extensively in text summarization process.Classical attention techniques are utilized to acquire the context data in the decoding phase.Nevertheless,without real and efficient feature extraction,the produced summary may diverge from the core topic.In this article,we present an encoder-decoder attention system employing dual attention mechanism.In the dual attention mechanism,the attention algorithm gathers main data from the encoder side.In the dual attentionmodel,the system can capture and producemore rational main content.The merging of the two attention phases produces precise and rational text summaries.The enhanced attention mechanism gives high score to text repetition to increase phrase score.It also captures the relationship between phrases and the title giving them higher score.We assessed our proposed model with or without significance optimization using ablation procedure.Our model with significance optimization achieved the highest performance of 96.7%precision and the least CPU time among other models in both training and sentence extraction.
文摘With the rapid development of the Internet globally since the 21st century,the amount of data information has increased exponentially.Data helps improve people’s livelihood and working conditions,as well as learning efficiency.Therefore,data extraction,analysis,and processing have become a hot issue for people from all walks of life.Traditional recommendation algorithm still has some problems,such as inaccuracy,less diversity,and low performance.To solve these problems and improve the accuracy and variety of the recommendation algorithms,the research combines the convolutional neural networks(CNN)and the attention model to design a recommendation algorithm based on the neural network framework.Through the text convolutional network,the input layer in CNN has transformed into two channels:static ones and non-static ones.Meanwhile,the self-attention system focuses on the system so that data can be better processed and the accuracy of feature extraction becomes higher.The recommendation algorithm combines CNN and attention system and divides the embedding layer into user information feature embedding and data name feature extraction embedding.It obtains data name features through a convolution kernel.Finally,the top pooling layer obtains the length vector.The attention system layer obtains the characteristics of the data type.Experimental results show that the proposed recommendation algorithm that combines CNN and the attention system can perform better in data extraction than the traditional CNN algorithm and other recommendation algorithms that are popular at the present stage.The proposed algorithm shows excellent accuracy and robustness.
文摘The social engineering cyber-attack is where culprits mislead the users by getting the login details which provides the information to the evil server called phishing.The deep learning approaches and the machine learning are compared in the proposed system for presenting the methodology that can detect phishing websites via Uniform Resource Locator(URLs)analysis.The legal class is composed of the home pages with no inclusion of login forms in most of the present modern solutions,which deals with the detection of phishing.Contrarily,the URLs in both classes from the login page due,considering the representation of a real case scenario and the demonstration for obtaining the rate of false-positive with the existing approaches during the legal login pages provides the test having URLs.In addition,some model reduces the accuracy rather than training the base model and testing the latest URLs.In addition,a feature analysis is performed on the present phishing domains to identify various approaches to using the phishers in the campaign.A new dataset called the MUPD dataset is used for evaluation.Lastly,a prediction model,the Dense forward-backwards Long Short Term Memory(LSTM)model(d−FBLSTM),is presented for combining the forward and backward propagation of LSMT to obtain the accuracy of 98.5%on the initiated login URL dataset.
基金This research was supported by the Chung-Ang University Research Scholarship Grants in 2021 and the Culture,Sports and Tourism R&D Program through the Korea Creative Content Agency grant funded by the Ministry of Culture,Sports,and Tourism in 2022(Project Name:Development of Digital Quarantine and Operation Technologies for Creation of Safe Viewing Environment in Cultural Facilities,Project Number:R2021040028,Contribution Rate:100%).
文摘In the present technological world,surveillance cameras generate an immense amount of video data from various sources,making its scrutiny tough for computer vision specialists.It is difficult to search for anomalous events manually in thesemassive video records since they happen infrequently and with a low probability in real-world monitoring systems.Therefore,intelligent surveillance is a requirement of the modern day,as it enables the automatic identification of normal and aberrant behavior using artificial intelligence and computer vision technologies.In this article,we introduce an efficient Attention-based deep-learning approach for anomaly detection in surveillance video(ADSV).At the input of the ADSV,a shots boundary detection technique is used to segment prominent frames.Next,The Lightweight ConvolutionNeuralNetwork(LWCNN)model receives the segmented frames to extract spatial and temporal information from the intermediate layer.Following that,spatial and temporal features are learned using Long Short-Term Memory(LSTM)cells and Attention Network from a series of frames for each anomalous activity in a sample.To detect motion and action,the LWCNN received chronologically sorted frames.Finally,the anomaly activity in the video is identified using the proposed trained ADSV model.Extensive experiments are conducted on complex and challenging benchmark datasets.In addition,the experimental results have been compared to state-ofthe-artmethodologies,and a significant improvement is attained,demonstrating the efficiency of our ADSV method.
基金supported by the National NaturalScience Foundation of China(U1811463)the Fundamental Research Funds for the Central Universities(12060093192)。
文摘The movement of pedestrians involves temporal continuity,spatial interactivity,and random diversity.As a result,pedestrian trajectory prediction is rather challenging.Most existing trajectory prediction methods tend to focus on just one aspect of these challenges,ignoring the temporal information of the trajectory and making too many assumptions.In this paper,we propose a recurrent attention and interaction(RAI)model to predict pedestrian trajectories.The RAI model consists of a temporal attention module,spatial pooling module,and randomness modeling module.The temporal attention module is proposed to assign different weights to the input sequence of a target,and reduce the speed deviation of different pedestrians.The spatial pooling module is proposed to model not only the social information of neighbors in historical frames,but also the intention of neighbors in the current time.The randomness modeling module is proposed to model the uncertainty and diversity of trajectories by introducing random noise.We conduct extensive experiments on several public datasets.The results demonstrate that our method outperforms many that are state-ofthe-art.
文摘Dear Editor, The process of relapse involves firm or aberrant memories of environmental cues associated with drug craving or addiction. To date, it is not known where these memories are stored in the brain, what kinds of regulatory biological factors or molecules are involved, nor why it is so difficult to stop addiction psychologically. Currently, rodent animal models, such as the self-administration and conditioning place preference / aversion paradigm are still widely used in the studies of drug withdrawal syndromes or drug-associate memories. However, the differences between humans and rodents--particularly in terms of genetics, and pathology and pharmacology--have significantly limited the application of further studies on this topic. Essentially, rodents lack the longterm or life-time memories humans possess and lose their drug-associated memory only after a few weeks of withdrawal.
文摘In this paper,we summarize recent progresses made in deep learning based acoustic models and the motivation and insights behind the surveyed techniques.We first discuss models such as recurrent neural networks(RNNs) and convolutional neural networks(CNNs) that can effectively exploit variablelength contextual information,and their various combination with other models.We then describe models that are optimized end-to-end and emphasize on feature representations learned jointly with the rest of the system,the connectionist temporal classification(CTC) criterion,and the attention-based sequenceto-sequence translation model.We further illustrate robustness issues in speech recognition systems,and discuss acoustic model adaptation,speech enhancement and separation,and robust training strategies.We also cover modeling techniques that lead to more efficient decoding and discuss possible future directions in acoustic model research.
基金This work was supported in part by Qatar National Library,Doha,Qatar,and in part by the Qatar University Internal under Grant IRCC-2021-010。
文摘Video summarization is applied to reduce redundancy and developa concise representation of key frames in the video, more recently, video summaries have been used through visual attention modeling. In these schemes,the frames that stand out visually are extracted as key frames based on humanattention modeling theories. The schemes for modeling visual attention haveproven to be effective for video summaries. Nevertheless, the high cost ofcomputing in such techniques restricts their usability in everyday situations.In this context, we propose a method based on KFE (key frame extraction)technique, which is recommended based on an efficient and accurate visualattention model. The calculation effort is minimized by utilizing dynamicvisual highlighting based on the temporal gradient instead of the traditionaloptical flow techniques. In addition, an efficient technique using a discretecosine transformation is utilized for the static visual salience. The dynamic andstatic visual attention metrics are merged by means of a non-linear weightedfusion technique. Results of the system are compared with some existing stateof-the-art techniques for the betterment of accuracy. The experimental resultsof our proposed model indicate the efficiency and high standard in terms ofthe key frames extraction as output.
文摘Major chronic diseases such as Cardiovascular Disease(CVD),diabetes,and cancer impose a significant burden on people and healthcare systems around the globe.Recently,Deep Learning(DL)has shown great potential for the development of intelligentmobile Health(mHealth)interventions for chronic diseases that could revolutionize the delivery of health care anytime,anywhere.The aimof this study is to present a systematic review of studies that have used DL based on mHealth data for the diagnosis,prognosis,management,and treatment of major chronic diseases and advance our understanding of the progress made in this rapidly developing field.Type 2 Diabetes Mellitus(T2DMs)is a regular chronic disorder that is caused by the secretion of insulin,which leads to serious death-related issues and the most complicated ones.Coronary Heart Disease(CHD)is the most frequent issue related to T2DM patients.The major concern is recognizing the high possibility of CHD complications,yet the model is not available to identify it.This work introduces a deep learning technique that can predict heart disease effectively using a hybrid model,which integrates DNNs(Deep Neural Networks)with a Multi-Head Attention Model called MADNN.The scheme canbedesignedtoautomatically learnthe best-quality features fromElectronic Health Records(EHRs),and effectively combine heterogeneous and time-sequencedmedical data for predicting the risk of CVD.The analysis is done using the Kaggle dataset.The outcomes prove that the MADNN has improved accuracy by about 95%and indicates the precise accuracy is higher for the disease compared with SVM,CNN and ANN.
基金supported by the National Natural Science Foundation of China (No.61871350)the Zhejiang Science and Technology Plan Project (No.2019C011123)the Zhejiang Province Basic Public Welfare Research Project (No.LGG19F030011)。
文摘The current life-prediction models for lithium-ion batteries have several problems, such as the construction of complex feature structures, a high number of feature dimensions, and inaccurate prediction results. To overcome these problems, this paper proposes a deep-learning model combining an autoencoder network and a long short-term memory network. First, this model applies the characteristics of the autoencoder to reduce the dimensionality of the high-dimensional features extracted from the battery data set and realize the fusion of complex time-domain features, which overcomes the problems of redundant model information and low computational efficiency. This model then uses a long short-term memory network that is sensitive to time-series data to solve the long-path dependence problem in the prediction of battery life. Lastly, the attention mechanism is used to give greater weight to features that have a greater impact on the target value, which enhances the learning effect of the model on the long input sequence. To verify the efficacy of the proposed model, this paper uses NASA's lithium-ion battery cycle life data set.
基金supported by National Natural Science Foundation of China(61673079)Natural Science Foundation of Chongqing(cstc2018jcyjAX0160)。
文摘Text classification is a classic task innatural language process(NLP).Convolutional neural networks(CNNs)have demonstrated its effectiveness in sentence and document modeling.However,most of existing CNN models are applied to the fixed-size convolution filters,thereby unable to adapt different local interdependency.To address this problem,a deep global-attention based convolutional network with dense connections(DGA-CCN)is proposed.In the framework,dense connections are applied to connect each convolution layer to each of the other layers which can accept information from all previous layers and get multiple sizes of local information.Then the local information extracted by the convolution layer is reweighted by deep global-attention to obtain a sequence representation with more valuable information of the whole sequence.A series of experiments are conducted on five text classification benchmarks,and the experimental results show that the proposed model improves upon the state of-the-art baselines on four of five datasets,which can show the effectiveness of our model for text classification.
基金the Key Research and Development Project of Zhejiang Province,China(No.2017C03029)。
文摘A novel structure based on channel-wise attention mechanism is presented in this paper.With the proposed structure embedded,an efficient classification model that accepts multi-lead electrocardiogram(ECG)as input is constructed.One-dimensional convolutional neural networks(CNNs)have proven to be effective in pervasive classification tasks,enabling the automatic extraction of features while classifying targets.We implement the residual connection and design a structure which can learn the weights from the information contained in different channels in the input feature map during the training process.An indicator named mean square deviation is introduced to monitor the performance of a particular model segment in the classification task on the two out of five ECG classes.The data in the MIT-BIH arrhythmia database is used and a series of control experiments is conducted.Utilizing both leads of the ECG signals as input to the neural network classifier can achieve better classification results than those from using single channel inputs in different application scenarios.Models embedded with the channel-wise attention structure always achieve better scores on sensitivity and precision than the plain Resnet models.The proposed model exceeds most of the state-of-the-art models in ventricular ectopic beats(VEB)classification performance and achieves competitive scores for supraventricular ectopic beats(SVEB).Adopting more lead ECG signals as input can increase the dimensions of the input feature maps,helping to improve both the performance and generalization of the network model.Due to its end-to-end characteristics,and the extensible intrinsic for multi-lead heart diseases diagnosing,the proposed model can be used for the realtime ECG tracking of ECG waveforms for Holter or wearable devices.
文摘Multivariate time series with missing values are common in a wide range of applications,including energy data.Existing imputation methods often fail to focus on the temporal dynamics and the cross-dimensional correlation simultaneously.In this paper we propose a two-step method based on an attention model to impute missing values in multivariate energy time series.First,the underlying distribution of the missing values in the data is learned.This information is then further used to train an attention based imputation model.By learning the distribution prior to the imputation process,the model can respond flexibly to the specific characteristics of the underlying data.The developed model is applied to European energy data,obtained from the European Network of Transmission System Operators for Electricity.Using different evaluation metrics and benchmarks,the conducted experiments show that the proposed model is preferable to the benchmarks and is able to accurately impute missing values.
