While encryption technology safeguards the security of network communications,malicious traffic also uses encryption protocols to obscure its malicious behavior.To address the issues of traditional machine learning me...While encryption technology safeguards the security of network communications,malicious traffic also uses encryption protocols to obscure its malicious behavior.To address the issues of traditional machine learning methods relying on expert experience and the insufficient representation capabilities of existing deep learning methods for encrypted malicious traffic,we propose an encrypted malicious traffic classification method that integrates global semantic features with local spatiotemporal features,called BERT-based Spatio-Temporal Features Network(BSTFNet).At the packet-level granularity,the model captures the global semantic features of packets through the attention mechanism of the Bidirectional Encoder Representations from Transformers(BERT)model.At the byte-level granularity,we initially employ the Bidirectional Gated Recurrent Unit(BiGRU)model to extract temporal features from bytes,followed by the utilization of the Text Convolutional Neural Network(TextCNN)model with multi-sized convolution kernels to extract local multi-receptive field spatial features.The fusion of features from both granularities serves as the ultimate multidimensional representation of malicious traffic.Our approach achieves accuracy and F1-score of 99.39%and 99.40%,respectively,on the publicly available USTC-TFC2016 dataset,and effectively reduces sample confusion within the Neris and Virut categories.The experimental results demonstrate that our method has outstanding representation and classification capabilities for encrypted malicious traffic.展开更多
Predicting travel trajectory of vehicles can not only provide personalized services to users,but also have a certain effect on traffic guidance and traffic control.In this paper,we build a Bayonet-Corpus based on the ...Predicting travel trajectory of vehicles can not only provide personalized services to users,but also have a certain effect on traffic guidance and traffic control.In this paper,we build a Bayonet-Corpus based on the context of traffic intersections,and use it to model a traffic network.Besides,Bidirectional Gated Recurrent Unit(Bi-GRU)is used to predict the sequence of traffic intersections in one single trajectory.Firstly,considering that real traffic networks are usually complex and disorder and cannot reflect the higher dimensional relationship among traffic intersections,this paper proposes a new traffic network modeling algorithm based on the context of traffic intersections:inspired by the probabilistic language model,a Bayonet-Corpus is constructed from traffic intersections in real trajectory sequence,so the high-dimensional similarity between corpus nodes can be used to measure the semantic relation of real traffic intersections.This algorithm maps vehicle trajectory nodes into a high-dimensional space vector,blocking complex structure of real traffic network and reconstructing the traffic network space.Then,the bayonets sequence in real traffic network is mapped into a matrix.Considering the trajectories sequence is bidirectional,and Bi-GRU can handle information from forward and backward simultaneously,we use Bi-GRU to bidirectionally model the trajectory matrix for the purpose of prediction.展开更多
Memristor-based neuromorphic computing shows great potential for high-speed and high-throughput signal processing applications,such as electroencephalogram(EEG)signal processing.Nonetheless,the size of one-transistor ...Memristor-based neuromorphic computing shows great potential for high-speed and high-throughput signal processing applications,such as electroencephalogram(EEG)signal processing.Nonetheless,the size of one-transistor one-resistor(1T1R)memristor arrays is limited by the non-ideality of the devices,which prevents the hardware implementation of large and complex networks.In this work,we propose the depthwise separable convolution and bidirectional gate recurrent unit(DSC-BiGRU)network,a lightweight and highly robust hybrid neural network based on 1T1R arrays that enables efficient processing of EEG signals in the temporal,frequency and spatial domains by hybridizing DSC and BiGRU blocks.The network size is reduced and the network robustness is improved while ensuring the network classification accuracy.In the simulation,the measured non-idealities of the 1T1R array are brought into the network through statistical analysis.Compared with traditional convolutional networks,the network parameters are reduced by 95%and the network classification accuracy is improved by 21%at a 95%array yield rate and 5%tolerable error.This work demonstrates that lightweight and highly robust networks based on memristor arrays hold great promise for applications that rely on low consumption and high efficiency.展开更多
Purpose-Multi-domain convolutional neural network(MDCNN)model has been widely used in object recognition and tracking in the field of computer vision.However,if the objects to be tracked move rapid or the appearances ...Purpose-Multi-domain convolutional neural network(MDCNN)model has been widely used in object recognition and tracking in the field of computer vision.However,if the objects to be tracked move rapid or the appearances of moving objects vary dramatically,the conventional MDCNN model will suffer from the model drift problem.To solve such problem in tracking rapid objects under limiting environment for MDCNN model,this paper proposed an auto-attentional mechanism-based MDCNN(AA-MDCNN)model for the rapid moving and changing objects tracking under limiting environment.Design/methodology/approach-First,to distinguish the foreground object between background and other similar objects,the auto-attentional mechanism is used to selectively aggregate the weighted summation of all feature maps to make the similar features related to each other.Then,the bidirectional gated recurrent unit(Bi-GRU)architecture is used to integrate all the feature maps to selectively emphasize the importance of the correlated feature maps.Finally,the final feature map is obtained by fusion the above two feature maps for object tracking.In addition,a composite loss function is constructed to solve the similar but different attribute sequences tracking using conventional MDCNN model.Findings-In order to validate the effectiveness and feasibility of the proposed AA-MDCNN model,this paper used ImageNet-Vid dataset to train the object tracking model,and the OTB-50 dataset is used to validate the AA-MDCNN tracking model.Experimental results have shown that the augmentation of auto-attentional mechanism will improve the accuracy rate 2.75%and success rate 2.41%,respectively.In addition,the authors also selected six complex tracking scenarios in OTB-50 dataset;over eleven attributes have been validated that the proposed AA-MDCNN model outperformed than the comparative models over nine attributes.In addition,except for the scenario of multi-objects moving with each other,the proposed AA-MDCNN model solved the majority rapid moving objects tracking scenarios and outperformed than the comparative models on such complex scenarios.Originality/value-This paper introduced the auto-attentional mechanism into MDCNN model and adopted Bi-GRU architecture to extract key features.By using the proposed AA-MDCNN model,rapid object tracking under complex background,motion blur and occlusion objects has better effect,and such model is expected to be further applied to the rapid object tracking in the real world.展开更多
Modern power grids face the challenge of increasing renewable energy penetration that is stochastic in nature and calls for accurate demand predictions to provide the optimized power supply.Hence,increasing the self-c...Modern power grids face the challenge of increasing renewable energy penetration that is stochastic in nature and calls for accurate demand predictions to provide the optimized power supply.Hence,increasing the self-consumption of renewable energy through demand response in households,local communities,and micro-grids is essential and calls for high demand prediction performance at lower levels of demand aggregations to achieve optimal performance.Although many of the recent studies have investigated both macro and micro scale short-term load forecasting(STLF),a comprehensive investigation on the effects of electrical demand aggregation size on STLF is minimal,especially with large sample sizes,where it is essential for optimal sizing of residential micro-grids,demand response markets,and virtual power plants.Hence,this study comprehensively investigates STLF of five aggregation levels(3,10,30,100,and 479)based on a dataset of 479 residential dwellings in Osaka,Japan,with a sample size of(159,47,15,4,and 1)per level,respectively,and investigates the underlying challenges in lower aggregation forecasting.Five deep learning(DL)methods are utilized for STLF and fine-tuned with extensive methodological sensitivity analysis and a variation of early stopping,where a detailed comparative analysis is developed.The test results reveal that a MAPE of(2.47-3.31%)close to country levels can be achieved on the highest aggregation,and below 10%can be sustained at 30 aggregated dwellings.Furthermore,the deep neural network(DNN)achieved the highest performance,followed by the Bi-directional Gated recurrent unit with fully connected layers(Bi-GRU-FCL),which had close to 15%faster training time and 40%fewer learnable parameters.展开更多
基金This research was funded by National Natural Science Foundation of China under Grant No.61806171Sichuan University of Science&Engineering Talent Project under Grant No.2021RC15+2 种基金Open Fund Project of Key Laboratory for Non-Destructive Testing and Engineering Computer of Sichuan Province Universities on Bridge Inspection and Engineering under Grant No.2022QYJ06Sichuan University of Science&Engineering Graduate Student Innovation Fund under Grant No.Y2023115The Scientific Research and Innovation Team Program of Sichuan University of Science and Technology under Grant No.SUSE652A006.
文摘While encryption technology safeguards the security of network communications,malicious traffic also uses encryption protocols to obscure its malicious behavior.To address the issues of traditional machine learning methods relying on expert experience and the insufficient representation capabilities of existing deep learning methods for encrypted malicious traffic,we propose an encrypted malicious traffic classification method that integrates global semantic features with local spatiotemporal features,called BERT-based Spatio-Temporal Features Network(BSTFNet).At the packet-level granularity,the model captures the global semantic features of packets through the attention mechanism of the Bidirectional Encoder Representations from Transformers(BERT)model.At the byte-level granularity,we initially employ the Bidirectional Gated Recurrent Unit(BiGRU)model to extract temporal features from bytes,followed by the utilization of the Text Convolutional Neural Network(TextCNN)model with multi-sized convolution kernels to extract local multi-receptive field spatial features.The fusion of features from both granularities serves as the ultimate multidimensional representation of malicious traffic.Our approach achieves accuracy and F1-score of 99.39%and 99.40%,respectively,on the publicly available USTC-TFC2016 dataset,and effectively reduces sample confusion within the Neris and Virut categories.The experimental results demonstrate that our method has outstanding representation and classification capabilities for encrypted malicious traffic.
基金This research is partially supported by the National Natural Science Foundation of China(Grant No.61772098)Science and Technology Research Program of Chongqing Municipal Education Commission(Grant No.KJZD K201900603,KJQN201900629)Chongqing Grad-uate Education Teaching Reform Project(No.yjg183081).
文摘Predicting travel trajectory of vehicles can not only provide personalized services to users,but also have a certain effect on traffic guidance and traffic control.In this paper,we build a Bayonet-Corpus based on the context of traffic intersections,and use it to model a traffic network.Besides,Bidirectional Gated Recurrent Unit(Bi-GRU)is used to predict the sequence of traffic intersections in one single trajectory.Firstly,considering that real traffic networks are usually complex and disorder and cannot reflect the higher dimensional relationship among traffic intersections,this paper proposes a new traffic network modeling algorithm based on the context of traffic intersections:inspired by the probabilistic language model,a Bayonet-Corpus is constructed from traffic intersections in real trajectory sequence,so the high-dimensional similarity between corpus nodes can be used to measure the semantic relation of real traffic intersections.This algorithm maps vehicle trajectory nodes into a high-dimensional space vector,blocking complex structure of real traffic network and reconstructing the traffic network space.Then,the bayonets sequence in real traffic network is mapped into a matrix.Considering the trajectories sequence is bidirectional,and Bi-GRU can handle information from forward and backward simultaneously,we use Bi-GRU to bidirectionally model the trajectory matrix for the purpose of prediction.
基金Project supported by the National Key Research and Development Program of China(Grant No.2019YFB2205102)the National Natural Science Foundation of China(Grant Nos.61974164,62074166,61804181,62004219,62004220,and 62104256).
文摘Memristor-based neuromorphic computing shows great potential for high-speed and high-throughput signal processing applications,such as electroencephalogram(EEG)signal processing.Nonetheless,the size of one-transistor one-resistor(1T1R)memristor arrays is limited by the non-ideality of the devices,which prevents the hardware implementation of large and complex networks.In this work,we propose the depthwise separable convolution and bidirectional gate recurrent unit(DSC-BiGRU)network,a lightweight and highly robust hybrid neural network based on 1T1R arrays that enables efficient processing of EEG signals in the temporal,frequency and spatial domains by hybridizing DSC and BiGRU blocks.The network size is reduced and the network robustness is improved while ensuring the network classification accuracy.In the simulation,the measured non-idealities of the 1T1R array are brought into the network through statistical analysis.Compared with traditional convolutional networks,the network parameters are reduced by 95%and the network classification accuracy is improved by 21%at a 95%array yield rate and 5%tolerable error.This work demonstrates that lightweight and highly robust networks based on memristor arrays hold great promise for applications that rely on low consumption and high efficiency.
基金supported by the Education and Scientific Research Project for Young and Middle-aged Teachers in Fujian Province(No.JAT200581).
文摘Purpose-Multi-domain convolutional neural network(MDCNN)model has been widely used in object recognition and tracking in the field of computer vision.However,if the objects to be tracked move rapid or the appearances of moving objects vary dramatically,the conventional MDCNN model will suffer from the model drift problem.To solve such problem in tracking rapid objects under limiting environment for MDCNN model,this paper proposed an auto-attentional mechanism-based MDCNN(AA-MDCNN)model for the rapid moving and changing objects tracking under limiting environment.Design/methodology/approach-First,to distinguish the foreground object between background and other similar objects,the auto-attentional mechanism is used to selectively aggregate the weighted summation of all feature maps to make the similar features related to each other.Then,the bidirectional gated recurrent unit(Bi-GRU)architecture is used to integrate all the feature maps to selectively emphasize the importance of the correlated feature maps.Finally,the final feature map is obtained by fusion the above two feature maps for object tracking.In addition,a composite loss function is constructed to solve the similar but different attribute sequences tracking using conventional MDCNN model.Findings-In order to validate the effectiveness and feasibility of the proposed AA-MDCNN model,this paper used ImageNet-Vid dataset to train the object tracking model,and the OTB-50 dataset is used to validate the AA-MDCNN tracking model.Experimental results have shown that the augmentation of auto-attentional mechanism will improve the accuracy rate 2.75%and success rate 2.41%,respectively.In addition,the authors also selected six complex tracking scenarios in OTB-50 dataset;over eleven attributes have been validated that the proposed AA-MDCNN model outperformed than the comparative models over nine attributes.In addition,except for the scenario of multi-objects moving with each other,the proposed AA-MDCNN model solved the majority rapid moving objects tracking scenarios and outperformed than the comparative models on such complex scenarios.Originality/value-This paper introduced the auto-attentional mechanism into MDCNN model and adopted Bi-GRU architecture to extract key features.By using the proposed AA-MDCNN model,rapid object tracking under complex background,motion blur and occlusion objects has better effect,and such model is expected to be further applied to the rapid object tracking in the real world.
文摘Modern power grids face the challenge of increasing renewable energy penetration that is stochastic in nature and calls for accurate demand predictions to provide the optimized power supply.Hence,increasing the self-consumption of renewable energy through demand response in households,local communities,and micro-grids is essential and calls for high demand prediction performance at lower levels of demand aggregations to achieve optimal performance.Although many of the recent studies have investigated both macro and micro scale short-term load forecasting(STLF),a comprehensive investigation on the effects of electrical demand aggregation size on STLF is minimal,especially with large sample sizes,where it is essential for optimal sizing of residential micro-grids,demand response markets,and virtual power plants.Hence,this study comprehensively investigates STLF of five aggregation levels(3,10,30,100,and 479)based on a dataset of 479 residential dwellings in Osaka,Japan,with a sample size of(159,47,15,4,and 1)per level,respectively,and investigates the underlying challenges in lower aggregation forecasting.Five deep learning(DL)methods are utilized for STLF and fine-tuned with extensive methodological sensitivity analysis and a variation of early stopping,where a detailed comparative analysis is developed.The test results reveal that a MAPE of(2.47-3.31%)close to country levels can be achieved on the highest aggregation,and below 10%can be sustained at 30 aggregated dwellings.Furthermore,the deep neural network(DNN)achieved the highest performance,followed by the Bi-directional Gated recurrent unit with fully connected layers(Bi-GRU-FCL),which had close to 15%faster training time and 40%fewer learnable parameters.
