Hyperspectral imagery encompasses spectral and spatial dimensions,reflecting the material properties of objects.Its application proves crucial in search and rescue,concealed target identification,and crop growth analy...Hyperspectral imagery encompasses spectral and spatial dimensions,reflecting the material properties of objects.Its application proves crucial in search and rescue,concealed target identification,and crop growth analysis.Clustering is an important method of hyperspectral analysis.The vast data volume of hyperspectral imagery,coupled with redundant information,poses significant challenges in swiftly and accurately extracting features for subsequent analysis.The current hyperspectral feature clustering methods,which are mostly studied from space or spectrum,do not have strong interpretability,resulting in poor comprehensibility of the algorithm.So,this research introduces a feature clustering algorithm for hyperspectral imagery from an interpretability perspective.It commences with a simulated perception process,proposing an interpretable band selection algorithm to reduce data dimensions.Following this,amulti-dimensional clustering algorithm,rooted in fuzzy and kernel clustering,is developed to highlight intra-class similarities and inter-class differences.An optimized P systemis then introduced to enhance computational efficiency.This system coordinates all cells within a mapping space to compute optimal cluster centers,facilitating parallel computation.This approach diminishes sensitivity to initial cluster centers and augments global search capabilities,thus preventing entrapment in local minima and enhancing clustering performance.Experiments conducted on 300 datasets,comprising both real and simulated data.The results show that the average accuracy(ACC)of the proposed algorithm is 0.86 and the combination measure(CM)is 0.81.展开更多
Mural paintings hold significant historical information and possess substantial artistic and cultural value.However,murals are inevitably damaged by natural environmental factors such as wind and sunlight,as well as b...Mural paintings hold significant historical information and possess substantial artistic and cultural value.However,murals are inevitably damaged by natural environmental factors such as wind and sunlight,as well as by human activities.For this reason,the study of damaged areas is crucial for mural restoration.These damaged regions differ significantly from undamaged areas and can be considered abnormal targets.Traditional manual visual processing lacks strong characterization capabilities and is prone to omissions and false detections.Hyperspectral imaging can reflect the material properties more effectively than visual characterization methods.Thus,this study employs hyperspectral imaging to obtain mural information and proposes a mural anomaly detection algorithm based on a hyperspectral multi-scale residual attention network(HM-MRANet).The innovations of this paper include:(1)Constructing mural painting hyperspectral datasets.(2)Proposing a multi-scale residual spectral-spatial feature extraction module based on a 3D CNN(Convolutional Neural Networks)network to better capture multiscale information and improve performance on small-sample hyperspectral datasets.(3)Proposing the Enhanced Residual Attention Module(ERAM)to address the feature redundancy problem,enhance the network’s feature discrimination ability,and further improve abnormal area detection accuracy.The experimental results show that the AUC(Area Under Curve),Specificity,and Accuracy of this paper’s algorithm reach 85.42%,88.84%,and 87.65%,respectively,on this dataset.These results represent improvements of 3.07%,1.11%and 2.68%compared to the SSRN algorithm,demonstrating the effectiveness of this method for mural anomaly detection.展开更多
Sanxingdui cultural relics are the precious cultural heritage of humanity with high values of history,science,culture,art and research.However,mainstream analytical methods are contacting and detrimental,which is unfa...Sanxingdui cultural relics are the precious cultural heritage of humanity with high values of history,science,culture,art and research.However,mainstream analytical methods are contacting and detrimental,which is unfavorable to the protection of cultural relics.This paper improves the accuracy of the extraction,location,and analysis of artifacts using hyperspectral methods.To improve the accuracy of cultural relic mining,positioning,and analysis,the segmentation algorithm of Sanxingdui cultural relics based on the spatial spectrum integrated network is proposed with the support of hyperspectral techniques.Firstly,region stitching algorithm based on the relative position of hyper spectrally collected data is proposed to improve stitching efficiency.Secondly,given the prominence of traditional HRNet(High-Resolution Net)models in high-resolution data processing,the spatial attention mechanism is put forward to obtain spatial dimension information.Thirdly,in view of the prominence of 3D networks in spectral information acquisition,the pyramid 3D residual network model is proposed to obtain internal spectral dimensional information.Fourthly,four kinds of fusion methods at the level of data and decision are presented to achieve cultural relic labeling.As shown by the experiment results,the proposed network adopts an integrated method of data-level and decision-level,which achieves the optimal average accuracy of identification 0.84,realizes shallow coverage of cultural relics labeling,and effectively supports the mining and protection of cultural relics.展开更多
In this paper,we propose a neoteric and high-efficiency single image dehazing algorithm via contrast enhancement which is called STRASS(Spatio-Temporal Retinex-Inspired by an Averaging of Stochastic Samples)dehazing,i...In this paper,we propose a neoteric and high-efficiency single image dehazing algorithm via contrast enhancement which is called STRASS(Spatio-Temporal Retinex-Inspired by an Averaging of Stochastic Samples)dehazing,it is realized by constructing an efficient high-pass filter to process haze images and taking the influence of human vision system into account in image dehazing principles.The novel high-pass filter works by getting each pixel using RSR and computes the average of the samples.Then the low-pass filter resulting from the minimum envelope in STRESS framework has been replaced by the average of the samples.The final dehazed image is yielded after iterations of the high-pass filter.STRASS can be run directly without any machine learning.Extensive experimental results on datasets prove that STRASS surpass the state-of-the-arts.Image dehazing can be applied in the field of printing and packaging,our method is of great significance for image pre-processing before printing.展开更多
Abnormal event detection aims to automatically identify unusual events that do not comply with expectation.Recently,many methods have been proposed to obtain the temporal locations of abnormal events under various det...Abnormal event detection aims to automatically identify unusual events that do not comply with expectation.Recently,many methods have been proposed to obtain the temporal locations of abnormal events under various determined thresholds.However,the specific categories of abnormal events are mostly neglect,which are important to help in monitoring agents to make decisions.In this study,a Temporal Attention Network(TANet)is proposed to capture both the specific categories and temporal locations of abnormal events in a weakly supervised manner.The TANet learns the anomaly score and specific category for each video segment with only video-level abnormal event labels.An event recognition module is exploited to predict the event scores for each video segment while a temporal attention module is proposed to learn a temporal attention value.Finally,to learn anomaly scores and specific categories,three constraints are considered:event category constraint,event separation constraint and temporal smoothness constraint.Experiments on the University of Central Florida Crime dataset demonstrate the effectiveness of the proposed method.展开更多
Lung is an important organ of human body.More and more people are suffering from lung diseases due to air pollution.These diseases are usually highly infectious.Such as lung tuberculosis,novel coronavirus COVID-19,etc...Lung is an important organ of human body.More and more people are suffering from lung diseases due to air pollution.These diseases are usually highly infectious.Such as lung tuberculosis,novel coronavirus COVID-19,etc.Lung nodule is a kind of high-density globular lesion in the lung.Physicians need to spend a lot of time and energy to observe the computed tomography image sequences to make a diagnosis,which is inefficient.For this reason,the use of computer-assisted diagnosis of lung nodules has become the current main trend.In the process of computer-aided diagnosis,how to reduce the false positive rate while ensuring a low missed detection rate is a difficulty and focus of current research.To solve this problem,we propose a three-dimensional optimization model to achieve the extraction of suspected regions,improve the traditional deep belief network,and to modify the dispersion matrix between classes.We construct a multi-view model,fuse local three-dimensional information into two-dimensional images,and thereby to reduce the complexity of the algorithm.And alleviate the problem of unbalanced training caused by only a small number of positive samples.Experiments show that the false positive rate of the algorithm proposed in this paper is as low as 12%,which is in line with clinical application standards.展开更多
A panorama can reflect the surrounding scenery because it is an image with a wide angle of view.It can be applied in virtual reality,smart homes and other fields as well.A multi-directional reconstruction algorithm fo...A panorama can reflect the surrounding scenery because it is an image with a wide angle of view.It can be applied in virtual reality,smart homes and other fields as well.A multi-directional reconstruction algorithm for panoramic camera is proposed in this paper according to the imaging principle of dome camera,as the distortion inevitably exists in the captured panorama.First,parameters of a panoramic image are calculated.Then,a weighting operator with location information is introduced to solve the problem of rough edges by taking full advantage of pixels.Six directions of the mapping model are built,which include up,down,left,right,front and back,according to the correspondence between cylinder and spherical coordinates.Finally,multi-directional image reconstruction can be realized.Various experiments are performed in panoramas(1024×1024)with 30 different shooting scenes.Results show that the azimuth image can be reconstructed quickly and accurately.The fuzzy edge can be alleviated effectively.The rate of pixel utilization can reach 84%,and it is 33%higher than the direct mapping algorithm.Large scale distortion is also further studied.展开更多
基金Yulin Science and Technology Bureau production Project“Research on Smart Agricultural Product Traceability System”(No.CXY-2022-64)Light of West China(No.XAB2022YN10)+1 种基金The China Postdoctoral Science Foundation(No.2023M740760)Shaanxi Province Key Research and Development Plan(No.2024SF-YBXM-678).
文摘Hyperspectral imagery encompasses spectral and spatial dimensions,reflecting the material properties of objects.Its application proves crucial in search and rescue,concealed target identification,and crop growth analysis.Clustering is an important method of hyperspectral analysis.The vast data volume of hyperspectral imagery,coupled with redundant information,poses significant challenges in swiftly and accurately extracting features for subsequent analysis.The current hyperspectral feature clustering methods,which are mostly studied from space or spectrum,do not have strong interpretability,resulting in poor comprehensibility of the algorithm.So,this research introduces a feature clustering algorithm for hyperspectral imagery from an interpretability perspective.It commences with a simulated perception process,proposing an interpretable band selection algorithm to reduce data dimensions.Following this,amulti-dimensional clustering algorithm,rooted in fuzzy and kernel clustering,is developed to highlight intra-class similarities and inter-class differences.An optimized P systemis then introduced to enhance computational efficiency.This system coordinates all cells within a mapping space to compute optimal cluster centers,facilitating parallel computation.This approach diminishes sensitivity to initial cluster centers and augments global search capabilities,thus preventing entrapment in local minima and enhancing clustering performance.Experiments conducted on 300 datasets,comprising both real and simulated data.The results show that the average accuracy(ACC)of the proposed algorithm is 0.86 and the combination measure(CM)is 0.81.
基金supported by Key Research and Development Plan of Ministry of Science and Technology(No.2023YFF0906200)Shaanxi Key Research and Development Plan(No.2018ZDXM-SF-093)+3 种基金Shaanxi Province Key Industrial Innovation Chain(Nos.S2022-YF-ZDCXL-ZDLGY-0093 and 2023-ZDLGY-45)Light of West China(No.XAB2022YN10)The China Postdoctoral Science Foundation(No.2023M740760)Shaanxi Key Research and Development Plan(No.2024SF-YBXM-678).
文摘Mural paintings hold significant historical information and possess substantial artistic and cultural value.However,murals are inevitably damaged by natural environmental factors such as wind and sunlight,as well as by human activities.For this reason,the study of damaged areas is crucial for mural restoration.These damaged regions differ significantly from undamaged areas and can be considered abnormal targets.Traditional manual visual processing lacks strong characterization capabilities and is prone to omissions and false detections.Hyperspectral imaging can reflect the material properties more effectively than visual characterization methods.Thus,this study employs hyperspectral imaging to obtain mural information and proposes a mural anomaly detection algorithm based on a hyperspectral multi-scale residual attention network(HM-MRANet).The innovations of this paper include:(1)Constructing mural painting hyperspectral datasets.(2)Proposing a multi-scale residual spectral-spatial feature extraction module based on a 3D CNN(Convolutional Neural Networks)network to better capture multiscale information and improve performance on small-sample hyperspectral datasets.(3)Proposing the Enhanced Residual Attention Module(ERAM)to address the feature redundancy problem,enhance the network’s feature discrimination ability,and further improve abnormal area detection accuracy.The experimental results show that the AUC(Area Under Curve),Specificity,and Accuracy of this paper’s algorithm reach 85.42%,88.84%,and 87.65%,respectively,on this dataset.These results represent improvements of 3.07%,1.11%and 2.68%compared to the SSRN algorithm,demonstrating the effectiveness of this method for mural anomaly detection.
基金supported by Light of West China(No.XAB2022YN10)Shaanxi Key Rsearch and Development Plan(No.2018ZDXM-SF-093)Shaanxi Province Key Industrial Innovation Chain(Nos.S2022-YF-ZDCXL-ZDLGY-0093,2023-ZDLGY-45).
文摘Sanxingdui cultural relics are the precious cultural heritage of humanity with high values of history,science,culture,art and research.However,mainstream analytical methods are contacting and detrimental,which is unfavorable to the protection of cultural relics.This paper improves the accuracy of the extraction,location,and analysis of artifacts using hyperspectral methods.To improve the accuracy of cultural relic mining,positioning,and analysis,the segmentation algorithm of Sanxingdui cultural relics based on the spatial spectrum integrated network is proposed with the support of hyperspectral techniques.Firstly,region stitching algorithm based on the relative position of hyper spectrally collected data is proposed to improve stitching efficiency.Secondly,given the prominence of traditional HRNet(High-Resolution Net)models in high-resolution data processing,the spatial attention mechanism is put forward to obtain spatial dimension information.Thirdly,in view of the prominence of 3D networks in spectral information acquisition,the pyramid 3D residual network model is proposed to obtain internal spectral dimensional information.Fourthly,four kinds of fusion methods at the level of data and decision are presented to achieve cultural relic labeling.As shown by the experiment results,the proposed network adopts an integrated method of data-level and decision-level,which achieves the optimal average accuracy of identification 0.84,realizes shallow coverage of cultural relics labeling,and effectively supports the mining and protection of cultural relics.
基金This work was supported in part by National Natural Science Foundation of China under Grant 62076199in part by the Open Research Fund of Beijing Key Laboratory of Big Data Technology for Food Safety under Grant BTBD-2020KF08+2 种基金Beijing Technology and Business University,in part by the China Postdoctoral Science Foundation under Grant 2019M653784in part by Key Laboratory of Spectral Imaging Technology of Chinese Academy of Sciences under Grant LSIT201801Din part by the Key R&D Project of Shaan’xi Province under Grant 2021GY-027。
文摘In this paper,we propose a neoteric and high-efficiency single image dehazing algorithm via contrast enhancement which is called STRASS(Spatio-Temporal Retinex-Inspired by an Averaging of Stochastic Samples)dehazing,it is realized by constructing an efficient high-pass filter to process haze images and taking the influence of human vision system into account in image dehazing principles.The novel high-pass filter works by getting each pixel using RSR and computes the average of the samples.Then the low-pass filter resulting from the minimum envelope in STRESS framework has been replaced by the average of the samples.The final dehazed image is yielded after iterations of the high-pass filter.STRASS can be run directly without any machine learning.Extensive experimental results on datasets prove that STRASS surpass the state-of-the-arts.Image dehazing can be applied in the field of printing and packaging,our method is of great significance for image pre-processing before printing.
基金supported in part by the National Science Fund for Distinguished Young Scholars under grant no.61925112,in part by the National Natural Science Foundation of China under grant no.61806193 and grant no.61772510Support Program of Shaanxi under grant no.2020KJXX‐091in part by the Key Research Program of Frontier Sciences,Chinese Academy of Sciences under grant no.QYZDY‐SSW‐JSC044.
文摘Abnormal event detection aims to automatically identify unusual events that do not comply with expectation.Recently,many methods have been proposed to obtain the temporal locations of abnormal events under various determined thresholds.However,the specific categories of abnormal events are mostly neglect,which are important to help in monitoring agents to make decisions.In this study,a Temporal Attention Network(TANet)is proposed to capture both the specific categories and temporal locations of abnormal events in a weakly supervised manner.The TANet learns the anomaly score and specific category for each video segment with only video-level abnormal event labels.An event recognition module is exploited to predict the event scores for each video segment while a temporal attention module is proposed to learn a temporal attention value.Finally,to learn anomaly scores and specific categories,three constraints are considered:event category constraint,event separation constraint and temporal smoothness constraint.Experiments on the University of Central Florida Crime dataset demonstrate the effectiveness of the proposed method.
基金This work was supported by Science and Technology Rising Star of Shaanxi Youth(No.2021KJXX-61)The Open Project Program of the State Key Lab of CAD&CG,Zhejiang University(No.A2206)+3 种基金The China Postdoctoral Science Foundation(No.2020M683696XB)Natural Science Basic Research Plan in Shaanxi Province of China(No.2021JQ-455)Natural Science Foundation of China(No.62062003),Key Research and Development Project of Ningxia(Special projects for talents)(No.2020BEB04022)North Minzu University Research Project of Talent Introduction(No.2020KYQD08).
文摘Lung is an important organ of human body.More and more people are suffering from lung diseases due to air pollution.These diseases are usually highly infectious.Such as lung tuberculosis,novel coronavirus COVID-19,etc.Lung nodule is a kind of high-density globular lesion in the lung.Physicians need to spend a lot of time and energy to observe the computed tomography image sequences to make a diagnosis,which is inefficient.For this reason,the use of computer-assisted diagnosis of lung nodules has become the current main trend.In the process of computer-aided diagnosis,how to reduce the false positive rate while ensuring a low missed detection rate is a difficulty and focus of current research.To solve this problem,we propose a three-dimensional optimization model to achieve the extraction of suspected regions,improve the traditional deep belief network,and to modify the dispersion matrix between classes.We construct a multi-view model,fuse local three-dimensional information into two-dimensional images,and thereby to reduce the complexity of the algorithm.And alleviate the problem of unbalanced training caused by only a small number of positive samples.Experiments show that the false positive rate of the algorithm proposed in this paper is as low as 12%,which is in line with clinical application standards.
基金This work is supported by Light of West China(Grant No.XAB2016B23)Chinese Academy of Sciences.And the Open Project Program of the State Key Lab of CAD&CG(Grant No.A2026),Zhejiang University.
文摘A panorama can reflect the surrounding scenery because it is an image with a wide angle of view.It can be applied in virtual reality,smart homes and other fields as well.A multi-directional reconstruction algorithm for panoramic camera is proposed in this paper according to the imaging principle of dome camera,as the distortion inevitably exists in the captured panorama.First,parameters of a panoramic image are calculated.Then,a weighting operator with location information is introduced to solve the problem of rough edges by taking full advantage of pixels.Six directions of the mapping model are built,which include up,down,left,right,front and back,according to the correspondence between cylinder and spherical coordinates.Finally,multi-directional image reconstruction can be realized.Various experiments are performed in panoramas(1024×1024)with 30 different shooting scenes.Results show that the azimuth image can be reconstructed quickly and accurately.The fuzzy edge can be alleviated effectively.The rate of pixel utilization can reach 84%,and it is 33%higher than the direct mapping algorithm.Large scale distortion is also further studied.
