Contrastive self‐supervised representation learning on attributed graph networks with Graph Neural Networks has attracted considerable research interest recently.However,there are still two challenges.First,most of t...Contrastive self‐supervised representation learning on attributed graph networks with Graph Neural Networks has attracted considerable research interest recently.However,there are still two challenges.First,most of the real‐word system are multiple relations,where entities are linked by different types of relations,and each relation is a view of the graph network.Second,the rich multi‐scale information(structure‐level and feature‐level)of the graph network can be seen as self‐supervised signals,which are not fully exploited.A novel contrastive self‐supervised representation learning framework on attributed multiplex graph networks with multi‐scale(named CoLM^(2)S)information is presented in this study.It mainly contains two components:intra‐relation contrast learning and interrelation contrastive learning.Specifically,the contrastive self‐supervised representation learning framework on attributed single‐layer graph networks with multi‐scale information(CoLMS)framework with the graph convolutional network as encoder to capture the intra‐relation information with multi‐scale structure‐level and feature‐level selfsupervised signals is introduced first.The structure‐level information includes the edge structure and sub‐graph structure,and the feature‐level information represents the output of different graph convolutional layer.Second,according to the consensus assumption among inter‐relations,the CoLM^(2)S framework is proposed to jointly learn various graph relations in attributed multiplex graph network to achieve global consensus node embedding.The proposed method can fully distil the graph information.Extensive experiments on unsupervised node clustering and graph visualisation tasks demonstrate the effectiveness of our methods,and it outperforms existing competitive baselines.展开更多
In the field of hyperspectral image(HSI)classification in remote sensing,the combination of spectral and spatial features has gained considerable attention.In addition,the multiscale feature extraction approach is ver...In the field of hyperspectral image(HSI)classification in remote sensing,the combination of spectral and spatial features has gained considerable attention.In addition,the multiscale feature extraction approach is very effective at improving the classification accuracy for HSIs,capable of capturing a large amount of intrinsic information.However,some existing methods for extracting spectral and spatial features can only generate low-level features and consider limited scales,leading to low classification results,and dense-connection based methods enhance the feature propagation at the cost of high model complexity.This paper presents a two-branch multiscale spectral-spatial feature extraction network(TBMSSN)for HSI classification.We design the mul-tiscale spectral feature extraction(MSEFE)and multiscale spatial feature extraction(MSAFE)modules to improve the feature representation,and a spatial attention mechanism is applied in the MSAFE module to reduce redundant information and enhance the representation of spatial fea-tures at multiscale.Then we densely connect series of MSEFE or MSAFE modules respectively in a two-branch framework to balance efficiency and effectiveness,alleviate the vanishing-gradient problem and strengthen the feature propagation.To evaluate the effectiveness of the proposed method,the experimental results were carried out on bench mark HsI datasets,demonstrating that TBMSSN obtained higher classification accuracy compared with several state-of-the-art methods.展开更多
基金support by the National Natural Science Foundation of China(NSFC)under grant number 61873274.
文摘Contrastive self‐supervised representation learning on attributed graph networks with Graph Neural Networks has attracted considerable research interest recently.However,there are still two challenges.First,most of the real‐word system are multiple relations,where entities are linked by different types of relations,and each relation is a view of the graph network.Second,the rich multi‐scale information(structure‐level and feature‐level)of the graph network can be seen as self‐supervised signals,which are not fully exploited.A novel contrastive self‐supervised representation learning framework on attributed multiplex graph networks with multi‐scale(named CoLM^(2)S)information is presented in this study.It mainly contains two components:intra‐relation contrast learning and interrelation contrastive learning.Specifically,the contrastive self‐supervised representation learning framework on attributed single‐layer graph networks with multi‐scale information(CoLMS)framework with the graph convolutional network as encoder to capture the intra‐relation information with multi‐scale structure‐level and feature‐level selfsupervised signals is introduced first.The structure‐level information includes the edge structure and sub‐graph structure,and the feature‐level information represents the output of different graph convolutional layer.Second,according to the consensus assumption among inter‐relations,the CoLM^(2)S framework is proposed to jointly learn various graph relations in attributed multiplex graph network to achieve global consensus node embedding.The proposed method can fully distil the graph information.Extensive experiments on unsupervised node clustering and graph visualisation tasks demonstrate the effectiveness of our methods,and it outperforms existing competitive baselines.
基金supported by the National Natural Science Foundation of China(62077038,61672405,62176196 and 62271374)。
文摘In the field of hyperspectral image(HSI)classification in remote sensing,the combination of spectral and spatial features has gained considerable attention.In addition,the multiscale feature extraction approach is very effective at improving the classification accuracy for HSIs,capable of capturing a large amount of intrinsic information.However,some existing methods for extracting spectral and spatial features can only generate low-level features and consider limited scales,leading to low classification results,and dense-connection based methods enhance the feature propagation at the cost of high model complexity.This paper presents a two-branch multiscale spectral-spatial feature extraction network(TBMSSN)for HSI classification.We design the mul-tiscale spectral feature extraction(MSEFE)and multiscale spatial feature extraction(MSAFE)modules to improve the feature representation,and a spatial attention mechanism is applied in the MSAFE module to reduce redundant information and enhance the representation of spatial fea-tures at multiscale.Then we densely connect series of MSEFE or MSAFE modules respectively in a two-branch framework to balance efficiency and effectiveness,alleviate the vanishing-gradient problem and strengthen the feature propagation.To evaluate the effectiveness of the proposed method,the experimental results were carried out on bench mark HsI datasets,demonstrating that TBMSSN obtained higher classification accuracy compared with several state-of-the-art methods.
