Objective To propose two novel methods based on deep learning for computer-aided tongue diagnosis,including tongue image segmentation and tongue color classification,improving their diagnostic accuracy.Methods LabelMe...Objective To propose two novel methods based on deep learning for computer-aided tongue diagnosis,including tongue image segmentation and tongue color classification,improving their diagnostic accuracy.Methods LabelMe was used to label the tongue mask and Snake model to optimize the labeling results.A new dataset was constructed for tongue image segmentation.Tongue color was marked to build a classified dataset for network training.In this research,the Inception+Atrous Spatial Pyramid Pooling(ASPP)+UNet(IAUNet)method was proposed for tongue image segmentation,based on the existing UNet,Inception,and atrous convolution.Moreover,the Tongue Color Classification Net(TCCNet)was constructed with reference to ResNet,Inception,and Triple-Loss.Several important measurement indexes were selected to evaluate and compare the effects of the novel and existing methods for tongue segmentation and tongue color classification.IAUNet was compared with existing mainstream methods such as UNet and DeepLabV3+for tongue segmentation.TCCNet for tongue color classification was compared with VGG16 and GoogLeNet.Results IAUNet can accurately segment the tongue from original images.The results showed that the Mean Intersection over Union(MIoU)of IAUNet reached 96.30%,and its Mean Pixel Accuracy(MPA),mean Average Precision(mAP),F1-Score,G-Score,and Area Under Curve(AUC)reached 97.86%,99.18%,96.71%,96.82%,and 99.71%,respectively,suggesting IAUNet produced better segmentation than other methods,with fewer parameters.Triplet-Loss was applied in the proposed TCCNet to separate different embedded colors.The experiment yielded ideal results,with F1-Score and mAP of the TCCNet reached 88.86% and 93.49%,respectively.Conclusion IAUNet based on deep learning for tongue segmentation is better than traditional ones.IAUNet can not only produce ideal tongue segmentation,but have better effects than those of PSPNet,SegNet,UNet,and DeepLabV3+,the traditional networks.As for tongue color classification,the proposed network,TCCNet,had better F1-Score and mAP values as compared with other neural networks such as VGG16 and GoogLeNet.展开更多
Tongue diagnosis is an important process to non-invasively assess the condition of a patient’s internal organs in traditional Chinese medicine(TCM)and each part of the tongue is related to corresponding internal orga...Tongue diagnosis is an important process to non-invasively assess the condition of a patient’s internal organs in traditional Chinese medicine(TCM)and each part of the tongue is related to corresponding internal organs.Due to continuing computer technological advances,especially the artificial intelligence(AI)methods have achieved significant success in tackling tongue image acquisition,processing,and classification,novel AI methods are being introduced in traditional Chinese medicine tongue diagnosis medical practices.Traditional tongue diagnose depends on observations of tongue characteristics,such as color,shape,texture,moisture,etc.by traditional Chinese medicine physicians.The appearance of the tongue color,texture and coating reflects the improvement or deterioration of patient’s conditions.Moreover,AI can now distinguish patient’s condition through tongue images,texture or coating,which is all possible increasingly with help from traditional Chinese medicine physicians under the traditional Chinese medicine tongue theory.AI has enabled humans to do what was previously unimagined:traditional Chinese medicine tongue diagnosis with feeding a large amount of tongue image and tongue texture/coating data to train the AI modes.This review focuses on the research advances of AI in TCM tongue diagnosis thus far to identify the major scientific methods and prospects.In this article,we tried to review the AI application in resolving the tongue diagnosis of traditional Chinese medicine on color correction,tongue image extraction,tongue texture/coating segmentation.展开更多
In this paper, we propose a novel automatic object extraction algorithm, named the Template Guided Live Wire, based on the popularly used live-wire techniques. We discuss in details the novel method’s applications on...In this paper, we propose a novel automatic object extraction algorithm, named the Template Guided Live Wire, based on the popularly used live-wire techniques. We discuss in details the novel method’s applications on tongue extraction in digital images. With the guides of a given template curve which approximates the tongue’s shape, our method can finish the extraction of tongue without any human intervention. In the paper, we also discussed in details how the template guides the live wire, and why our method functions more effectively than other boundary based segmentation methods especially the snake algorithm. Experimental results on some tongue images are as well provided to show our method’s better accuracy and robustness than the snake algorithm.展开更多
基金Scientific Research Project of the Education Department of Hunan Province(20C1435)Open Fund Project for Computer Science and Technology of Hunan University of Chinese Medicine(2018JK05).
文摘Objective To propose two novel methods based on deep learning for computer-aided tongue diagnosis,including tongue image segmentation and tongue color classification,improving their diagnostic accuracy.Methods LabelMe was used to label the tongue mask and Snake model to optimize the labeling results.A new dataset was constructed for tongue image segmentation.Tongue color was marked to build a classified dataset for network training.In this research,the Inception+Atrous Spatial Pyramid Pooling(ASPP)+UNet(IAUNet)method was proposed for tongue image segmentation,based on the existing UNet,Inception,and atrous convolution.Moreover,the Tongue Color Classification Net(TCCNet)was constructed with reference to ResNet,Inception,and Triple-Loss.Several important measurement indexes were selected to evaluate and compare the effects of the novel and existing methods for tongue segmentation and tongue color classification.IAUNet was compared with existing mainstream methods such as UNet and DeepLabV3+for tongue segmentation.TCCNet for tongue color classification was compared with VGG16 and GoogLeNet.Results IAUNet can accurately segment the tongue from original images.The results showed that the Mean Intersection over Union(MIoU)of IAUNet reached 96.30%,and its Mean Pixel Accuracy(MPA),mean Average Precision(mAP),F1-Score,G-Score,and Area Under Curve(AUC)reached 97.86%,99.18%,96.71%,96.82%,and 99.71%,respectively,suggesting IAUNet produced better segmentation than other methods,with fewer parameters.Triplet-Loss was applied in the proposed TCCNet to separate different embedded colors.The experiment yielded ideal results,with F1-Score and mAP of the TCCNet reached 88.86% and 93.49%,respectively.Conclusion IAUNet based on deep learning for tongue segmentation is better than traditional ones.IAUNet can not only produce ideal tongue segmentation,but have better effects than those of PSPNet,SegNet,UNet,and DeepLabV3+,the traditional networks.As for tongue color classification,the proposed network,TCCNet,had better F1-Score and mAP values as compared with other neural networks such as VGG16 and GoogLeNet.
基金China National Funds for Distinguished Young Scientists(CN)(Grants No.81725024)China Postdoctoral Science Foundation(No.2020M670236).
文摘Tongue diagnosis is an important process to non-invasively assess the condition of a patient’s internal organs in traditional Chinese medicine(TCM)and each part of the tongue is related to corresponding internal organs.Due to continuing computer technological advances,especially the artificial intelligence(AI)methods have achieved significant success in tackling tongue image acquisition,processing,and classification,novel AI methods are being introduced in traditional Chinese medicine tongue diagnosis medical practices.Traditional tongue diagnose depends on observations of tongue characteristics,such as color,shape,texture,moisture,etc.by traditional Chinese medicine physicians.The appearance of the tongue color,texture and coating reflects the improvement or deterioration of patient’s conditions.Moreover,AI can now distinguish patient’s condition through tongue images,texture or coating,which is all possible increasingly with help from traditional Chinese medicine physicians under the traditional Chinese medicine tongue theory.AI has enabled humans to do what was previously unimagined:traditional Chinese medicine tongue diagnosis with feeding a large amount of tongue image and tongue texture/coating data to train the AI modes.This review focuses on the research advances of AI in TCM tongue diagnosis thus far to identify the major scientific methods and prospects.In this article,we tried to review the AI application in resolving the tongue diagnosis of traditional Chinese medicine on color correction,tongue image extraction,tongue texture/coating segmentation.
文摘In this paper, we propose a novel automatic object extraction algorithm, named the Template Guided Live Wire, based on the popularly used live-wire techniques. We discuss in details the novel method’s applications on tongue extraction in digital images. With the guides of a given template curve which approximates the tongue’s shape, our method can finish the extraction of tongue without any human intervention. In the paper, we also discussed in details how the template guides the live wire, and why our method functions more effectively than other boundary based segmentation methods especially the snake algorithm. Experimental results on some tongue images are as well provided to show our method’s better accuracy and robustness than the snake algorithm.
