摘要
目的超声胎儿头部边缘检测是胎儿头围测量的关键步骤,因胎儿头部超声图像边界模糊、超声声影造成图像中胎儿颅骨部分缺失、羊水及子宫壁形成与胎儿头部纹理及灰度相似的结构等因素干扰,给超声胎儿头部边缘检测及头围测量带来一定的难度。本文提出一种基于端到端的神经网络超声图像分割方法,用于胎儿头部边缘检测。方法以UNet++神经网络结构为基础,结合UNet++最后一层特征,构成融合型UNet++网络。训练过程中,为缓解模型训练过拟合问题,在每一卷积层后接一个空间dropout层。具体思路是通过融合型UNet++深度神经网络提取超声胎儿头部图像特征,通过胎儿头部区域概率图预测,输出胎儿头部语义分割的感兴趣区域。进一步获取胎儿的头部边缘关键点信息,并采用边缘曲线拟合方法拟合边缘,最终测量出胎儿头围大小。结果针对现有2维超声胎儿头围自动测量公开数据集HC18,以Dice系数、Hausdorff距离(HD)、头围绝对差值(AD)等指标评估本文模型性能,结果Dice系数为98.06%,HD距离为1.21±0.69 mm,头围测量AD为1.84±1.73 mm。在妊娠中期测试数据中,Dice系数为98.24%,HD距离为1.15±0.59 mm,头围测量AD为1.76±1.55 mm。在生物医学图像分析平台Grand Challenge上HC18数据集已提交结果中,融合型UNet++的Dice系数排在第3名,HD排在第2名,AD排在第10名。结论与经典超声胎儿头围测量方法及已有的机器学习方法应用研究相比,融合型UNet++能有效克服超声边界模糊、边缘缺失等干扰,精准分割出胎儿头部感兴趣区域,获取边缘关键点信息。与现有神经网络框架相比,融合型UNet++能充分利用上下文相关信息与局部定位功能,在妊娠中期的头围测量中,本文方法明显优于其他方法。
Objective Ultrasound fetal head circumference measurement is crucial for monitoring fetus growth and estimating the gestational age.Computer-aided measurement of fetal head circumference is valuable for sonographers who are short of experiments in ultrasound examinations.Through computer-aided measurement,they can further accurately detect fetal head edge and quickly finish an examination.Fetal head edge detection is necessary for the automatic measurement of fetal head circumference.Ultrasound fetal head image boundary is fuzzy,and the gray scale of fetal head is similar to the mother’s abdominal tissue,especially in the first trimester.Ultrasound shadow leads to the loss of head edge and incomplete fetal head in the image,which brings certain difficulties in detecting the complete fetal head edge and fit head ellipse.The structures of the amniotic fluid and uterine wall are similar to the head texture and gray scale,often leading to misclassification of this part as fetal head.All these factors result in challenges to ultrasound fetal head edge detection.Therefore,we propose a method for detecting the ultrasound fetal head edge by using convolutional neural network to segment the fetal head region end-to-end.Method The model proposed in this paper is based on UNet++.In deep supervised UNet++,every output is different and can provide a predicted result of the region of interest,but only the best predicted result will be used to predict the region of fetal head.Generally,the output results increase in accuracy from left to right.Four feature blocks exist before four outputs of UNet++.The left feature contains location information,and the right one contains sematic information.To utilize the feature map before outputs fully,we fuse them by concatenation and further extract fused features.The improved model is named Fusion UNet++.To prevent overfitting,we introduce spatial dropout after each convolutional layer instead of standard dropout,which extends the dropout value across the entire feature map.The idea of fetal head circumference measurement is as follows:first,we use Fusion UNet++to learn the features of 2 D ultrasound fetal head image and obtain the semantic segmentation result of the fetal head by using fetal head probability map.Second,on the basis of the image segmentation result,we extract the fetal head edge by using an edge detection algorithm and use the direct least square ellipse fitting method to fit the head contour.Finally,the fetal head circumference can be calculated using the ellipse circumference formula.Result The open dataset of the automated measurement of fetal head circumference of the 2 D ultrasound image named HC18 on Grand Challenges contains the first,second,and third trimester images of fetal heads.All fetal head images are the standard plane of measuring fetal head circumference.In the HC18 dataset,9992 D ultrasound images have annotations of fetal head circumference in the train set,and 3352 D ultrasound fetal head images have no annotations in the test set.We use the train set to train the convolutional neural network and submit the predicted results of the test set to participate in the model evaluation on HC18,Grand Challenges.We use the Dice coefficient,Hausdorff distance(HD),and absolute difference(AD)as assessment indexes to evaluate the proposed method quantitatively.With the proposed method,for the dataset of fetal head images for all three trimesters,the Dice coefficient of the fetal head segmentation is 98.06%,the HD is 1.21±0.69 mm,and the AD of the fetal head circumference measurement is1.84±1.73 mm.The skull in the second trimester is visible and appears as a bright structure;it is invisible in the first trimester and visible but incomplete in the third trimester.Seeing the complete skull is difficult in the first and third trimesters;thus,the measurement result of the fetal head circumference in the second trimester is the best among all trimesters.Most algorithms measure the fetal head circumference only in the second trimester or in the second and third trimester fetal head ultrasound images.For the second trimester,the Dice coefficient of the fetal head segmentation is 98.24%,the HD is1.15±0.59 mm,and the AD of the fetal head circumference measurement is 1.76±1.55 mm.On the basis of the results presented in the open test set,our Dice ranked the 3 rd,HD is the 2 nd,and AD is the 10 th.Conclusion In comparison with the traditional and machine learning methods,the proposed method can effectively overcome the interference of fuzzy boundary and lack of edge and can accurately segment the fetal head region.In comparison with existing neural network methods,the proposed method surpasses the other methods in the second trimester of pregnancy in fetal head segmentation and head circumference measurement.The proposed method achieves the state-of-the-art results of fetal head segmentation.
作者
邢妍妍
杨丰
唐宇姣
张利云
Xing Yanyan;Yang Feng;Tang Yujiao;Zhang Liyun(School of Biomedical Engineering,Southern Medical University,Guangzhou 510515,China;Guangdong Provincial Key Laboratory of Medical Image Processing,Southern Medical University,Guangzhou 510515,China)
出处
《中国图象图形学报》
CSCD
北大核心
2020年第2期366-377,共12页
Journal of Image and Graphics
基金
国家自然科学基金项目(61771233).
关键词
医学图像分割
UNet++
胎儿头部边缘检测
胎儿头围测量
深度学习
超声图像
medical image segmentation
UNet++
fetal head edge detection
fetal head circumference measurement
deep learning
ultrasound image
