Tumour segmentation in medical images(especially 3D tumour segmentation)is highly challenging due to the possible similarity between tumours and adjacent tissues,occurrence of multiple tumours and variable tumour shap...Tumour segmentation in medical images(especially 3D tumour segmentation)is highly challenging due to the possible similarity between tumours and adjacent tissues,occurrence of multiple tumours and variable tumour shapes and sizes.The popular deep learning‐based segmentation algorithms generally rely on the convolutional neural network(CNN)and Transformer.The former cannot extract the global image features effectively while the latter lacks the inductive bias and involves the complicated computation for 3D volume data.The existing hybrid CNN‐Transformer network can only provide the limited performance improvement or even poorer segmentation performance than the pure CNN.To address these issues,a short‐term and long‐term memory self‐attention network is proposed.Firstly,a distinctive self‐attention block uses the Transformer to explore the correlation among the region features at different levels extracted by the CNN.Then,the memory structure filters and combines the above information to exclude the similar regions and detect the multiple tumours.Finally,the multi‐layer reconstruction blocks will predict the tumour boundaries.Experimental results demonstrate that our method outperforms other methods in terms of subjective visual and quantitative evaluation.Compared with the most competitive method,the proposed method provides Dice(82.4%vs.76.6%)and Hausdorff distance 95%(HD95)(10.66 vs.11.54 mm)on the KiTS19 as well as Dice(80.2%vs.78.4%)and HD95(9.632 vs.12.17 mm)on the LiTS.展开更多
This study is to compare three-dimensional(3D)isotropic T2-weighted magnetic resonance imaging(MRI)with compressed sensing-sampling perfection with application optimized contrast(CS-SPACE)and the conventional image(3D...This study is to compare three-dimensional(3D)isotropic T2-weighted magnetic resonance imaging(MRI)with compressed sensing-sampling perfection with application optimized contrast(CS-SPACE)and the conventional image(3D-SPACE)sequence in terms of image quality,estimated signal-to-noise ratio(SNR),relative contrast-to-noise ratio(CNR),and the lesions’conspicuous of the female pelvis.Thirty-six females(age:51,28-73)with cervical carcinoma(n=20),rectal carcinoma(n=7),or uterine fibroid(n=9)were included.Patients underwent magnetic resonance(MR)imaging at a 3T scanner with the sequences of 3D-SPACE,CS-SPACE,and twodimensional(2D)T2-weighted turbo-spin echo(TSE).Quantitative analyses of estimated SNR and relative CNR between tumors and other tissues,image quality,and tissue conspicuity were performed.Two radiologists assessed the difference in diagnostic findings for carcinoma.Quantitative values and qualitative scores were analyzed,respectively.The estimated SNR and the relative CNR of tumor-to-muscle obturator internus,tumor-to-myometrium,and myometrium-to-muscle obturator internus was comparable between 3D-SPACE and CS-SPACE.The overall image quality and the conspicuity of the lesion scores of the CS-SPACE were higher than that of the 3D-SPACE(P<0.01).The CS-SPACE sequence offers shorter scan time,fewer artifacts,and comparable SNR and CNR to conventional 3D-SPACE,and has the potential to improve the performance of T2-weighted images.展开更多
Currently,deep learning is widely used in medical image segmentation and has achieved good results.However,3D medical image segmentation tasks with diverse lesion characters,blurred edges,and unstable positions requir...Currently,deep learning is widely used in medical image segmentation and has achieved good results.However,3D medical image segmentation tasks with diverse lesion characters,blurred edges,and unstable positions require complex networks with a large number of parameters.It is computationally expensive and results in high requirements on equipment,making it hard to deploy the network in hospitals.In this work,we propose a method for network lightweighting and applied it to a 3D CNN based network.We experimented on a COVID-19 lesion segmentation dataset.Specifically,we use three cascaded one-dimensional convolutions to replace a 3D convolution,and integrate instance normalization with the previous layer of one-dimensional convolutions to accelerate network inference.In addition,we simplify test-time augmentation and deep supervision of the network.Experiments show that the lightweight network can reduce the prediction time of each sample and the memory usage by 50%and reduce the number of parameters by 60%compared with the original network.The training time of one epoch is also reduced by 50%with the segmentation accuracy dropped within the acceptable range.展开更多
This paper presents an innovative method for digital refocusing of different point in space after capturing and also extracts all-in-focus image. The proposed method extracts all-in-focus image using Michelson contras...This paper presents an innovative method for digital refocusing of different point in space after capturing and also extracts all-in-focus image. The proposed method extracts all-in-focus image using Michelson contrast formula hence, it helps in calculating the coordinates of the 3D object location. With light field integral camera setup the scene to capture the objects precisely positioned in a measurable distance from the camera therefore, it helps in refocusing process to return the original location where the object is focused;else it will be blurred with less contrast. The highest contrast values at different points in space can return the focused points where the objects are initially positioned as a result;all-in-focus image can also be obtained. Detailed experiments are conducted to demonstrate the credibility of proposed method with results.展开更多
Based on patient computerized tomography data,we segmented a region containing an intracranial hematoma using the threshold method and reconstructed the 3D hematoma model.To improve the efficiency and accuracy of iden...Based on patient computerized tomography data,we segmented a region containing an intracranial hematoma using the threshold method and reconstructed the 3D hematoma model.To improve the efficiency and accuracy of identifying puncture points,a point-cloud search arithmetic method for modified adaptive weighted particle swarm optimization is proposed and used for optimal external axis extraction.According to the characteristics of the multitube drainage tube and the clinical needs of puncture for intracranial hematoma removal,the proposed algorithm can provide an optimal route for a drainage tube for the hematoma,the precise position of the puncture point,and preoperative planning information,which have considerable instructional significance for clinicians.展开更多
The most recent discoveries in the biochemical field are highlighting the increasingly important role of lipid droplets(LDs)in several regulatory mechanisms in living cells.LDs are dynamic organelles and therefore the...The most recent discoveries in the biochemical field are highlighting the increasingly important role of lipid droplets(LDs)in several regulatory mechanisms in living cells.LDs are dynamic organelles and therefore their complete characterization in terms of number,size,spatial positioning and relative distribution in the cell volume can shed light on the roles played by LDs.Until now,fluorescence microscopy and transmission electron microscopy are assessed as the gold standard methods for identifying LDs due to their high sensitivity and specificity.However,such methods generally only provide 2D assays and partial measurements.Furthermore,both can be destructive and with low productivity,thus limiting analysis of large cell numbers in a sample.Here we demonstrate for the first time the capability of 3D visualization and the full LD characterization in high-throughput with a tomographic phase-contrast flow-cytometer,by using ovarian cancer cells and monocyte cell lines as models.A strategy for retrieving significant parameters on spatial correlations and LD 3D positioning inside each cell volume is reported.The information gathered by this new method could allow more in depth understanding and lead to new discoveries on how LDs are correlated to cellular functions.展开更多
In airborne array synthetic aperture radar(SAR), the three-dimensional(3D) imaging performance and cross-track resolution depends on the length of the equivalent array. In this paper, Barker sequence criterion is used...In airborne array synthetic aperture radar(SAR), the three-dimensional(3D) imaging performance and cross-track resolution depends on the length of the equivalent array. In this paper, Barker sequence criterion is used for sparse flight sampling of airborne array SAR, in order to obtain high cross-track resolution in as few times of flights as possible. Under each flight, the imaging algorithm of back projection(BP) and the data extraction method based on modified uniformly redundant arrays(MURAs) are utilized to obtain complex 3D image pairs. To solve the side-lobe noise in images, the interferometry between each image pair is implemented, and compressed sensing(CS) reconstruction is adopted in the frequency domain. Furthermore, to restore the geometrical relationship between each flight, the phase information corresponding to negative MURA is compensated on each single-pass image reconstructed by CS. Finally,by coherent accumulation of each complex image, the high resolution in cross-track direction is obtained. Simulations and experiments in X-band verify the availability.展开更多
In order to improve the registration accuracy of brain magnetic resonance images(MRI),some deep learning registration methods use segmentation images for training model.How-ever,the segmentation values are constant fo...In order to improve the registration accuracy of brain magnetic resonance images(MRI),some deep learning registration methods use segmentation images for training model.How-ever,the segmentation values are constant for each label,which leads to the gradient variation con-centrating on the boundary.Thus,the dense deformation field(DDF)is gathered on the boundary and there even appears folding phenomenon.In order to fully leverage the label information,the morphological opening and closing information maps are introduced to enlarge the non-zero gradi-ent regions and improve the accuracy of DDF estimation.The opening information maps supervise the registration model to focus on smaller,narrow brain regions.The closing information maps supervise the registration model to pay more attention to the complex boundary region.Then,opening and closing morphology networks(OC_Net)are designed to automatically generate open-ing and closing information maps to realize the end-to-end training process.Finally,a new registra-tion architecture,VM_(seg+oc),is proposed by combining OC_Net and VoxelMorph.Experimental results show that the registration accuracy of VM_(seg+oc) is significantly improved on LPBA40 and OASIS1 datasets.Especially,VM_(seg+oc) can well improve registration accuracy in smaller brain regions and narrow regions.展开更多
This paper proposes a practical algorithms of plane cutting, stereo clipping and arbitrary cutting for 3D surface model reconstructed from medical images. In plane cutting and stereo clipping algorithms, the 3D model ...This paper proposes a practical algorithms of plane cutting, stereo clipping and arbitrary cutting for 3D surface model reconstructed from medical images. In plane cutting and stereo clipping algorithms, the 3D model is cut by plane or polyhedron. Lists of edge and vertex in every cut plane are established. From these lists the boundary contours are created and their relationship of embrace is ascertained. The region closed by the contours is triangulated using Delaunay triangulation algorithm. Arbitrary cutting operation creates cutting curve interactively. The cut model still maintains its correct topology structure. With these operations, tissues inside can be observed easily and it can aid doctors to diagnose. The methods can also be used in surgery planning of radiotherapy.展开更多
Objective To study the effect of using improved 2D computer-assisted fluoroscopic navigation through simulating 3D vertebrae image to guide pedicle screw internal fixation.Methods Posterior pedicle screw internal fixa...Objective To study the effect of using improved 2D computer-assisted fluoroscopic navigation through simulating 3D vertebrae image to guide pedicle screw internal fixation.Methods Posterior pedicle screw internal fixation,distraction展开更多
Traditional clothing design models based on adaptive meshes cannot reflect.To solve this problem,a clothing simulation design model based on 3D image analysis technology is established.The model uses feature extractio...Traditional clothing design models based on adaptive meshes cannot reflect.To solve this problem,a clothing simulation design model based on 3D image analysis technology is established.The model uses feature extraction and description of image evaluation parameters,and establishes the mapping relationship between image features and simulation results by using the optimal parameter values,thereby obtaining a three-dimensional image simulation analysis environment.On the basis of this model,by obtaining the response results of clothing collision detection and the results of local adaptive processing of clothing meshes,the cutting form and actual cutting effect of clothing are determined to construct a design model.The simulation results show that compared with traditional clothing design models,clothing simulation design based on 3D image analysis technology has a better effect,with the definition of fabric folds increasing by 40%.More striking contrast between light and dark,the resolution increasing by 30%,and clothing details getting a more real manifestation.展开更多
Holoscopic 3D imaging is a true 3D imaging system mimics fly’s eye technique to acquire a true 3D optical model of a real scene. To reconstruct the 3D image computationally, an efficient implementation of an Auto-Fea...Holoscopic 3D imaging is a true 3D imaging system mimics fly’s eye technique to acquire a true 3D optical model of a real scene. To reconstruct the 3D image computationally, an efficient implementation of an Auto-Feature-Edge (AFE) descriptor algorithm is required that provides an individual feature detector for integration of 3D information to locate objects in the scene. The AFE descriptor plays a key role in simplifying the detection of both edge-based and region-based objects. The detector is based on a Multi-Quantize Adaptive Local Histogram Analysis (MQALHA) algorithm. This is distinctive for each Feature-Edge (FE) block i.e. the large contrast changes (gradients) in FE are easier to localise. The novelty of this work lies in generating a free-noise 3D-Map (3DM) according to a correlation analysis of region contours. This automatically combines the exploitation of the available depth estimation technique with edge-based feature shape recognition technique. The application area consists of two varied domains, which prove the efficiency and robustness of the approach: a) extracting a set of setting feature-edges, for both tracking and mapping process for 3D depthmap estimation, and b) separation and recognition of focus objects in the scene. Experimental results show that the proposed 3DM technique is performed efficiently compared to the state-of-the-art algorithms.展开更多
Recently, 3D display technology, and content creation tools have been undergone rigorous development and as a result they have been widely adopted by home and professional users. 3D digital repositories are increasing...Recently, 3D display technology, and content creation tools have been undergone rigorous development and as a result they have been widely adopted by home and professional users. 3D digital repositories are increasing and becoming available ubiquitously. However, searching and visualizing 3D content remains a great challenge. In this paper, we propose and present the development of a novel approach for creating hypervideos, which ease the 3D content search and retrieval. It is called the dynamic hyperlinker for 3D content search and retrieval process. It advances 3D multimedia navigability and searchability by creating dynamic links for selectable and clickable objects in the video scene whilst the user consumes the 3D video clip. The proposed system involves 3D video processing, such as detecting/tracking clickable objects, annotating objects, and metadata engineering including 3D content descriptive protocol. Such system attracts the attention from both home and professional users and more specifically broadcasters and digital content providers. The experiment is conducted on full parallax holoscopic 3D videos “also known as integral images”.展开更多
In current research,a series of triaxial tests,which were employed to simulate three typical mining layouts(i.e.,top-coal caving,non-pillar mining and protected coal seam mining),were conducted on coal by using MTS815...In current research,a series of triaxial tests,which were employed to simulate three typical mining layouts(i.e.,top-coal caving,non-pillar mining and protected coal seam mining),were conducted on coal by using MTS815 Flex Test GT rock mechanics test system,and the fracture networks in the broken coal samples were qualitatively and quantitatively investigated by employing CT scanning and 3D reconstruction techniques.This work aimed at providing a detail description on the micro-structure and fractureconnectivity characteristics of rupture coal samples under different mining layouts.The results show that:(i)for protected coal seam mining layout,the coal specimens failure is in a compression-shear manner and oppositely,(ii)the tension-shear failure phenomenon is observed for top-coal caving and non-pillar mining layouts.By investigating the connectivity features of the generated fractures in the direction ofσ_1,under different mining layouts,it is found that the connectivity level of the fractures of the samples corresponding to non-pillar mining layout was the highest.展开更多
To avoid the complicated motion compensation in interferometric inverse synthetic aperture(InISAR)and achieve realtime three-dimensional(3 D)imaging,a novel approach for 3 D imaging of the target only using a single e...To avoid the complicated motion compensation in interferometric inverse synthetic aperture(InISAR)and achieve realtime three-dimensional(3 D)imaging,a novel approach for 3 D imaging of the target only using a single echo is presented.This method is based on an isolated scatterer model assumption,thus the scatterers in the beam can be extracted individually.The radial range of each scatterer is estimated by the maximal likelihood estimation.Then,the horizontal and vertical wave path difference is derived by using the phase comparison technology for each scatterer,respectively.Finally,by utilizing the relationship among the 3 D coordinates,the radial range,the horizontal and vertical wave path difference,the 3 D image of the target can be reconstructed.The reconstructed image is free from the limitation in InISAR that the image plane depends on the target's own motions and on its relative position with respect to the radar.Furthermore,a phase ambiguity resolution method is adopted to ensure the success of the 3 D imaging when phase ambiguity occurs.It can be noted that the proposed phase ambiguity resolution method only uses one antenna pair and does not require a priori knowledge,whereas the existing phase ambiguity methods may require two or more antenna pairs or a priori knowledge for phase unwarping.To evaluate the performance of the proposed method,the theoretical analyses on estimation accuracy are presented and the simulations in various scenarios are also carried out.展开更多
The dip-angle-domain common-image gather(DDCIG)is a key tool to separate the diffraction and reflection imaging results.Reflectors with different spatial geometries produce different responses in DDCIGs.Compared with ...The dip-angle-domain common-image gather(DDCIG)is a key tool to separate the diffraction and reflection imaging results.Reflectors with different spatial geometries produce different responses in DDCIGs.Compared with Kirchhoff migration,Gaussian beam migration(GBM)is more effective and robust to overcome the multipathing problem.As a ray-based method,it has explicit angle information naturally during the propagation.We have developed a 3D DDCIG computational method using GBM,which obtain both the imaging result and angle-domain gathers with only one pass of calculation.The angle-gather computation is based on geometrical optics,and multiple angle conversions are implemented under the rules of space geometry,which helps to avoid rounding errors and improve accuracy.Additionally,the multi-azimuth joint presentation strategy is proposed to describe the characteristic of omnidirectional dip angles using a finite number of gathers.After using a 2D model to illustrate application advantages of DDCIG,we apply the proposed method to two 3D models to test its feasibility and accuracy.A field data example further demonstrates the adaptability of our method to seismic imaging for a land survey.展开更多
The volumetric rendering of 3 D medical image data is very effective method for communication about radiological studies to clinicians. Algorithms that produce images with artifacts and inaccuracies are not clinically...The volumetric rendering of 3 D medical image data is very effective method for communication about radiological studies to clinicians. Algorithms that produce images with artifacts and inaccuracies are not clinically useful. This paper proposed a direct voxel projection algorithm to implement volumetric data rendering. Using this algorithm, arbitrary volume rotation, transparent and cutaway views are generated satisfactorily. Compared with the existing raytracing methods, it improves the projection image quality greatly. Some experimental results about real medical CT image data demonstrate the advantages and fidelity of the proposed algorithm.展开更多
Deep learning (DL) has experienced an exponential development in recent years, with major impact in many medical fields, especially in the field of medical image and, respectively, as a specific task, in the segmentat...Deep learning (DL) has experienced an exponential development in recent years, with major impact in many medical fields, especially in the field of medical image and, respectively, as a specific task, in the segmentation of the medical image. We aim to create a computer assisted diagnostic method, optimized by the use of deep learning (DL) and validated by a randomized controlled clinical trial, is a highly automated tool for diagnosing and staging precancerous and cervical cancer and thyroid cancers. We aim to design a high-performance deep learning model, combined from convolutional neural network (U-Net)-based architectures, for segmentation of the medical image that is independent of the type of organs/tissues, dimensions or type of image (2D/3D) and to validate the DL model in a randomized, controlled clinical trial. We used as a methodology primarily the analysis of U-Net-based architectures to identify the key elements that we considered important in the design and optimization of the combined DL model, from the U-Net-based architectures, imagined by us. Secondly, we will validate the performance of the DL model through a randomized controlled clinical trial. The DL model designed by us will be a highly automated tool for diagnosing and staging precancers and cervical cancer and thyroid cancers. The combined model we designed takes into account the key features of each of the architectures Overcomplete Convolutional Network Kite-Net (Kite-Net), Attention gate mechanism is an improvement added on convolutional network architecture for fast and precise segmentation of images (Attention U-Net), Harmony Densely Connected Network-Medical image Segmentation (HarDNet-MSEG). In this regard, we will create a comprehensive computer assisted diagnostic methodology validated by a randomized controlled clinical trial. The model will be a highly automated tool for diagnosing and staging precancers and cervical cancer and thyroid cancers. This would help drastically minimize the time and effort that specialists put into analyzing medical images, help to achieve a better therapeutic plan, and can provide a “second opinion” of computer assisted diagnosis.展开更多
基金supported by the National Key Research and Development Program of China under Grant No.2018YFE0206900the National Natural Science Foundation of China under Grant No.61871440 and CAAI‐Huawei Mind-Spore Open Fund.
文摘Tumour segmentation in medical images(especially 3D tumour segmentation)is highly challenging due to the possible similarity between tumours and adjacent tissues,occurrence of multiple tumours and variable tumour shapes and sizes.The popular deep learning‐based segmentation algorithms generally rely on the convolutional neural network(CNN)and Transformer.The former cannot extract the global image features effectively while the latter lacks the inductive bias and involves the complicated computation for 3D volume data.The existing hybrid CNN‐Transformer network can only provide the limited performance improvement or even poorer segmentation performance than the pure CNN.To address these issues,a short‐term and long‐term memory self‐attention network is proposed.Firstly,a distinctive self‐attention block uses the Transformer to explore the correlation among the region features at different levels extracted by the CNN.Then,the memory structure filters and combines the above information to exclude the similar regions and detect the multiple tumours.Finally,the multi‐layer reconstruction blocks will predict the tumour boundaries.Experimental results demonstrate that our method outperforms other methods in terms of subjective visual and quantitative evaluation.Compared with the most competitive method,the proposed method provides Dice(82.4%vs.76.6%)and Hausdorff distance 95%(HD95)(10.66 vs.11.54 mm)on the KiTS19 as well as Dice(80.2%vs.78.4%)and HD95(9.632 vs.12.17 mm)on the LiTS.
文摘This study is to compare three-dimensional(3D)isotropic T2-weighted magnetic resonance imaging(MRI)with compressed sensing-sampling perfection with application optimized contrast(CS-SPACE)and the conventional image(3D-SPACE)sequence in terms of image quality,estimated signal-to-noise ratio(SNR),relative contrast-to-noise ratio(CNR),and the lesions’conspicuous of the female pelvis.Thirty-six females(age:51,28-73)with cervical carcinoma(n=20),rectal carcinoma(n=7),or uterine fibroid(n=9)were included.Patients underwent magnetic resonance(MR)imaging at a 3T scanner with the sequences of 3D-SPACE,CS-SPACE,and twodimensional(2D)T2-weighted turbo-spin echo(TSE).Quantitative analyses of estimated SNR and relative CNR between tumors and other tissues,image quality,and tissue conspicuity were performed.Two radiologists assessed the difference in diagnostic findings for carcinoma.Quantitative values and qualitative scores were analyzed,respectively.The estimated SNR and the relative CNR of tumor-to-muscle obturator internus,tumor-to-myometrium,and myometrium-to-muscle obturator internus was comparable between 3D-SPACE and CS-SPACE.The overall image quality and the conspicuity of the lesion scores of the CS-SPACE were higher than that of the 3D-SPACE(P<0.01).The CS-SPACE sequence offers shorter scan time,fewer artifacts,and comparable SNR and CNR to conventional 3D-SPACE,and has the potential to improve the performance of T2-weighted images.
文摘Currently,deep learning is widely used in medical image segmentation and has achieved good results.However,3D medical image segmentation tasks with diverse lesion characters,blurred edges,and unstable positions require complex networks with a large number of parameters.It is computationally expensive and results in high requirements on equipment,making it hard to deploy the network in hospitals.In this work,we propose a method for network lightweighting and applied it to a 3D CNN based network.We experimented on a COVID-19 lesion segmentation dataset.Specifically,we use three cascaded one-dimensional convolutions to replace a 3D convolution,and integrate instance normalization with the previous layer of one-dimensional convolutions to accelerate network inference.In addition,we simplify test-time augmentation and deep supervision of the network.Experiments show that the lightweight network can reduce the prediction time of each sample and the memory usage by 50%and reduce the number of parameters by 60%compared with the original network.The training time of one epoch is also reduced by 50%with the segmentation accuracy dropped within the acceptable range.
文摘This paper presents an innovative method for digital refocusing of different point in space after capturing and also extracts all-in-focus image. The proposed method extracts all-in-focus image using Michelson contrast formula hence, it helps in calculating the coordinates of the 3D object location. With light field integral camera setup the scene to capture the objects precisely positioned in a measurable distance from the camera therefore, it helps in refocusing process to return the original location where the object is focused;else it will be blurred with less contrast. The highest contrast values at different points in space can return the focused points where the objects are initially positioned as a result;all-in-focus image can also be obtained. Detailed experiments are conducted to demonstrate the credibility of proposed method with results.
基金funded by the National Science Foundation of China,Nos.51674121 and 61702184the Returned Overseas Scholar Funding of Hebei Province,No.C2015005014the Hebei Key Laboratory of Science and Application,and Tangshan Innovation Team Project,No.18130209B.
文摘Based on patient computerized tomography data,we segmented a region containing an intracranial hematoma using the threshold method and reconstructed the 3D hematoma model.To improve the efficiency and accuracy of identifying puncture points,a point-cloud search arithmetic method for modified adaptive weighted particle swarm optimization is proposed and used for optimal external axis extraction.According to the characteristics of the multitube drainage tube and the clinical needs of puncture for intracranial hematoma removal,the proposed algorithm can provide an optimal route for a drainage tube for the hematoma,the precise position of the puncture point,and preoperative planning information,which have considerable instructional significance for clinicians.
基金funded by the Italian Ministry of University and Research(PRIN 2017-Prot.2017N7R2CJ)Fondazione Cassa di Risparmio in Bologna(Italy)for the financial support to I.K.finalized to the acquisition of EVOS M5000。
文摘The most recent discoveries in the biochemical field are highlighting the increasingly important role of lipid droplets(LDs)in several regulatory mechanisms in living cells.LDs are dynamic organelles and therefore their complete characterization in terms of number,size,spatial positioning and relative distribution in the cell volume can shed light on the roles played by LDs.Until now,fluorescence microscopy and transmission electron microscopy are assessed as the gold standard methods for identifying LDs due to their high sensitivity and specificity.However,such methods generally only provide 2D assays and partial measurements.Furthermore,both can be destructive and with low productivity,thus limiting analysis of large cell numbers in a sample.Here we demonstrate for the first time the capability of 3D visualization and the full LD characterization in high-throughput with a tomographic phase-contrast flow-cytometer,by using ovarian cancer cells and monocyte cell lines as models.A strategy for retrieving significant parameters on spatial correlations and LD 3D positioning inside each cell volume is reported.The information gathered by this new method could allow more in depth understanding and lead to new discoveries on how LDs are correlated to cellular functions.
文摘In airborne array synthetic aperture radar(SAR), the three-dimensional(3D) imaging performance and cross-track resolution depends on the length of the equivalent array. In this paper, Barker sequence criterion is used for sparse flight sampling of airborne array SAR, in order to obtain high cross-track resolution in as few times of flights as possible. Under each flight, the imaging algorithm of back projection(BP) and the data extraction method based on modified uniformly redundant arrays(MURAs) are utilized to obtain complex 3D image pairs. To solve the side-lobe noise in images, the interferometry between each image pair is implemented, and compressed sensing(CS) reconstruction is adopted in the frequency domain. Furthermore, to restore the geometrical relationship between each flight, the phase information corresponding to negative MURA is compensated on each single-pass image reconstructed by CS. Finally,by coherent accumulation of each complex image, the high resolution in cross-track direction is obtained. Simulations and experiments in X-band verify the availability.
基金supported by Shandong Provincial Natural Science Foundation(No.ZR2023MF062)the National Natural Science Foundation of China(No.61771230).
文摘In order to improve the registration accuracy of brain magnetic resonance images(MRI),some deep learning registration methods use segmentation images for training model.How-ever,the segmentation values are constant for each label,which leads to the gradient variation con-centrating on the boundary.Thus,the dense deformation field(DDF)is gathered on the boundary and there even appears folding phenomenon.In order to fully leverage the label information,the morphological opening and closing information maps are introduced to enlarge the non-zero gradi-ent regions and improve the accuracy of DDF estimation.The opening information maps supervise the registration model to focus on smaller,narrow brain regions.The closing information maps supervise the registration model to pay more attention to the complex boundary region.Then,opening and closing morphology networks(OC_Net)are designed to automatically generate open-ing and closing information maps to realize the end-to-end training process.Finally,a new registra-tion architecture,VM_(seg+oc),is proposed by combining OC_Net and VoxelMorph.Experimental results show that the registration accuracy of VM_(seg+oc) is significantly improved on LPBA40 and OASIS1 datasets.Especially,VM_(seg+oc) can well improve registration accuracy in smaller brain regions and narrow regions.
基金This research was supported by the National Nature Science Foundation of China under Grant No.60473024 the Nature Science Foundation of Zhejiang Province of China under Grant No.Y104341 and z105391.
文摘This paper proposes a practical algorithms of plane cutting, stereo clipping and arbitrary cutting for 3D surface model reconstructed from medical images. In plane cutting and stereo clipping algorithms, the 3D model is cut by plane or polyhedron. Lists of edge and vertex in every cut plane are established. From these lists the boundary contours are created and their relationship of embrace is ascertained. The region closed by the contours is triangulated using Delaunay triangulation algorithm. Arbitrary cutting operation creates cutting curve interactively. The cut model still maintains its correct topology structure. With these operations, tissues inside can be observed easily and it can aid doctors to diagnose. The methods can also be used in surgery planning of radiotherapy.
文摘Objective To study the effect of using improved 2D computer-assisted fluoroscopic navigation through simulating 3D vertebrae image to guide pedicle screw internal fixation.Methods Posterior pedicle screw internal fixation,distraction
文摘Traditional clothing design models based on adaptive meshes cannot reflect.To solve this problem,a clothing simulation design model based on 3D image analysis technology is established.The model uses feature extraction and description of image evaluation parameters,and establishes the mapping relationship between image features and simulation results by using the optimal parameter values,thereby obtaining a three-dimensional image simulation analysis environment.On the basis of this model,by obtaining the response results of clothing collision detection and the results of local adaptive processing of clothing meshes,the cutting form and actual cutting effect of clothing are determined to construct a design model.The simulation results show that compared with traditional clothing design models,clothing simulation design based on 3D image analysis technology has a better effect,with the definition of fabric folds increasing by 40%.More striking contrast between light and dark,the resolution increasing by 30%,and clothing details getting a more real manifestation.
文摘Holoscopic 3D imaging is a true 3D imaging system mimics fly’s eye technique to acquire a true 3D optical model of a real scene. To reconstruct the 3D image computationally, an efficient implementation of an Auto-Feature-Edge (AFE) descriptor algorithm is required that provides an individual feature detector for integration of 3D information to locate objects in the scene. The AFE descriptor plays a key role in simplifying the detection of both edge-based and region-based objects. The detector is based on a Multi-Quantize Adaptive Local Histogram Analysis (MQALHA) algorithm. This is distinctive for each Feature-Edge (FE) block i.e. the large contrast changes (gradients) in FE are easier to localise. The novelty of this work lies in generating a free-noise 3D-Map (3DM) according to a correlation analysis of region contours. This automatically combines the exploitation of the available depth estimation technique with edge-based feature shape recognition technique. The application area consists of two varied domains, which prove the efficiency and robustness of the approach: a) extracting a set of setting feature-edges, for both tracking and mapping process for 3D depthmap estimation, and b) separation and recognition of focus objects in the scene. Experimental results show that the proposed 3DM technique is performed efficiently compared to the state-of-the-art algorithms.
文摘Recently, 3D display technology, and content creation tools have been undergone rigorous development and as a result they have been widely adopted by home and professional users. 3D digital repositories are increasing and becoming available ubiquitously. However, searching and visualizing 3D content remains a great challenge. In this paper, we propose and present the development of a novel approach for creating hypervideos, which ease the 3D content search and retrieval. It is called the dynamic hyperlinker for 3D content search and retrieval process. It advances 3D multimedia navigability and searchability by creating dynamic links for selectable and clickable objects in the video scene whilst the user consumes the 3D video clip. The proposed system involves 3D video processing, such as detecting/tracking clickable objects, annotating objects, and metadata engineering including 3D content descriptive protocol. Such system attracts the attention from both home and professional users and more specifically broadcasters and digital content providers. The experiment is conducted on full parallax holoscopic 3D videos “also known as integral images”.
基金financially supported by the Major State Fundamental Research Project of China(Nos.2011CB201201and2010CB226802)the National Natural Science Foundation of China(No.51204113)the Youth Science and Technology Fund of Sichuan Province(No.2012JQ0031)
文摘In current research,a series of triaxial tests,which were employed to simulate three typical mining layouts(i.e.,top-coal caving,non-pillar mining and protected coal seam mining),were conducted on coal by using MTS815 Flex Test GT rock mechanics test system,and the fracture networks in the broken coal samples were qualitatively and quantitatively investigated by employing CT scanning and 3D reconstruction techniques.This work aimed at providing a detail description on the micro-structure and fractureconnectivity characteristics of rupture coal samples under different mining layouts.The results show that:(i)for protected coal seam mining layout,the coal specimens failure is in a compression-shear manner and oppositely,(ii)the tension-shear failure phenomenon is observed for top-coal caving and non-pillar mining layouts.By investigating the connectivity features of the generated fractures in the direction ofσ_1,under different mining layouts,it is found that the connectivity level of the fractures of the samples corresponding to non-pillar mining layout was the highest.
基金supported by the Science and Technique Commission Foundation of Fujian Province(2018H6023)。
文摘To avoid the complicated motion compensation in interferometric inverse synthetic aperture(InISAR)and achieve realtime three-dimensional(3 D)imaging,a novel approach for 3 D imaging of the target only using a single echo is presented.This method is based on an isolated scatterer model assumption,thus the scatterers in the beam can be extracted individually.The radial range of each scatterer is estimated by the maximal likelihood estimation.Then,the horizontal and vertical wave path difference is derived by using the phase comparison technology for each scatterer,respectively.Finally,by utilizing the relationship among the 3 D coordinates,the radial range,the horizontal and vertical wave path difference,the 3 D image of the target can be reconstructed.The reconstructed image is free from the limitation in InISAR that the image plane depends on the target's own motions and on its relative position with respect to the radar.Furthermore,a phase ambiguity resolution method is adopted to ensure the success of the 3 D imaging when phase ambiguity occurs.It can be noted that the proposed phase ambiguity resolution method only uses one antenna pair and does not require a priori knowledge,whereas the existing phase ambiguity methods may require two or more antenna pairs or a priori knowledge for phase unwarping.To evaluate the performance of the proposed method,the theoretical analyses on estimation accuracy are presented and the simulations in various scenarios are also carried out.
基金financial support jointly provided by the National Key R&D Program of China under contract number 2019YFC0605503Cthe Major Projects during the 14th Five-year Plan period under contract number 2021QNLM020001+2 种基金the National Outstanding Youth Science Foundation under contract number 41922028the Funds for Creative Research Groups of China under contract number 41821002the Major Projects of CNPC under contract number ZD2019-183-003。
文摘The dip-angle-domain common-image gather(DDCIG)is a key tool to separate the diffraction and reflection imaging results.Reflectors with different spatial geometries produce different responses in DDCIGs.Compared with Kirchhoff migration,Gaussian beam migration(GBM)is more effective and robust to overcome the multipathing problem.As a ray-based method,it has explicit angle information naturally during the propagation.We have developed a 3D DDCIG computational method using GBM,which obtain both the imaging result and angle-domain gathers with only one pass of calculation.The angle-gather computation is based on geometrical optics,and multiple angle conversions are implemented under the rules of space geometry,which helps to avoid rounding errors and improve accuracy.Additionally,the multi-azimuth joint presentation strategy is proposed to describe the characteristic of omnidirectional dip angles using a finite number of gathers.After using a 2D model to illustrate application advantages of DDCIG,we apply the proposed method to two 3D models to test its feasibility and accuracy.A field data example further demonstrates the adaptability of our method to seismic imaging for a land survey.
基金Shanghai Science and Technology Devel-opment Fund(9944 190 2 7)
文摘The volumetric rendering of 3 D medical image data is very effective method for communication about radiological studies to clinicians. Algorithms that produce images with artifacts and inaccuracies are not clinically useful. This paper proposed a direct voxel projection algorithm to implement volumetric data rendering. Using this algorithm, arbitrary volume rotation, transparent and cutaway views are generated satisfactorily. Compared with the existing raytracing methods, it improves the projection image quality greatly. Some experimental results about real medical CT image data demonstrate the advantages and fidelity of the proposed algorithm.
文摘Deep learning (DL) has experienced an exponential development in recent years, with major impact in many medical fields, especially in the field of medical image and, respectively, as a specific task, in the segmentation of the medical image. We aim to create a computer assisted diagnostic method, optimized by the use of deep learning (DL) and validated by a randomized controlled clinical trial, is a highly automated tool for diagnosing and staging precancerous and cervical cancer and thyroid cancers. We aim to design a high-performance deep learning model, combined from convolutional neural network (U-Net)-based architectures, for segmentation of the medical image that is independent of the type of organs/tissues, dimensions or type of image (2D/3D) and to validate the DL model in a randomized, controlled clinical trial. We used as a methodology primarily the analysis of U-Net-based architectures to identify the key elements that we considered important in the design and optimization of the combined DL model, from the U-Net-based architectures, imagined by us. Secondly, we will validate the performance of the DL model through a randomized controlled clinical trial. The DL model designed by us will be a highly automated tool for diagnosing and staging precancers and cervical cancer and thyroid cancers. The combined model we designed takes into account the key features of each of the architectures Overcomplete Convolutional Network Kite-Net (Kite-Net), Attention gate mechanism is an improvement added on convolutional network architecture for fast and precise segmentation of images (Attention U-Net), Harmony Densely Connected Network-Medical image Segmentation (HarDNet-MSEG). In this regard, we will create a comprehensive computer assisted diagnostic methodology validated by a randomized controlled clinical trial. The model will be a highly automated tool for diagnosing and staging precancers and cervical cancer and thyroid cancers. This would help drastically minimize the time and effort that specialists put into analyzing medical images, help to achieve a better therapeutic plan, and can provide a “second opinion” of computer assisted diagnosis.
