In recent times,an image enhancement approach,which learns the global transformation function using deep neural networks,has gained attention.However,many existing methods based on this approach have a limitation:thei...In recent times,an image enhancement approach,which learns the global transformation function using deep neural networks,has gained attention.However,many existing methods based on this approach have a limitation:their transformation functions are too simple to imitate complex colour transformations between low-quality images and manually retouched high-quality images.In order to address this limitation,a simple yet effective approach for image enhancement is proposed.The proposed algorithm based on the channel-wise intensity transformation is designed.However,this transformation is applied to the learnt embedding space instead of specific colour spaces and then return enhanced features to colours.To this end,the authors define the continuous intensity transformation(CIT)to describe the mapping between input and output intensities on the embedding space.Then,the enhancement network is developed,which produces multi-scale feature maps from input images,derives the set of transformation functions,and performs the CIT to obtain enhanced images.Extensive experiments on the MIT-Adobe 5K dataset demonstrate that the authors’approach improves the performance of conventional intensity transforms on colour space metrics.Specifically,the authors achieved a 3.8%improvement in peak signal-to-noise ratio,a 1.8%improvement in structual similarity index measure,and a 27.5%improvement in learned perceptual image patch similarity.Also,the authors’algorithm outperforms state-of-the-art alternatives on three image enhancement datasets:MIT-Adobe 5K,Low-Light,and Google HDRþ.展开更多
Underwater image enhancement aims to restore a clean appearance and thus improves the quality of underwater degraded images.Current methods feed the whole image directly into the model for enhancement.However,they ign...Underwater image enhancement aims to restore a clean appearance and thus improves the quality of underwater degraded images.Current methods feed the whole image directly into the model for enhancement.However,they ignored that the R,G and B channels of underwater degraded images present varied degrees of degradation,due to the selective absorption for the light.To address this issue,we propose an unsupervised multi-expert learning model by considering the enhancement of each color channel.Specifically,an unsupervised architecture based on generative adversarial network is employed to alleviate the need for paired underwater images.Based on this,we design a generator,including a multi-expert encoder,a feature fusion module and a feature fusion-guided decoder,to generate the clear underwater image.Accordingly,a multi-expert discriminator is proposed to verify the authenticity of the R,G and B channels,respectively.In addition,content perceptual loss and edge loss are introduced into the loss function to further improve the content and details of the enhanced images.Extensive experiments on public datasets demonstrate that our method achieves more pleasing results in vision quality.Various metrics(PSNR,SSIM,UIQM and UCIQE) evaluated on our enhanced images have been improved obviously.展开更多
Low-light images suffer from low quality due to poor lighting conditions,noise pollution,and improper settings of cameras.To enhance low-light images,most existing methods rely on normal-light images for guidance but ...Low-light images suffer from low quality due to poor lighting conditions,noise pollution,and improper settings of cameras.To enhance low-light images,most existing methods rely on normal-light images for guidance but the collection of suitable normal-light images is difficult.In contrast,a self-supervised method breaks free from the reliance on normal-light data,resulting in more convenience and better generalization.Existing self-supervised methods primarily focus on illumination adjustment and design pixel-based adjustment methods,resulting in remnants of other degradations,uneven brightness and artifacts.In response,this paper proposes a self-supervised enhancement method,termed as SLIE.It can handle multiple degradations including illumination attenuation,noise pollution,and color shift,all in a self-supervised manner.Illumination attenuation is estimated based on physical principles and local neighborhood information.The removal and correction of noise and color shift removal are solely realized with noisy images and images with color shifts.Finally,the comprehensive and fully self-supervised approach can achieve better adaptability and generalization.It is applicable to various low light conditions,and can reproduce the original color of scenes in natural light.Extensive experiments conducted on four public datasets demonstrate the superiority of SLIE to thirteen state-of-the-art methods.Our code is available at https://github.com/hanna-xu/SLIE.展开更多
Due to the selective absorption of light and the existence of a large number of floating media in sea water, underwater images often suffer from color casts and detail blurs. It is therefore necessary to perform color...Due to the selective absorption of light and the existence of a large number of floating media in sea water, underwater images often suffer from color casts and detail blurs. It is therefore necessary to perform color correction and detail restoration. However,the existing enhancement algorithms cannot achieve the desired results. In order to solve the above problems, this paper proposes a multi-stream feature fusion network. First, an underwater image is preprocessed to obtain potential information from the illumination stream, color stream and structure stream by histogram equalization with contrast limitation, gamma correction and white balance, respectively. Next, these three streams and the original raw stream are sent to the residual blocks to extract the features. The features will be subsequently fused. It can enhance feature representation in underwater images. In the meantime, a composite loss function including three terms is used to ensure the quality of the enhanced image from the three aspects of color balance, structure preservation and image smoothness. Therefore, the enhanced image is more in line with human visual perception.Finally, the effectiveness of the proposed method is verified by comparison experiments with many stateof-the-art underwater image enhancement algorithms. Experimental results show that the proposed method provides superior results over them in terms of MSE,PSNR, SSIM, UIQM and UCIQE, and the enhanced images are more similar to their ground truth images.展开更多
The current study provides a quantum calculus-based medical image enhancement technique that dynamically chooses the spatial distribution of image pixel intensity values.The technique focuses on boosting the edges and...The current study provides a quantum calculus-based medical image enhancement technique that dynamically chooses the spatial distribution of image pixel intensity values.The technique focuses on boosting the edges and texture of an image while leaving the smooth areas alone.The brain Magnetic Resonance Imaging(MRI)scans are used to visualize the tumors that have spread throughout the brain in order to gain a better understanding of the stage of brain cancer.Accurately detecting brain cancer is a complex challenge that the medical system faces when diagnosing the disease.To solve this issue,this research offers a quantum calculus-based MRI image enhancement as a pre-processing step for brain cancer diagnosis.The proposed image enhancement approach improves images with low gray level changes by estimating the pixel’s quantum probability.The suggested image enhancement technique is demonstrated to be robust and resistant to major quality changes on a variety ofMRIscan datasets of variable quality.ForMRI scans,the BRISQUE“blind/referenceless image spatial quality evaluator”and the NIQE“natural image quality evaluator”measures were 39.38 and 3.58,respectively.The proposed image enhancement model,according to the data,produces the best image quality ratings,and it may be able to aid medical experts in the diagnosis process.The experimental results were achieved using a publicly available collection of MRI scans.展开更多
Digital watermarking technology is adequate for copyright protection and content authentication.There needs to be more research on the watermarking algorithm after printing and scanning.Aiming at the problem that exis...Digital watermarking technology is adequate for copyright protection and content authentication.There needs to be more research on the watermarking algorithm after printing and scanning.Aiming at the problem that existing anti-print scanning text image watermarking algorithms cannot take into account the invisibility and robustness of the watermark,an anti-print scanning watermarking algorithm suitable for text images is proposed.This algorithm first performs a series of image enhancement preprocessing operations on the printed scanned image to eliminate the interference of incorrect bit information on watermark embedding and then uses a combination of Discrete Wavelet Transform(DWT)-Singular Value Decomposition(SVD)to embed the watermark.Experiments show that the average Normalized Correlation(NC)of the watermark extracted by this algorithm against attacks such as Joint Photographic Experts Group(JPEG)compression,JPEG2000 compression,and print scanning is above 0.93.Especially,the average NC of the watermark extracted after print scanning attacks is greater than 0.964,and the average Bit Error Ratio(BER)is 5.15%.This indicates that this algorithm has strong resistance to various attacks and print scanning attacks and can better take into account the invisibility of the watermark.展开更多
Low-light image enhancement methods have limitations in addressing issues such as color distortion,lack of vibrancy,and uneven light distribution and often require paired training data.To address these issues,we propo...Low-light image enhancement methods have limitations in addressing issues such as color distortion,lack of vibrancy,and uneven light distribution and often require paired training data.To address these issues,we propose a two-stage unsupervised low-light image enhancement algorithm called Retinex and Exposure Fusion Network(RFNet),which can overcome the problems of over-enhancement of the high dynamic range and under-enhancement of the low dynamic range in existing enhancement algorithms.This algorithm can better manage the challenges brought about by complex environments in real-world scenarios by training with unpaired low-light images and regular-light images.In the first stage,we design a multi-scale feature extraction module based on Retinex theory,capable of extracting details and structural information at different scales to generate high-quality illumination and reflection images.In the second stage,an exposure image generator is designed through the camera response mechanism function to acquire exposure images containing more dark features,and the generated images are fused with the original input images to complete the low-light image enhancement.Experiments show the effectiveness and rationality of each module designed in this paper.And the method reconstructs the details of contrast and color distribution,outperforms the current state-of-the-art methods in both qualitative and quantitative metrics,and shows excellent performance in the real world.展开更多
A method to remove stripes from remote sensing images is proposed based on statistics and a new image enhancement method.The overall processing steps for improving the quality of remote sensing images are introduced t...A method to remove stripes from remote sensing images is proposed based on statistics and a new image enhancement method.The overall processing steps for improving the quality of remote sensing images are introduced to provide a general baseline.Due to the differences in satellite sensors when producing images,subtle but inherent stripes can appear at the stitching positions between the sensors.These stitchingstripes cannot be eliminated by conventional relative radiometric calibration.The inherent stitching stripes cause difficulties in downstream tasks such as the segmentation,classification and interpretation of remote sensing images.Therefore,a method to remove the stripes based on statistics and a new image enhancement approach are proposed in this paper.First,the inconsistency in grayscales around stripes is eliminated with the statistical method.Second,the pixels within stripes are weighted and averaged based on updated pixel values to enhance the uniformity of the overall image radiation quality.Finally,the details of the images are highlighted by a new image enhancement method,which makes the whole image clearer.Comprehensive experiments are performed,and the results indicate that the proposed method outperforms the baseline approach in terms of visual quality and radiation correction accuracy.展开更多
Aiming at the scattering and absorption of light in the water body,which causes the problems of color shift,uneven brightness,poor sharpness and missing details in the acquired underwater images,an underwater image en...Aiming at the scattering and absorption of light in the water body,which causes the problems of color shift,uneven brightness,poor sharpness and missing details in the acquired underwater images,an underwater image enhancement algorithm based on IMSRCR and CLAHE-WGIF is proposed.Firstly,the IMSRCR algorithm proposed in this paper is used to process the original underwater image with adaptive color shift correction;secondly,the image is converted to HSV color space,and the segmentation exponential algorithm is used to process the S component to enhance the image saturation;finally,multi-scale Retinex is used to decompose the V component image into detail layer and base layer,and adaptive two-dimensional gamma correction is made to the base layer to adjust the brightness unevenness,while the detail layer is processed by CLAHE-WGIF algorithm to enhance the image contrast and detail information.The experimental results show that our algorithm has some advantages over existing algorithms in both subjective and objective evaluations,and the information entropy of the image is improved by 6.3%on average,and the UIQM and UCIQE indexes are improved by 12.9%and 20.3%on average.展开更多
In this paper,we present a tensor least square based model for sand/sandstorm removal in images.The main contributions of this paper are as follows.First,an important intrinsic natural feature of outdoor scenes free o...In this paper,we present a tensor least square based model for sand/sandstorm removal in images.The main contributions of this paper are as follows.First,an important intrinsic natural feature of outdoor scenes free of sand/sandstorm is found that the outlines in RGB channels are somewise similar,which discloses the physical validation using the tensor instead of the matrix.Second,a tensor least square optimization model is presented for the decomposition of edge-preserving base layers and details.This model not only decomposes the color image(taken as an inseparable indivisibility)in X,Y directions,but also in Z direction,which meets the statistical feature of natural scenes and can physically disclose the intrinsic color information.The model’s advantages are twofold:one is the decomposition of edgepreserving base layers and details that can be employed for contrast enhancement without artificial halos,and the other one is the color driving ability that makes the enhanced images as close to natural images as possible via the inherent color structure.Thirdly,the tensor least square optimization model based image enhancement scheme is discussed for the sandstorm weather images.Finally,the experiments and comparisons with the stateof-the-art methods on real degraded images under sandstorm weather are shown to verify our method’s efficiency.展开更多
The enhancement of medical images is a challenging research task due to the unforeseeable variation in the quality of the captured images.The captured images may present with low contrast and low visibility,which migh...The enhancement of medical images is a challenging research task due to the unforeseeable variation in the quality of the captured images.The captured images may present with low contrast and low visibility,which might inuence the accuracy of the diagnosis process.To overcome this problem,this paper presents a new fractional integral entropy(FITE)that estimates the unforeseeable probabilities of image pixels,posing as the main contribution of the paper.The proposed model dynamically enhances the image based on the image contents.The main advantage of FITE lies in its capability to enhance the low contrast intensities through pixels’probability.Initially,the pixel probability of the fractional power is utilized to extract the illumination value from the pixels of the image.Next,the contrast of the image is then adjusted to enhance the regions with low visibility.Finally,the fractional integral entropy approach is implemented to enhance the low visibility contents from the input image.Tests were conducted on brain MRI,lungs CT,and kidney MRI scans datasets of different image qualities to show that the proposed model is robust and can withstand dramatic variations in quality.The obtained comparative results show that the proposed image enhancement model achieves the best BRISQUE and NIQE scores.Overall,this model improves the details of brain MRI,lungs CT,and kidney MRI scans,and could therefore potentially help the medical staff during the diagnosis process.展开更多
Objective:This paper proposes a new photoacoustic computed tomography(PACT)imaging system employing dual ultrasonic transducers with different frequencies.When imaging complex biological tissues,photoacoustic(PA)signa...Objective:This paper proposes a new photoacoustic computed tomography(PACT)imaging system employing dual ultrasonic transducers with different frequencies.When imaging complex biological tissues,photoacoustic(PA)signals with multiple frequencies are produced simultaneously;however,due to the limited bandwidth of a single-frequency transducer,the received PA signals with specific frequencies may be missing,leading to a low imaging quality.Methods:In contrast to our previous work,the proposed system has a compact volume as well as specific selection of the detection center frequency of the transducer,which can provide a comprehensive range for the detection of PA signals.In this study,a series of numerical simulation and phantom experiments were performed to validate the efficacy of the developed PACT system.Results:The images generated by our system combined the advantages of both high resolution and ideal brightness/contrast.Conclusion:The interchangeability of transducers with different frequencies provides potential for clinical deployment under the circumstance where a single frequency transducer cannot perform well.展开更多
The scattering and absorption of light propagating underwater cause the underwater images to present lowcontrast,color deviation,and loss of details,which in turn make human posture recognition challenging.To address ...The scattering and absorption of light propagating underwater cause the underwater images to present lowcontrast,color deviation,and loss of details,which in turn make human posture recognition challenging.To address these issues,this study introduced the dual-guided filtering technique and developed an underwater diver image improvement method.First,the color distortion of the underwater diver image was solved using white balance technology to obtain a color-corrected image.Second,dual-guided filtering was applied to the white balanced image to correct the distorted color and enhance its details.Four feature weight maps of the two images were then calculated,and two normalizedweightmapswere constructed formulti-scale fusion using normalization.To better preserve the obtained image details,the fusion image was histogram-stretched to obtain the final enhanced result.The experimental results validated that this method has improved the accuracy of underwater human posture recognition.展开更多
AIM:To develop and evaluate a new fundus image optimization software based on red,green,blue channels(RGB) for the evaluation of age-related macular degeneration(AMD) in the Chinese population.METHODS:Fundus images th...AIM:To develop and evaluate a new fundus image optimization software based on red,green,blue channels(RGB) for the evaluation of age-related macular degeneration(AMD) in the Chinese population.METHODS:Fundus images that were diagnosed as AMD from the Shanghai Changfeng Study database were analyzed to develop a standardized optimization procedure.Image brightness,contrast,and color balance were measured.Differences between central lesion area and normal retinal area under different image brightness,contrast,and color balance were observed.The optimal optimization parameters were determined based on the visual system to avoid image distortion.A paired-sample diagnostic test was used to evaluate the enhancement software.Fundus optical coherence tomography(OCT) was used as the gold standard.Diagnostic performances were compared between original images and optimized images using Mc Nemar’s test.RESULTS:A fundus image optimization procedure was developed using 86 fundus images of 74 subjects diagnosed with AMD.By observing gray-scale images,choroid can be best displayed in red channel and retina in green channel was found.There was limited information in blue channel.Totally 104 participants were included in the paired sample diagnostic test to assess the performance of the optimization software.After the image enhancement,sensitivity increased from 74% to 88%(P=0.008),specificity decreased slightly from 88% to 84%(P=0.500),and Youden index increased by 0.11.CONCLUSION:The standardized image optimization software increases diagnostic sensitivity and may help ophthalmologists in AMD diagnosis and screening.展开更多
Residual learning based deep generative networks have achieved promising performance in image enhancement.However,due to the large color gap between a low-quality image and its highquality version,the identical mappin...Residual learning based deep generative networks have achieved promising performance in image enhancement.However,due to the large color gap between a low-quality image and its highquality version,the identical mapping in conventional residual learning cannot explore the elaborate detail differences,resulting in color deviations and texture losses in enhanced images.To address this issue,an innovative non-identical residual learning architecture is proposed,which views image enhancement as two complementary branches,namely a holistic color adjustment branch and a finegrained residual generation branch.In the holistic color adjustment,an adjusting map is calculated for each input low-quality image,in order to regulate the low-quality image to the high-quality representation in an overall way.In the fine-grained residual generation branch,a novel attention-aware recursive network is designed to generate residual images.This design can alleviate the overfitting problem by reusing parameters and promoting the network’s adaptability for different input conditions.In addition,a novel dynamic multi-level perceptual loss based on the error feedback ideology is proposed.Consequently,the proposed network can be dynamically optimized by the hybrid perceptual loss provided by a well-trained VGG,so as to improve the perceptual quality of enhanced images in a guided way.Extensive experiments conducted on publicly available datasets demonstrate the state-of-the-art performance of the proposed method.展开更多
Medical imaging includes different modalities and processes to visualize the interior of human body for diagnostic and treatment purpose. However, one of the most common degradations in medical images is their poor co...Medical imaging includes different modalities and processes to visualize the interior of human body for diagnostic and treatment purpose. However, one of the most common degradations in medical images is their poor contrast quality and noise. The existence of several objects and the close proximity of adjacent pixels values make the diagnostic process a daunting task. The idea of image enhancement techniques is to improve the quality of an image. In this study, morphological transform operation is carried out on medical images to enhance the contrast and quality. A disk shaped mask is used in Top-Hat and Bottom-Hat transform and this mask plays a vital role in the operation. Different types and sizes of medical images need different masks so that they can be successfully enhanced. The method shown in this study takes a mask of an arbitrary size and keeps changing its size until an optimum enhanced image is obtained from the transformation operation. The enhancement is achieved via an iterative exfoliation process. The results indicate that this method improves the contrast of medical images and can help with better diagnosis.展开更多
Microcirculation images often have low quality in acquisition process, which affect the following steps of process. This paper introduces enhancement algorithm based on nonsubsampled Contourlet transform (NSCT). It an...Microcirculation images often have low quality in acquisition process, which affect the following steps of process. This paper introduces enhancement algorithm based on nonsubsampled Contourlet transform (NSCT). It analyzes the characteristics of the microcirculation images generated, and separates microcirculation images to light weight and the reflection weight. It also analyzes the construction method on NSCT and proves that this method can be applied on microcirculation image enhancement algorithm. To correct light weight of microcirculation image and obtain enhancement image the enhancement microcirculation image was not only superior to the original image visually, but also improved objective data obviously. The algorithms provide a new method to microcirculation image pre-processing and guide the latter steps of the image processing.展开更多
Poor illumination greatly affects the quality of obtained images.In this paper,a novel convolutional neural network named DEANet is proposed on the basis of Retinex for low-light image enhancement.DEANet combines the ...Poor illumination greatly affects the quality of obtained images.In this paper,a novel convolutional neural network named DEANet is proposed on the basis of Retinex for low-light image enhancement.DEANet combines the frequency and content information of images and is divided into three subnetworks:decomposition,enhancement,and adjustment networks,which perform image decomposition;denoising,contrast enhancement,and detail preservation;and image adjustment and generation,respectively.The model is trained on the public LOL dataset,and the experimental results show that it outperforms the existing state-of-the-art methods regarding visual effects and image quality.展开更多
Current Retinex-based image enhancement methods with fixed scale filters cannot adapt to situations involving various depths of field and illuminations.In this paper,a simple but effective method based on adaptive ful...Current Retinex-based image enhancement methods with fixed scale filters cannot adapt to situations involving various depths of field and illuminations.In this paper,a simple but effective method based on adaptive full-scale Retinex(AFSR)is proposed to clarify underwater images or videos.First,we design an adaptive full-scale filter that is guided by the optical transmission rate to estimate illumination components.Then,to reduce the computational complexity,we develop a quantitative mapping method instead of non-linear log functions for directly calculating the reflection component.The proposed method is capable of real-time processing of underwater videos using temporal coherence and Fourier transformations.Compared with eight state-of-the-art clarification methods,our method yields comparable or better results for image contrast enhancement,color-cast correction and clarity.展开更多
In recent years,learning-based low-light image enhancement methods have shown excellent performance,but the heuristic design adopted by most methods requires high engineering skills for developers,causing expensive in...In recent years,learning-based low-light image enhancement methods have shown excellent performance,but the heuristic design adopted by most methods requires high engineering skills for developers,causing expensive inference costs that are unfriendly to the hardware platform.To handle this issue,we propose to automatically discover an efficient architecture,called progressive attentive Retinex network(PAR-Net).We define a new attentive Retinex framework by introducing the attention mechanism to strengthen structural representation.A multi-level search space containing micro-level on the operation and macro-level on the cell is established to realize meticulous construction.To endow the searched architecture with the hardware-aware property,we develop a latency-constrained progressive search strategy that successfully improves the model capability by explicitly expressing the intrinsic relationship between different models defined in the attentive Retinex framework.Extensive quantitative and qualitative experimental results fully justify the superiority of our proposed approach against other state-of-the-art methods.A series of analytical evaluations is performed to illustrate the validity of our proposed algorithm.展开更多
基金National Research Foundation of Korea,Grant/Award Numbers:2022R1I1A3069113,RS-2023-00221365Electronics and Telecommunications Research Institute,Grant/Award Number:2014-3-00123。
文摘In recent times,an image enhancement approach,which learns the global transformation function using deep neural networks,has gained attention.However,many existing methods based on this approach have a limitation:their transformation functions are too simple to imitate complex colour transformations between low-quality images and manually retouched high-quality images.In order to address this limitation,a simple yet effective approach for image enhancement is proposed.The proposed algorithm based on the channel-wise intensity transformation is designed.However,this transformation is applied to the learnt embedding space instead of specific colour spaces and then return enhanced features to colours.To this end,the authors define the continuous intensity transformation(CIT)to describe the mapping between input and output intensities on the embedding space.Then,the enhancement network is developed,which produces multi-scale feature maps from input images,derives the set of transformation functions,and performs the CIT to obtain enhanced images.Extensive experiments on the MIT-Adobe 5K dataset demonstrate that the authors’approach improves the performance of conventional intensity transforms on colour space metrics.Specifically,the authors achieved a 3.8%improvement in peak signal-to-noise ratio,a 1.8%improvement in structual similarity index measure,and a 27.5%improvement in learned perceptual image patch similarity.Also,the authors’algorithm outperforms state-of-the-art alternatives on three image enhancement datasets:MIT-Adobe 5K,Low-Light,and Google HDRþ.
基金supported in part by the National Key Research and Development Program of China(2020YFB1313002)the National Natural Science Foundation of China(62276023,U22B2055,62222302,U2013202)+1 种基金the Fundamental Research Funds for the Central Universities(FRF-TP-22-003C1)the Postgraduate Education Reform Project of Henan Province(2021SJGLX260Y)。
文摘Underwater image enhancement aims to restore a clean appearance and thus improves the quality of underwater degraded images.Current methods feed the whole image directly into the model for enhancement.However,they ignored that the R,G and B channels of underwater degraded images present varied degrees of degradation,due to the selective absorption for the light.To address this issue,we propose an unsupervised multi-expert learning model by considering the enhancement of each color channel.Specifically,an unsupervised architecture based on generative adversarial network is employed to alleviate the need for paired underwater images.Based on this,we design a generator,including a multi-expert encoder,a feature fusion module and a feature fusion-guided decoder,to generate the clear underwater image.Accordingly,a multi-expert discriminator is proposed to verify the authenticity of the R,G and B channels,respectively.In addition,content perceptual loss and edge loss are introduced into the loss function to further improve the content and details of the enhanced images.Extensive experiments on public datasets demonstrate that our method achieves more pleasing results in vision quality.Various metrics(PSNR,SSIM,UIQM and UCIQE) evaluated on our enhanced images have been improved obviously.
基金supported by the National Natural Science Foundation of China(62276192)。
文摘Low-light images suffer from low quality due to poor lighting conditions,noise pollution,and improper settings of cameras.To enhance low-light images,most existing methods rely on normal-light images for guidance but the collection of suitable normal-light images is difficult.In contrast,a self-supervised method breaks free from the reliance on normal-light data,resulting in more convenience and better generalization.Existing self-supervised methods primarily focus on illumination adjustment and design pixel-based adjustment methods,resulting in remnants of other degradations,uneven brightness and artifacts.In response,this paper proposes a self-supervised enhancement method,termed as SLIE.It can handle multiple degradations including illumination attenuation,noise pollution,and color shift,all in a self-supervised manner.Illumination attenuation is estimated based on physical principles and local neighborhood information.The removal and correction of noise and color shift removal are solely realized with noisy images and images with color shifts.Finally,the comprehensive and fully self-supervised approach can achieve better adaptability and generalization.It is applicable to various low light conditions,and can reproduce the original color of scenes in natural light.Extensive experiments conducted on four public datasets demonstrate the superiority of SLIE to thirteen state-of-the-art methods.Our code is available at https://github.com/hanna-xu/SLIE.
基金supported by the national key research and development program (No.2020YFB1806608)Jiangsu natural science foundation for distinguished young scholars (No.BK20220054)。
文摘Due to the selective absorption of light and the existence of a large number of floating media in sea water, underwater images often suffer from color casts and detail blurs. It is therefore necessary to perform color correction and detail restoration. However,the existing enhancement algorithms cannot achieve the desired results. In order to solve the above problems, this paper proposes a multi-stream feature fusion network. First, an underwater image is preprocessed to obtain potential information from the illumination stream, color stream and structure stream by histogram equalization with contrast limitation, gamma correction and white balance, respectively. Next, these three streams and the original raw stream are sent to the residual blocks to extract the features. The features will be subsequently fused. It can enhance feature representation in underwater images. In the meantime, a composite loss function including three terms is used to ensure the quality of the enhanced image from the three aspects of color balance, structure preservation and image smoothness. Therefore, the enhanced image is more in line with human visual perception.Finally, the effectiveness of the proposed method is verified by comparison experiments with many stateof-the-art underwater image enhancement algorithms. Experimental results show that the proposed method provides superior results over them in terms of MSE,PSNR, SSIM, UIQM and UCIQE, and the enhanced images are more similar to their ground truth images.
文摘The current study provides a quantum calculus-based medical image enhancement technique that dynamically chooses the spatial distribution of image pixel intensity values.The technique focuses on boosting the edges and texture of an image while leaving the smooth areas alone.The brain Magnetic Resonance Imaging(MRI)scans are used to visualize the tumors that have spread throughout the brain in order to gain a better understanding of the stage of brain cancer.Accurately detecting brain cancer is a complex challenge that the medical system faces when diagnosing the disease.To solve this issue,this research offers a quantum calculus-based MRI image enhancement as a pre-processing step for brain cancer diagnosis.The proposed image enhancement approach improves images with low gray level changes by estimating the pixel’s quantum probability.The suggested image enhancement technique is demonstrated to be robust and resistant to major quality changes on a variety ofMRIscan datasets of variable quality.ForMRI scans,the BRISQUE“blind/referenceless image spatial quality evaluator”and the NIQE“natural image quality evaluator”measures were 39.38 and 3.58,respectively.The proposed image enhancement model,according to the data,produces the best image quality ratings,and it may be able to aid medical experts in the diagnosis process.The experimental results were achieved using a publicly available collection of MRI scans.
基金sponsored by the National Natural Science Foundation of China under Grants 61972207,U1836208,U1836110,61672290,and the Project was through the Priority Academic Program Development(PAPD)of Jiangsu Higher Education Institution.
文摘Digital watermarking technology is adequate for copyright protection and content authentication.There needs to be more research on the watermarking algorithm after printing and scanning.Aiming at the problem that existing anti-print scanning text image watermarking algorithms cannot take into account the invisibility and robustness of the watermark,an anti-print scanning watermarking algorithm suitable for text images is proposed.This algorithm first performs a series of image enhancement preprocessing operations on the printed scanned image to eliminate the interference of incorrect bit information on watermark embedding and then uses a combination of Discrete Wavelet Transform(DWT)-Singular Value Decomposition(SVD)to embed the watermark.Experiments show that the average Normalized Correlation(NC)of the watermark extracted by this algorithm against attacks such as Joint Photographic Experts Group(JPEG)compression,JPEG2000 compression,and print scanning is above 0.93.Especially,the average NC of the watermark extracted after print scanning attacks is greater than 0.964,and the average Bit Error Ratio(BER)is 5.15%.This indicates that this algorithm has strong resistance to various attacks and print scanning attacks and can better take into account the invisibility of the watermark.
基金supported by the National Key Research and Development Program Topics(Grant No.2021YFB4000905)the National Natural Science Foundation of China(Grant Nos.62101432 and 62102309)in part by Shaanxi Natural Science Fundamental Research Program Project(No.2022JM-508).
文摘Low-light image enhancement methods have limitations in addressing issues such as color distortion,lack of vibrancy,and uneven light distribution and often require paired training data.To address these issues,we propose a two-stage unsupervised low-light image enhancement algorithm called Retinex and Exposure Fusion Network(RFNet),which can overcome the problems of over-enhancement of the high dynamic range and under-enhancement of the low dynamic range in existing enhancement algorithms.This algorithm can better manage the challenges brought about by complex environments in real-world scenarios by training with unpaired low-light images and regular-light images.In the first stage,we design a multi-scale feature extraction module based on Retinex theory,capable of extracting details and structural information at different scales to generate high-quality illumination and reflection images.In the second stage,an exposure image generator is designed through the camera response mechanism function to acquire exposure images containing more dark features,and the generated images are fused with the original input images to complete the low-light image enhancement.Experiments show the effectiveness and rationality of each module designed in this paper.And the method reconstructs the details of contrast and color distribution,outperforms the current state-of-the-art methods in both qualitative and quantitative metrics,and shows excellent performance in the real world.
文摘A method to remove stripes from remote sensing images is proposed based on statistics and a new image enhancement method.The overall processing steps for improving the quality of remote sensing images are introduced to provide a general baseline.Due to the differences in satellite sensors when producing images,subtle but inherent stripes can appear at the stitching positions between the sensors.These stitchingstripes cannot be eliminated by conventional relative radiometric calibration.The inherent stitching stripes cause difficulties in downstream tasks such as the segmentation,classification and interpretation of remote sensing images.Therefore,a method to remove the stripes based on statistics and a new image enhancement approach are proposed in this paper.First,the inconsistency in grayscales around stripes is eliminated with the statistical method.Second,the pixels within stripes are weighted and averaged based on updated pixel values to enhance the uniformity of the overall image radiation quality.Finally,the details of the images are highlighted by a new image enhancement method,which makes the whole image clearer.Comprehensive experiments are performed,and the results indicate that the proposed method outperforms the baseline approach in terms of visual quality and radiation correction accuracy.
文摘Aiming at the scattering and absorption of light in the water body,which causes the problems of color shift,uneven brightness,poor sharpness and missing details in the acquired underwater images,an underwater image enhancement algorithm based on IMSRCR and CLAHE-WGIF is proposed.Firstly,the IMSRCR algorithm proposed in this paper is used to process the original underwater image with adaptive color shift correction;secondly,the image is converted to HSV color space,and the segmentation exponential algorithm is used to process the S component to enhance the image saturation;finally,multi-scale Retinex is used to decompose the V component image into detail layer and base layer,and adaptive two-dimensional gamma correction is made to the base layer to adjust the brightness unevenness,while the detail layer is processed by CLAHE-WGIF algorithm to enhance the image contrast and detail information.The experimental results show that our algorithm has some advantages over existing algorithms in both subjective and objective evaluations,and the information entropy of the image is improved by 6.3%on average,and the UIQM and UCIQE indexes are improved by 12.9%and 20.3%on average.
基金supported by the National Natural Science Foundation of China(61771020,61471412,2019KD0AC02)。
文摘In this paper,we present a tensor least square based model for sand/sandstorm removal in images.The main contributions of this paper are as follows.First,an important intrinsic natural feature of outdoor scenes free of sand/sandstorm is found that the outlines in RGB channels are somewise similar,which discloses the physical validation using the tensor instead of the matrix.Second,a tensor least square optimization model is presented for the decomposition of edge-preserving base layers and details.This model not only decomposes the color image(taken as an inseparable indivisibility)in X,Y directions,but also in Z direction,which meets the statistical feature of natural scenes and can physically disclose the intrinsic color information.The model’s advantages are twofold:one is the decomposition of edgepreserving base layers and details that can be employed for contrast enhancement without artificial halos,and the other one is the color driving ability that makes the enhanced images as close to natural images as possible via the inherent color structure.Thirdly,the tensor least square optimization model based image enhancement scheme is discussed for the sandstorm weather images.Finally,the experiments and comparisons with the stateof-the-art methods on real degraded images under sandstorm weather are shown to verify our method’s efficiency.
基金funded by the Deanship of Scientic Research at Princess Nourah bint Abdulrahman University through the Fast-track Research Funding Progr。
文摘The enhancement of medical images is a challenging research task due to the unforeseeable variation in the quality of the captured images.The captured images may present with low contrast and low visibility,which might inuence the accuracy of the diagnosis process.To overcome this problem,this paper presents a new fractional integral entropy(FITE)that estimates the unforeseeable probabilities of image pixels,posing as the main contribution of the paper.The proposed model dynamically enhances the image based on the image contents.The main advantage of FITE lies in its capability to enhance the low contrast intensities through pixels’probability.Initially,the pixel probability of the fractional power is utilized to extract the illumination value from the pixels of the image.Next,the contrast of the image is then adjusted to enhance the regions with low visibility.Finally,the fractional integral entropy approach is implemented to enhance the low visibility contents from the input image.Tests were conducted on brain MRI,lungs CT,and kidney MRI scans datasets of different image qualities to show that the proposed model is robust and can withstand dramatic variations in quality.The obtained comparative results show that the proposed image enhancement model achieves the best BRISQUE and NIQE scores.Overall,this model improves the details of brain MRI,lungs CT,and kidney MRI scans,and could therefore potentially help the medical staff during the diagnosis process.
基金supported by National Key R&D program of China(No.2019YFB1312400)Hong Kong Health and Medical Research Fund(HMRF)(No.06171066)CUHK-Direct(No.134997202).
文摘Objective:This paper proposes a new photoacoustic computed tomography(PACT)imaging system employing dual ultrasonic transducers with different frequencies.When imaging complex biological tissues,photoacoustic(PA)signals with multiple frequencies are produced simultaneously;however,due to the limited bandwidth of a single-frequency transducer,the received PA signals with specific frequencies may be missing,leading to a low imaging quality.Methods:In contrast to our previous work,the proposed system has a compact volume as well as specific selection of the detection center frequency of the transducer,which can provide a comprehensive range for the detection of PA signals.In this study,a series of numerical simulation and phantom experiments were performed to validate the efficacy of the developed PACT system.Results:The images generated by our system combined the advantages of both high resolution and ideal brightness/contrast.Conclusion:The interchangeability of transducers with different frequencies provides potential for clinical deployment under the circumstance where a single frequency transducer cannot perform well.
基金National Natural Science Foundation of China(No.61702074)the Liaoning Provincial Natural Science Foundation of China(No.20170520196)the Fundamental Research Funds for the Central Universities(Nos.3132019205 and 3132019354).
文摘The scattering and absorption of light propagating underwater cause the underwater images to present lowcontrast,color deviation,and loss of details,which in turn make human posture recognition challenging.To address these issues,this study introduced the dual-guided filtering technique and developed an underwater diver image improvement method.First,the color distortion of the underwater diver image was solved using white balance technology to obtain a color-corrected image.Second,dual-guided filtering was applied to the white balanced image to correct the distorted color and enhance its details.Four feature weight maps of the two images were then calculated,and two normalizedweightmapswere constructed formulti-scale fusion using normalization.To better preserve the obtained image details,the fusion image was histogram-stretched to obtain the final enhanced result.The experimental results validated that this method has improved the accuracy of underwater human posture recognition.
文摘AIM:To develop and evaluate a new fundus image optimization software based on red,green,blue channels(RGB) for the evaluation of age-related macular degeneration(AMD) in the Chinese population.METHODS:Fundus images that were diagnosed as AMD from the Shanghai Changfeng Study database were analyzed to develop a standardized optimization procedure.Image brightness,contrast,and color balance were measured.Differences between central lesion area and normal retinal area under different image brightness,contrast,and color balance were observed.The optimal optimization parameters were determined based on the visual system to avoid image distortion.A paired-sample diagnostic test was used to evaluate the enhancement software.Fundus optical coherence tomography(OCT) was used as the gold standard.Diagnostic performances were compared between original images and optimized images using Mc Nemar’s test.RESULTS:A fundus image optimization procedure was developed using 86 fundus images of 74 subjects diagnosed with AMD.By observing gray-scale images,choroid can be best displayed in red channel and retina in green channel was found.There was limited information in blue channel.Totally 104 participants were included in the paired sample diagnostic test to assess the performance of the optimization software.After the image enhancement,sensitivity increased from 74% to 88%(P=0.008),specificity decreased slightly from 88% to 84%(P=0.500),and Youden index increased by 0.11.CONCLUSION:The standardized image optimization software increases diagnostic sensitivity and may help ophthalmologists in AMD diagnosis and screening.
基金Supported by the National Natural Science Foundation of China(No.62172035)。
文摘Residual learning based deep generative networks have achieved promising performance in image enhancement.However,due to the large color gap between a low-quality image and its highquality version,the identical mapping in conventional residual learning cannot explore the elaborate detail differences,resulting in color deviations and texture losses in enhanced images.To address this issue,an innovative non-identical residual learning architecture is proposed,which views image enhancement as two complementary branches,namely a holistic color adjustment branch and a finegrained residual generation branch.In the holistic color adjustment,an adjusting map is calculated for each input low-quality image,in order to regulate the low-quality image to the high-quality representation in an overall way.In the fine-grained residual generation branch,a novel attention-aware recursive network is designed to generate residual images.This design can alleviate the overfitting problem by reusing parameters and promoting the network’s adaptability for different input conditions.In addition,a novel dynamic multi-level perceptual loss based on the error feedback ideology is proposed.Consequently,the proposed network can be dynamically optimized by the hybrid perceptual loss provided by a well-trained VGG,so as to improve the perceptual quality of enhanced images in a guided way.Extensive experiments conducted on publicly available datasets demonstrate the state-of-the-art performance of the proposed method.
文摘Medical imaging includes different modalities and processes to visualize the interior of human body for diagnostic and treatment purpose. However, one of the most common degradations in medical images is their poor contrast quality and noise. The existence of several objects and the close proximity of adjacent pixels values make the diagnostic process a daunting task. The idea of image enhancement techniques is to improve the quality of an image. In this study, morphological transform operation is carried out on medical images to enhance the contrast and quality. A disk shaped mask is used in Top-Hat and Bottom-Hat transform and this mask plays a vital role in the operation. Different types and sizes of medical images need different masks so that they can be successfully enhanced. The method shown in this study takes a mask of an arbitrary size and keeps changing its size until an optimum enhanced image is obtained from the transformation operation. The enhancement is achieved via an iterative exfoliation process. The results indicate that this method improves the contrast of medical images and can help with better diagnosis.
基金Doctoral Program of Higher Education of China grant number: 20093218110024+1 种基金International Science and Technology Cooperation Grantgrant number: BZ2008060
文摘Microcirculation images often have low quality in acquisition process, which affect the following steps of process. This paper introduces enhancement algorithm based on nonsubsampled Contourlet transform (NSCT). It analyzes the characteristics of the microcirculation images generated, and separates microcirculation images to light weight and the reflection weight. It also analyzes the construction method on NSCT and proves that this method can be applied on microcirculation image enhancement algorithm. To correct light weight of microcirculation image and obtain enhancement image the enhancement microcirculation image was not only superior to the original image visually, but also improved objective data obviously. The algorithms provide a new method to microcirculation image pre-processing and guide the latter steps of the image processing.
基金This work was supported by the Shanghai Aerospace Science and Technology Innovation Fund(No.SAST2019-048)the Cross-Media Intelligent Technology Project of Beijing National Research Center for Information Science and Technology(BNRist)(No.BNR2019TD01022).
文摘Poor illumination greatly affects the quality of obtained images.In this paper,a novel convolutional neural network named DEANet is proposed on the basis of Retinex for low-light image enhancement.DEANet combines the frequency and content information of images and is divided into three subnetworks:decomposition,enhancement,and adjustment networks,which perform image decomposition;denoising,contrast enhancement,and detail preservation;and image adjustment and generation,respectively.The model is trained on the public LOL dataset,and the experimental results show that it outperforms the existing state-of-the-art methods regarding visual effects and image quality.
基金supported by the National Natural Science Foundation of China under Grant Nos.62001129 and 62161051the Xingdian Talent Support Program 2022 of Yunnan Province of China+1 种基金the Yunnan University of Finance and Economics Foundation under Grant No.2021D17the Guangxi Provincial Natural Science Foundation under Grant No.2021GXNSFBA075029.
文摘Current Retinex-based image enhancement methods with fixed scale filters cannot adapt to situations involving various depths of field and illuminations.In this paper,a simple but effective method based on adaptive full-scale Retinex(AFSR)is proposed to clarify underwater images or videos.First,we design an adaptive full-scale filter that is guided by the optical transmission rate to estimate illumination components.Then,to reduce the computational complexity,we develop a quantitative mapping method instead of non-linear log functions for directly calculating the reflection component.The proposed method is capable of real-time processing of underwater videos using temporal coherence and Fourier transformations.Compared with eight state-of-the-art clarification methods,our method yields comparable or better results for image contrast enhancement,color-cast correction and clarity.
文摘In recent years,learning-based low-light image enhancement methods have shown excellent performance,but the heuristic design adopted by most methods requires high engineering skills for developers,causing expensive inference costs that are unfriendly to the hardware platform.To handle this issue,we propose to automatically discover an efficient architecture,called progressive attentive Retinex network(PAR-Net).We define a new attentive Retinex framework by introducing the attention mechanism to strengthen structural representation.A multi-level search space containing micro-level on the operation and macro-level on the cell is established to realize meticulous construction.To endow the searched architecture with the hardware-aware property,we develop a latency-constrained progressive search strategy that successfully improves the model capability by explicitly expressing the intrinsic relationship between different models defined in the attentive Retinex framework.Extensive quantitative and qualitative experimental results fully justify the superiority of our proposed approach against other state-of-the-art methods.A series of analytical evaluations is performed to illustrate the validity of our proposed algorithm.
