Deep learning techniques have significantly improved image restoration tasks in recent years.As a crucial compo-nent of deep learning,the loss function plays a key role in network optimization and performance enhancem...Deep learning techniques have significantly improved image restoration tasks in recent years.As a crucial compo-nent of deep learning,the loss function plays a key role in network optimization and performance enhancement.However,the currently prevalent loss functions assign equal weight to each pixel point during loss calculation,which hampers the ability to reflect the roles of different pixel points and fails to exploit the image’s characteristics fully.To address this issue,this study proposes an asymmetric loss function based on the image and data characteristics of the image recovery task.This novel loss function can adjust the weight of the reconstruction loss based on the grey value of different pixel points,thereby effectively optimizing the network training by differentially utilizing the grey information from the original image.Specifically,we calculate a weight factor for each pixel point based on its grey value and combine it with the reconstruction loss to create a new loss function.This ensures that pixel points with smaller grey values receive greater attention,improving network recovery.In order to verify the effectiveness of the proposed asymmetric loss function,we conducted experimental tests in the image super-resolution task.The experimental results show that the model with the introduction of asymmetric loss weights improves all the indexes of the processing results without increasing the training time.In the typical super-resolution network SRCNN,by introducing asymmetric weights,it is possible to improve the peak signal-to-noise ratio(PSNR)by up to about 0.5%,the structural similarity index(SSIM)by up to about 0.3%,and reduce the root-mean-square error(RMSE)by up to about 1.7%with essentially no increase in training time.In addition,we also further tested the performance of the proposed method in the denoising task to verify the potential applicability of the method in the image restoration task.展开更多
As the representative of flexibility in optical imaging media,in recent years,fiber bundles have emerged as a promising architecture in the development of compact visual systems.Dedicated to tackling the problems of u...As the representative of flexibility in optical imaging media,in recent years,fiber bundles have emerged as a promising architecture in the development of compact visual systems.Dedicated to tackling the problems of universal honeycomb artifacts and low signal-to-noise ratio(SNR)imaging in fiber bundles,the iterative super-resolution reconstruction network based on a physical model is proposed.Under the constraint of solving the two subproblems of data fidelity and prior regularization term alternately,the network can efficiently“regenerate”the lost spatial resolution with deep learning.By building and calibrating a dual-path imaging system,the real-world dataset where paired low-resolution(LR)-high-resolution(HR)images on the same scene can be generated simultaneously.Numerical results on both the United States Air Force(USAF)resolution target and complex target objects demonstrate that the algorithm can restore high-contrast images without pixilated noise.On the basis of super-resolution reconstruction,compound eye image composition based on fiber bundle is also embedded in this paper for the actual imaging requirements.The proposed work is the first to apply a physical model-based deep learning network to fiber bundle imaging in the infrared band,effectively promoting the engineering application of thermal radiation detection.展开更多
The purpose of this paper is to show the preconditioned BMinPert algorithm and analyse the practical implementation. Then a posteriori backward error for BGMRES is given. Furthermore, we discuss their applications in ...The purpose of this paper is to show the preconditioned BMinPert algorithm and analyse the practical implementation. Then a posteriori backward error for BGMRES is given. Furthermore, we discuss their applications in color image restoration. The key differences between BMinPert and other methods such as BFGMRES-S(m, p<sub>f</sub>), GsGMRES and BGMRES are illustrated with numerical experiments which expound the advantages of BMinPert in the presence of sensitive data with ill-condition problems.展开更多
The random-value impulse noise(RVIN)detection approach in image denoising,which is dependent on manually defined detection thresholds or local window information,does not have strong generalization performance and can...The random-value impulse noise(RVIN)detection approach in image denoising,which is dependent on manually defined detection thresholds or local window information,does not have strong generalization performance and cannot successfully cope with damaged pictures with high noise levels.The fusion of the K-means clustering approach in the noise detection stage is reviewed in this research,and the internal relationship between the flat region and the detail area of the damaged picture is thoroughly explored to suggest an unique two-stage method for gray image denoising.Based on the concept of pixel clustering and grouping,all pixels in the damaged picture are separated into various groups based on gray distance similarity features,and the best detection threshold of each group is solved to identify the noise.In the noise reduction step,a partition decision filter based on the gray value characteristics of pixels in the flat and detail areas is given.For the noise pixels in flat and detail areas,local consensus index(LCI)weighted filter and edge direction filter are designed respectively to recover the pixels damaged by the RVIN.The experimental results show that the accuracy of the proposed noise detection method is more than 90%,and is superior to most mainstream methods.At the same time,the proposed filtering method not only has good noise reduction and generalization performance for natural images and medical images with medium and high noise but also is superior to other advanced filtering technologies in visual effect and objective quality evaluation.展开更多
Image processing is becoming more popular because images are being used increasingly in medical diagnosis,biometric monitoring,and character recognition.But these images are frequently contaminated with noise,which ca...Image processing is becoming more popular because images are being used increasingly in medical diagnosis,biometric monitoring,and character recognition.But these images are frequently contaminated with noise,which can corrupt subsequent image processing stages.Therefore,in this paper,we propose a novel nonlinear filter for removing“salt and pepper”impulsive noise from a complex color image.The new filter is called the Modified Vector Directional Filter(MVDF).The suggested method is based on the traditional Vector Directional Filter(VDF).However,before the candidate pixel is processed by the VDF,theMVDF employs a threshold and the neighboring pixels of the candidate pixel in a 3×3 filter window to determine whether it is noise-corrupted or noise-free.Several reference color images corrupted by impulsive noise with intensities ranging from 3%to 20%are used to assess theMVDF’s effectiveness.The results of the experiments show that theMVDF is better than the VDF and the Generalized VDF(GVDF)in terms of the PSNR(Peak Signal-to-Noise Ratio),NCD(Normalized Color Difference),and execution time for the denoised image.In fact,the PSNR is increased by 6.554%and 12.624%,the NCD is decreased by 20.273%and 44.147%,and the execution time is reduced by approximately a factor of 3 for the MVDF relative to the VDF and GVDF,respectively.These results prove the efficiency of the proposed filter.Furthermore,a hardware design is proposed for the MVDF using the High-Level Synthesis(HLS)flow in order to increase its performance.This design,which is implemented on the Xilinx ZynqXCZU9EG Field-ProgrammableGate Array(FPGA),allows the restoration of a 256×256-pixel image in 2 milliseconds(ms)only.展开更多
A novel image restoration model coupling with a gradient fidelity term based on adaptive total variation is proposed in this paper. In order to choose proper parameters, the selection criteria were analyzed theoretica...A novel image restoration model coupling with a gradient fidelity term based on adaptive total variation is proposed in this paper. In order to choose proper parameters, the selection criteria were analyzed theoretically, and a simple scheme to demonstrate its validity was adopted experimentally. To make fair comparisons of performances of three models, the same numerical algorithm was used to solve partial differential equations. Both the international standard test image on Lena and HR image of CBERS-02B of Dalian city were used to verify the performance of the model. Experimental results illustrate that the new model not only preserved the edge and important details but also alleviated the staircase effect effectively.展开更多
Filling techniques are often used in the restoration of images.Yet the existing filling technique approaches either have high computational costs or present problems such as filling holes redundantly.This paper propos...Filling techniques are often used in the restoration of images.Yet the existing filling technique approaches either have high computational costs or present problems such as filling holes redundantly.This paper proposes a novel algorithm for filling holes and regions of the images.The proposed algorithm combines the advantages of both the parity-check filling approach and the region-growing inpainting technique.Pairing points of the region’s boundary are used to search and to fill the region.The scanning range of the filling method is within the target regions.The proposed method does not require additional working memory or assistant colors,and it can correctly fill any complex contours.Experimental results show that,compared to other approaches,the proposed algorithm fills regions faster and with lower computational cost.展开更多
The multispectral remote sensing image(MS-RSI)is degraded existing multi-spectral camera due to various hardware limitations.In this paper,we propose a novel core tensor dictionary learning approach with the robust mo...The multispectral remote sensing image(MS-RSI)is degraded existing multi-spectral camera due to various hardware limitations.In this paper,we propose a novel core tensor dictionary learning approach with the robust modified Gaussian mixture model for MS-RSI restoration.First,the multispectral patch is modeled by three-order tensor and high-order singular value decomposition is applied to the tensor.Then the task of MS-RSI restoration is formulated as a minimum sparse core tensor estimation problem.To improve the accuracy of core tensor coding,the core tensor estimation based on the robust modified Gaussian mixture model is introduced into the proposed model by exploiting the sparse distribution prior in image.When applied to MS-RSI restoration,our experimental results have shown that the proposed algorithm can better reconstruct the sharpness of the image textures and can outperform several existing state-of-the-art multispectral image restoration methods in both subjective image quality and visual perception.展开更多
Images are generally corrupted by impulse noise during acquisition and transmission.Noise deteriorates the quality of images.To remove corruption noise,we propose a hybrid approach to restoring a random noisecorrupted...Images are generally corrupted by impulse noise during acquisition and transmission.Noise deteriorates the quality of images.To remove corruption noise,we propose a hybrid approach to restoring a random noisecorrupted image,including a block matching 3D(BM3D)method,an adaptive non-local mean(ANLM)scheme,and the K-singular value decomposition(K-SVD)algorithm.In the proposed method,we employ the morphological component analysis(MCA)to decompose an image into the texture,structure,and edge parts.Then,the BM3D method,ANLM scheme,and K-SVD algorithm are utilized to eliminate noise in the texture,structure,and edge parts of the image,respectively.Experimental results show that the proposed approach can effectively remove interference random noise in different parts;meanwhile,the deteriorated image is able to be reconstructed well.展开更多
A new method of back propagation learning with respect to the problem of image restoration which is named as greyscale based learning in back propagation neural networks ( BPNN) is investigated. It is observed that by...A new method of back propagation learning with respect to the problem of image restoration which is named as greyscale based learning in back propagation neural networks ( BPNN) is investigated. It is observed that by using this method the value of mean square error ( MSE) decreases significantly. In addition,this method also gives good visual results when it is applied in image restoration problem. This method is also useful to tackle the inherited drawback of falling into local minima by reducing its effect on overall system by bifurcating the learning locally different for different grey scale values. The performance of this algorithm has been studied in detail with different combinations of weights. In short,this algorithm provides much better results especially when compared with the simple back propagation algorithm with any further enhancements and without going for hybrid solutions.展开更多
With the development of image restoration technology based on deep learning,more complex problems are being solved,especially in image semantic inpainting based on context.Nowadays,image semantic inpainting techniques...With the development of image restoration technology based on deep learning,more complex problems are being solved,especially in image semantic inpainting based on context.Nowadays,image semantic inpainting techniques are becoming more mature.However,due to the limitations of memory,the instability of training,and the lack of sample diversity,the results of image restoration are still encountering difficult problems,such as repairing the content of glitches which cannot be well integrated with the original image.Therefore,we propose an image inpainting network based on Wasserstein generative adversarial network(WGAN)distance.With the corresponding technology having been adjusted and improved,we attempted to use the Adam algorithm to replace the traditional stochastic gradient descent,and another algorithm to optimize the training used in recent years.We evaluated our algorithm on the ImageNet dataset.We obtained high-quality restoration results,indicating that our algorithm improves the clarity and consistency of the image.展开更多
To implement restoration in a single motion blurred image,the PSF(Point Spread Function)is difficult to estimate and the image deconvolution is ill-posed as a result that a good recovery effect cannot be obtained.Cons...To implement restoration in a single motion blurred image,the PSF(Point Spread Function)is difficult to estimate and the image deconvolution is ill-posed as a result that a good recovery effect cannot be obtained.Considering that several different PSFs can get joint invertibility to make restoration wellposed,we proposed a motion-blurred image restoration method based on joint invertibility of PSFs by means of computational photography.Firstly,we designed a set of observation device which composed by multiple cameras with the same parameters to shoot the moving target in the same field of view continuously to obtain the target images with the same background.The target images have the same brightness,but different exposure time and different motion blur length.It is easy to estimate the blur PSFs of the target images make use of the sequence frames obtained by one camera.According to the motion blur superposition feature of the target and its background,the complete blurred target images can be extracted from the observed images respectively.Finally,for the same target images with different PSFs,the iterative restoration is solved by joint solution of multiple images in spatial domain.The experiments showed that the moving target observation device designed by this method had lower requirements on hardware conditions,and the observed images are more convenient to use joint-PSF solution for image restoration,and the restoration results maintained details well and had lower signal noise ratio(SNR).展开更多
Regularization methods have been substantially applied in image restoration due to the ill-posedness of the image restoration problem.Different assumptions or priors on images are applied in the construction of image ...Regularization methods have been substantially applied in image restoration due to the ill-posedness of the image restoration problem.Different assumptions or priors on images are applied in the construction of image regularization methods.In recent years,matrix low-rank approximation has been successfully introduced in the image denoising problem and significant denoising effects have been achieved.Low-rank matrix minimization is an NP-hard problem and it is often replaced with the matrix’s weighted nuclear norm minimization(WNNM).The assumption that an image contains an extensive amount of self-similarity is the basis for the construction of the matrix low-rank approximation-based image denoising method.In this paper,we develop a model for image restoration using the sum of block matching matrices’weighted nuclear norm to be the regularization term in the cost function.An alternating iterative algorithm is designed to solve the proposed model and the convergence analyses of the algorithm are also presented.Numerical experiments show that the proposed method can recover the images much better than the existing regularization methods in terms of both recovered quantities and visual qualities.展开更多
The blurred image restoration method can dramatically highlight the image details and enhance the global contrast, which is of benefit to improvement of the visual effect during practical applications. This paper is b...The blurred image restoration method can dramatically highlight the image details and enhance the global contrast, which is of benefit to improvement of the visual effect during practical applications. This paper is based on the dark channel prior principle and aims at the prior information absent blurred image degradation situation. A lot of improvements have been made to estimate the transmission map of blurred images. Since the dark channel prior principle can effectively restore the blurred image at the cost of a large amount of computation, the total variation(TV) and image morphology transform(specifically top-hat transform and bottomhat transform) have been introduced into the improved method.Compared with original transmission map estimation methods, the proposed method features both simplicity and accuracy. The estimated transmission map together with the element can restore the image. Simulation results show that this method could inhibit the ill-posed problem during image restoration, meanwhile it can greatly improve the image quality and definition.展开更多
Image restoration is often solved by minimizing an energy function consisting of a data-fidelity term and a regularization term. A regularized convex term can usually preserve the image edges well in the restored imag...Image restoration is often solved by minimizing an energy function consisting of a data-fidelity term and a regularization term. A regularized convex term can usually preserve the image edges well in the restored image. In this paper, we consider a class of convex and edge-preserving regularization functions, I.e., multiplicative half-quadratic regularizations, and we use the Newton method to solve the correspondingly reduced systems of nonlinear equations. At each Newton iterate, the preconditioned conjugate gradient method, incorporated with a constraint preconditioner, is employed to solve the structured Newton equation that has a symmetric positive definite coefficient matrix.The igenvalue bounds of the preconditioned matrix are deliberately derived, which can be used to estimate the convergence speed of the preconditioned conjugate gradient method. We use experimental results to demonstrate that this new approach is efficient,and the effect of image restoration is r0easonably well.展开更多
This paper proposes a new image restoration technique, in which the resultingregularized image approximates the optimal solution steadily. The affect of the regular-ization operator and parameter on the lower band and...This paper proposes a new image restoration technique, in which the resultingregularized image approximates the optimal solution steadily. The affect of the regular-ization operator and parameter on the lower band and upper band energy of the residueof the regularized image is theoretically analyzed by employing wavelet transform. Thispaper shows that regularization operator should generally be lowstop and highpass. So thispaper chooses a lowstop and highpass operator as regularization operator, and constructan optimization model which minimizes the mean squares residue of reg ularized solutionto determine regularization parameter. Although the model is random, on the conditionof this paper, it can be solved and yields regularization parameter and regularized solu-tion. Otherwise, the technique has a mechanism to predict noise energy. So, without noiseinformation, it can also work and yield good restoration results.展开更多
Focusing on the degradation of foggy images, a restoration approach from a single image based on spatial correlation of dark channel prior is proposed. Firstly, the transmission of each pixel is estimated by the spati...Focusing on the degradation of foggy images, a restoration approach from a single image based on spatial correlation of dark channel prior is proposed. Firstly, the transmission of each pixel is estimated by the spatial correlation of dark channel prior. Secondly, a degradation model is utilized to restore the foggy image. Thirdly, the final recovered image, with enhanced contrast,is obtained by performing a post-processing technique based on just-noticeable difference. Experimental results demonstrate that the information of a foggy image can be recovered perfectly by the proposed method, even in the case of the abrupt depth changing scene.展开更多
In this paper, we study an operator s which maps every n-by-n symmetric matrix A, to a matrix s(A_n) that minimizes || B_n-A_n || F over the set of all matrices B_n, that can be diagonalized by the sine transform. The...In this paper, we study an operator s which maps every n-by-n symmetric matrix A, to a matrix s(A_n) that minimizes || B_n-A_n || F over the set of all matrices B_n, that can be diagonalized by the sine transform. The matrix s(A_n), called the optimal sine transform preconditioner, is defined for any n-by-n symmetric matrices A_n. The cost of constructing s(A_n) is the same as that of optimal circulant preconditioner c(A_n) which is defined in [8], The s(A_n) has been proved in [6] to be a good preconditioner in solving symmetric Toeplitz systems with the preconditioned conjugate gradient (PCG) method. In this paper, we discuss the algebraic and geometric properties of the operator s, and compute its operator norms in Banach spaces of symmetric matrices. Some numerical tests and an application in image restoration are also given.展开更多
In this paper, we present a method of ROV based image processing to restore underwater blurry images from the theory of light and image transmission in the sea. Computer is used to simulate the maximum detection range...In this paper, we present a method of ROV based image processing to restore underwater blurry images from the theory of light and image transmission in the sea. Computer is used to simulate the maximum detection range of the ROV under different water body conditions. The receiving irradiance of the video camera at different detection ranges is also calculated. The ROV’s detection performance under different water body conditions is given by simulation. We restore the underwater blurry images using the Wiener filter based on the simulation. The Wiener filter is shown to be a simple useful method for underwater image restoration in the ROV underwater experiments. We also present examples of restored images of an underwater standard target taken by the video camera in these experiments.展开更多
基金supported by the National Natural Science Foundation of China(62201618).
文摘Deep learning techniques have significantly improved image restoration tasks in recent years.As a crucial compo-nent of deep learning,the loss function plays a key role in network optimization and performance enhancement.However,the currently prevalent loss functions assign equal weight to each pixel point during loss calculation,which hampers the ability to reflect the roles of different pixel points and fails to exploit the image’s characteristics fully.To address this issue,this study proposes an asymmetric loss function based on the image and data characteristics of the image recovery task.This novel loss function can adjust the weight of the reconstruction loss based on the grey value of different pixel points,thereby effectively optimizing the network training by differentially utilizing the grey information from the original image.Specifically,we calculate a weight factor for each pixel point based on its grey value and combine it with the reconstruction loss to create a new loss function.This ensures that pixel points with smaller grey values receive greater attention,improving network recovery.In order to verify the effectiveness of the proposed asymmetric loss function,we conducted experimental tests in the image super-resolution task.The experimental results show that the model with the introduction of asymmetric loss weights improves all the indexes of the processing results without increasing the training time.In the typical super-resolution network SRCNN,by introducing asymmetric weights,it is possible to improve the peak signal-to-noise ratio(PSNR)by up to about 0.5%,the structural similarity index(SSIM)by up to about 0.3%,and reduce the root-mean-square error(RMSE)by up to about 1.7%with essentially no increase in training time.In addition,we also further tested the performance of the proposed method in the denoising task to verify the potential applicability of the method in the image restoration task.
基金the National Natural Science Foundation of China(Grant Nos.61905115,62105151,62175109,U21B2033)Leading Technology of Jiangsu Basic Research Plan(Grant No.BK20192003)+2 种基金Youth Foundation of Jiangsu Province(Grant Nos.BK20190445,BK20210338)Fundamental Research Funds for the Central Universities(Grant No.30920032101)Open Research Fund of Jiangsu Key Laboratory of Spectral Imaging&Intelligent Sense(Grant No.JSGP202105)to provide fund for conducting experiments。
文摘As the representative of flexibility in optical imaging media,in recent years,fiber bundles have emerged as a promising architecture in the development of compact visual systems.Dedicated to tackling the problems of universal honeycomb artifacts and low signal-to-noise ratio(SNR)imaging in fiber bundles,the iterative super-resolution reconstruction network based on a physical model is proposed.Under the constraint of solving the two subproblems of data fidelity and prior regularization term alternately,the network can efficiently“regenerate”the lost spatial resolution with deep learning.By building and calibrating a dual-path imaging system,the real-world dataset where paired low-resolution(LR)-high-resolution(HR)images on the same scene can be generated simultaneously.Numerical results on both the United States Air Force(USAF)resolution target and complex target objects demonstrate that the algorithm can restore high-contrast images without pixilated noise.On the basis of super-resolution reconstruction,compound eye image composition based on fiber bundle is also embedded in this paper for the actual imaging requirements.The proposed work is the first to apply a physical model-based deep learning network to fiber bundle imaging in the infrared band,effectively promoting the engineering application of thermal radiation detection.
文摘The purpose of this paper is to show the preconditioned BMinPert algorithm and analyse the practical implementation. Then a posteriori backward error for BGMRES is given. Furthermore, we discuss their applications in color image restoration. The key differences between BMinPert and other methods such as BFGMRES-S(m, p<sub>f</sub>), GsGMRES and BGMRES are illustrated with numerical experiments which expound the advantages of BMinPert in the presence of sensitive data with ill-condition problems.
基金This work is supported by the Hainan Provincial Natural Science Foundation of China(621MS019)Major Science and Technology Project of Haikou(Grant:2020-009)+2 种基金Innovative Research Project of Postgraduates in Hainan Province(Qhyb2021-10)National Natural Science Foundation of China(Grant:62062030)Key R&D Project of Hainan province(Grant:ZDYF2021SHFZ243).
文摘The random-value impulse noise(RVIN)detection approach in image denoising,which is dependent on manually defined detection thresholds or local window information,does not have strong generalization performance and cannot successfully cope with damaged pictures with high noise levels.The fusion of the K-means clustering approach in the noise detection stage is reviewed in this research,and the internal relationship between the flat region and the detail area of the damaged picture is thoroughly explored to suggest an unique two-stage method for gray image denoising.Based on the concept of pixel clustering and grouping,all pixels in the damaged picture are separated into various groups based on gray distance similarity features,and the best detection threshold of each group is solved to identify the noise.In the noise reduction step,a partition decision filter based on the gray value characteristics of pixels in the flat and detail areas is given.For the noise pixels in flat and detail areas,local consensus index(LCI)weighted filter and edge direction filter are designed respectively to recover the pixels damaged by the RVIN.The experimental results show that the accuracy of the proposed noise detection method is more than 90%,and is superior to most mainstream methods.At the same time,the proposed filtering method not only has good noise reduction and generalization performance for natural images and medical images with medium and high noise but also is superior to other advanced filtering technologies in visual effect and objective quality evaluation.
基金funded by the Deanship of Scientific Research at Jouf University (Kingdom of Saudi Arabia)under Grant No.DSR-2021-02-0393.
文摘Image processing is becoming more popular because images are being used increasingly in medical diagnosis,biometric monitoring,and character recognition.But these images are frequently contaminated with noise,which can corrupt subsequent image processing stages.Therefore,in this paper,we propose a novel nonlinear filter for removing“salt and pepper”impulsive noise from a complex color image.The new filter is called the Modified Vector Directional Filter(MVDF).The suggested method is based on the traditional Vector Directional Filter(VDF).However,before the candidate pixel is processed by the VDF,theMVDF employs a threshold and the neighboring pixels of the candidate pixel in a 3×3 filter window to determine whether it is noise-corrupted or noise-free.Several reference color images corrupted by impulsive noise with intensities ranging from 3%to 20%are used to assess theMVDF’s effectiveness.The results of the experiments show that theMVDF is better than the VDF and the Generalized VDF(GVDF)in terms of the PSNR(Peak Signal-to-Noise Ratio),NCD(Normalized Color Difference),and execution time for the denoised image.In fact,the PSNR is increased by 6.554%and 12.624%,the NCD is decreased by 20.273%and 44.147%,and the execution time is reduced by approximately a factor of 3 for the MVDF relative to the VDF and GVDF,respectively.These results prove the efficiency of the proposed filter.Furthermore,a hardware design is proposed for the MVDF using the High-Level Synthesis(HLS)flow in order to increase its performance.This design,which is implemented on the Xilinx ZynqXCZU9EG Field-ProgrammableGate Array(FPGA),allows the restoration of a 256×256-pixel image in 2 milliseconds(ms)only.
基金Supported by the National Basic Research Program of China ("973"Program)(2009CB72400603) the National Natural Science Foundation of China(6102700260972100)
文摘A novel image restoration model coupling with a gradient fidelity term based on adaptive total variation is proposed in this paper. In order to choose proper parameters, the selection criteria were analyzed theoretically, and a simple scheme to demonstrate its validity was adopted experimentally. To make fair comparisons of performances of three models, the same numerical algorithm was used to solve partial differential equations. Both the international standard test image on Lena and HR image of CBERS-02B of Dalian city were used to verify the performance of the model. Experimental results illustrate that the new model not only preserved the edge and important details but also alleviated the staircase effect effectively.
基金The research is jointly supported by the National Natural Science Foundation of China No.61561035by Ukrainian government project No.0117U007177the Slovak Research and Development Agency project number APVV-18-0214.
文摘Filling techniques are often used in the restoration of images.Yet the existing filling technique approaches either have high computational costs or present problems such as filling holes redundantly.This paper proposes a novel algorithm for filling holes and regions of the images.The proposed algorithm combines the advantages of both the parity-check filling approach and the region-growing inpainting technique.Pairing points of the region’s boundary are used to search and to fill the region.The scanning range of the filling method is within the target regions.The proposed method does not require additional working memory or assistant colors,and it can correctly fill any complex contours.Experimental results show that,compared to other approaches,the proposed algorithm fills regions faster and with lower computational cost.
基金This work was supported by the Project of Shandong Province Higher Educational Science and Technology Program[KJ2018BAN047,Geng,L.]National Natural Science Foundation of China[61801222,Fu,P.]+2 种基金Fundamental Research Funds for the Central Universities[30919011230,Fu,P.]Science and Technology Innovation Program for Distributed Young Talents of Shandong Province Higher Education Institutions[2019KJN045,Guo,Q.]Shandong Provincial Key Laboratory of Network Based Intelligent Computing[http://nbic.ujn.edu.cn/].
文摘The multispectral remote sensing image(MS-RSI)is degraded existing multi-spectral camera due to various hardware limitations.In this paper,we propose a novel core tensor dictionary learning approach with the robust modified Gaussian mixture model for MS-RSI restoration.First,the multispectral patch is modeled by three-order tensor and high-order singular value decomposition is applied to the tensor.Then the task of MS-RSI restoration is formulated as a minimum sparse core tensor estimation problem.To improve the accuracy of core tensor coding,the core tensor estimation based on the robust modified Gaussian mixture model is introduced into the proposed model by exploiting the sparse distribution prior in image.When applied to MS-RSI restoration,our experimental results have shown that the proposed algorithm can better reconstruct the sharpness of the image textures and can outperform several existing state-of-the-art multispectral image restoration methods in both subjective image quality and visual perception.
基金supported by MOST under Grant No.104-2221-E-468-007
文摘Images are generally corrupted by impulse noise during acquisition and transmission.Noise deteriorates the quality of images.To remove corruption noise,we propose a hybrid approach to restoring a random noisecorrupted image,including a block matching 3D(BM3D)method,an adaptive non-local mean(ANLM)scheme,and the K-singular value decomposition(K-SVD)algorithm.In the proposed method,we employ the morphological component analysis(MCA)to decompose an image into the texture,structure,and edge parts.Then,the BM3D method,ANLM scheme,and K-SVD algorithm are utilized to eliminate noise in the texture,structure,and edge parts of the image,respectively.Experimental results show that the proposed approach can effectively remove interference random noise in different parts;meanwhile,the deteriorated image is able to be reconstructed well.
基金Supported by the National Natural Science Foundation of China(60772066)Higher Education Commission,Pakistan
文摘A new method of back propagation learning with respect to the problem of image restoration which is named as greyscale based learning in back propagation neural networks ( BPNN) is investigated. It is observed that by using this method the value of mean square error ( MSE) decreases significantly. In addition,this method also gives good visual results when it is applied in image restoration problem. This method is also useful to tackle the inherited drawback of falling into local minima by reducing its effect on overall system by bifurcating the learning locally different for different grey scale values. The performance of this algorithm has been studied in detail with different combinations of weights. In short,this algorithm provides much better results especially when compared with the simple back propagation algorithm with any further enhancements and without going for hybrid solutions.
基金supported by the National Natural Science Foundation of China(Grant No.42075007)the Open Project of Provincial Key Laboratory for Computer Information Processing Technology under Grant KJS1935,Soochow University+1 种基金the Priority Academic Program Development of Jiangsu Higher Education InstitutionsGraduate Scientific Research Innovation Program of Jiangsu Province under Grant no.KYCX21_1015.
文摘With the development of image restoration technology based on deep learning,more complex problems are being solved,especially in image semantic inpainting based on context.Nowadays,image semantic inpainting techniques are becoming more mature.However,due to the limitations of memory,the instability of training,and the lack of sample diversity,the results of image restoration are still encountering difficult problems,such as repairing the content of glitches which cannot be well integrated with the original image.Therefore,we propose an image inpainting network based on Wasserstein generative adversarial network(WGAN)distance.With the corresponding technology having been adjusted and improved,we attempted to use the Adam algorithm to replace the traditional stochastic gradient descent,and another algorithm to optimize the training used in recent years.We evaluated our algorithm on the ImageNet dataset.We obtained high-quality restoration results,indicating that our algorithm improves the clarity and consistency of the image.
基金funding of Natural Science Foundation of Shandong Province(ZR2013F0025),www.sdnsf.gov.cn.
文摘To implement restoration in a single motion blurred image,the PSF(Point Spread Function)is difficult to estimate and the image deconvolution is ill-posed as a result that a good recovery effect cannot be obtained.Considering that several different PSFs can get joint invertibility to make restoration wellposed,we proposed a motion-blurred image restoration method based on joint invertibility of PSFs by means of computational photography.Firstly,we designed a set of observation device which composed by multiple cameras with the same parameters to shoot the moving target in the same field of view continuously to obtain the target images with the same background.The target images have the same brightness,but different exposure time and different motion blur length.It is easy to estimate the blur PSFs of the target images make use of the sequence frames obtained by one camera.According to the motion blur superposition feature of the target and its background,the complete blurred target images can be extracted from the observed images respectively.Finally,for the same target images with different PSFs,the iterative restoration is solved by joint solution of multiple images in spatial domain.The experiments showed that the moving target observation device designed by this method had lower requirements on hardware conditions,and the observed images are more convenient to use joint-PSF solution for image restoration,and the restoration results maintained details well and had lower signal noise ratio(SNR).
基金This work is supported by the National Natural Science Foundation of China nos.11971215 and 11571156,MOE-LCSMSchool of Mathematics and Statistics,Hunan Normal University,Changsha,Hunan 410081,China.
文摘Regularization methods have been substantially applied in image restoration due to the ill-posedness of the image restoration problem.Different assumptions or priors on images are applied in the construction of image regularization methods.In recent years,matrix low-rank approximation has been successfully introduced in the image denoising problem and significant denoising effects have been achieved.Low-rank matrix minimization is an NP-hard problem and it is often replaced with the matrix’s weighted nuclear norm minimization(WNNM).The assumption that an image contains an extensive amount of self-similarity is the basis for the construction of the matrix low-rank approximation-based image denoising method.In this paper,we develop a model for image restoration using the sum of block matching matrices’weighted nuclear norm to be the regularization term in the cost function.An alternating iterative algorithm is designed to solve the proposed model and the convergence analyses of the algorithm are also presented.Numerical experiments show that the proposed method can recover the images much better than the existing regularization methods in terms of both recovered quantities and visual qualities.
基金supported by the National Natural Science Foundation of China(61301095)the Chinese University Scientific Fund(HEUCF130807)the Chinese Defense Advanced Research Program of Science and Technology(10J3.1.6)
文摘The blurred image restoration method can dramatically highlight the image details and enhance the global contrast, which is of benefit to improvement of the visual effect during practical applications. This paper is based on the dark channel prior principle and aims at the prior information absent blurred image degradation situation. A lot of improvements have been made to estimate the transmission map of blurred images. Since the dark channel prior principle can effectively restore the blurred image at the cost of a large amount of computation, the total variation(TV) and image morphology transform(specifically top-hat transform and bottomhat transform) have been introduced into the improved method.Compared with original transmission map estimation methods, the proposed method features both simplicity and accuracy. The estimated transmission map together with the element can restore the image. Simulation results show that this method could inhibit the ill-posed problem during image restoration, meanwhile it can greatly improve the image quality and definition.
基金supported by the National Basic Research Program (No.2005CB321702)the National Outstanding Young Scientist Foundation(No. 10525102)the Specialized Research Grant for High Educational Doctoral Program(Nos. 20090211120011 and LZULL200909),Hong Kong RGC grants and HKBU FRGs
文摘Image restoration is often solved by minimizing an energy function consisting of a data-fidelity term and a regularization term. A regularized convex term can usually preserve the image edges well in the restored image. In this paper, we consider a class of convex and edge-preserving regularization functions, I.e., multiplicative half-quadratic regularizations, and we use the Newton method to solve the correspondingly reduced systems of nonlinear equations. At each Newton iterate, the preconditioned conjugate gradient method, incorporated with a constraint preconditioner, is employed to solve the structured Newton equation that has a symmetric positive definite coefficient matrix.The igenvalue bounds of the preconditioned matrix are deliberately derived, which can be used to estimate the convergence speed of the preconditioned conjugate gradient method. We use experimental results to demonstrate that this new approach is efficient,and the effect of image restoration is r0easonably well.
基金This work was supported by the National Natural Science Foundation of China(60204001, 60133010)the Scientific Research Fundation of Hunan Provincial Education Department(02C640)the Youth Chengguang Project of Science and Technology of Wuhan City(
文摘This paper proposes a new image restoration technique, in which the resultingregularized image approximates the optimal solution steadily. The affect of the regular-ization operator and parameter on the lower band and upper band energy of the residueof the regularized image is theoretically analyzed by employing wavelet transform. Thispaper shows that regularization operator should generally be lowstop and highpass. So thispaper chooses a lowstop and highpass operator as regularization operator, and constructan optimization model which minimizes the mean squares residue of reg ularized solutionto determine regularization parameter. Although the model is random, on the conditionof this paper, it can be solved and yields regularization parameter and regularized solu-tion. Otherwise, the technique has a mechanism to predict noise energy. So, without noiseinformation, it can also work and yield good restoration results.
基金supported by "the Twelfth Five-year Civil Aerospace Technologies Pre-Research Program"(D040201)
文摘Focusing on the degradation of foggy images, a restoration approach from a single image based on spatial correlation of dark channel prior is proposed. Firstly, the transmission of each pixel is estimated by the spatial correlation of dark channel prior. Secondly, a degradation model is utilized to restore the foggy image. Thirdly, the final recovered image, with enhanced contrast,is obtained by performing a post-processing technique based on just-noticeable difference. Experimental results demonstrate that the information of a foggy image can be recovered perfectly by the proposed method, even in the case of the abrupt depth changing scene.
文摘In this paper, we study an operator s which maps every n-by-n symmetric matrix A, to a matrix s(A_n) that minimizes || B_n-A_n || F over the set of all matrices B_n, that can be diagonalized by the sine transform. The matrix s(A_n), called the optimal sine transform preconditioner, is defined for any n-by-n symmetric matrices A_n. The cost of constructing s(A_n) is the same as that of optimal circulant preconditioner c(A_n) which is defined in [8], The s(A_n) has been proved in [6] to be a good preconditioner in solving symmetric Toeplitz systems with the preconditioned conjugate gradient (PCG) method. In this paper, we discuss the algebraic and geometric properties of the operator s, and compute its operator norms in Banach spaces of symmetric matrices. Some numerical tests and an application in image restoration are also given.
基金supported by the National Natural Science Foundation of China(No.60178017)
文摘In this paper, we present a method of ROV based image processing to restore underwater blurry images from the theory of light and image transmission in the sea. Computer is used to simulate the maximum detection range of the ROV under different water body conditions. The receiving irradiance of the video camera at different detection ranges is also calculated. The ROV’s detection performance under different water body conditions is given by simulation. We restore the underwater blurry images using the Wiener filter based on the simulation. The Wiener filter is shown to be a simple useful method for underwater image restoration in the ROV underwater experiments. We also present examples of restored images of an underwater standard target taken by the video camera in these experiments.
