Microsoft Word - cet-01.docx CHEMICAL ENGINEERING TRANSACTIONS VOL. 46, 2015 A publication of The Italian Association of Chemical Engineering Online at www.aidic.it/cet Guest Editors: Peiyu Ren, Yancang Li, Huiping Song Copyright © 2015, AIDIC Servizi S.r.l., ISBN 978-88-95608-37-2; ISSN 2283-9216 Image Quality Enhancement Model and its Application Based on PDE Feng Yuan*, Zhiping W ang School of Communication, Yangtze Normal University, Chongqing, 408100, China. yuanfeng1@yznu.cn Partial differential equations application in digital image processing is developing rapidly in recent years. The method aim to establish a mathematical model with the partial differential equation, and the model will change the image based on partial differential equation and eventually get the expected effect on the image. Through the processing method with partial differential equation, the image can get the effect unattainable by traditional method. Based on the research result both domestic and abroad, this paper mainly illustrates the establish, analysis and realization of an image enhancement model with PDE. By testing the PDE model with the real image enhancement process, the validity of this method has been verified. 1. Overview Nature can be described in mathematical language, equations is a strong tool of analyzing scientific phenomena. Human cannot get any knowledge of nature or transform the nature to a human adapted environment without the help of mathematical tool, such as partial differential equation. Partial differential equation to have a history of less than 300 years, its development is very rapid, from the partial differential equation of separation of variables method to the traveling wave method, with the advent of the computer, finite difference method arises and has been applied to many fields in recent years, Cheng Wang and Suming Zhu (2015) reported. Partial differential equation can describe a lot of physical and chemical phenomena, Pavlidis, T (2012) reported. Algorithms for graphics and image processing. Springer Science & Business Media. In recent years, as people’s constantly research and the understanding of partial differential equations arises, partial differential equation is also gradually applied to the field of digital image. And its application in the field of digital image enhancing also emerges. 2. The establishment of the partial differential equation The establishment process of Partial differential equation model can be generally concluded as follows: (1) W ork out the target energy functional. (2) Solve the functional extremum problems. With Eluer formula, transform the functional extremum problem into solving a partial differential equation. (3) Evolve curve and surface to according to the solution of partial differential equations, finite difference method and programming will be needed in the process of solving partial differential equation. (4) Observe and analysis of the research results, modify models such as morbid equation which must be regularized. 2.1 Catte model of image enhancement Among all the PDE models, the man-made structure of energy function and model established based on this function have a large proportion. Its main point is to construct an energy function, through minimize the energy functional of the structure, the researchers can achieve the purpose of realization of digital image processing such as image enhancement. The partial differential equation derived from the minimize energy function with variational method is the core of the digital image processing. The PDE model described in this article are all man-made structure of an energy functional model which was confirmed (Demirel, H. and Anbarjafari, G. (2011)). DOI: 10.3303/CET1546056 Please cite this article as: Yuan F., Wang Z.P., 2015, Image quality enhancement model and its application based on pde, Chemical Engineering Transactions, 46, 331-336 DOI:10.3303/CET1546056 331 Catte F, Lions and Morel put forward a kind of anisotropic diffusion model, the model use ( ) g u ,   u G u as diffusion coefficient, to reduce the noise caused by the estimated error. The improved Catte diffusion model is as follows: ( ( ) )        u div g G u u t (1) 0 ( , , 0) ( , )u x y u x y (2) Which  G is Gaussian kernel function, 2 2 4 1 4      x y G e ,  G u means the gradient of image with scale of  , ( , , 0)u x y is the original image, Celik, T., & Tjahjadi, T (2012) reported. In the model, the gradient u is calculating with diffusion coefficient which get from the Gaussian filter convolution image. Dispersion coefficient  G u prevents the excessive proliferation in border, effectively solve the well-posedness of the problems in the equations. The model’s success depends on the choice of an appropriate value for the regularization parameter, but how to select an accurate Gaussian kernel scale  is a problem, if  is too small, the result can be inaccurate estimates, the model will get more spread diffusion than before, if  large will lead to a smooth too fast. 2.2 Other PDE model of image enhancement Image after Catte model filter and enhanced, highly easy to loss on the edge of the detail, which make the image lost peak shape edge features and the edge of the model become too narrow. Therefore, Lin Zhouchen, Shi Qingyun proposed a denoising model which keep the reality of anisotropic diffusion model, advocately using 2 2 2     xx yy u u u to replace u in Catte model, the PDE equation is as follows: 2 2 2 ( ( ( ) ( ) ) )             xx yy u div g G u G u G u u t (3) 0 ( , , 0) ( , )u x y u x y (4) The equations above use the second degree derivative, compared with Catte m odel, the model spread quickly on a flat area, and enhance the image at the border or edge, especially reserves the weak boundary. But this model is only suitable for the removal of uniform distribution of noise and Gaussian noise which is not too strong, model operator is quite reserve on the edge of the peak shape, if the Gaussian noise is very strong, certain isolated point may be caused on the processed image. Domestic scholars Liu Gui -Lan argues that replace the classic anisotropic diffusion coefficient with diffusion tensor, this method is same as the PDE model above, both of these two method will achieve the same effect. 3. The PDE model in image enhancement 3.1 Conversion Function in the Process of Image Enhancement Assume the original image is ( , ) A I x y , the enhanced image is ( , ) B I x y , image conversion function is ( )f D . Easy to know function ( )f D monotonous, original image grey scale set to A D , after the ( )f D enhanced image grey scale is B D . A D is in the range of min max [ , ] A A D D , B D is in the range of 332 min max [ , ] B B D D . ( ) A A h D represents the original image grey scale A D for the number of pixels to account for the proportion of the total number of pixels, ( ) B B h D represents the original image grey scale B D for the number of pixels to account for the proportion of the total number of pixels. From the map, the grey scale of the original image ( , ) A I x y falls in the set of [ , ] A A A D D D equal to the number of enhanced image grey scale set [ , ] B B B D D D , then the following equation is valid: ( ) ( )   A A A B B B h D D h D D (5) The equation above is the main idea of cumulative frequency conversion function in image enhancement. According to ( )    B A D f D D , we can get the equation as follow: ( ) ( ) ( )  A A B B h D f D h D (6) Based on the Newton-Leibniz formula, we can get: min min ( ) ( ) ( )     A D A B D B h f D d D h (7) The enhanced image ( , )I x y ’s grey scale is uniform distributed among the set of min max [ , ]D D , then: max min 1 ( )   B B B h D D D (8) The transformation function is as follow when combined the above two equation: min max min min ( ) ( ) ( )     A D b b A b D f D D D h d D (9) Thus the image enhancement of cumulative frequency transition function is the equation above with the agreed restriction: min ( ) ( )    A D A A D H D h d (10) 3.2 The piecewise linear stretch histogram equalization method The main idea of the piecewise linear stretch histogram equalization method is to divide the original image grey scale to none even N sections. The dividing principle is satisfy when within each segment  n the sum of the histogram equals to: 1 ( ) , 1, ,    ni h i n N N (11) The enhanced image grey scales will be evenly divided into N sections, then paits the starting point and end point of every grey scale sections to get the corresponding conversion function of each section, Hammo nd, D. K et al (2011) reported. 3.3 The PDE method of Image Enhancement For the gray scale image, image enhancement is gray scale image contrast enhancement. Traditional digital image processing method includes cumulative frequency transition function method and the piecewise linear stretch histogram equalization method. Only on the ground of im age enhancement, the PDE method and cumulative frequency transition function methods get the same conclusion. However, the PDE method used in image enhancement also realize the image denoising at the same time. This is the advantage of PDE method which was confirmed (Demirel, H. and Anbarjafari, G. (2011)). Image enhancement of the PDE method need to minimize the energy functional: 333 2 max 1 ( , ) 1 1 ( ) ( , ) ( , ) 2 2 4            d I x y E I dxdy I x y I u v dxdydudv D (12) The aim of minimize ( )E I is to minimize the first term and maximize the second term, Arosio, L., et al(2013) reported. Then purpose of minimize the first term is to make the overall grey scale after the enhancement equals max 2 b D , the purpose of maximize the second term is to increase the contrast after the enhancement compared to the original image. Both of the two process have the effect to enhance the image quality. According to equation (9) and (10), the energy functional gradient descent flow of minimized equation (12) is as follows: max ( , , ) ( , , ) [1 ] ( ( , , ))       b I x y t I x y t A A I x y t t D (13)  A is the total number of image pixels, ( ( , , ))A I x y t is the number of grey scales which bigger than ( , , )I x y t . When stablizied, the left side of equation (13) equals to 0, then: max max ( ) ( , , ) ( ( ))      b b A A I I x y D D H I A (14) Assume min 0 b D , the equation (14) is same as equation (9), thus the PDE method have the same result to the image enhancement method with the cumulative frequency and conversion function. But that doe sn't mean the PDE method has no actual meaning, this will elaborate later. Then the equation (13) change to: max min min ( , , ) [( ) ( ( , , )) ] ( , , )       b b I x y t D D H I x y t D I x y t t (15) Among equation (15), max min min [( ) ( ( , , )) ]  b b D D H I x y t D is the image enhanced with the cumulative frequency for conversion function method, equation (15) can be summerized as: ( , , ) ( ( , , )) ( , , )     I x y t f I x y t I x y t t (16) ( ( , , )f I x y t represents the user specified grey scale transformation function. An simple analysis of the equation (16) shows, that when (.)f is bigger than ( , , )I x y t , the ( , , )I x y t will increase, when (.)f is smaller than ( , , )I x y t , the ( , , )I x y t will decrease, that’s to say, the ( , , )I x y t will “follow” the change of ( ( , , ))f I x y t , and finally equals to ( ( , , ))f I x y t . The advantage of PDE method is the noise removal along with the image quality enhancement, which shown as follows: ( , , ) ( ) [ ( ( , , )) ( , , )]         I x y t I div f I x y t I x y t t I (17) On the gradient descent flow of equation (17) can enhance the image quality, but also de -noising the image, selection of parameters  will balance the image de-noising and image enhancement. Traditional image 334 enhancement method enhance the image quality after denoising or before it. The enhancement of image quality before the image de-noising will increase the noise of the image, making the latter de-nosing ineffective. The enhancement of image quality before the image de-noising hardly can protect the weak edge or boarder of the image, the original weak edge or boarder will not be enhanced effectively. Thus both of the traditional methods of image enhancement can't achieve the result of the PDE method. Here again to see the advantages of the proposed PDE image quality enhancement method. 4. The application of image quality enhancement with PDE model The reason of the image blur is because of the mean integral operation. In addition, the convolution of fu zzy kernel function will make the image look more blurrer, such as Gaussian voncolution kernels. Then the deconvolution or inverse operation such as differential, can make the image clear. In the traditional method of image sharpening, Laplace operator will sharpening the image. In fact, this method is equivalent to isotropic reverse diffusion equation. Koenderink and Perona introduce the linear and nonlinear diffusion equation in the digital image processing, Koenderink illustrates the initial image 0 ( , )u x y convolution with Gaussian filter in different scales, the result is equivalent to the thermal diffusion equation with a constant conduction coefficient, for two-dimensional image, the filtering process can be expressed as the follow: 2 2 2 2         u u u t x y (18) The Gaussian filter variance is proportional to the time solution of the equation. Due to the thermal diffusion equation of heat conduction coefficient is constant, the diffusion is isotropic diffusion. In 1990, Perona an d Malik announced the anisotropic diffusion smoothing, the partial differential equation of anisotropic smoothing is: [ ( ). ]      u div c u u t (19) Above which div is the divergence operator, u is the image gradient, c is diffusion coefficient, usually adopt 2 ( ) exp( ( / ) )   c u u k , k is the gradient threshold. Observe the above equation (18) and (19), and change the spread symbol of the two equation, the anti-diffusion equation can be shown as follows: 2 2 2 2 ( )         u u u t x y (20) [ ( ). ]       u div c u u t (21) Figure 1: Original Lucy Image Figure 2: Enhanced Lucy Image Figure 3: Enhanced Lucy Image with with histogram equalization method PDE Equation Method The progress of image forward diffusion is equivalent to the Gaussian kernel convolution process, and the backward diffusion process is equivalent to the anti-convolution process. Reverse diffusion process also play an important role in other aspects of image processing. It is worth noting that the image can be sharpened only if the image has high signal-to-noise ratio, or else the sharpened image will have a low signal-to-noise ratio, the reason is after sharpening the noise increased greatly compare to the signal. Figure 1 of Lucy is the original image, Figure 2 is the enhanced image of Lucy after the use of histogram equalization method. Figure 3 is the enhanced image of Lucy with the use of PDE equation method proposed in this paper. It’s obviously that the image quality after enhancement have a better edge details and overall quality. 335 Reference Arosio, L., Bracci, F., & Wold, E. F. 2013. Solving the Loewner PDE in complete hyperbolic starlike domains of CN. Advances in Mathematics, 242, 209-216. DOI:10.1016/j.aim.2013.02.024 Celik, T., & Tjahjadi, T. 2012. Automatic image equalization and contrast enhancement using Gaussian mixture modeling. Image Processing, IEEE Transactions on, 21(1), 145-156. DOI:10.1109/TIP.2011.2162419. Demirel, H., & Anbarjafari, G. 2011. Discrete wavelet transform -based satellite image resolution enhancement. Geoscience and Remote Sensing, IEEE Transactions on, 49(6), 1997-2004. DOI:10.1109/TGRS.2010.2100401 Demirel, H., & Anbarjafari, G. 2011. Image resolution enhancement by using discrete and stationary wavelet decomposition. Image Processing, IEEE Transactions on, 20(5), 1458-1460. DOI:10.1109/TIP.2010.2087767 Fiedler, B., Grotta-Ragazzo, C., & Rocha, C. 2014. An explicit Lyapunov function for reflection symmetric parabolic partial differential equations on the circle. Russian Mathematical Surveys, 69(3), 419. doi:10.1070/RM2014v069n03ABEH004897 Funaki, T., & Woyczynski, W. (Eds.) 2012. Nonlinear Stochastic PDEs: Hydrodynamic Limit and Burgers’ Turbulence (Vol. 77). Springer Science & Business Media. Hammond, D. K., Vandergheynst, P., & Gribonval, R. 2011. Wavelets on graphs via spectral graph theory. Applied and Computational Harmonic Analysis, 30(2), 129-150. DOI:10.1016/j.acha.2010.04.005 Hou, Y. C., & Peng, W. 2014. Distance between uncertain random variables. Mathematical Modelling and Engineering Problems, 1(1), 15-20. DOI: 10.18280/mmep.010104 Jiao, L. C., Yang, S. Y., Liu, F., & Hou, B. 2011. Development and prospect of compressive sensing. Dianzi Xuebao(Acta Electronica Sinica), 39(7), 1651-1662. Mian, D., Gang, S. Y., Qiang, H. Y., & Wei, X. T. 2014. Modeling and Simulation Research of Active Heave Compensation System. Review of Computer Engineer Studies. 1(2), 15-18. DOI: 10.18280/rces.010204 Nam, S., Davies, M. E., Elad, M., & Gribonval, R. 2013. The cosparse analysis model and algorithms. Applied and Computational Harmonic Analysis, 34(1), 30-56. DOI:10.1016/j.acha.2012.03.006. Paulinas, M., & Ušinskas, A. 2015. A survey of genetic algorithms applications for image enhancement and segmentation. Information Technology and control, 36(3). Pavlidis, T. 2012. Algorithms for graphics and image processing. Springer Sc ience & Business Media. DOI: 10.1007/978-3-642-93208-3 Peter, P., Schmaltz, C., Mach, N., Mainberger, M., & Weickert, J. 2015. Beyond pure quality: Progressive modes, region of interest coding, and real time video decoding for PDE-based image compression. Journal of Visual Communication and Image Representation, 31, 253-265. DOI:10.1016/j.jvcir.2015.06.017 Sangwine, S. J., & Horne, R. E. (Eds.). 2012. The colour image processing handbook. Springer Science & Business Media. DOI: 10.1007-978-1-4615-5779-1 Wang, C. & Zhu, S. M. 2015. A Design of FPGA-Based System for Image Processing. Review of Computer Engineering Studies. 2(1), 25-30. DOI: 10.18280/rces.020104. 336 http://dx.doi.org/10.1016/j.aim.2013.02.024 http://dx.doi.org/10.1109/TIP.2011.2162419 http://www.iieta.org/sites/default/files/Journals/RCES/Vol1_No2_2014/01.2_04.pdf http://www.iieta.org/sites/default/files/Journals/RCES/Vol1_No2_2014/01.2_04.pdf http://dx.doi.org/10.1016/j.jvcir.2015.06.017 http://www.iieta.org/sites/default/files/Journals/RCES/Vol2_No1_2015/02.1_04.pdf http://www.iieta.org/sites/default/files/Journals/RCES/Vol2_No1_2015/02.1_04.pdf