J. Vis. Commun. Image R.: Feng Liu, Jingbo Liu
J. Vis. Commun. Image R.: Feng Liu, Jingbo Liu
J. Vis. Commun. Image R.: Feng Liu, Jingbo Liu
23 (2012) 516–521
a r t i c l e i n f o a b s t r a c t
Article history: In this paper, the anisotropic diffusion for image denoising is considered. A new method to construct dif-
Received 12 July 2010 fusion tensors is proposed. The tensors obtained by our approach depend on four directional derivatives
Accepted 17 January 2012 of the intensity of an image, and hence they are adaptively determined by local image structure. It is
Available online 30 January 2012
shown that the proposed diffusion filter is isotropic in the interior of a region, whereas it is anisotropic
at edges. This property of tensors allows us to efficiently remove noise in an image, particularly noise at
Keywords: edges. Several numerical experiments are conducted on both synthetic and real images.
Image denoising
Ó 2012 Elsevier Inc. All rights reserved.
Anisotropic diffusion
Nonlinear diffusion
Diffusion tensor
Diffusion filter
Diffusion direction
Diffusion amount
Multi-scale method
1047-3203/$ - see front matter Ó 2012 Elsevier Inc. All rights reserved.
doi:10.1016/j.jvcir.2012.01.012
F. Liu, J. Liu / J. Vis. Commun. Image R. 23 (2012) 516–521 517
D(ux, uy) specified by (8). ¼ dþnl g jdnl uki;j j dnl uki;j ; for 1 6 i 6 M; 16j
s l¼1
It is easy to show that the eigenvalues of D (ux, uy) are given by
6 N; k P 0:
qffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffi
A þ E þ 2C 1
lk ¼ ðA EÞ2 þ 4B2 ; k ¼ 1; 2: ð11Þ That is
4 4
X
4
ð12Þ kþ1
n1 ¼ n2 ; n2 ¼ n1 ; otherwise: ui;j ¼ uki;j þ s g kl;ði;jÞþml ukði;jÞþml g kl;ði;jÞþml þ g kl;i;j uki;j þ g kl;i;j ukði;jÞml :
l¼1
If B – 0, then ð15Þ
pffiffiffiffiffiffiffiffiffiffiffiffiffiffi
n1 ¼ ða þ signðBÞ 1 þ a2 ; 1Þ; By the theory of finite difference, the scheme (15) requires small
pffiffiffiffiffiffiffiffiffiffiffiffiffiffi time step s in order to be stable (see [2] for more details).
n2 ¼ ð1; a signðBÞ 1 þ a2 Þ; ð13Þ
4.2. Property of anisotropic diffusion model
where a = (E A)/(2B).
Let the image uki;j ð1 6 i 6 M; 1 6 j 6 NÞ for any fixed k P 0 be
Property 1. (i) hn1, n2 i = 0; (ii) l1 = l2 if and only if r u = 0; (iii)
extended by reflecting boundary. Then uk0;j ¼ uk1;j ; ukMþ1;j ¼ ukM;j ;
l1 > l2 if and only if ru – 0.
uki;0 ¼ uki;1 and uki;Nþ1 ¼ uki;N for all i, j and k P 0. Using (15), we can
Property (i) indicates that n1 and n2 are mutually orthogonal, get, for all k P 0
which is important for achieving anisotropic diffusion. Property
1 X M X N
1 X M
s X M X N
(ii) and (iii) show that the filter (9) is isotropic at points belonging ukþ1
i;j ¼ uki;j þ
M N i¼1 j¼1 M N i¼1 M N i¼1 j¼1
to a homogeneous region, but it is anisotropic at edges as expected.
For the anisotropic diffusion at edges, we need to further dis- 4
X
cuss the relations between the eigenvectors and ru so as to under- g kl;ði;jÞþml ukði;jÞþml g kl;i;j uki;j
stand the diffusion filter behavior. By the (iii) and (11), ru – 0 if l¼1
following results. þ
MN i¼1 j¼1
2 2 4
X
Noting that 0 < g kl;i;j 6 1, it is easy to show that if s < 1/8, then
Eq. (17) indicates that the explicit scheme (15) obeys the maxi-
mum–minimum principle when s < 1/8. This property forbids un-
der-and overshoots in diffusion filtering. It also ensures that iso-
intensity linking toward the original image is possible.
5. Experimental results
Fig. 2. Filtered results for the synthetic image: (a) original image; (b) noisy image, 5.1. Synthetic image
r = 50, PSNR = 14.17 dB; (c) result of using the C-model, PSNR = 30.15 dB; (d) result
of using the TDM, PSNR = 34.79 dB.
We first test the TDM (10) on a synthetic image to illustrate the
effectiveness of the diffusion filtering at edges. The clear image
Table 1 consists of a triangle and a rectangle, as shown in Fig. 2(a). The
PSNR (dB) of the smoothed images by using the C-model and the proposed model, noisy data (see Fig. 2(b)) is generated from the clear image by add-
where r presents the standard variance of the Gaussian noises, CM and TDM denotes ing an addition Gaussian white noise with zero-mean and standard
the C-model and the proposed model, respectively.
variance r = 50. Fig. 2(c) and (d) depict the denoised results which
r Lena Boat have the largest peak signal-to-noise ratio (PSNR) (in dB). The PSNR
CM TDM CM TDM is defined by
50 25.01 25.15 23.83 24.04
30 26.75 27.29 25.80 26.16 2552
PSNR ¼ 10log10 P ; ð18Þ
25 27.43 28.10 26.29 26.89 j2 =ðM NÞ
ju u
20 28.33 29.14 27.44 27.84
15 29.62 30.53 28.50 29.13 denote the clear image and the denoised image,
where u and u
10 31.72 32.65 30.83 31.16
respectively.
We observe that the C-model performs well in the interior of re-
4
gions, but fails to efficiently remove noise at edges. The TDM yields
X
ukþ1 ¼s g kl;ði;jÞþml ukði;jÞþml þ g kl;i;j ukði;jÞml better smoothing results for this example. An improvement in the
i;j
l¼1 result can be perceived by observing the restoration of the edges of
!
4
X
the triangle and rectangle. In addition, the background of Fig. 2(c)
þ 1s g kl;ði;jÞþml þ g kl;i;j uki;j : is slight darker than Fig. 2(d) (in version). This indicates that
l¼1 Fig. 2(c) includes more remained noise.
Fig. 3. Comparisons between the C-model and TDM: (a) result for Lena picture; (b) result for Boat picture.
520 F. Liu, J. Liu / J. Vis. Commun. Image R. 23 (2012) 516–521
6. Conclusions
Appendix A
Let ux > 0 and h = argru. By the monotonicity of g(s) and [10] Y.L. You, W.Y. Xu, A. Tannenbaum, M. Kaveh, Behavioral analysis of anisotropic
diffusion in image processing, IEEE Trans. Image Process. 5 (11) (1996) 1539–
EA gðjuy jÞ gðjux jÞ 1553.
a¼ ¼ ; [11] M.J. Black, G. Sapiro, D.H. Marimont, D. Heeger, Robust anisotropic diffusion,
2B gðj@u=@n3 Þ gðj@u=@n4 jÞ
IEEE Trans. Image Process. 7 (3) (1998) 1539–1553.
[12] T.F. Chan, H.M. Zhou, Total variation improved wavelet thresholding in image
we have the following results, as shown in Fig. 6,
compression, in: Proceedings Seventh International Conference on Image
8 Processing, vol. 2, 2000, pp. 391–394.
> h 2 ðp=4; 0Þ if B > 0 and a > 0;
>
> [13] P. Mrazek, J. Weickert, G. Steidl, Correspondences between wavelet shrinkage
< h 2 ðp=2; p=4Þ if B > 0 and a < 0; and nonlinear diffusion, in: L.D. Griffin, M. Lillholm (Eds.), Scale-Space, LNCS
2695, Springer-Verlag, Berlin, 2003, pp. 101–116.
>
> h 2 ð0; p=4Þ if B < 0 and a < 0;
>
: [14] D.L. Donoho, De-noising by soft-thresholding, IEEE Trans. Inform. Theory. 41
h 2 ðp=4; p=2Þ if B < 0 and a > 0: (3) (1995) 613–627.
[15] D.L. Donoho, I.M. Johnstone, Ideal spatial adaptation via wavelet, shrinkage,
Therefore j/(ru, n2)j < p/4. Similarly, we can verify that j/(ru, Biometrika 81 (1994) 425–455.
[16] M. Nitzberg, T. Shiota, Nonlinear image filtering with edge and corner
n2)j < p/4 when ux < 0. The proof of property 2 is completed. h
enhancement, IEEE Trans. PAMI 14 (1992) 826–833.
[17] J. Weickert, Theoretical foundations of anisotropic diffusion in image
processing, Comput. Suppl. 11 (1996) 221–236.
References [18] U. Clarenz, U. Diewald, M. Rumpf, Processing textured surfaces via anisotropic
geometric diffusion, IEEE Trans. Image Process. 13 (2) (2004) 248–261.
[1] P. Perona, J. Malik, Scale-space and edge detection using anisotropic diffusion, [19] L. Alvarez, P.L. Lions, J.M. Morel, Image selective smoothing and edge detection
IEEE Trans. PAMI 12 (7) (1990) 629–639. by nonlinear diffusion II, SIAM J. Numer. Anal. 29 (3) (1992) 845–866.
[2] G. Aubert, P. Kornprobst, Mathematical Problems in Image Processing: Partial [20] F. Malgouyres, Combining total variation and wavelet packet approaches for
Differential Equations and the Calculus of Variations, Springer, New York, 2002. image debluring, in: Proceedings IEEE Workshop, 2001, pp. 57–64.
[3] L. Alvarez, F. Guichard, P.L. Lions, J.M. Morel, Axioms and fundamental [21] M. Lysaker, A. Lundervold, X.C. Tai, Noise removal using fourth-order partial
equations of image processing, Arch. Ration. Mech. 123 (1993) 200–257. differential equation with applications to medical magnetic resonance images
[4] J. Weickert, Nonlinear diffusion scale-spaces: From the continuous to discrete in space and time, IEEE Trans. Image Process. 12 (12) (2003) 1579–1590.
setting, in: M.O. Berger et al. (Eds.), Proceedings ICAOS’96: Images, Wavelets [22] S. Osher, L.I. Rudin, Feature-oriented image enhancement using shock filters,
and PDE’s 219, Springer, New York, 1996, pp. 111–118. SIAM J. Numer. Anal. 27 (4) (1990) 919–940.
[5] L.I. Rudin, S.Osher.E. Fatemi, Nonlinear total variation based noise removal [23] G. Gilboa, N. Sochen, Y.Y. Zeevi, Forward and backward diffusion processes for
algorithms, Physics D 60 (1992) 259–268. adaptive image enhancement and denoising, IEEE Trans. PAMI 11 (7) (2002)
[6] F. Catté, P.L. Lions, J.M. Morel, T. Coll, Image selective smoothing and edge 689–703.
detection by nonlinear diffusion, SIAM J. Numer. Anal. 29 (1992) 182–193. [24] Y. Wang, L.P. Zhang, P.X. Li, Local variance-controlled forward-and-backward
[7] G. Gilboa, N. Sochen, Y.Y. Zeevi, Image enhancement and denoising by complex diffusion for image enhancement and noise reduction, IEEE Trans. Image
diffusion processes, IEEE Trans. PAMI 26 (8) (2004) 1020–1036. Process. 16 (7) (2007) 1854–1864.
[8] J. Weickert, Anisotropic diffusion in image processing, Stuttgart, Teubner, [25] Y. Yue, M.M. Croitoru, A. Bidani, et al., Nonlinear multiscale wavelet diffusion
Germany, 1998. for speckle suppression and edge enhancement in ultrasound images, IEEE
[9] J. Weickert, Efficient and reliable schemes for nonlinear diffusion filtering, IEEE Trans. Medical Imag. 25 (3) (2006) 297–311.
Trans. Image Process. 7 (3) (1998) 398–410.