30343
30343
30343
https://ebookultra.com
https://ebookultra.com/download/beyond-
wavelets-1st-edition-grant-welland/
https://ebookultra.com/download/wavelets-and-multiwavelets-1st-
edition-fritz-keinert/
ebookultra.com
https://ebookultra.com/download/a-friendly-guide-to-wavelets-1st-
edition-gerald-kaiser-auth/
ebookultra.com
https://ebookultra.com/download/discrete-fourier-analysis-and-
wavelets-2ed-edition-broughton-s-a/
ebookultra.com
https://ebookultra.com/download/square%c2%b3-mira-grant/
ebookultra.com
Plant Speciation Verne Grant
https://ebookultra.com/download/plant-speciation-verne-grant/
ebookultra.com
https://ebookultra.com/download/parry-and-grant-encyclopaedic-
dictionary-of-international-law-3rd-edition-john-p-grant/
ebookultra.com
https://ebookultra.com/download/fundamentals-of-wavelets-theory-
algorithms-and-applications-2ed-edition-goswami-j/
ebookultra.com
https://ebookultra.com/download/mapping-the-posthuman-1st-edition-
grant-hamilton/
ebookultra.com
https://ebookultra.com/download/world-war-ii-reg-grant/
ebookultra.com
Beyond Wavelets 1st Edition Grant Welland Digital
Instant Download
Author(s): Grant Welland
ISBN(s): 9781435631991, 1435631994
Edition: 1
File Details: PDF, 14.30 MB
Year: 2003
Language: english
BEYOND WAVELETS
BEYOND WAVELETS
Gran t V. WELLAND
University of Missouri - St. Louis
Department of Mathematicsand Computer Science
St.Louis, USA
ACADEMIC PRESS
An imprint of Elsevier Science
2003
Amsterdam - Boston - Heidelberg - London - New York - Oxford - Paris
San Diego - San Francisco - Singapore - Sydney - Tokyo
STUDIES IN
COMPUTATIONA
L MATHEMATIC
S 10
Editors:
C.K. CHUI
StanfordUniversity
Stanford, CA,USA
P. MONK
University of Delaware
Newark. DE. USA
L. WUYTACK
University of Antwerp
Antwerp, Belgium
ACADEMI
C PRESS
An imprint of Elsevier Science
2003
Amsterdam - Boston - Heidelberg - London - New York - Oxford - Paris
San Diego - San Francisco - Singapore - Sydney - Tokyo
ELSEVIER SCIENCE Inc.
360 Park Avenu e South
New York, NY 10010-1710. USA
This work is protecte d unde r copyrigh t by Elsevier Science, and the followin g terms and condition s appl y to its use:
Photocopyin g
Single photocopie s of single chapter s may be made for persona l use as allowed by national copyrigh t laws. Permission
of the Publishe r and paymen t of a fee is require d for all other photocopying , includin g multipl e or systematic copying ,
copyin g for advertisin g or promotiona l purposes , resale, and all forms of documen t delivery . Special rates are availabl e
for educationa l institution s that wish to make photocopie s for non-profi t educationa l classroom use.
Permission s may be sough t directl y from Elsevier’ s Science & Technolog y Rights Departmen t in Oxford, UK: phone :
(+44) 1865 843830, fax: (+44) 1865 853333, e-mail: [email protected] . You may also complet e your reques t
on-lin e via the Elsevier Science homepag e (http://www.elsevier.com) , by selecting ’Custome r Support ’ and then
’Obtainin g Permissions’ .
In the USA, users may clear permission s and make payment s throug h the Copyrigh t Clearanc e Center , Inc., 222
Rosewood Drive, Danvers , MA 01923, USA; phone : (978) 7508400, fax: (978) 7504744, and in the UK throug h the
Copyrigh t Licensin g Agency Rapid Clearanc e Service (CLARCS), 90 Tottenham Court Road, London WIP OLP, UK;
phone : (+44) 207 631 5555; fax: (+44) 207 631 5500. Other countrie s may hav e a local reprographi c rights agency for
payments .
Derivativ e Works
Tables of content s may be reproduce d for interna l circulation , but permissio n of Elsevier Science is require d for external
resale or distributio n of such material .
Permission of the Publishe r is require d for all other derivativ e works , includin g compilation s and translations .
Except as outline d above , no part of this work may be reproduced , stored in aretrieval system or transmitte d in any form
or by any means , electronic , mechanical , photocopying , recordin g or otherwise , withou t prior written permissio n of the
Publisher .
Addres s permission s request s to: Elsevier’ s Science & Technolog y Rights Department , at the phone , fax and e-mail
addresse s noted above .
Notice
No responsibility is assume d by the Publishe r for any injur y and/or damage to person s or propert y as a matter of
product s liability, negligenc e or otherwise , or from any use or operatio n of any methods , products , instruction s or ideas
containe d in the material herein . Because of rapid advance s in the medica l sciences , in particular , independen t
verificatio n of diagnose s and dru g dosages shoul d be made.
Academi c Press
An Elsevier Science Imprint
525 B Street, Suite 1900, San Diego, CaHfomia 92101-4495, USA
http://www.academicpress.co m
ISBN: 0 1 2 743273 6
ISSN: 1570 579 X (Series)
' The paper used in this publicatio n meets the requirement s of ANSI/NISO Z3 9.48-1992 (Permanenc e of Paper).
Printed in The Netherlands .
PREFACE
The themes of classical wavelets include terms such as compression and effi›
cient representation. Important features which play a role in analysis of functions
in two variables are dilation, translation, spatial and frequency localization and
singularity orientation. Singularities of functions in more than one variable vary in
dimensionality. Important singularities in one dimension are simply points. In two
dimensions zero and one dimensional singularities are important. A smooth singu›
larity in two dimensions may be a one dimensional smooth manifold. Smooth sin›
gularities in two dimensional images often occur as boundaries of physical objects.
Efficient representation in two dimensions is a hard problem and is addressed in
the first six chapters. The next two chapters return to problems of one dimen›
sion where new important results are given. The final two chapters represent a
transition from harmonic analysis to statistical methods and filtering theory but
the goals remain consistent with those of earlier chapters. We have chosen to
title "Beyond Wavelets". We could have used the title, "Pursuing the Promise of
Wavelets". We briefly describe each chapter.
The lead chapter, "Digital Ridgelet Transform based on True Ridge Functions"
by David Donoho and Georgina Flesia addresses the problem of analyzing the
structure of a function of two real variables. It extends work of Donoho and an
associated group of co-workers. Special credit is due to Emmanuel Candes. Donoho
and Candes have constructed a system called curvelets which gives high-quality
asymptotic approximation of singularities. Passage from their continuum study
to one appropriate for applications requires development of digital algorithms to
implement concepts of the continuum study faithfully. A less obvious proposal
than a standard tensor product basis was made earlier by Donoho emphasizing
"wide-sense" ridgelets with localization properties in radial and angular frequency
domains. Wide-sense ridgelets are no longer of strict ridge form but allow the
possibility of an orthonormal set of elements. The theory is related to that of
the Radon transform and to rotation and scaling of images. At the continuum
level these are natural but for digital data issues are problematic. In this chapter a
definiton of digital ridgelet transform is given. The digital transform has structural
relationships strongly analogous to those of the continuum case. The transform
takes a n-by-n array of data in Cartesian coordinates and expands it by a factor
of 4 in creating a coefficient array. This leaves room for further improvements.
VI
that begin s with an artificial stochastic process , the spike process , from which
they obtain theorem s which give precis e condition s on the sparsit y and statistical
independenc e criteri a to select the same basis for the spike process .
S. Akkarakaran and P.P. Vaidyanatha n provid e a new directio n from previou s
work in Chapter 10. Standard filter banks fall unde r the theor y of design and uni›
form filter banks. A nonunifor m filter bank is one whose channe l decimatio n rates
need not all be equal . Most nonunifor m filter bank design s resul t in approximatio n
or near-perfec t reconstructio n which leaves open theoretica l issues for nonunifor m
filter banks. Their stud y is restricte d to filter banks with integer decimatio n rates.
A set, S, of integer s satisfies maximal decimatio n if the reciprocal s of the inte›
gers sum to unity. They only stud y filter banks with integer decimatio n rates.
Their stud y searche s for necessar y and sufficien t condition s on S for existence of
a perfect-reconstructio n filter bank belongin g to some class which uses S as its set
of decimators . They presen t examples with condition s which are either sufficien t
or necessar y but unfortunatel y different . They focus on rational filter banks and
strengthe n known necessar y condition s providin g an importan t step to solvin g the
problem . However , the basic proble m remain s unresolved . Necessary and sufficien t
condition s remai n unknown . Thus they open an importan t proble m and provid e
insigh t toward solvin g it.
This volum e is a produc t which was conceive d durin g a conferenc e funde d
by the National Science Foundatio n and the Conferenc e Board of Mathematical
Sciences at which David Donoho was the principa l speaker in May of 2000 at the
Universit y of Missouri - St. Louis. The title "Beyond Wavelets" is due to David
Donoho. I thank the NSF and the Universit y of Missouri - St. Louis and the suppor t
staff of the Mathematics Departmen t there . A very special thank s is extended to
David Donoho for his continue d suppor t and understanding .
Many contribute d to the success of that conferenc e and to the origina l idea to
develo p "Beyond Wavelets". I give thanks to Charles Chui, Raphy Coiftnan, Ingrid
Daubechies , and Joachim Stockier and Shiying Zhao. I thank the contributor s to
the volum e both for their efforts and understanding . I take responsibilit y for the
delays encountere d and beg your forgiveness . Many more deserv e to be mentione d
to whom I extend my thank s anonymously .
Grant Welland
St. Louis, MO
February , 2003.
CONTENTS
V Preface v
1 Digital Ridgele t TVansfor m
base d on Tru e Ridg e Function s
IX
X CONTENTS
4 Contourlet s
M. N. Do and M. Vetterli 83
4.1 Introduction and Motivation 83
4.2 Representing 2-D Piecewise Smooth Functions 85
4.2.1 Curvelet construction 85
4.2.2 Non-linear approximation behaviors 85
4.2.3 A filter bank approach for sparse image expansions 87
4.3 Pyramidal Directional Filter Bank 89
4.3.1 Multiscale decomposition 89
4.3.2 Directional decomposition 90
4.3.3 Multiscale and directional decomposition 91
4.3.4 PDFB for curvelets 93
4.4 Multiresolution Analysis 93
4.4.1 Multiscale 94
4.4.2 Multiple Directions 95
4.4.3 Multiscale and multidirection 98
4.5 Numerical Experiments 100
4.6 Conclusion 104
Reference s 104
5 ENO-wavelet Transform s
£Uid Some Application s
A b s t r a ct
We study a notion of ridgelet transform for arrays of digital data in which
the analysis operator uses true ridge functions, as does the synthesis oper›
ator. There are fast algorithms for analysis, for synthesis, and for partial
reconstruction. Associated with this is a transform which is a digital analog
of the orthonormal ridgelet transform (but not orthonormal for finite n). In
either approach, we get an overcomplete frame; the result of ridgelet trans›
forming an n X n array is a 2n x 2n array. The analysis operator is invertible
on its range; the appropriately preconditioned operator has a tightly con›
trolled spread of singular values. There is a near-parseval relationship.
Our construction exploits the recent development by Averbuch et al.
(2001) of the Fast Slant Stack, a Radon transform for digital image data;
it may be viewed as following a Fast Slant Stack with fast 2-d wavelet
transform. A consequence of this construction is that it offers discrete
objects (discrete ridgelets, discrete Radon transform, discrete Pseudopo-
lar Fourier domain) which obey inter-relationships paralleling those in the
continuum ridgelet theory (between ridgelets. Radon transform, and polar
Fourier domain).
We make comparisons with other notions of ridgelet transform, and we
investigate what we view as the key issue: the summability of the kernel
underlying the constructed frame. The sparsity observed in our current
implementation is not nearly as good as the sparsity of the underlying
continuum theory, so there is room for substantial progress in future imple›
mentations.
2 DIGITAL RIDGELET TRANSFORM
1.1 INTRODUCTION
1.1.1 Ridgelets on the Continuum
Recently, several theoretical papers have called attention to the potential benefits
of analyzing continuum objects /(x, y) with (x, y) R^ using new bases/frames
called ridgelets [3], [4] and [12]
A ridge function p(x,y) = r{ax -f- by), that is to say, it is a function of two
variables which is obtained as a scalar function r{t) of a synthetic scalar variable
t = ax+hy [20]. Geometrically, the level sets of such a function are lines ax-i-by = t
and so the graph of such a function, viewed as a topographic surface, exhibits
ridges. The function r{t) is the profile of the ridge function as one traverses the
ridge orthogonally to its level sets.
In Candes’ thesis [3], a ridgelet is a function pa,h,e{x,y) xjj{{cos{9)x-f
sin(^)y - b)/a)/a^/’^ where V’(t) is a wavelet - an oscillatory function obeying
certain moment conditions and smoothness conditions. The continuous Ridgelet
transform Rf{a,b,0) = {f,Pa,b,9)is defined on functions / in L^ and extends by
density to L^. This transform obeys a parseval relation and an exact reconstruc›
tion formula. Candes also showed that discrete decompositions were possible, so
that for L^ spaces of compactly supported functions one could develop a frame
of ridgelets - a discrete family (^an,6n,^n(^)) serving the role of an approximating
system.
The "classic ridgelets" of Candes are not in L^(R^), being constant on lines
t = xi cos 9 -h X2sin^ in the plane. This fact seems responsible for certain tech›
nical difficulties in the deployment and interpretation of discrete systems based
on Candes’ notion of ridgelet. In [12] Donoho proposed to broaden the concept of
ridgelet somewhat, allowing ’Svide-sense" ridgelets to be functions obeying certain
localization properties in a radial frequency x angular frequency domain. Under
this broader conception, ridgelets no longer are of strict ridge the form pa,b,u{^)y
so the elegant simplicity of formulation is lost. However, in exchange, it becomes
possible to have an orthonormal set of "wide-sense" ridgelets. These orthonormal
ridgelets are believed to be appropriate L^-substitutes for ridge functions, and to
fulfill the goal of a constructive and stable system which although not based on true
ridge functions are believed to play operationally the same role as ridge functions,
compare [12, 13].
For either classic ridgelets or orthonormal ridgelets, the central issue is that
such systems should behave very well at representing functions with linear singu›
larities. As a prototype, consider the mutilated Gaussian :
See Figure 1.1. This is discontinuous along the line X2 = 0 and smooth away
from that line. Due to the singularity along the line, this function has coefficients
of relatively slow decay in both wavelet and Fourier domains, so it requires large
numbers of wavelets or sinusoids to represent accurately. The rate of convergence of
best iV-term superpositions of wavelets or sinusoids cannot be faster than 0{N~^).
On the other hand, g can be represented by relatively few ridgelets: the rate of
INTRODUCTION
grid, and has clear superiority over some other notions of discrete ridge let trans›
form which are, in our view, false starts.
Our definition offers:
Analysis and synthesis by true ridge functions. The underlying analysis and
synthesis functions depend on (u, v) as p{u + bv) or p{v + bu). This means that
the transform is geometrically faithful, and avoids wrap-around artifacts.
Exact reconstruction formula. There is an iterative algorithm which in the limit
gives exact reconstruction from the ridgelet transform.
Near-Parseval Relationship. There is a variant of the DRT, which we call the
(pseudo-) Ortho-Ridgelet Transform, in which the energy in coefficient space is
equal to the energy in original space, to within a few percent.
Fast algorithm. There is a fast algorithm requiring only 0{N \og{N))flops for
data sampled in an n by n grid, where N = ’n? \s the total number of data.
Continuum analogies. The transform and related objects have structural rela›
tionships bearing a strong analogy with all the principal relationships that exist
in the continuum case, between ridgelet transform. Radon transform, and Polar
Fourier transform.
Cartesian data structures. The transform takes data on a Cartesian grid and
creates a rectangular coefficient array indexed according to a semi-direct product
of simple integer indices measuring scale, location, and orientation.
Overcompleteness. The transform takes an n-by-n array and expands it by a
factor of 4 in creating the coefficient array.
We also compare properties of this DRT with its continuum counterpart, and
with other discrete counterparts, particularly as regards sparse representation of
objects with discontinuities along lines. We point out certain conceptual and practi›
cal advantages of the new transform, over, for example, the Z^ transform proposed
by Do and Vetterli [8], and certain advantages over straightforward discretizations
of the Fourier plane proposed by Donoho [9] and Starck et al. [22].
Our current implementation provides a frame whose kernel does not have,
in our view, sufficient sparsity to provide in the digital setting all the quantita›
tive advantages offered by the continuum theory, leaving ample room for further
improvements.
of a certain complex sequence (cj;’^) which can be derived, e.g. using arguments in
[1]. Since the formula makes sense for all t and not only for integers in the range
DIGITAL RIDGELETS 5
m/ 2 < t < m/2, the periodic discrete Meyer wavelet is unambiguously defined
not just at integral t, hut in fact for all real t. Figure 1.2 displays a Meyer Wavelet
of degree 2.
We will also have use for fractionally-differentiated Meyer wavelets, defined as
follows. For a certain sequence {6^})
r _ j y/2w/m w ^ 0
" " \ y/Tjt^ W = 0
we apply this as a multiplier to the Fourier coefficients of ipj^k, getting
m / 2 -l
V^j,fc(0 = Yl ^^’^w^ ’ exp((227r/m)ti;t).
w= m/2
1.
0.5
i ^V ^ (
^
' ^V i j 0 f^v-
^ M i! i
1
ll -0.5
y i
Figure 1.2. Left side: Meyer Wavelet of degree 2. Right side: Fractionally differenciated
Meyer wavelet of degree 2
n arrays indexed by coordinates (u, v) ranging in the square n/ 2 < u,v < n/2
centered at (0,0). Let 6^^ be defined so that
tan(^]. ) = 2£/n, -n/2 <£< n/2; cotan(^|.^) = 2£/n, n/2 < £ < n/2.
The lines v = ta.n{6j.^)u-ht we speak of as ’basically horizontal lines’ and the lines
u = cota.n{6f,^)v-{-twe speak of as ’basically vertical lines’. Each family of lines is
equispaced in slope, rather than angle. Figure 1.3 illustrates this family of angles.
and
Pj,k,sA’^y^) = ’^jA’^ + cotan(^l)u), s = 2.
RI={{I,px):X£A)
Rl = {{irpx):XeA)
Figure 1.5. Ridgelet analysis of an object with a linear singularity: Left sideiAmplitude Map
of Ridgelet coefficients. Right side: Amplitude Map of Ridgelet coefficients on a square root
scale
1 = 3 4 5 6 7 3 4 5 6 7
Figure 1.6. Map of coefficient space: Left side: Ridgelets, Right side: Ortho-Ridgelets
R*a = Y^axpx.
The notation J?* is meant to suggest the adjoint operation, and in fact /?* is
precisely the formal adjoint of R.
The first main result is that these transforms are in a sense invertible, and so
exact reconstruction is possible in principle.
Theore m 1.2.4 The operators R and R are one-one and so invertible on their
range.
The second main result is that these transforms are rapidly computable.
Definition 1.2.6 Given the normalized discrete Ridgelet transform array RI, we
define the (pseudo-) Ortho Ridgelet transform array UI by taking the wavelet
transform along the angular variable of RI:
Figure 1.7 shows the ortho-ridgelet transform of the same Halfdome object as
in Figure 1.5. It will be evident that the display is more sparse; the transform in 6
has compressed the laterally elongated features in Figure 1.5 into more point-like
features. Figure 1.6(b) gives a map of the coefficient space M for this transform.
There is, of course, a Riesz representer for each coefficient of UI. For later
use, let fjL = {j,k\i,£) denote the tuple indexing UI, and let u^ denote the Riesz
representer of {UI)^, i.e. the vector obeying
{UI)^ = {I,u^).
DIGITAL RIDGELETS
WT "TT"
Figure 1.7. Ortho-Ridgelet analysis of an object with a linear singularity: Left side:Amplitude
map of Ortho-Ridgelet Coefficients. Right side.Ortho-Ridgelet Coefficients on a square root
scale
Figure 1.8 gives an example of such a representer, which we will call a (pseudo-)
ortho ridgelet. Just like the ortho ridgelets for the continuum, these are no longer
true ridge functions; they crudely behave like fragments of ridgelets windowed by
circular windows depending on i. Now U and R are related by an ort honormal
Corollar y 1.2.7 The An? elements {u^ : /i G M) make a frame with frame bounds
empirically within about 10% of each other.
10 DIGITAL RIDGELET TRANSFORM
Thus, we are summing at n values (w, au H- 6) along the line y = ax -\-b. Since a
is not integral, the ordinates at which we are summing do not in general lie in the
original pixel grid on integer pairs. Therefore, the values we are summing come not
from the original image /, but instead an interpolant /^(u,y), which takes integer
values in the first argument, and real values in the second argument.
The interpolation "in y only", is performed as follows. Letting m = 2n, we
define the Dirichlet kernel of order m by
We then set
n/2- l
v=-n/2
We note that Dm is an interpolating kernel, so that
I{u,v) = i^{u,v), - n /2 <u,v < n/2.
(b)
Lglpri
Figure 1.9. Left: Half Dome. Right: Slant Stack of Half Dome
In the case of basically vertical lines, we define the Radon transform similarly,
interchanging roles of x and y:
Figure 1.10. The Slant Stack of a point is a broken line. First row: Images with nonzero
entry at a single point. Second row corresponding Radon Transform, with break in slope at
n corresponding to ^ = n/4.
Theorem 1.3.2 The operator 5 is one-one and hence invertible on its range.
T h e o r e m 1.3.4 The operator S has r? nonzero singular values; the ratio of the
largest to smallest is hounded independently of n.
{RI){j,k,s,l) = {{SI{-,s,l),^j,ki-))).
(^/)0-,A:,5,/) = ({57(-;5,0,V^,-,fc(-))).
With this equivalence established, it is clear that all the results of the last
section follow immediately from the results quoted here. Since the Meyer wavelet
transform is an isometry, we have
All the norm bounds and norm ratios for the ridgelet transform and for the normal›
ized Slant Stack transform are identical. Since the 1-dimensional Meyer transform
costs 0 ( n l o g ( n )) flops, and we perform this once for each column of S the con›
version from the 2n x 2n slant stack domain to ridgelet domain costs a total of
0 ( n 2 l o g ( n )) or 0{N\og{N)) flops.
It remains to prove Theorem 1.3.5. Let [, ] denote the inner product in the
2n X 2n slant domain, and let lso,io denote the Kronecker sequence indexed by
{s,£) which has a 1 in position s = SQ, I = IQ and is zero elsewhere. Then
{{SI{-;sJ),^j,k{-))) = [SI.^j,k^ls,i]-
n- l
t=-n
Indeed, S* involves application of the trigonometric interpolation operator to
each column of ipj^k <8> !«,/ and this gives exactly the same result at a given
{v = tan(^)u -f z) as applying the formula for ijjj^k directly at that point. The›
orem 3.5 is established.
We remark that the continuum Slant stack and the continuum Radon transform
contain the same information: for 0 G [-7r/4,7r/4),
(X/)(t.cos(^),^) = (y/)(t,^);
a similar relationship holds for 9 e [7r/4,37r/4).
It should be evident that the continuum slant stack has a close relationship
to the discrete slant stack; hence, the above relationship between the continuum
slant stack and the continuum Radon transform, provides a connection between
the discrete slant stack and the continuum Radon, albeit with a certain amount
of relabelling.
This observation is responsible for the several analogies described in this sec›
tion.
The discrete pseudopolar Fourier transform P of the digital image / is defined for
n<k<n and - n /2 < i < n/2 by sampling the 2-D Fourier transform at the
collection of pseudopolar grid points illustrated Figure 1.11. Formally,
STRUCTURAL ANALOGIES 15
(I{7rk/nta.n{0l),7rk/n) s=l
{PI){Ks,£)
\ /(TT/C/TI, cotan(^|)7rA:/n) s = 2
where now Fi denotes discrete Fourier transform of length 2n in the first variable
and u = nk/n, n<k<n and 6 = O^^. It follows that the (slant-) transform
of digital data is isometric to the pseudopolar Fourier Transform. We remark that
this situa,tion parallels a similar relationship for the continuum-domain Slant stack
transform Yf introduced above.
^ J-ooJo
Indeed,
oo /»27r /"Oo /»27r
/
/ \F{w, e)\^\ij\dwd9 = 2 / / | / ( r cos(6l), r sm(e))\’^rdrde
-oo Jo 2\\ff2
Jo Jo
= nf\\i
16 DIGITAL RIDGELET TRANSFORM
F(uj,e) = \uj\F{uj,e)
is a Radon-like object isometric with / , which we call the Radon isometry. Now
this object has an alternate definition. Let A denote the convolution operator on
smooth Z/^(R) functions g defined on the Fourier side by the multiplier relation
(Kicg){u;) = \uj\g{oj), u; € R.
It follows that
xf{;e)= A*xf{;e)
so that simple postprocessing of X by the Fourier multiplier |u;| creates an isometry.
SinceA*A = - ( ^ ) 2 , A is in an obvious sense a fractional differentiation operator.
The Radon isometry X bears a strong analogy with the normalized Slant Stack
S. Indeed, the fact that X is an isometry of L^, makes it comparable to a matrix
operator having all its singular values equal to one, while S has all its_singular
values within a reasonable percentage of each other. Moreover, X = {A (S)I)X
- i.e. a fractional differential operator is applied to the Radon transform; while
S = (A (g) / ) 5 - a discrete analog of fractional operator is applied to the Slant
stack.
Figure 1.13. Fourier Transform of Halfdome on log scale, (a) without (b) with ridgelet tiling
We now conside r the situation in the Radon domain . Figur e 1.14 reveal s that
the Slant Stack of the HalfDome objec t is smooth away from a singularit y at a
single (5, /, t) value . Now, the ridgele t coefficients of HalfDome are roughl y speak›
ing such wavele t coefficients of the Slant Stack. It makes sense that a 2 d wavele t
transfor m of this objec t will have sparse coefficients, with the large coefficients con›
centrate d at indice s associated with spatial position s near the singularity . Hence,
we expect the ridgele t transfor m to be sparse . However , to be rigorousl y correct ,
we must remembe r that the ridgele t coefficients arise from the wavele t transfor m
of the normalize d Slant Stack, which is portraye d in Figur e 1.14.
(b)
The normalize d Slant Stack exhibits - like the unnormalize d Slant Stack -
smoothnes s away from a singularit y at a single point . Consequently , it is clear that
we shoul d indee d have sparsit y of the 2-D wavele t transfor m and henc e sparsit y
SPARSITY OF THE FRAME KERNEL 19
in the ridgelet domain, as indeed we observe in Figure 1.5. For extra clarity, we
show the wavelet transform with nonlinear transformation .
(a)
^^11^^^
Figure 1.16. Ortho-Ridgelet Synthesis and Analysis Planes: Left side: OrthoRidgelet Synthe-
sis. Right side:OrthoRidgelet Analysis on a square root scale
behavior in the analysis plane simply plots the sizes of coefficients in decreasing
order, as shown in Figure 1.18. Evidently, there are few "big" coefficients, followed
by a decaying tail.
analysis and synthesis planes. The analysis plane is dramatically more spread out
than before, exhibiting long stripes, see Figure 1.20. Figure 1.21 presents a close-up
of the principal subband.
1.7 COMPARISONS
1.7.1 Comparison with Zp-ridgelets
Do and Vetterli [8] have proposed a method of ridgelet analysis based on the
use of the Radon transform for Zp, the cartesian product of two copies of the
integers mod p, where p is a prime. At a formal level, this has much to recommend
it, including orthogonality. Essentially, one applies the Z^ Radon transform, and
then take the wavelet transform in the T direction.
22 DIGITAL RIDGELET TRANSFORM
Unfortunately, the Z’^ Radon transform integrates over ’lines’ which are defined
algebraically rather than geometrically, and so the points in a ’line’ can be rather
arbitrarily and randomly spread out over the spatial domain. In consequence, the
Zp ridgelets that are defined in this way have a rather strange apppearance. Tyj)-
ical examples are shown on Figure 1.22. Such ’ridge functions’ have their support
scattered haphazardly throughout the image plane, and resemble neither a a tra-
COMPARISONS 23
ditional ridge function, nor any spatially coherent object. As a consequence of this
behavior, partial reconstructions in the Zp system have errors which look very
much like textured random noise. Figure 1.23 compares reconstruction of Half-
Dome by 50 Zp ridgelet coefficients with reconstruction by 50 ridgelets based on
the transform developed here. The additional noisiness is clear. Figure 1.24 con-
(a) (b)
4gP
(c) (d)
Figure 1.23. Reconstruction of HalfDome by Zp ridgelets, and digital ridgelets. (a) Recon-
struction by 50 Zp coefficients, (b) Reconstruction by 50 DR coefficients, (c) Reconstruction
by 100 Zl coefficients, (d) Reconstruction by 100 DR coefficients
siders an object used by Do and Vetterli [8] in their paper on Z’^ ridgelets, and
compares reconstruction by 50 Z^ ridgelet coefficients with reconstruction by 50
ridgelets based on the transform developed here. Again, the additional noisiness
in Z^ reconstruction is clear.
In summary, the Z’^ approach simply is not based on a geometrically faithful
notion of ridgelet, and suffers from textural artifacts.
(a) (b)
# ^ ^ ^ ^ ^ ^
d d
(c) (d)
Figure 1.24. Reconstruction by Zp ridgelets, and digital ridgelets. (a) Reconstruction by 128
Zp coefficients, (b) Reconstruction by 256 Zp coefficients, (c) Reconstruction by 128 DR
coefficients, (d) Reconstruction by 256 DR coefficients
modern hierarchical memory computers might cause frequent cache misses, and
correspondingly slow operations. Third, the method was inelegant to program, for
example, because of attempting to ’fit a round polar grid in a square cartesian
box’ the were annoying special cases arose at the corners of the grid.
In [10], the strategy described in this paper, based on the pseudo-polar grid,
was described and implemented, only with m n in the definition rather than
the choice vn ln used here. A key advantage of this approach is that the under›
lying pseudopolar FFT requires only one-dimensional FFT’s and so is completely
vectorizable; this is an advantage on modern hierarchical memory machines and
machines with 1-dimensional FFT’s as built-in operations. The difference between
the m n and m = 2n versions comes in boundary behavior. The m = n approach
has ridgelets which wrap around at the border, while the m = 2n approach does
not suffer from the wrap-around artifacts (seeFigure 1.28).
(a) (b)
(c) (d)
A
Figure 1.26. Comparison between Wavelet reconstructions, earlier Ridgelet reconstruction
and OrthoRidgelet reconstruction of (a) Half Dome using, (b) 16 Wavelet coefficients, (c)
16 Earlier Ridgelet coefficinets, (d) 16 Ridgelet coefficients
(a) (b)
(d)
Figure 1.27. (a) Half Dome, (b)BandPassed HalfDome, (c) FT of Half Dome on square root
scale, (d) Windowed FT of Half Dome on a square root scale.
The above cited papers were not released at the time they were written because
of Stanford University’s patent fiUng in this area.
The paper [22], follows part of the strategy described in this paper, based on
the pseudo-polar grid. However, instead of exact evaluation of the trigonometric
polynomial / on the pseudo-polar grid, it uses a simple nearest-neighbor interpo›
lation scheme to evaluate pseudo-polar grid points in terms of nearby Cartesian
grid points. The frame bounds available by this approach are considerably broader
than those obtained by the exact interpolation used in this paper, although for
26 DIGITAL RIDGELET TRANSFORM
(a) (b)
Figure 1.29. Left side: Decreasing Rearrangement of Ridgelet Analysis Plane, Right side:
m-term aproximation errors
the image de-noising application described there, this factor does not seem to be
very important.
Yoel Shkolnisky has pointed out another possible variation on our approach,
discussed in [2] and forthcoming work. In extending the image we zero pad out to
length m = 2n-j- I rather than 2n, obtaining a corresponding expression for Dm
which is purely real, namely
m sin[7rt/m)
This fixes a slightly inelegant property of the choice m = 2n, namely that the
ridgelets with the highest radial index j are not purely real - they have a small
imaginary component, owing to the small imaginary component of the kernel D2n-
With m = 2n 4-1 this component goes away.
1.8 DISCUSSION
We have described a notion of ridgelet transform which is able to synthesize or
analyze using true ridge functions and which has various exact reconstruction
DISCUSSION 27
(a) (b)
Figure 1.30. Reconstructions from 16, 50 and 100 OR coefficients: (a) Band Passed Half
Dome, (b) Reconstructed by 16 coefficients, (c) reconstructed by 50 coefficients, (d) recon-
structed by 100 coefficients.
and frame properties. It also obeys a series of relationships with a notion of digital
Radon transform and a notion of digital polar Fourier transform which are precisely
analogous to corresponding relationships that exist in the frequency domain. At
its heart, the method is based on the use of pseudopolar F FT and Fast Slant Stack
described in [2] .
The principal disappointment of the existing implementation is the relatively
slow decay of the ortho-ridgelet coefficients of a ortho-ridgelet. Figure 19 shows
that, after an initially steep decline in coefficients, a kind of flat ’background’
sets in. The slow decay is reminiscent of the behavior one would see from Gibbs
phenomena in fourier analysis of discontinuities, or from critical sampling in Gabor
analysis. It is not hard to see why this behavior obtains, and to see that it is
intrinsically tied to our central assumption - the use of ridge functions in a digital
setting. Figure 1.31 illustrates the ridgelet analysis process; Figure 1.32 illustrates
its adjoint, the ridgelet synthesis process. The ridgelet analysis process works as
follows: an image is extended to twice its length, then sheared, then projected,
then wavelet analyzed. The ridgelet synthesis process works ’in reverse’: a delta
sequence in the wavelet coefficient domain is inverted into a wavelet, which is
then backprojected into a ridge function, which is then sheared into a tilted ridge
function, which is then mutilated.
This last step - mutilation - is the adjoint of extension by zero-padding, mean›
ing that digital ridgelets, when viewed as an array, amount to a series of columns
containing 1-d wavelets which have been brutally truncated from an n x 2n array
to fit in an n X n array. If the wavelets were not mutilated, their inner products
would decay rapidly with separation in index space; but the mutilation spoils the
28 DIGITAL RIDGELET TRANSFORM
Figure 1.32. Stages of Radon synthesis (right to left): backprojection, shearing, mutilation
decay property. From this point of view, it is rather obvious what to try next. One
should develop analysis and synthesis transforms not based on ridge functions, but
instead based on windowed ridge functions. We have not explored this proposal
in detail here simply because although a straightforward and obvious extension, it
violates the initial assumption marking the origin of this project: the use of true
ridge functions.
ACKNOWLEDGEMENT
This work has been partially supported by AFOSR MURI 95-P49620-96-1-O028,
by National Science Foundation grant DMS 98-72890 (KDI), and by DARPA
ACMP BAA 98-04. The authors would like to thank Amir Averbuch, Emmanuel
Candes, Raphy Coifman, Jean-Luc Starck, Yoel Shkolnisky, and Martin Vetterli
for helpful comments, preprints, and references. AGF would like to thank the
Statistics Department at UC Berkeley for its hospitality.
REFERENCES 29
REFERENCES
[1] P. Auscher, G. Weiss and M.V. Wickerhauser, Local sine and cosine bases of
Coifman and Meyer and the construction of smooth wavelets. Wavelets: A
tutorial in Theory and Applications Academic Press: Boston, 237-256.
[2] A. Averbuch, R.R. Coifman, D.L. Donoho, M. Israeli and J. Walden Fast Slant
Stack: A notion of Radon Transform for Data in a Cartesian Grid which is
Rapidly Computible, Algebraically Exact, Geometrically Faithful and Invert-
ible, to Appear: SIAM J.Sci. Comp.
[3] E. Candes Ridgelets: Theory and Applications. Ph.D. Thesis, Department of
Statistics, Stanford University, 1998.
[4] E.J. Candes, and D. L. Donoho Ridgelets: The key to High-Dimensional Inter-
mittency? in Phil. Trans. R. Soc. Lond. A. 3 5 7 1999, 2495-2509.
[5] E. Candes and D. Donoho Curvelets and Curvilinear integrals (1999) Tech›
nical Report, Department of Statistics, Stanford University. http://www-
stat. Stanford, edu/’ donoho/Reports/2000/Curves- Curvelets.ps.
[6] E. Candes and D.L. Donoho. Curvelets: a surprisingly effective nonadaptive
representation of objects with edges. Curve and Surface Fitting: Saint-Malo
1999 Albert Cohen, Christophe Rabut, and Larry L. Schumaker (eds.) Van-
derbilt University Press, Nashville, TN. ISBN 0-8265-1357-3.
[7] S. R. Deans The Radon transform and some of its applications. New York:
Wiley & Sons.
[8] M. Do and M. Vetterli. Orthonormal finite Ridgelet transform for image com›
pression. To appear Proc. of IEEE International Conference on Image Pro›
cessing, ICIP-2000.
[9] D. L. Donoho. Fast Ridgelet Transform in Dimension 2. Available: http://www-
stat. Stanford. edu/^donoho/Reports/1997/FRT.pdf 1997.
[10] D.L.Donoho, Fast Ridgelet Transform via Digital Polar Coordinate Transform.
Available: http://www-st at. Stanford, edu/’donoho/Reports/ 1998/FRTvD-
PCT.pdf 1998.
[11] D.L. Donoho. Tight Frames of /c-Plane Ridgelets and the Problem of Repre›
senting c?-dimensional singularities in R"^. Proc. Nat. Acad. Sci. USA, 96
1998, 1828-1833.
[12] D.L. Donoho. Orthonormal Ridgelets and Linear Singularities. SIAM J. Math
Anal. 3 1 no 5 2000, 1062-1099.
[13] D.L. Donoho Ridge Functions and Orthonormal Ridgelets. Journ. Approx.
Thry. I l l 2001, 143-179.
[14] P. Edholm and G.T. Herman.Linogram s in image reconstruction from projec›
tions. IEEE Trans. Medical Imaging, M I - 6 ( 4) 1987, 301-307.
[15] P. Edholm, G.T. Herman, and D.A. Roberts. Image reconstruction from lino-
grams: Implementation and evaluation. IEEE Trans. Medical Imaging, M I-
7(3)1988, 239-246.
[16] I.M. Gel’fand and G.E. Shilov Generalized Functions: Properties and Opera›
tions. Academic Press, 1964.
[17] S. Helgason, Groups and Geometric analysis: integral geometry, invariant dif›
ferential operators, and spherical functions. Series title: Pure and applied
30 REFERENCES
⁂ Also a large selection of Rewards at 1s., 9d., 6d., 3d., 2d., and 1d.
A complete list will be sent post free on application.
BLACKIE’S
SCHOOL AND HOME LIBRARY.
Under the above title the publishers have arranged to issue, for
School Libraries and the Home Circle, a selection of the best and
most interesting books in the English language. The Library includes
lives of heroes, ancient and modern, records of travel and adventure
by sea and land, fiction of the highest class, historical romances,
books of natural history, and tales of domestic life.
The greatest care has been devoted to the get-up of the Library. The
volumes are clearly printed on good paper, and the binding made
specially durable, to withstand the wear and tear to which well-
circulated books are necessarily subjected.
In crown 8vo volumes. Strongly bound in cloth. Price 1s. 4d.
each.
LONDON:
BLACKIE & SON, Limited, 50 OLD BAILEY, E.C.
Transcriber's Notes
A number of typographical errors were corrected silently.
Cover image is in the public domain.
Caption for illustration "The figure moved, rose, came forward with the painful caution of
dreary suspense" was incorrect in original image and was changed to match the text.
*** END OF THE PROJECT GUTENBERG EBOOK A GIRL OF TO-DAY
***
1.D. The copyright laws of the place where you are located also
govern what you can do with this work. Copyright laws in most
countries are in a constant state of change. If you are outside
the United States, check the laws of your country in addition to
the terms of this agreement before downloading, copying,
displaying, performing, distributing or creating derivative works
based on this work or any other Project Gutenberg™ work. The
Foundation makes no representations concerning the copyright
status of any work in any country other than the United States.
1.E.6. You may convert to and distribute this work in any binary,
compressed, marked up, nonproprietary or proprietary form,
including any word processing or hypertext form. However, if
you provide access to or distribute copies of a Project
Gutenberg™ work in a format other than “Plain Vanilla ASCII” or
other format used in the official version posted on the official
Project Gutenberg™ website (www.gutenberg.org), you must,
at no additional cost, fee or expense to the user, provide a copy,
a means of exporting a copy, or a means of obtaining a copy
upon request, of the work in its original “Plain Vanilla ASCII” or
other form. Any alternate format must include the full Project
Gutenberg™ License as specified in paragraph 1.E.1.
• You pay a royalty fee of 20% of the gross profits you derive
from the use of Project Gutenberg™ works calculated using the
method you already use to calculate your applicable taxes. The
fee is owed to the owner of the Project Gutenberg™ trademark,
but he has agreed to donate royalties under this paragraph to
the Project Gutenberg Literary Archive Foundation. Royalty
payments must be paid within 60 days following each date on
which you prepare (or are legally required to prepare) your
periodic tax returns. Royalty payments should be clearly marked
as such and sent to the Project Gutenberg Literary Archive
Foundation at the address specified in Section 4, “Information
about donations to the Project Gutenberg Literary Archive
Foundation.”
• You comply with all other terms of this agreement for free
distribution of Project Gutenberg™ works.
1.F.