EECE/CS 253 Image Processing: Lecture Notes

EECE/CS 253 Image Processing
Lecture Notes: Lecture Notes on Color Perception

Richard Alan Peters Richard Peters II II Department of of Electrical Engineering Department Engineeringand and Computer Science Computer Science Fall Semester 2011 Fall 2011
. . . . . . . . .
This work is licensed under the Creative Commons Attribution-Noncommercial 2.5 License. To view a copy of this license, visit http://creativecommons.org/licenses/by-nc/2.5/ or send a letter to Creative Commons, 543 Howard Street, 5th Floor, San Francisco, California, 94105, USA.
Color Images

Are constructed from three intensity maps. Each intensity map is projected through a color filter (e.g., red, green, or blue, or cyan, magenta, or yellow) to create a single color image. The intensity maps are overlaid to create a color image. Each pixel in a color image is a three element vector.
2011-09-14
1999-2011 by Richard Alan Peters II
Color Images on a CRT or LCD Display

Projected image primary colors: red, green, and blue. Intensity images are projected through dot-array color filters which are slightly offset from one another.
1999-2011 by Richard Alan Peters II 3
2011-09-14
Color Images on a CRT or LCD Display

Photographs of various displays, showing various pixel geometries. Clockwise from top left, a standard definition CRT television, a CRT computer monitor, a laptop LCD, and the OLPC XO-1 LCD display. [Peter Halasz (user:Pengo), Wikipedia, http://en.wikipedia.org/wiki/Pixel_geometry]
2011-09-14
Color Images In Print
Images are separated into four color bands, each of which is printed as a grid regularly spaced dots. A dots diameter varies in proportion to the intensity of the color.
2011-09-14 1999-2011 by Richard Alan Peters II 5
Color Images in Print
The four colors are magenta, cyan, yellow, and black
2011-09-14
Standard Halftone Screen Angles

The dot grids are created with a screen that overlays the intensity images.
Cyan: 105 Yellow: 90 Magenta: 75 Black: 45
The screens are oriented at different angles. The resulting patterns are called rosettes.
2011-09-14
Color Separation / Halftoning
The original is separated into an intensity image for each of the four color bands.
2011-09-14
2011-09-14

Each intensity image is multiplied by a corresponding screen, Cyan Magenta
Yellow
Black
Each screened image is printed in its own color on the same page.
2011-09-14
10
2011-09-14
11
The Eye
Diagram from http://webvision.med.utah.edu/

The Retina
Fovea
Macula Diagram from http://webvision.med.utah.edu/
Optic nerve
2011-09-14
13
The Retina
Light
Diagram from http://webvision.med.utah.edu/
Retinal Mosaic
Cepko, Connie, Giving in to the blues, Nature Genetics, 24, 99 - 100 (2000) [email protected]
Photoreceptor Densities
Diagrams from http://webvision.med.utah.edu/
2011-09-14
16
Photoreceptor Densities
The density of cone photoreceptors decreases from the high-resolution fovea to the periphery of the eye. A human eyes field of view is about 155 of that, the fovea comprises the central 2. To see the world in detail requires active scanning by the eyes. A person does not see much more than he or she does see in most situations. The slides that follow mimic a multiresolution scan of a painting by a single eye. (The digital image processing in this case was done with a log-polar transform.)
Figure: Anatomical Distribution of Rods and Cones from Neuroscience. 2nd edition. Purves D, Augustine GJ, Fitzpatrick D, et al., editors. Sunderland (MA): Sinauer Associates; 2001. http://www.ncbi.nlm.nih.gov/books/NBK10848/ 2011-09-14 1999-2011 by Richard Alan Peters II 17
Retinal Space-Variant Sensing
Louis Boilly (1761-1845) Thirty-Six Faces of Expression. Log-polar transform applied.
2011-09-14
18
2011-09-14
19
2011-09-14
20
2011-09-14
21
2011-09-14
22
2011-09-14
23
2011-09-14
24
2011-09-14
25

Louis Boilly (1761-1845) Thirty-Six Faces of Expression.
2011-09-14
26
Retina: CenterSurround Edge Detector

The interconnection of the photoreceptors by the other cells in the retina cause its output to be an edge map, similar to the action of a Laplacian of Gaussian filter on a digital image.
2011-09-14
spatial domain
= 32
frequency domain
=2
g (r ) =
2
r2 r2 1 exp 2 2 2 2
G ( ) = exp
2
2 2
2
Laplacian of Gaussian (LoG) Filter
r2 = x2 + y2
2 = u2 + v2
27
Retinal Edge Detection
Louis Boilly (1761-1845) Thirty-Six Faces of Expression. Photo negative of LoG output.
2011-09-14
28
Space Variant Retinal Edge Detection
2011-09-14
29
The Retinal Transform Minimizes Data Bandwidth

This is the reduction in size from the full image to a compact multiresolution representation including the fovea (the disk) and the periphery.
2011-09-14
30
L downsample factor R information content
Pixelization of Color Images: All Bands Equal
2011-09-14
Photo: R. A. Peters II, 1998, The Lake, Central Park, NYC.
31
L downsampled band R information content
16 Pixelization of Color Images: R, G, & B Bands
2011-09-14
32
Visual Areas in the Brain

Retina: center-surround color feature detectors LGN: (lateral geniculate nucleus) relay to V1; audio attention V1: selective spatiotemporal filters V2: feature aggregation V3: visual attention IT: (Inferior temporal gyrus) complex object features Graphic from M. Lewicky
In the Brain: from RGB to LHS

The eye has 3 types of photoreceptors: sensitive to red, green, or blue light.
luminance
2011-09-14
hue saturation
The brain transforms RGB into separate brightness and color channels (e.g., LHS).
brain photo receptors
34
16 Pixelization of Color Images: Luminance Only
2011-09-14
35
16 Pixelization of Color Images: Chrominance (H+S) Only
2011-09-14
36
16 Pixelization
2011-09-14
37
16 Pixelization
These 4 images all have the same amount of digital information
2011-09-14
38
16 Pixelization
but different visual information.
2011-09-14
39
Color Sensing / Color Perception

These are approximations of the responses to the visible spectrum of the red, green, and blue receptors of a typical human eye.
2011-09-14
40

Note that the red receptor exhibits the same response at 4 different wavelengths
2011-09-14
41

but the responses of the green and blue receptors differ
b1
r1 g1
2011-09-14
42

at each of the 4 locations so that
b2
r2 g2
2011-09-14
43

each of the 4 wavelengths is represented by a unique response from the set of 3 receptors.
g3
r3 b3
2011-09-14
44

1 2 3 4
r4 g4 b4
2011-09-14
45

These are approximations of the responses to the visible spectrum of the red, green, and blue receptors of a typical human eye.
The simultaneous red + blue response causes us to perceive a continuous range of hues on a circle. No hue is greater than or less than any other hue.
2011-09-14
46
Complementary Colors
CYAN - RED
GREEN - MAGENTA
BLUE - YELLOW
Colors opposite each other on the color disk are called complementary.
Complementary Colors
response
red green blue
color
0 180
red green blue
color
response photoreceptor response is represented as proportional to brightness
To complementary colors, the response of the retinas photoreceptors is opposite.
2011-09-14
48
Color Perception: The Afterimage Effect
Stare at the dot in the center of the image

2011-09-14
50
2011-09-14
51
2011-09-14
52
Color Perception: The Afterimage Effect
The color negatives saturate the local receptors so that when the color is removed the agonist (opposite) color receptors remain saturated.
Color Perception: the Cornsweet Effect
Dale Purves, R. Beau Lotto, Surajit Nundy, Why We See What We Do, American Scientist, Volume 90, No. 3, May-June 2002
The top is darker
than the bottom, Right?
Wrong!
Brightness Perception
255
image
intensity profile
Linear intensity changes are not seen as such.

Brightness Perception
The previous slide demonstrates the WeberFechner relation. The linear slope of the intensity change is perceived as logarithmic.
g1 - g 2 Dg = g1 + g 2
The green curve is the actual intensity; the blue curve is the perceived intensity.
2011-09-14
59
Uniform Change in Frequency and Contrast
decreasing contrast
increasing frequency

EECE/CS 253 Image Processing: Lecture Notes

Uploaded by

Copyright:

Available Formats

EECE/CS 253 Image Processing: Lecture Notes

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

EECE/CS 253 Image Processing: Lecture Notes

Uploaded by

Copyright:

Available Formats

EECE/CS 253 Image Processing

Lecture Notes: Lecture Notes on Color Perception

1999-2011 by Richard Alan Peters II

Color Images on a CRT or LCD Display

Color Images on a CRT or LCD Display

1999-2011 by Richard Alan Peters II

Color Images In Print

Color Images in Print

The four colors are magenta, cyan, yellow, and black

1999-2011 by Richard Alan Peters II

Standard Halftone Screen Angles

Cyan: 105 Yellow: 90 Magenta: 75 Black: 45

1999-2011 by Richard Alan Peters II

Color Separation / Halftoning

1999-2011 by Richard Alan Peters II

Color Separation / Halftoning

1999-2011 by Richard Alan Peters II

Color Separation / Halftoning

1999-2011 by Richard Alan Peters II

Color Separation / Halftoning

1999-2011 by Richard Alan Peters II

Diagram from http://webvision.med.utah.edu/

Macula Diagram from http://webvision.med.utah.edu/

1999-2011 by Richard Alan Peters II

Diagrams from http://webvision.med.utah.edu/

1999-2011 by Richard Alan Peters II

Retinal Space-Variant Sensing

Louis Boilly (1761-1845) Thirty-Six Faces of Expression. Log-polar transform applied.

1999-2011 by Richard Alan Peters II

Retinal Space-Variant Sensing

Louis Boilly (1761-1845) Thirty-Six Faces of Expression. Log-polar transform applied.

1999-2011 by Richard Alan Peters II

Retinal Space-Variant Sensing

Louis Boilly (1761-1845) Thirty-Six Faces of Expression. Log-polar transform applied.

1999-2011 by Richard Alan Peters II

Retinal Space-Variant Sensing

Louis Boilly (1761-1845) Thirty-Six Faces of Expression. Log-polar transform applied.

1999-2011 by Richard Alan Peters II

Retinal Space-Variant Sensing

Louis Boilly (1761-1845) Thirty-Six Faces of Expression. Log-polar transform applied.

1999-2011 by Richard Alan Peters II

Retinal Space-Variant Sensing

Louis Boilly (1761-1845) Thirty-Six Faces of Expression. Log-polar transform applied.

1999-2011 by Richard Alan Peters II

Retinal Space-Variant Sensing

Louis Boilly (1761-1845) Thirty-Six Faces of Expression. Log-polar transform applied.

1999-2011 by Richard Alan Peters II

Retinal Space-Variant Sensing

Louis Boilly (1761-1845) Thirty-Six Faces of Expression. Log-polar transform applied.

1999-2011 by Richard Alan Peters II

Retinal Space-Variant Sensing

1999-2011 by Richard Alan Peters II

Retina: CenterSurround Edge Detector

Laplacian of Gaussian (LoG) Filter

1999-2011 by Richard Alan Peters II

Retinal Edge Detection

1999-2011 by Richard Alan Peters II

Space Variant Retinal Edge Detection

1999-2011 by Richard Alan Peters II