Augmented Reality in Medicine Seminar

Human Vision & Perception

How the Eye works
&
How the human perceives images

January 15

Jonas von Beck

Overview

Human Vision
The eye
Light & Colors
Seeing in 3D (depth as third dimension)

Human visual perception

Using cues to simulate depth

binocular-depth cues
monocular-depth cues

January 15

Fun Things in Vision

Jonas von Beck

Human Vision - The Eye

January 15

Jonas von Beck

Human Vision

Courtesy of Peter K. Kaiser

January 15

Jonas von Beck

Resolution Of The Eye

6-7 Mio cones
120 Mio rods

Courtesy of Peter K. Kaiser

January 15

Jonas von Beck

Spectral Sensitivity

Courtesy Dr.P.Kipfer Computer Graphics and Visualization Group TUM

January 15

Jonas von Beck

The Visible Spectrum

Different wavelengths are perceived as
different colors
Human eye can only see light between
380nm and 780nm

Courtesy Dr.P.Kipfer Computer Graphics and Visualization Group TUM

January 15

Jonas von Beck

Light & Colors

Light consists of rays of different frequencies.

Different rays represent different colors

Courtesy of Peter K. Kaiser

January 15

Jonas von Beck

Color Mixing

Courtesy of Peter K. Kaiser

January 15

Jonas von Beck

Subtractive Color Mixing

Painting on a white surface reduces amount

of frequencies reflected

Courtesy of Peter K. Kaiser

January 15

Jonas von Beck

10

Additive Color Mixing

Different light frequencies are overlapped

Courtesy of Peter K. Kaiser

January 15

Jonas von Beck

11

Seeing in 3D Recognizing Depth

You cant really see in 3D.
You just get two 2D images.
Even though you can perceive depth
information (depth cues)

January 15

Jonas von Beck

12

Binocular Depth Cues

Stereo Disparity

Courtesy of John H. Krantz

January 15

Jonas von Beck

13

Stereo Disparity
Since we have two eyes, we can see two
slightly different images.
You always have disparity in the real
world.
You can simulate disparity with two
pictures or single-image random dot
stereogram SIRDS

January 15

Jonas von Beck

14

Stereo Disparity

Courtesy of Peter K. Kaiser

January 15

Jonas von Beck

15

Relax your eyes (SIRDS)

Courtesy of John H. Krantz

January 15

Jonas von Beck

16

Cross your eyes (SIRDS)

Courtesy of John H. Krantz

January 15

Jonas von Beck

17

Monocular Depth Cues

The brain tries to add depth into
two-dimensional information

January 15

Jonas von Beck

18

Kinetic Depth Cues

Relative Motion Parallax

Motion Perspective
Kinetic Depth Effect

January 15

Jonas von Beck

19

Relative Motion Parallax

Nearby objects move

faster than more
distant objects

Courtesy of John H. Krantz

January 15

Jonas von Beck

20

Motion Perspective

When moving towards an object, more

centered parts seem to move slower
than parts on the edges

January 15

Jonas von Beck

21

Pictorial Depth Cues

Interposition
Relative Height
Relative Size (Size
Constancy)
Linear Perspective

January 15

Texture Gradient
Shadows
Aerial Perspective
Spatial Summation

Jonas von Beck

23

Interposition

Interposition means, nearer objects block

more distant ones.

Courtesy of John H. Krantz

January 15

Jonas von Beck

24

Relative Height

The closer an object is to the horizon,

the more distant it seems

Courtesy of John H. Krantz

January 15

Jonas von Beck

25

Relative Size (Size Constancy)

Smaller objects seem to be further away than

closer ones, when the objects are supposed to
be the same size.

Courtesy of John H. Krantz

January 15

Jonas von Beck

26

Linear Perspective

Parallel lines converge in a vanishing in infinity

Courtesy of John H. Krantz

January 15

Jonas von Beck

27

Texture Gradient

Most surfaces, such as walls and roads and a

field of flowers in bloom, have a texture. As the
surface gets farther away the texture gets finer
and appears smoother.

Courtesy of John H. Krantz

January 15

Courtesy of John H. Krantz

Jonas von Beck

28

Shadows / Shading

Courtesy of John H. Krantz

January 15

Jonas von Beck

29

Shadows / Shading

Courtesy of John H. Krantz

January 15

Jonas von Beck

30

Aerial Perspective

Object that are far away tend to get blurry

cause of the atmosphere.

Courtesy of John H. Krantz

January 15

Jonas von Beck

31

Aerial Perspective

Courtesy of John H. Krantz

January 15

Jonas von Beck

32

Physiological Depth Cues

Convergence

Accommodation
Blur

January 15

Jonas von Beck

34

Convergence
The brain registers
the angel how the
eyes are
converged and
can estimate
distance
Max. to 10m

Courtesy of Peter K. Kaiser

January 15

Jonas von Beck

35

Accommodation

Depending on how the lenses focus on

depth the brain is able to estimate a
distance

January 15

Jonas von Beck

36

Fun Things in Vision

Do we really see reality?

January 15

Jonas von Beck

37

Fun Things in Vision

The Blind Spot

Courtesy of Peter K. Kaiser

Close your right eye and look onto number 3*

* Could be different on wall projection

January 15

Jonas von Beck

38

Fun Things in Vision

Color
Assimilation

Why is one red

line darker
than the other
one
It isnt really.

Courtesy of Peter K. Kaiser

January 15

Jonas von Beck

39

Fun Things in Vision

Kanizsa
Illusion

If you look
carefully you
will probably
see the
edges of the
entire
triangle.

Courtesy of Peter K. Kaiser

January 15

Jonas von Beck

40

Fun Things in Vision

Simultaneous Contrast

Both areas have the same intensity.

Courtesy Dr.P.Kipfer Computer Graphics and Visualization Group TUM

January 15

Jonas von Beck

42

Fun Things in Vision

Perspective Illusion

Which colored block

looks the largest?
Theyre all the same
size

Courtesy of Peter K. Kaiser

January 15

Jonas von Beck

43

Fun Things in Vision

Reversible Figures

Comes from Figure

Ground Perception
A vase or two faces
looking at each other
Depends on what is
perceived as
background
Courtesy of Peter K. Kaiser

January 15

Jonas von Beck

44

Impossible Figures
Tricking Human Perception

Courtesy of Peter K. Kaiser

January 15

Jonas von Beck

45

Impossible Figures

Courtesy of Peter K. Kaiser

January 15

Courtesy of Peter K. Kaiser

Jonas von Beck

46