MULTIMEDIA Signal Processing

MULTIMEDIA
SIGNAL PROCESSING
MULTIMEDIA SIGNAL PROCESSING
1. WHAT IS MULTIMEDIA (MM) ?

2. WHAT IS THE TOPIC OF MULTIMEDIA
SIGNAL PROCESSING?
WHAT IS MULTIMEDIA?
Composed Of Multi+media
Media = Medium Of Communication
We Communicate Naturally:
Visually, By Speech, By Touch
We Communicate By Technology:
Radio (Mobile Phones), Tv, Press,
Cinema, Books
People Use Variouscommunication Media:

Speech, Vision, Touch.
In The Past When People Communicated They
Had To Use Those Media Directly.
In Present Civilisation There Are Many
Technologies Which
Extend Human Communication
GENERAL MODEL OF HUMAN COMMUNICATION

PRODUCER
OF
INFORMATION
HUMAN
RECEIVER
OF
INFORMATION
HUMAN
Communication Medium Natural

(E.G. Voice, Touch): We Use Specific Physical Medium
E.G. Air Plus Production Specially Encoded Signals For
Conveying Information
Communication Medium Indirect Via Technology (E.G.
Cinema, Radio, Press, Tv)
More Recent Is A Model Of

Human Machine Communication Or Even
Machine-machine Communication.
When We Use Computers, We Communicate With
Machine, The Communication Media Are:
Touch/Gesture <-> Keyboard, Mouse
Vision <-> Display
Hearing <-> Sound
Humans Can Use Several Different Media For

Communication
Eg: Speech, Touch, Visual System
Humans Often Use Several
Media Simultaneously Or In Other
Words Multiple Media =Multimedia
For Example: When We Talk With
Somebody We Use Gestures, Face
Expressions
In Fact People Prefer To Use Multimedia

- We Can Use Single Media
E.G. Speech When Talking On The Phone
But Seeing Each Other When Talking
''Enhance'' The Contact
- We Can Listen To The Radio
E.G. News, But Tv Is Preferred Even If We Just
See A Person Reading The News
- Multimedia Is More Natural For People
There Is Another Use Of Word Media, In The

Sense Of Media Industry
Media Industry Is Dealing With Producing,
Distributing And Selling Information Addressing
Human Media System
~ Multimedia Information Is Very Important For The
Industry.
~ There Are Many Engineering Problems In Dealing
With Multimedia Information.
What Is Multimedia Signal Processing (Mmsp) ?

It Is About Processing
Communication And Utilization
Of Information Used By Humans.
One Can Consider Three
Scenarios Of Usage:
1. Human-human
2. Human Machine
3. Machine - Machine
Why Multimedia Signal Processing Is Possible?

This Is Because We Have Means For Digital
Representation And Processing Of Any Type
Of Information.
If We Talk On The Phone, Listen To The
Music From Mp3player, Watch Movie From
Dvd Disc, Take Picture With Camera, We
Know That Information Is Represented By Bits
And Processed Digitally.
What We Need Are Algorithms

How To Process The Signals Digitally?
Multimedia Signal Processing
Is About Algorithms For The Processing Of
Signals Which Are Used By Humans For
Communication
With Other People Or Machines Or Dealing With
The World Around.
WHAT ARE THE MEDIA SIGNALS?

Media Signals Are Those Signals Which Are
Accessible To The Human Information
Processing System One Of The Issues In
Multimedia Signal Processing Is What Type Of
Signals And What Kind Of Combinations Of
Signals Can Be Used.
For Example: Acoustical Signals: Sounds,
Speech-language, Music We Convert Those
Signals To Digital Format And Use.
Example: Digital Music (Cd, Mp3, Dvd,

Internet Radio)
Example: Digital Video (Dvd, Blue Ray,
Internet Tv)
These Are Systems For Transferring Content
Produced By Artists To People. These Systems
Use Specific Digital Encoding And
Compression Of Information To Record The
Content.
The Question Is How To Make This.
But Having Such Systems A New

Problem Emerges:
How To Protect Media Information
Unauthorized Use?
(For Example Illegal Copying?)
How To Represent Media Information In
Most Pleasing Way?
Examples Are High Definition Technologies:
- Flat Displays
- HD DVD, Blue Ray Discs, HDTV
The Second Main Aspect Of Mmsp

2. Human-machine Communication
How To Make Interaction With Computers & Other
Machines More Natural?
Natural Means Eg. More Similar To Human-human
Interaction, More Intuitive, More
Pleasing,Attractive
That Include Also How To Make

Machines More Intelligent:
For Example , Instead Of Typing We Could
Talk To Computers And Instead Of Computers
Printing On Screen Answers They Would Talk
To Us Or If Computers Would See Us Using
Cameras, They Possibly Could React More
Like People.
But Today We Still Use Keyboard
And Mouse, Why?
We Use Keyboard And Mouse Because We Do Not

Have Better Technology!
We Do Not Know How To Process Speech And
Visual Information As Effectively As People Are
Able To Do.
But We May Think Of Computers With Cameras
And Microphones
Which Will Be Able To Do So.
This May Become Possible Because
Of Fast Progress In Development Of Algorithms
And Processors.
This progress can be illustrated on many examples

- compare pc today and 10 YEARS ago
(Today we have multicore processors and the
number of cores is growing fast)
- Compare mobile device today and mobile phone
10 YEARS ago
(Today the telephone function is just one addition
to multiple media processing: music, video,
camera, touch, orientation)
Extrapolate this to the next 10 YEARS!
WE CAN EXPECT IN THE FUTURE:

COMPUTERS, MOBILE, AND ALL KIND OF
OTHER DEVICES WILL BE MORE AND
MORE CLEVER i.e INTELLIGENT
THESE SYSTEMS WILL BE RELYING
ON INCREASINGLY SOPHISTICATED
MULTIMEDIA SIGNAL PROCESSING
CAPABILITIES
Two main areas to cover in MMSP:

1. Media information processing
in Multimedia systems
2. Media computer interface for
Human-computer interaction
Multimedia signal processing allows for new classess of

devices and systems:
More sophisticated communication
More advanced interfaces.
Mobile Multimedia Devices Examples
What these mobile device examples

show to us?
-Devices have multiple sensors and
mulitple media processing capabilities
- Take one example - Touch
Device is controlled by fingers, e.g. picture size

or even playing guitar
ANOTHER EXAMPLE: DIGITAL CAMERAS

Digital cameras perform a lot of processing
for best picture quality. But recent cameras
have new features related to analysis of
visual information.
Face Detection automatically detects a face in the frame and
adjusts focus, exposure, contrast, and skin complexion so it
turns out perfectly.
Face Recognition a feature that remembers faces from
previous shots. When a familiar face is recorded several times,
the camera will prompt the users to register the face. Once
registered, if the face appears into the frame again, the camera
will display the name specified for that person and prioritize
focus and exposure for the face.
To make such feature an algorithm for
face detection and recognition is needed
working fast and reliably
COMPLETELY NEW TYPES OF DEVICES ARE

POSSIBLE: EXAMPLE Wii
Game & fitness accessories
Wii by Nintendo
Contollers have
motion sensors
Dancing pad Balance board
Sports game Music performance
Completely New Types of Devices
AIBO DOG PERSONAL ROBOT WITH SENSES
IT HAS SENSES:
MICROPHONE,
CAMERA, TEMPERATURE,
DISTANCE, ACCELERATION,
BALANCE, TOUCH
IT HAS INSTINCTS
AND BEHAVIORS
Completely New Types of Devices

"Is this a real cat?" A
robot cat you can bond
with like a real pet -NeCoRo is born
Omron ready to test demand for robo-cat
PERSONAL ROBOTS
START APPEARING ...
The two-legged walking

technology developed by
Honda represents a unique
approach to the challenge of
autonomous locomotion.
Using the know-how gained
from these prototypes,
research and development
began on new technology for
actual use. ASIMO represents
the fruition of this pursuit.
Menagerie of devicesDEVICES
Progress of technology is fast: Even the old

television is changing, in 2010 a three
dimensional television, 3D TV, will start
3D TV set
Glasses
And also a first TV controlled

by hand gestures will be
available (but very expensive)
CONCLUSION:
We can see that devices are developing to have
- More complexity
- More intelligence
- More natural interaction with people
To add even more such features one needs
algorithms for multimedia signal processing,
many of these algorithms should have
capabilities similar to biological systems.

MULTIMEDIA Signal Processing

Uploaded by

Copyright:

Available Formats

MULTIMEDIA Signal Processing

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

MULTIMEDIA Signal Processing

Uploaded by

Copyright:

Available Formats

MULTIMEDIA

MULTIMEDIA SIGNAL PROCESSING

1. WHAT IS MULTIMEDIA (MM) ?

People Use Variouscommunication Media:

GENERAL MODEL OF HUMAN COMMUNICATION

Communication Medium Natural

More Recent Is A Model Of

Humans Can Use Several Different Media For

In Fact People Prefer To Use Multimedia

There Is Another Use Of Word Media, In The

What Is Multimedia Signal Processing (Mmsp) ?

Why Multimedia Signal Processing Is Possible?

What We Need Are Algorithms

WHAT ARE THE MEDIA SIGNALS?

Example: Digital Music (Cd, Mp3, Dvd,

But Having Such Systems A New

The Second Main Aspect Of Mmsp

That Include Also How To Make

We Use Keyboard And Mouse Because We Do Not

This progress can be illustrated on many examples

WE CAN EXPECT IN THE FUTURE:

Two main areas to cover in MMSP:

Multimedia signal processing allows for new classess of

Mobile Multimedia Devices Examples

What these mobile device examples

Device is controlled by fingers, e.g. picture size

ANOTHER EXAMPLE: DIGITAL CAMERAS

COMPLETELY NEW TYPES OF DEVICES ARE

Game & fitness accessories

Dancing pad Balance board

Sports game Music performance

Completely New Types of Devices

AIBO DOG PERSONAL ROBOT WITH SENSES

Completely New Types of Devices

Omron ready to test demand for robo-cat

The two-legged walking

Progress of technology is fast: Even the old

And also a first TV controlled

You might also like