Data Compression?: 4. (A) What Is The Distinction Between Lossy and Lossless
Data Compression?: 4. (A) What Is The Distinction Between Lossy and Lossless
Data Compression?: 4. (A) What Is The Distinction Between Lossy and Lossless
19_ How can MIDI be used with modern data compression techniques?
Briefly describe how such compression techniques may be implemented?
We have seen the need for compression already in Digital Audio -- Large Data
Files
Basic Ideas of compression (see next Chapter) used as integral part of audio format
-MP3, real audio etc.
Mpeg-4 audio -- actually combines compression synthesis and midi to have a
massive
impact on compression.
Midi, Synthesis encode what note to play and how to play it with a small number
of
parameters -- Much greater reduction than simply having some encoded bits of audio.
Responsibility to create audio delegated to generation side.
MPEG-4 comprises of 6 Structured Audio tools are:
SAOL the Structured Audio Orchestra Language
SASL the Structured Audio Score Language
SASBF the Structured Audio Sample Bank Format
a set of MIDI semantics which describes how to control SAOL with MIDI
a scheduler which describes how to take the above parts and create sound
the AudioBIFS part of BIFS, which lets you make audio soundtracks in MPEG-4
using a variety of tools and effects-processing techniques
MIDI IS the control language for the synthesis part:
As well as controlling synthesis with SASL scripts, it can be controlled with MIDI
files and scores in MPEG-4. MIDI is today's most commonly used representation for
music score data, and many sophisticated authoring tools (such as sequencers) work
with MIDI.
The MIDI syntax is external to the MPEG-4 Structured Audio standard; only
references to the MIDI Manufacturers Association's definition in the standard. But in
order to make the MIDI controls work right in the MPEG context, some semantics
(what the instructions "mean") have been redefined in MPEG-4. The new semantics
.are carefully defined as part of the MPEG-4 specification
(b) What are the key distinctions between multimedia data and more conventional
types of media?
Multimedia systems deal with the generation, manipulation, storage, presentation,
and communication of information in digital form.
The data may be in a variety of formats: text, graphics, images, audio, video.
A majority of this data is large and the different media may need synchronisation - the data may have temporal relationships as an integral property.
Some media is time independent or static or discrete media: normal data, text,
single images, graphics are examples.
Video, animation and audio are examples of continuous media
13_ What key issues or problems does a multimedia system have to deal with when
handling multimedia data?
A Multimedia system has four basic characteristics:
Multimedia systems must be computer controlled.
Multimedia systems are integrated.
The information they handle must be represented digitally.
The interface to the final presentation of media is usually interactive.
CM0340
3
Multimedia systems may have to render a variety of media at the same instant -- a
distinction from normal applications. There is a temporal relationship between many
forms of media (e.g. Video and Audio. There 2 are forms of problems here
Sequencing within the media -- playing frames in correct order/time frame in
video
Synchronisation -- inter-media scheduling (e.g. Video and Audio). Lip
synchronisation is clearly important for humans to watch playback of video
and audio and even animation and audio. Ever tried watching an out of (lip)
sync film for a long time?
The key issues multimedia systems need to deal with here are:
How to represent and store temporal information.
How to strictly maintain the temporal relationships on play back/retrieval
What process are involved in the above.
Data has to represented digitally so many initial source of data needs to be digitise -translated from analog source to digital representation. The will involve scanning
(graphics, still images), sampling (audio/video) although digital cameras now exist for
direct scene to digital capture of images and video.
The data is large several Mb easily for audio and video -- therefore storage, transfer
(bandwidth) and processing overheads are high. Data compression techniques very
.common
YUV (YCrCb)
CMY/CMYK
Different models reflect need to represent colour in a perceptually
relevant model
for effective compression.
Different models also due to evolution of colour from Video
(YIQ,YUV), Display
.and Print (CMYK) media requirements (RGB)