1 introduction
1.1 branch-overlapping aspects of multimedia
1.2 content
1.3 global structure
1.4 multimedia literature
2 multimedia：media and data streams
2.1 medium
2.1.1 the perception medium
2.1.2 the representation medium
2.1.3 the presentation medium
2.1.4 the storage medium
2.1.5 the transmission medium
2.1.6 the information exchange medium
2.1.7 representation values and representation spaces
2.1.8 representation dimensions
2.2 main properties of a multimedia system
2.2.1 multimedia system definition
2.2.2 combination of media
2.2.3 independence
2.2.4 computer-supported integration
2.2.5 communication systems
2.3 multimedia
2.4 traditional data streams characteristics
2.4.1 asynchronous transmission mode
2.4.2 synchronous transmission mode
2.4.3 isochronous transmission mode
2.5 data stream characteristics for continuous media
2.5.1 the time interval between a complete transmission of consecutive packets
2.5.2 variation of consecutive packet amount
2.5.3 contiguous packets
2.6 information units
3 sound/audio
3.1 basic sound concepts
3.1.1 computer representation of sound
3.1.2 audio formats
3.2 music
3.2.1 midi basic concepts
3.2.2 midi devices
3.2.3 midi messages
3.2.4 midi and smpte timing standards
3.2.5 midi software
3.3 speech
3.3.1 speech generation
3.3.2 speech analysis
3.3.3 speech transmission
4 images and graphics
4.1 basic concepts
4.1.1 digital image representation
4.1.2 image format
4.2 computer image processing
4.2.1 image synthesis
4.2.2 image analysis
4.2.3 image transmission
4.3 comments
5 video and animation
5.1 basic concepts
5.1.1 video signal representation
5.1.2 computer video format
5.2 television
5.2.1 conventional systems
5.2.2 enhanced definition systems
5.2.3 high-definition systems
5.2.4 transmission
5.3 computer-based animation
5.3.1 basic concepts
5.3.2 animation languages
5.3.3 methods of controlling animation
5.3.4 display of animation
5.3.5 transmission of animation
5.3.6 comments
6 data compression
6.1 storage space
6.2 coding requirements
6.3 source，entropy and hybrid coding
6.4 some basic compression techniques
6.5 jpeg
6.5.1 image preparation
6.5.2 lossy sequential dct-based mode
6.5.3 expanded lossy dct-based mode
6.5.4 lossless mode
6.5.5 hierarchical mode
6.6 h.261(px64)
6.6.1 image preparation
6.6.2 coding algorithms
6.6.3 data stream
6.7 mpeg
6.7.1 video encoding
6.7.2 audio encoding
6.7.3 data stream
6.7.4 mpeg-2
6.7.5 mpeg-4
6.8 dvi
6.8.1 video encoding
6.8.3 data stream
6.9 comments
7 optical storage media
7.1 history
7.2 basic technology
7.3 video disks and other worms
7.4 compact disk digital audio
7.4.1 preliminary technical background
7.4.2 eight-to-fourteen modulation
7.4.3 error handling
7.4.4 frames，tracks，areas and blocks of a cd-da
7.4.5 advantages of digital cd-da technology
7.5 compact disk read only memory
7.5.1 blocks
7.5.2 modes
7.5.3 logical data format
7.5.4 limitations of the cd-rom technology
7.6 cd-rom extended architecture
7.6.1 form 1 and form 2
7.6.2 compressed data of different media
7.7 further cd-rom-based developments
7.7.1 compact disk interactive
7.7.2 compact disk interactive ready format
7.7.3 compact disk bridge disk
7.7.5 digital video interactive
7.8 compact disk write once
7.8.1 principle of the cd-wo
7.8.2 sessions
7.9 compact disk magneto optical
7.9.1 principle of the magnetic-optical method
7.9.2 areas of the cd-mo
8 computer technology
8.1 communication architecture
8.1.1 hybrid systems
8.1.2 digital systems
8.2 multimedia workstation
8.3 comments
9 multimedia operating systems
9.1 introduction
9.2 real time
9.2.1 the notion of “real-time”
9.2.2 real time and multimedia
9.3 resource management
9.3.1 resources
9.3.2 requirements
9.3.3 components and phases
9.3.4 allocation scheme
9.3.5 continuous media resource model
9.4 process management
9.4.1 real time process management in conventional operating systems：an example
9.4.2 real-time processing requirements
9.4.3 traditional real-time scheduling
9.4.4 real-time scheduling：systim model
9.4.5 earliest deadline first algorithm
9.4.6 rate monotonic algorithm
9.4.7 edf and rate monotonic：context switches
9.4.8 edf and rate monotonic：processor utilizations
9.4.9 extensions to rate monotonic scheduling
9.4.10 other approaches for in-time scheduling
9.4.11 preemptive versus non-preemptive task scheduling
9.4.12 scheduling of continuous media tasks：prototype operating systems
9.5 file systems
9.5.1 traditional file systems
9.5.2 multimedia file systems
9.6 additional operating system issues
9.6.1 additional operating system issues
9.6.2 memory management
9.6.3 device management
9.7 system architecture
9.7.1 unix-based systems
9.7.2 quicktime
9.7.3 windows multimedia extensions
9.7.4 os/2 multimedia presentation manager/2
9.8 concluding remarks
10 networking systems
10.1 layers，protocols and services
10.2 networks
10.3 local area networks(lans)
10.3.1 high-speed ethernet
10.3.2 token ring
10.3.3 fddi
10.3.4 local atm networks
10.4 metropolitan area networks(mans)
10.4.1 distributed queue dual bus(dqdb)
10.4.2 orwell
10.4.3 man connectivity to atm networks
10.5 wide area networks(wans)
10.5.1 traditional wan's
10.5.2 b-isdn:atm
10.6 conclusion
11 multimedia communication systems
11.1 application subsystem
11.1.1 collaborative computing
11.1.2 session management
11.2 transport subsystem
11.2.1 requirements
11.2.2 transport layer
11.2.3 network layer
11.3 quality of service and resource management
11.3.1 basic concepts
11.3.2 establishment and closing of the multimedia call
11.3.3 managing resources during multimedia transmission
11.3.4 architectural issues
11.4 comments
11.4.1 trends in collaborative computing
11.4.2 trends in transport systems
12 database systems
12.1 multimedia database management system
12.2 characteristics of an mdbms
12.3 data analysis
12.4 data structure
12.4.1 raw data
12.4.2 registering data
12.4.3 descriptive data
12.4.4 examples of multimedia structures
12.4.5 comments on data analysis
12.5 operations on data
12.6 integration in a database model
12.6.1 relational database model
12.6.2 object-oriented database model
12.7 comments
13 documents，hypertext and mheg
13.1 documents
13.1.1 document architecture
13.1.2 manipulation of multimedia data
13.2 hypertext and hypermedia
13.2.1 hypertext，hypermedia and multimedia
13.2.2 hypermedia systems：an example
13.2.3 history
13.2.4 systems：architecture，nodes and pointers
13.2.5 some final comments about hypertext systems
13.3 document architecture sgml
13.3.1 some details
13.3.2 sgml and multimedia
13.3.3 closing comments about sgml
13.4 document architecture oda
13.4.1 some details on oda
13.4.2 oda and multimedia
13.5 mheg
13.5.1 example of an interactive multimedia presentation
13.5.2 derivation of a class hierarchy
13.5.3 contents
13.5.4 behavior
13.5.5 user interaction
13.5.6 container
13.5.7 closing comments
14 user interfaces
14.1 general design issues
14.1.1 architectural issues
14.1.2 information characteristics for presentation
14.1.3 presentation function
14.1.4 presentation design knowledge
14.1.5 effective human-computer interaction
14.2 current work
14.3 extension through video and audio
14.4 video at the user interface
14.4.1 hardware for visualization of motion pictures
14.4.2 example：remote camera control application
14.5 audio at the user interface
14.6 user-friendliness as the primary goal
14.6.1 easy to learn instructions
14.6.2 context-sensitive help functions
14.6.3 easy to remember instructions
14.6.4 effective instructions
14.6.5 aesthetics
14.6.6 effective implementation support
14.6.7 entry elements
14.6.8 meaningful location of functions
14.6.9 presentation
14.6.10 dialogue boxes
14.6.11 additional design criteria
14.6.12 design-specific criteria
14.7 comments
15 synchronization
15.1 introduction
15.2 notion of synchronization
15.2.1 multimedia systems
15.2.2 basic synchronization issues
15.2.3 intra-and inter-object synchronization
15.2.4 live and synthetic synchronization
15.2.5 comment
15.3 presentation requirements
15.3.1 lip synchronization requirements
15.3.3 elementary media synchronization
15.4 a reference model for multimedia synchronization
15.4.1 existing classification approaches
15.4.2 the synchronization reference model
15.4.3 synchronization in a distributed environment
15.4.4 aggregate characteristics of the synchronization reference model
15.5 synchronization specification
15.5.1 quality of service
15.5.2 multimedia synchronization specification methods
15.5.3 interval-based specifications
15.5.4 axes-based synchronization
15.5.5 control flow-based specification
15.5.6 event-based synchronization
15.5.7 scripts
15.5.8 comment
15.6 case studies
15.6.1 synchronization in mheg
15.6.2 hytime
15.6.3 firefly system
15.6.4 mode
15.6.5 multimedia tele-orchestra
15.6.6 littles framework
15.6.7 acme
15.6.8 further synchronization-related systems
15.6.9 comment
15.7 summary and outlook
15.7.1 summary
15.7.2 future topics
15.7.3 conclusion
16 abstractions for programming
16.1 abstraction levels
16.2 libraries
16.3 system software
16.3.1 data as time capsules
16.3.2 data as streams
16.4 toolkits
16.5 higher programming languages
16.5.1 media as types
16.5.2 media as files
16.5.3 media as processes
16.5.4 programming language requirements
16.6 object-oriented approaches
16.6.1 application-specific metaphors as classes
16.6.2 application-generic metaphors as classes
16.6.3 devices as classes
16.6.4 processing units as classes
16.6.5 media as classes
16.6.6 communication-specific metaphors as classes
16.7 comments
17 multimedia applications
17.1 introduction
17.1.1 programs
17.1.2 structure
17.2 media preparation
17.2.2 remarks on the current status
17.3 media composition
17.3.1 text and graphics editors
17.3.2 image editors
17.3.3 animation editors
17.3.4 sound editors
17.3.5 video editors
17.4 media integration
17.4.1 multimedia editors
17.4.2 hypermedia/hypertext editors
17.4.3 authoring tools
17.5 media communication
17.5.1 tele-services
17.5.2 implementation of conversational services
17.5.3 implementation of messaging services
17.5.4 implementation of retrieval services
17.5.5 implementation of tele-action services
17.5.6 implementation of tele-operation services
17.5.7 applications of tele-services
17.6 media consumption
17.6.1 viewing multimedia documents
17.6.2 books：proceedings and newspapers
17.6.3 kiosks
17.6.4 tele-shopping
17.7 media entertainment
17.7.1 virtual reality
17.7.2 interactive video
17.7.3 interactive audio
17.7.4 games
17.8 trends
18 future directions
18.1 where are we today?
18.1.1 user interface
18.1.2 operating systems
18.1.3 multimedia documents
18.1.4 synchronization
18.1.5 programming
18.2 what are the next steps?
18.2.1 devices
18.2.2 visualization
18.2.3 mobility
18.2.4 interactivity
18.2.5 operating systems
18.2.6 further issues in virtual environments
18.2.7 multimedia user interface
18.2.8 hypermedia
18.2.9 multimedia applications
18.3 what are the multimedia research issues?
a abbreviations
bibliography
index
· · · · · · (收起)