Time Schedule:
Jenq-Neng Hwang
E E 587
Seattle Campus
Addresses four major components of multimedia: 1) data compression of multimedia (e.g., speech, audio, image, and video); 2) quality of service (QoS) issues for data transmission over IP; 3) multimedia streaming and conferencing applications; and 4) intellectual property management and protection (IPMP) of multimedia contents. Co-requisite: E E 518.
Class description
Introduction:
With the fast technological progress in image/video sensors and very powerful CPU and graphic processing with less power consumption and much cheaper memory storage, multimedia signal processing and data compression have become reality nowadays. Moreover, built upon the mature IP based Internet and advanced compression standards of multimedia data, the new forms of wired/wireless networked multimedia applications have created a tremendous impact on computing and network infrastructures. These applications range from IPTV, interactive TV, audio/video messenging, and telematics for intelligent transportation systems (ITS), etc. To ensure the interoperability and QoS support of these applications, international standards ranging from multimedia data compression, streaming transport protocols, IP network layer routing, as well as link layer adaptation, etc, have been actively proposed or finalized. Another critical aspect of efficient management of multimedia data is the intellectual property management and protection, which prevents the disseminated and collected data from being illegally copied or modified. In this class, we would like to discuss the advanced theories and technologies behind these emerging networked multimedia applications, as well as the deployed or soon-to-be deployed practical applications. Prerequisite: graduate standing (knowledge on digital signal processing, image processing, and networking is highly recommended)
Goals: The goal of this course is to introduce students, who are majoring in Signal/Image Processing and Communications, the integration of multimedia signals and their transmission over IP networks. Important issues such as data compression, network protocols, multimedia standards, quality of service, system integration, etc. will be discussed.
Lecture Time: Mon 6:00 ¡V 8:50,
Office Hours: MW 3:00 ¡V 5:50, EEB M426
Grading:
„X 3 Biweekly Homework: 45% „X Midterm Exam: 25% (7th week), „X Final Exam: 30% (Final Week)
Lecture Notes: All lecture notes in printed PowerPoint formats and simulation software will be available before classes
Textbook: Jenq-Neng Hwang, ¡§Multimedia Networking, from Theory to Practice,¡¨ Cambridge University Press, April. 2009.
Lecture Outline
1): Multimedia Compression (Coding) Standards (3 weeks) „X Class Overview and Grading Policy „X Speech Coding (FS1015, FS1016, GSM, VSELP, , G.728, G.723.1, G.729) „X Audio Coding (MP3, AAC, HE AAC, AC3) „X Image Coding (JPEG, JPEG2000) „X Video Coding (H.263, MPEG1-2, H.264/AVC, H.264/SVC, WMV) „X Systems (MPEG-2, MP4, 3GPP)
2): Multimedia Streaming Architecture and QoS (3 weeks) „X Digital Broadcast Standards: DVB, DMB, ATSC, and ISDB „X QoS structures of IP Networks „X Architecture for Multimedia Streaming over IP networks „X IP Streaming Protocols (MPEG-2, RTP/RTCP, RTSP, MMS) „X Interactive IP Streaming Protocols (H.323, SIP) „X Proprietary Streaming Systems (RealSystems, Quicktime, MS WMT, MS IPTV) „X Scalable Streaming for Heterogeneous Systems (Layered Multicast, Application Level Multicast and P2P Live Streaming) „X IPTV Architectures „X Multimedia over Wireless Broadband and QoS
3): Multimedia Intellectual Property Management and Protection (3 weeks) „X Digital Watermarking Taxonomy „X Digital Watermarking of Image/Audio/Video „X Secret Key Cryptography (DES & AES) „X Public Key Cryptography (RSA) „X Authentication and Digital Signature „X Digital Certificate and Public Key Infrastructure (PKI) „X Digital Rights Management and Standards
Student learning goals
General method of instruction
Recommended preparation
Class assignments and grading
