Department of Computer Science, National Chiao-Tung University

IOE5078 (5224) Standards-based Multimedia Systems: Design and Implementation

Ÿ   Time of Offering: Fall Term, 2014

Ÿ   Level: The CS undergraduates and graduate students

Ÿ   Course Instructor

­         Wen-Hsiao Peng (彭文孝), Ph.D

­         E-mail: pawn@mail.si2lab.org

­         Office: EC431 (工三館 431)

­         Phone: 56625

­         Lab: Multimedia Architecture and Processing Laboratory (MAPL)

­         URL: http://mapl.nctu.edu.tw

Ÿ   Teaching Assistant

­         Chun-Chi Chen (陳俊吉cheerchen73@gmail.com

­         Room: ES704 (電子資訊大樓)

­         Phone: 59267

Ÿ   Course Homepage

­         http://mapl.nctu.edu.tw/course/SMSDI_2014/index.php

Ÿ   Lecture

­         The course meets on Tuesdays from 10:10am to 12:00am (2CD) and Thursdays from 15:40pm to 16:30pm (4G), in ED102.

Ÿ   Course Outline

Standardization 

Standards organization
Development process
 

Video Coding Concepts 


Capture & representation
Prediction
Transform
Quantization
Entropy coding
 

Video Compression Standards 

AVC (a.k.a H.264)
HEVC (a.k.a. H.265)
3DVC
Reading the specification
labs
 

Video Codec Implementation on Multi-core Architectures 

Multicore architecture, profiling, data parallelism
CUDA, OpenMP
Case study
 

Video Codec ASICs 

Case study
(To participate lectures)
 

Basics of Visual Search  

Gloabl image representation
Local feature representation
Local features: detection and description
Matching local features
Geometric verification of matched features
 

MPEG-7 Compact Descriptors for Visual Search (CDVS) 

System pipeline
Extraction
Encoding
Binarization
Matching
labs
 

option:
 

CDVS and Augumented Reality (AR)
SIFT Extraction with GPUs
 

Ÿ   Text Books

­         ISO/IEC FDIS 23008-2, MPEG-H (High Efficiency Coding and Media Delivery in Heterogeneous Environments) Part 2: High Efficiency Video Coding

­         ISO/IEC 14496-10:2012, MPEG-4 (Coding of Audio-Visual Objects) Part 10: Advanced Video Coding

­         ISO/IEC WD 15938-13, MPEG-7 (Multimedia Content Description Interface) Part 13: Compact Descriptors for Visual Search

­         Lecture Notes

Ÿ   Reference

­         MPEG活動相關網站 http://mpeg.chiariglione.org/

Ÿ   Grading Policy

labs 60% and final project 40% (可能變動)

Ÿ   Office Hours

­         Tuesdays/Thursdays after classes in ED102.

­         Other time slots are also possible by appointments beforehand.

Ÿ   Miscellaneous

­         10/16~10/30 - attending the MPEG Meeting, Strasbourg, France, and the International Conference on Image Processing (ICIP), Paris, France.

­         12/09~12/12attending 2014 the Asia-Pacific Signal and Information Processing Association (APSIPA), Siem Reap, city of Angkor Wat, Cambodia.