Download PDF:
IAT455-1a-2010.pdf
Credit Hours: 3
Instructors:
Philippe Pasquier
Location: SFU Surrey, Room 3340
Semester: Spring 2010
Course Description:
The representation of media is introduced: specifically, one dimensional (sound), two dimensional (images) and three dimensional (moving images).
This course focuses on techniques and methods for creating digital media special effects, allowing students to explore their creativity while extending their graphics and programming skills in digital media. Computational techniques based on signal processing are developed that support the creation, manipulation, combination, transformation, compression, storage and display/performance of different media forms. An important aspect is representation in the temporal/spatial vs. the frequency domain and different transformation techniques.
Students will be required to generate special effects, critique and analyze effects from movies, develop skills and abilities to manipulate digital images, video and audio, and implement their own algorithms to express their technical and artistic skills.
Learning Outcomes:
In this course students will learn:
- An introduction to media forms.
- The representation of media: one dimensional (i.e. sound or sensor data), two dimensional (i.e. images) and different representations of color, three dimensional (i.e. moving images – film, video), Nyquist’s Theorem and anti-aliasing, conversion between digital and analog and storage requirements.
- The fundamentals of digital signal processing. The creation, manipulation, combination, transformation, compression and storage of different media forms.
- To use MATLAB for digital signal processing.
- Fourier transformation between the temporal/spatial and frequency domains.
- An introduction to other transforms: Haar, Walsh and Wavelets.
- Filtering media.
- Transmission of media: coding and error correction, compression.
- Layers, Compositing, Chroma and other keys.
- Camera calibration.
- Image based rendering.
- Laplacian Pyramid.
Delivery Method:
Lectures (LEC) and Studio Lab (STL)
Learning Activities + Evaluation:
Assignment 1 (image): 10%
Assignment 2 (sound): 10%
Assignment 3 (video): 10%
Mid-term exam: 20%
Course project: 20%
Participation, workshop tasks: 10%
Final exam: 20%
Texts, Resources + Materials:
Required Text:
“Fundamentals of Multimedia” (2004) by Ze-Nian Li, Mark Drew; 1st Edition; Prentice Hall; ISBN 9780130618726
Recommended Texts:
“Digital Signal Processing: A Hands-On Approach” (2003) by Charles Schuler, Mahesh Chugani; McGraw-Hill; ISBN 9789780078297441
"DSP First: A Multimedia Approach" (1998) by James H. McClellan, Ronald W. Schafer, Mark A. Yoder; Prentice Hall; ISBN 9780132431712
Reference Texts:
“Digital Signal Processing Demystified” by J. Broesch; (1997); LLH Technology Publishing; ISBN: 1-878707-16-7
“Digital Signal Processing - A Practical Guide for Engineers and Scientists” by Steven W. Smith; (2003); Elsevier Science; ISBN: 0-7506-7444-X
“Display Systems: Design and Applications” by L. W. Macdonald & A. C. Lowe; (1997); Wiley; ISBN: 0-471-95870-0
“Display Interfaces: Fundamentals and Standards” by R. L. Myers; (2002); Wiley; ISBN: 0-471-49946-3
Papers:
“Feature-Based Image Metamorphosis” by Beier & Neely; (1992); SIGGRAPH
“The Laplacian Image as a Compact Image Code” by Burt & Adelson; IEEE Trans. Communications 31(4):532-540; April 1983
“A Multiresolution Spline with Application to Image Mosaics” by Burt & Adelson; ACM Trans. Graphics 2(4):217-236; October 1983
“View Interpolation for Image Synthesis” by Chen & Williams; (1993); SIGGRAPH
“Tour Into the Picture: Using a Spidery Mesh Interface to Make Animation from a Single Image” by Horry, Anyio & Arai; (1997); SIGGRAPH
“Light Field Rendering” by Levoy & Hanrahan; (1996); SIGGRAPH
“View Morphing” by Seitz & Dyer; (1992); SIGGRAPH
“A Flexible New Technique for Camera Calibration” by Zhang; Microsoft Research Tech Report MSR-TR-98-71 http://research.microsoft.com/~zhang/Papers/TR98-71.pdf
Prerequisites:
IAT 265 and MACM 101. Recommended: MATH 151 or equivalent.
Last Updated: November 9, 2009
These course outlines are drafts and are subject to change.
