Computer Vision for Visual Effects

Modern blockbuster movies seamlessly introduce impossible characters and action into real-world settings using digital visual effects. These effects are made possible by research from the field of computer vision, the study of how to automatically understand images. Computer Vision for Visual Effects will educate students, engineers and researchers about the fundamental computer vision principles and state-of-the-art algorithms used to create cutting-edge visual effects for movies and television. The author describes classical computer vision algorithms used on a regular basis in Hollywood (such as blue screen matting, structure from motion, optical flow and feature tracking) and exciting recent developments that form the basis for future effects (such as natural image matting, multi-image compositing, image retargeting and view synthesis). He also discusses the technologies behind motion capture and three-dimensional data acquisition. More than 200 original images demonstrating principles, algorithms and results, along with in-depth interviews with Hollywood visual effects artists, tie the mathematical concepts to real-world filmmaking. "Hollywood's achievements in visual effects have been enabled not just by advances in computer graphics, but just as much by techniques from the neighboring field of computer vision. Vision techniques such as camera tracking, 3D reconstruction, and face and body motion capture contribute to most of the visual effects shots we see today. Rich Radke's book Computer Vision for Visual Effects begins with the basics and shows how math, geometry, image processing, and scene understanding comprise these tools that create the movies. Read it and you'll understand an important part of the magic that makes the films we love." Paul Debevec, Scientific and Engineering Academy Award Winner for Lightstage Work "Richard Radke has produced a computer vision textbook like no other. The field of computer vision is vast and varied and many techniques apply to only a small number of applications. This book does something completely novel: not only does it provide a clear, current, and detailed examination and explanation of the latest computer vision techniques, it also shows how these techniques are used in the practice of visual effects. Including interviews with visual effects practitioners, this book answers the question, 'That's a cool technique, but is it useful?' and it does it in a complete, well-written, and engaging way. Anyone thinking of applying computer vision techniques to visual effects problems (and more) should run to get a copy of this book." Doug Roble, Digital Domain "The visual effects industry relies intimately on highly sophisticated computer vision algorithms and also provides one of the primary application areas for such algorithms. Richard Radke's comprehensive textbook on these subjects reviews hundreds of such algorithms with applications to topics such as image matting and compositing, feature tracking and matchmoving, motion capture, and 3D model acquisition. It will surely find a prominent place on both visual effect practitioners' and computer vision researchers' bookshelves." Richard Szeliski, Microsoft Research1. Introduction; 2. Image matting; 3. Image compositing and editing; 4. Features and matching; 5. Dense correspondence and its applications; 6. Matchmoving; 7. Motion capture; 8. Three-dimensional data acquisition; Appendix: optimization algorithms for computer vision.