TY - JOUR AU - Magnor, Marcus AB - Garment Replacement in Monocular Video Sequences LORENZ ROGGE, FELIX KLOSE, MICHAEL STENGEL, MARTIN EISEMANN, and MARCUS MAGNOR Technische Universitat Braunschweig ยจ We present a semi-automatic approach to exchange the clothes of an actor for arbitrary virtual garments in conventional monocular video footage as a postprocess. We reconstruct the actor's body shape and motion from the input video using a parameterized body model. The reconstructed dynamic 3D geometry of the actor serves as an animated mannequin for simulating the virtual garment. It also aids in scene illumination estimation, necessary to realistically light the virtual garment. An image-based warping technique ensures realistic compositing of the rendered virtual garment and the original video. We present results for eight real-world video sequences featuring complex test cases to evaluate performance for different types of motion, camera settings, and illumination conditions. Categories and Subject Descriptors: I.3.7 [Computer Graphics]: ThreeDimensional Graphics and Realism--Virtual reality; I.3.8 [Computer Graphics]: Applications; I.4.8 [Computer Graphics]: Scene Analyis; I.6.3 [Computer Graphics]: Simulation--Applications General Terms: Algorithms Additional Key Words and Phrases: Animation, image-based techniques, garment simulation, lighting reconstruction, video augmentation ACM Reference Format: Lorenz Rogge, Felix Klose, Michael Stengel, Martin Eisemann, and Marcus Magnor. 2014. Garment replacement in monocular video sequences. TI - Garment Replacement in Monocular Video Sequences JO - ACM Transactions on Graphics (TOG) DO - 10.1145/2634212 DA - 2014-12-29 UR - https://www.deepdyve.com/lp/association-for-computing-machinery/garment-replacement-in-monocular-video-sequences-GigW02yyXh SP - 1 VL - 34 IS - 1 DP - DeepDyve ER -