Access the full text.
Sign up today, get DeepDyve free for 14 days.
Loading next page...
/lp/association-for-computing-machinery/semantically-supervised-appearance-decomposition-for-virtual-staging-SFk3N0pBDs
References (109)
-
Jinsong Zhang, Kalyan Sunkavalli, Yannick Hold-Geoffroy, Sunil Hadap, Jonathan Eisenmann, Jean-François Lalonde (2019)
All-Weather Deep Outdoor Lighting Estimation2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
-
Kaixuan Wei, Jiaolong Yang, Ying Fu, D. Wipf, Hua Huang (2019)
Single Image Reflection Removal Exploiting Misaligned Training Data and Network Enhancements2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
-
K. Simonyan, Andrew Zisserman (2014)
Very Deep Convolutional Networks for Large-Scale Image RecognitionCoRR, abs/1409.1556
-
Zhengqi Li, Noah Snavely (2018)
CGIntrinsics: Better Intrinsic Image Decomposition through Physically-Based RenderingArXiv, abs/1808.08601
-
Evangelos Ntavelis, Andrés Romero, I. Kastanis, L. Gool, R. Timofte (2020)
SESAME: Semantic Editing of Scenes by Adding, Manipulating or Erasing Objects -
Gabriel Eilertsen, J. Kronander, G. Denes, Rafał Mantiuk, Jonas Unger (2017)
HDR image reconstruction from a single exposure using deep CNNsACM Transactions on Graphics (TOG), 36
-
Anat Levin, Yair Weiss (2004)
User Assisted Separation of Reflections from a Single Image Using a Sparsity PriorIEEE Transactions on Pattern Analysis and Machine Intelligence, 29
-
(2020)
Nerf: Representing scenes as neural radiance fields for view synthesis -
Yiwei Hu, Chen He, V. Deschaintre, Julie Dorsey, H. Rushmeier (2021)
An Inverse Procedural Modeling Pipeline for SVBRDF MapsACM Transactions on Graphics (TOG), 41
-
Jeong Park, Aleksander Holynski, S. Seitz (2020)
Seeing the World in a Bag of Chips2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
-
Zhe Chen, S. Nobuhara, K. Nishino (2020)
Invertible Neural BRDF for Object Inverse RenderingIEEE Transactions on Pattern Analysis and Machine Intelligence, 44
-
Yannick Hold-Geoffroy, A. Athawale, Jean-François Lalonde (2019)
Deep Sky Modeling for Single Image Outdoor Lighting Estimation2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
-
Kevin Karsch, Varsha Hedau, David Forsyth, Derek Hoiem (2011)
Rendering Synthetic Objects into Legacy PhotographsACM Transactions on Computer Systems, 30
-
Yunfei Liu, Yu Li, Shaodi You, Feng Lu (2019)
Unsupervised Learning for Intrinsic Image Decomposition From a Single Image2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
-
Yichang Shih, Dilip Krishnan, F. Durand, W. Freeman (2015)
Reflection removal using ghosting cues2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
-
Marc-André Gardner, Kalyan Sunkavalli, Ersin Yumer, Xiaohui Shen, Emiliano Gambaretto, Christian Gagné, Jean-François Lalonde (2017)
Learning to predict indoor illumination from a single imageACM Transactions on Graphics (TOG), 36
-
John Lambert, Zhuang Liu, Ozan Sener, James Hays, V. Koltun (2020)
MSeg: A Composite Dataset for Multi-Domain Semantic Segmentation2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
-
M. Tappen, W. Freeman, E. Adelson (2005)
Recovering intrinsic images from a single imageIEEE Transactions on Pattern Analysis and Machine Intelligence, 27
-
V. Gkitsas, N. Zioulis, Federico Álvarez, D. Zarpalas, P. Daras (2020)
Deep Lighting Environment Map Estimation from Spherical Panoramas2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
-
Evan Shelhamer, Jonathan Long, Trevor Darrell (2014)
Fully convolutional networks for semantic segmentation2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
-
R. Grosse, Micah Johnson, E. Adelson, W. Freeman (2009)
Ground truth dataset and baseline evaluations for intrinsic image algorithms2009 IEEE 12th International Conference on Computer Vision
-
Gowri Somanath, Daniel Kurz (2020)
HDR Environment Map Estimation for Real-Time Augmented RealityarXiv preprint arXiv:2011.10687 (2020).
-
Andrew Maas (2013)
Rectifier Nonlinearities Improve Neural Network Acoustic Models -
Mark Boss, Varun Jampani, Raphael Braun, Ce Liu, J. Barron, H. Lensch (2021)
Neural-PIL: Neural Pre-Integrated Lighting for Reflectance Decomposition -
Kihwan Kim, Jinwei Gu, Stephen Tyree, Pavlo Molchanov, M. Nießner, J. Kautz (2017)
A Lightweight Approach for On-the-Fly Reflectance Estimation2017 IEEE International Conference on Computer Vision (ICCV)
-
Xintao Wang, Liangbin Xie, Chao Dong, Ying Shan (2021)
Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Data2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW)
-
Richard Zhang, Phillip Isola, Alexei Efros, Eli Shechtman, Oliver Wang (2018)
The Unreasonable Effectiveness of Deep Features as a Perceptual Metric2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
-
Zhongqi Wu, Chuanqing Zhuang, Jian Shi, Jun Xiao, Jianwei Guo (2020)
Deep Specular Highlight Removal for Single Real-world ImageSIGGRAPH Asia 2020 Posters
-
Yu-Chuan Su, Kristen Grauman (2017)
Learning Spherical Convolution for Fast Features from 360° Imagery -
Jonathan Barron, Jitendra Malik (2015)
Shape, Illumination, and Reflectance from ShadingIEEE Transactions on Pattern Analysis and Machine Intelligence, 37
-
Cheng Sun, Chi-Wei Hsiao, Min Sun, Hwann-Tzong Chen (2019)
HorizonNet: Learning Room Layout With 1D Representation and Pano Stretch Data Augmentation2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
-
Mathieu Garon, Kalyan Sunkavalli, Sunil Hadap, N. Carr, Jean-François Lalonde (2019)
Fast Spatially-Varying Indoor Lighting Estimation2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
-
Jean-François Lalonde, S. Narasimhan, Alexei Efros (2010)
What Do the Sun and the Sky Tell Us About the Camera?International Journal of Computer Vision, 88
-
Jian Shi, Yue Dong, Hao Su, Stella Yu (2016)
Learning Non-Lambertian Object Intrinsics Across ShapeNet Categories2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
-
Nikolaos Arvanitopoulos, R. Achanta, S. Süsstrunk (2017)
Single Image Reflection Suppression2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
-
Diederik Kingma, Jimmy Ba (2014)
Adam: A Method for Stochastic OptimizationCoRR, abs/1412.6980
-
Zhengqin Li, Mohammad Shafiei, R. Ramamoorthi, Kalyan Sunkavalli, Manmohan Chandraker (2019)
Inverse Rendering for Complex Indoor Scenes: Shape, Spatially-Varying Lighting and SVBRDF From a Single Image2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
-
Soumyadip Sengupta, Angjoo Kanazawa, C. Castillo, D. Jacobs (2017)
SfSNet: Learning Shape, Reflectance and Illuminance of Faces 'in the Wild'2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
-
Pratul Srinivasan, B. Mildenhall, Matthew Tancik, J. Barron, Richard Tucker, Noah Snavely (2020)
Lighthouse: Predicting Lighting Volumes for Spatially-Coherent Illumination2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
-
Zhengqi Li, Noah Snavely (2018)
Learning Intrinsic Image Decomposition from Watching the World2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
-
Renjie Wan, Boxin Shi, Ling-yu Duan, A. Tan, A. Kot (2018)
CRRN: Multi-scale Guided Concurrent Reflection Removal Network2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
-
Yuchen Hong, Qian Zheng, Lingran Zhao, Xudong Jiang, A. Kot, Boxin Shi (2021)
Panoramic Image Reflection Removal2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
-
Chao Li, Yixiao Yang, Kun He, Stephen Lin, J. Hopcroft (2019)
Single Image Reflection Removal Through Cascaded Refinement2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
-
Liang-Chieh Chen, G. Papandreou, Iasonas Kokkinos, K. Murphy, A. Yuille (2016)
DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFsIEEE Transactions on Pattern Analysis and Machine Intelligence, 40
-
Yang Liu, T. Gevers, Xue-qing Li (2015)
Estimation of Sunlight Direction Using 3D Object ModelsIEEE Transactions on Image Processing, 24
-
Zian Wang, Jonah Philion, S. Fidler, J. Kautz (2021)
Learning Indoor Inverse Rendering with 3D Spatially-Varying Lighting2021 IEEE/CVF International Conference on Computer Vision (ICCV)
-
Fu-En Wang, Yu-Hsuan Yeh, Min Sun, Wei-Chen Chiu, Yi-Hsuan Tsai (2021)
LED2-Net: Monocular 360° Layout Estimation via Differentiable Depth Rendering2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
-
Kai Zhang, Fujun Luan, Qianqian Wang, Kavita Bala, Noah Snavely (2021)
PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relighting2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
-
Jean-François Lalonde, Alexei Efros, S. Narasimhan (2011)
Estimating the Natural Illumination Conditions from a Single Outdoor ImageInternational Journal of Computer Vision, 98
-
O. Ronneberger, P. Fischer, T. Brox (2015)
U-Net: Convolutional Networks for Biomedical Image SegmentationArXiv, abs/1505.04597
-
Chuhang Zou, Alex Colburn, Qi Shan, Derek Hoiem (2018)
LayoutNet: Reconstructing the 3D Room Layout from a Single RGB Image2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
-
Renjie Wan, Boxin Shi, A. Tan, A. Kot (2016)
Depth of field guided reflection removal2016 IEEE International Conference on Image Processing (ICIP)
-
V. Deschaintre, M. Aittala, F. Durand, G. Drettakis, A. Bousseau (2019)
Flexible SVBRDF Capture with a Multi‐Image Deep NetworkComputer Graphics Forum, 38
-
Soumyadip Sengupta, Jinwei Gu, Kihwan Kim, Guilin Liu, D. Jacobs, J. Kautz (2019)
Neural Inverse Rendering of an Indoor Scene From a Single Image2019 IEEE/CVF International Conference on Computer Vision (ICCV)
-
Zhengqin Li, Kalyan Sunkavalli, Manmohan Chandraker (2018)
Materials for Masses: SVBRDF Acquisition with a Single Mobile Phone ImageArXiv, abs/1804.05790
-
Semantically Supervised Appearance Decomposition for Virtual Staging from a Single Panorama • -
Jingdong Wang, Ke Sun, Tianheng Cheng, Borui Jiang, Chaorui Deng, Yang Zhao, Dong Liu, Yadong Mu, Mingkui Tan, Xinggang Wang, Wenyu Liu, Bin Xiao (2019)
Deep High-Resolution Representation Learning for Visual RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 43
-
Yu-Chuan Su, K. Grauman (2018)
Kernel Transformer Networks for Compact Spherical Convolution2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
-
R. Tan, K. Ikeuchi (2003)
Separating reflection components of textured surfaces using a single imageIEEE Transactions on Pattern Analysis and Machine Intelligence, 27
-
Ruizhen Hu, Xiangyu Su, Xiang Chen, Oliver Kaick, Hui Huang (2022)
Photo-to-shape material transfer for diverse structuresACM Transactions on Graphics (TOG), 41
-
V. Deschaintre, M. Aittala, F. Durand, G. Drettakis, A. Bousseau (2018)
Single-image SVBRDF capture with a rendering-aware deep networkACM Transactions on Graphics (TOG), 37
-
X. Zhang, Ren Ng, Qifeng Chen (2018)
Single Image Reflection Separation with Perceptual Losses2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
-
Richard Zhang, Phillip Isola, Alexei A Efros, Eli Shechtman, Oliver Wang (2018a)
The unreasonable effectiveness of deep features as a perceptual metricProceedings of the IEEE conference on computer vision and pattern recognition
-
Marshall Tappen, William Freeman, Edward Adelson (2003)
Recovering Intrinsic Images from a Single ImageAdvances in Neural Information Processing Systems
-
John Lin, M. Seddik, M. Tamaazousti, Y. Tamaazousti, A. Bartoli (2019)
Deep Multi-class Adversarial Specularity RemovalArXiv, abs/1904.02672
-
Zhengqin Li, Ting Yu, S. Sang, Sarah Wang, Sai Bi, Zexiang Xu, Hong-Xing Yu, Kalyan Sunkavalli, Miloš Hašan, R. Ramamoorthi, Manmohan Chandraker (2020)
OpenRooms: An End-to-End Open Framework for Photorealistic Indoor Scene DatasetsArXiv, abs/2007.12868
-
Salma Jiddi, P. Robert, É. Marchand (2020)
Detecting Specular Reflections and Cast Shadows to Estimate Reflectance and Illumination of Dynamic Indoor ScenesIEEE Transactions on Visualization and Computer Graphics, 28
-
Qingnan Fan, Jiaolong Yang, G. Hua, Baoquan Chen, D. Wipf (2017)
A Generic Deep Architecture for Single Image Reflection Removal and Image Smoothing2017 IEEE International Conference on Computer Vision (ICCV)
-
Berk Kaya, Suryansh Kumar, C. Oliveira, V. Ferrari, L. Gool (2020)
Uncalibrated Neural Inverse Rendering for Photometric Stereo of General Surfaces2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
-
Duan Gao, Xiao Li, Yue Dong, P. Peers, Kun Xu, Xin Tong (2019)
Deep inverse rendering for high-resolution SVBRDF estimation from an arbitrary number of imagesACM Transactions on Graphics (TOG), 38
-
Fu-En Wang, Yu-Hsuan Yeh, Min Sun, Wei-Chen Chiu, Yi-Hsuan Tsai
2021cLED2-Net: Monocular 360deg Layout Estimation via Differentiable Depth Rendering. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
-
Yannick Hold-Geoffroy, Kalyan Sunkavalli, Sunil Hadap, Emiliano Gambaretto, Jean-François Lalonde (2016)
Deep Outdoor Illumination Estimation2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
-
Dmitry Ulyanov, A. Vedaldi, V. Lempitsky (2016)
Instance Normalization: The Missing Ingredient for Fast StylizationArXiv, abs/1607.08022
-
Sergey Ioffe, Christian Szegedy (2015)
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate ShiftArXiv, abs/1502.03167
-
Michael Janner, Jiajun Wu, Tejas Kulkarni, Ilker Yildirim, J. Tenenbaum (2017)
Self-Supervised Intrinsic Image DecompositionArXiv, abs/1711.03678
-
Justin Johnson, Alexandre Alahi, Li Fei-Fei (2016)
Perceptual Losses for Real-Time Style Transfer and Super-ResolutionArXiv, abs/1603.08155
-
Zhixin Shu, Ersin Yumer, Sunil Hadap, Kalyan Sunkavalli, Eli Shechtman, D. Samaras (2017)
Neural Face Editing with Intrinsic Image Disentangling2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
-
Stamatios Georgoulis, Konstantinos Rematas, Tobias Ritschel, E. Gavves, Mario Fritz, L. Gool, T. Tuytelaars (2018)
Reflectance and Natural Illumination from Single-Material Specular Objects Using Deep LearningIEEE Transactions on Pattern Analysis and Machine Intelligence, 40
-
Hui-Liang Shen, Zhi-Huan Zheng (2013)
Real-time highlight removal using intensity ratio.Applied optics, 52 19
-
Yizhou Yu, P. Debevec, J. Malik, Tim Hawkins (1999)
Inverse global illumination: recovering reflectance models of real scenes from photographsProceedings of the 26th annual conference on Computer graphics and interactive techniques
-
Gowri Somanath, Daniel Kurz (2020)
HDR Environment Map Estimation for Real-Time Augmented Reality2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
-
Qingxiong Yang, Shengnan Wang, N. Ahuja (2010)
Real-Time Specular Highlight Removal Using Bilateral Filtering -
Mark Boss, V. Jampani, Kihwan Kim, H. Lensch, J. Kautz (2020)
Two-Shot Spatially-Varying BRDF and Shape Estimation2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
-
A. Baslamisli, P. Das, Hoang-An Le, Sezer Karaoglu, Theo Gevers (2019)
ShadingNet: Image Intrinsics by Fine-Grained Shading DecompositionInternational Journal of Computer Vision, 129
-
Mark Boss, Raphael Braun, V. Jampani, J. Barron, Ce Liu, H. Lensch (2020)
NeRD: Neural Reflectance Decomposition from Image Collections2021 IEEE/CVF International Conference on Computer Vision (ICCV)
-
Marc-André Gardner, Yannick Hold-Geoffroy, Kalyan Sunkavalli, Christian Gagné, Jean-François Lalonde (2019)
Deep Parametric Indoor Lighting Estimation2019 IEEE/CVF International Conference on Computer Vision (ICCV)
-
Yu Li, M. Brown (2014)
Single Image Layer Separation Using Relative Smoothness2014 IEEE Conference on Computer Vision and Pattern Recognition
-
Vinod Nair, Geoffrey Hinton (2010)
Rectified Linear Units Improve Restricted Boltzmann Machines -
S. Shafer (1985)
Using color to separate reflection components, 10
-
Zhen Dong, Ke Xu, Yin Yang, H. Bao, Weiwei Xu, Rynson Lau (2020)
Location-aware Single Image Reflection Removal2021 IEEE/CVF International Conference on Computer Vision (ICCV)
-
G. Pintore, Marco Agus, E. Gobbetti (2020)
AtlantaNet: Inferring the 3D Indoor Layout from a Single $360^\circ $ Image Beyond the Manhattan World Assumption -
(2010)
Mitsuba renderer -
Jie Guo, Zuojian Zhou, Limin Wang (2018)
Single Image Highlight Removal with a Sparse and Low-Rank Reflection Model -
Hyeongwoo Kim, Hailin Jin, Sunil Hadap, In-So Kweon (2013)
Specular Reflection Separation Using Dark Channel Prior2013 IEEE Conference on Computer Vision and Pattern Recognition
-
Jean-François Lalonde, Srinivasa G Narasimhan, Alexei A Efros (2010)
What do the sun and the sky tell us about the camera? International Journal of Computer Vision 88, 1 (2010), 24--51What do the sun and the sky tell us about the camera? International Journal of Computer Vision
-
Bolei Zhou, Hang Zhao, Xavier Puig, S. Fidler, Adela Barriuso, A. Torralba (2017)
Scene Parsing through ADE20K Dataset2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
-
Tristan Swedish, Connor Henley, R. Raskar (2021)
Objects as Cameras: Estimating High-Frequency Illumination from Shadows2021 IEEE/CVF International Conference on Computer Vision (ICCV)
-
Henrique Weber, D. Prévost, Jean-François Lalonde (2018)
Learning to Estimate Indoor Lighting from 3D Objects2018 International Conference on 3D Vision (3DV)
-
Gang Fu, Qing Zhang, Lei Zhu, Ping Li, Chunxia Xiao (2021)
A Multi-Task Network for Joint Specular Highlight Detection and Removal2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
-
Kevin Karsch, Kalyan Sunkavalli, Sunil Hadap, N. Carr, Hailin Jin, Rafael Fonte, Michael Sittig, D. Forsyth (2014)
Automatic Scene Inference for 3D Object CompositingACM Transactions on Graphics (TOG), 33
-
Jia Zheng, Junfei Zhang, Jing Li, Rui Tang, Shenghua Gao, Zihan Zhou (2019)
Structured3D: A Large Photo-realistic Dataset for Structured 3D Modeling -
Kevin Karsch, Varsha Hedau, D. Forsyth, Derek Hoiem (2011)
Rendering synthetic objects into legacy photographsProceedings of the 2011 SIGGRAPH Asia Conference
-
Tatsumi Uezato, D. Hong, N. Yokoya, Wei He (2020)
Guided Deep Decoder: Unsupervised Image Pair Fusion -
Junxuan Li, Hongdong Li, Y. Matsushita (2021)
Lighting, Reflectance and Geometry Estimation from 360° Panoramic Stereo2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
-
S. Cruz, Will Hutchcroft, Yuguang Li, Naji Khosravan, Ivaylo Boyadzhiev, S. Kang (2021)
Zillow Indoor Dataset: Annotated Floor Plans With 360° Panoramas and 3D Room Layouts2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
-
M. Aittala, Tim Weyrich, J. Lehtinen (2015)
Two-shot SVBRDF capture for stationary materialsACM Transactions on Graphics (TOG), 34
-
Sean Bell, Kavita Bala, Noah Snavely (2014)
Intrinsic images in the wildACM Transactions on Graphics (TOG), 33
-
Edward Zhang, Michael Cohen, B. Curless (2016)
Emptying, refurnishing, and relighting indoor spacesACM Transactions on Graphics (TOG), 35
-
Y. Akashi, Takayuki Okatani (2014)
Separation of reflection components by sparse non-negative matrix factorization
- Publisher
- Association for Computing Machinery
- Copyright
- Copyright © 2022 ACM
- ISSN
- 0730-0301
- eISSN
- 1557-7368
- DOI
- 10.1145/3528223.3530148
- Publisher site
- See Article on Publisher Site
Abstract
We describe a novel approach to decompose a single panorama of an empty indoor environment into four appearance components: specular, direct sunlight, diffuse and diffuse ambient without direct sunlight. Our system is weakly supervised by automatically generated semantic maps (with floor, wall, ceiling, lamp, window and door labels) that have shown success on perspective views and are trained for panoramas using transfer learning without any further annotations. A GAN-based approach supervised by coarse information obtained from the semantic map extracts specular reflection and direct sunlight regions on the floor and walls. These lighting effects are removed via a similar GAN-based approach and a semantic-aware inpainting step. The appearance decomposition enables multiple applications including sun direction estimation, virtual furniture insertion, floor material replacement, and sun direction change, providing an effective tool for virtual home staging. We demonstrate the effectiveness of our approach on a large and recently released dataset of panoramas of empty homes.
Journal
ACM Transactions on Graphics (TOG) – Association for Computing Machinery
Published: Jul 22, 2022
Keywords: appearance decomposition