Weakly-Supervised Component Suggestions for 3D Modeling

Abstract

We present a system for adaptive synthesis of indoor scenes given an empty room and only a few object categories. Automatically suggesting indoor objects and proper layouts to convert an empty room to a 3D scene is challenging, since it requires interior design knowledge to balance the factors like space, path distance, illumination and object relations, in order to insure the functional plausibility of the synthesized scenes. We exploit a database of 2D floor plans to extract object relations and provide layout examples for scene synthesis. With the labeled human positions and directions in each plan, we detect the activity relations and compute the coexistence frequency of object pairs to construct activity-associated object relation graphs. Given the input room and user-specified object categories, our system first leverages the object relation graphs and the database floor plans to suggest more potential object categories beyond the specified ones to make resulting scenes functionally complete, and then uses the similar plan references to create the layout of synthesized scenes. We show various synthesis results to demonstrate the practicability of our system, and validate its usability via a user study. We also compare our system with the state-of-the-art furniture layout and activity-centric scene representation methods, in terms of functional plausibility and user friendliness.

Downloads

Disclaimer: The paper listed on this page is copyright-protected. By clicking on the paper link below, you confirm that you or your institution have the right to access the corresponding pdf file.
Any questions, please contact Bin Zhou: zhoubin@buaa.edu.cn

  1. Paper: [PDF]

  2. Supplemental Video: [MP4]

  3. Data: [V0.5-floor plan labels] [V1.0-funiture objects]

  4. Data visualization code: Coming soon...

  5. System code: Coming soon...

Bibtex

@article {fu_siga17,
   author = { Qiang Fu and Xiaowu Chen and Xiaotian Wang and Sijia Wen and Bin Zhou and Hongbo Fu},
    title = {Adaptive Synthesis of Indoor Scenes via Activity-Associated Object Relation Graphs},
   journal = {ACM Transactions on Graphics (Proc. SIGGRAPH ASIA)},
   volume = {36},
   number = {6},
   pages = {Article No. 201},
   year = {2017}

© Copyright 2018 Bin Zhou. Thanks to the template from Hao Su and Kai Xu. Latest update: 2014-09-23