Building Envelope Object Detection Using YOLO Models

Norhan Bayomi, Mohanned El Kholy, John E. Fernandez, Senem Velipasalar, Tarek Rakha

Research output: Chapter in Book/Entry/PoemConference contribution

4 Scopus citations


Building performance significantly influences energy use and indoor thermal conditions tied to the quality of living for its occupants. Therefore, information on building envelopes is essential, especially considering that envelopes and windows can impact 50% of energy loads in the United States. However, current retrofits supporting Building Energy Modelling (BEM) tools face multiple barriers, including time consumption and labor intensity due to manual modeling and calibration processes. This paper proposes using Deep Learning (DL) -based object detection algorithms to detect building envelope components, more specificlly doors, and windows, that can be applied to building energy performance analysis, 3D modeling, and assessment of thermal irregularities. We compare four different versions of the state-of-the-art YOLO V5 model to identify which version best suits the goal of detecting these building components. Results show that YOLO V5_X provides the best performance for detection accuracy.

Original languageEnglish (US)
Title of host publicationProceedings of the 2022 Annual Modeling and Simulation Conference, ANNSIM 2022
EditorsCristina Ruiz Martin, Niloufar Emami, Maria Julia Blas, Roya Rezaee
PublisherInstitute of Electrical and Electronics Engineers Inc.
Number of pages14
ISBN (Electronic)9781713852889
StatePublished - 2022
Event2022 Annual Modeling and Simulation Conference, ANNSIM 2022 - San Diego, United States
Duration: Jul 18 2022Jul 20 2022

Publication series

NameProceedings of the 2022 Annual Modeling and Simulation Conference, ANNSIM 2022


Conference2022 Annual Modeling and Simulation Conference, ANNSIM 2022
Country/TerritoryUnited States
CitySan Diego


  • BEM
  • artificial neural networks
  • building performance
  • deep learning
  • object detection

ASJC Scopus subject areas

  • Artificial Intelligence
  • Modeling and Simulation
  • Decision Sciences (miscellaneous)


Dive into the research topics of 'Building Envelope Object Detection Using YOLO Models'. Together they form a unique fingerprint.

Cite this