AI and Digital Twin Applications in 3D Information Models for Heritage Buildings: A Systematic Review

AUTHOR(S)

Subhadha Battina, Siva Jaganathan

DOI: https://doi.org/10.46647/ijetms.2023.v07i03.017

ABSTRACT
The recent emergence of technology as digital tools has provided architects with possibilities for 3D modelling and simulation of built environments. Currently, the "digital twin" and Building Information Management (BIM) techniques enable analytical tools like connection analysis and energy performance modelling in tandem with the ideation of realistic 3D illustrations. These methods are now seen emerging in managing and documenting heritage structures. A Heritage Building Information Management (HBIM) platform is a multi-disciplinary process and a valuable tool to automate, manage, and document heritage structures. However, making the final product in an HBIM platform involves several laborious steps of processing, segmenting, and integrating raw data from different sources, such as laser-scanned point data and image data. Hence, an expedited, streamlined platform is necessary to facilitate conservation architects and other agencies involved in documenting, maintaining and interpreting heritage buildings and structures. Newer technologies like Artificial Intelligence can enhance previously unavailable opportunities to automate specific tasks and uncover paradigms through predictable simulations. For this, the researchers reviewed the literature on two fronts: i)Investigating process flow and identifying the issues and challenges in gathering digital data of the existing building effectively. ii)Reviewing the literature to understand the models and tech solutions that revolutionized building heritage building information models for practical use. This study unravels workflow patterns and challenges based on these two sections of this literature review. Further, this research explores and analyses the trends and techniques employed in a typical heritage Building Information Management (HBIM) platform. The focus is on AI's capabilities as a digital tool in different stages of documentation and interpretation, performance measurement and simulation of heritage buildings, such as energy performance modeling, 4D (3D+Time) for projects planning, cost solutions, and simulating the historical significance to propagate the importance of HBIM. This study referred to the progress in the scientific literature on HBIM after the initial studies of C. Dore, and M. Murphy (2009).

Page No: 122 - 131

References:

[1]Isabel Jordán Palomar, “Protocol to Manage Heritage-Building Interventions Using Heritage Building Information Modelling (HBIM),” Sustainability, vol. 10, no. 4, pp. 908–908, Mar. 2018, doi: https://doi.org/10.3390/su10040908.
[2]A. Shabani, M. Skamantzari, S. Tapinaki, A. Georgopoulos, Vagelis Plevris, and Mahdi Kioumarsi, “3D simulation models for developing digital twins of heritage structures: challenges and strategies,” Procedia structural integrity, vol. 37, pp. 314–320, Jan. 2022, doi: https://doi.org/10.1016/j.prostr.2022.01.090.
[3]M. Murphy, E. McGovern, and S. Pavia, “Historic building information modelling (HBIM),” Structural Survey, vol. 27, no. 4, pp. 311–327, Aug. 2009, doi: https://doi.org/10.1108/02630800910985108.
[4]S. Azhar, “Building Information Modeling (BIM): Trends, Benefits, Risks, and Challenges for the AEC Industry,” Leadership and Management in Engineering, vol. 11, no. 3, pp. 241–252, Jul. 2011, doi: https://doi.org/10.1061/(asce)lm.1943-5630.0000127.
[5] Azhar, S., Nadeem, A., Mok, J. Y., & Leung, B. H. (2008, August). Building Information Modeling (BIM): A new paradigm for visual interactive modeling and simulation for construction projects. In Proc., First International Conference on Construction in Developing Countries (Vol. 1, pp. 435-46).
[5]V. Croce, G. Caroti, A. Piemonte, Livio De Luca, and P. Veron, “H-BIM and Artificial Intelligence: Classification of Architectural Heritage for Semi-Automatic Scan-to-BIM Reconstruction,” Sensors, vol. 23, no. 5, pp. 2497–2497, Feb. 2023, doi: https://doi.org/10.3390/s23052497.
[6]Facundo Estanislao López, Pedro Martín Lerones, M. Coronel, J. Gómez-García-Bermejo, and E. Zalama, “A Review of Heritage Building Information Modeling (H-BIM),” Multimodal technologies and interaction, vol. 2, no. 2, pp. 21–21, May 2018, doi: https://doi.org/10.3390/mti2020021.
[7]E. Valero, Frédéric Bosché, and M. Bueno, “Laser scanning for BIM,” Journal of Information Technology in Construction, vol. 27, pp. 486–495, Apr. 2022, doi: https://doi.org/10.36680/j.itcon.2022.023.
[8]César Porras-Amores, F. R. Mazarrón, I. Cañas, and Paola Villoria Sáez, “Terrestial laser scanning digitalization in underground constructions,” Journal of Cultural Heritage, vol. 38, pp. 213–220, Jul. 2019, doi: https://doi.org/10.1016/j.culher.2019.01.007.
[9]“Archeologia e Calcolatori,” Archcalc.cnr.it, 2020. http://www.archcalc.cnr.it/journal/id.php?id=oai:www.archcalc.cnr.it/journal/A_C_oai_Archive.xml:1122 (accessed Apr. 24, 2023).
[10]Enrique Oliva Priego, José Herráez, José Luis Denia, and P. Navarro, “Technical study for restoration of mural paintings through the transfer of a photographic image to the vault of a church,” Journal of Cultural Heritage, vol. 58, pp. 112–121, Nov. 2022, doi: https://doi.org/10.1016/j.culher.2022.09.023.
[11]E. Valero, F. Bosché, and M. Bueno, “Laser scanning for BIM,” Journal of Information Technology in Construction, vol. 27, pp. 486–495, Apr. 2022, doi: https://doi.org/10.36680/j.itcon.2022.023.
[12]Frédéric Bosché, M. Ahmed, Yelda Turkan, C. T. Haas, and R. Haas, “The value of integrating Scan-to-BIM and Scan-vs-BIM techniques for construction monitoring using laser scanning and BIM: The case of cylindrical MEP components,” Automation in Construction, vol. 49, pp. 201–213, Jan. 2015, doi: https://doi.org/10.1016/j.autcon.2014.05.014.
[13]F. Blais, “Review of 20 years of range sensor development,” ResearchGate, 2004. https://www.researchgate.net/publication/220050372_Review_of_20_years_of_range_sensor_development (accessed Apr. 24, 2023).
[14]S. Monji-Azad, J. Hesser, and Nikolas Löw, “A review of non-rigid transformations and learning-based 3D point cloud registration methods,” Isprs Journal of Photogrammetry and Remote Sensing, vol. 196, pp. 58–72, Feb. 2023, doi: https://doi.org/10.1016/j.isprsjprs.2022.12.023.
[15]Armin Grün, Fabio Remondino, and L. Zhang, “Photogrammetric Reconstruction of the Great Buddha of Bamiyan, Afghanistan,” Photogrammetric Record, vol. 19, no. 107, pp. 177–199, Sep. 2004, doi: https://doi.org/10.1111/j.0031-868x.2004.00278.x.
[16]“Wayback Machine,” web.archive.org, Aug. 30, 2017. https://web.archive.org/web/20170830062535/https://www.cices.org/pdf/P%26RSinformation.pdf (accessed Apr. 25, 2023).
[17]P. Grussenmeyer, T. Landes, T. Voegtle, and K. Ringle, “COMPARISON METHODS OF TERRESTRIAL LASER SCANNING, PHOTOGRAMMETRY AND TACHEOMETRY DATA FOR RECORDING OF CULTURAL HERITAGE BUILDINGS.” Available: https://citeseerx.ist.psu.edu/document?repid=rep1&type=pdf&doi=fb25035c7231f9e8a37bcacc3c4927d5d024d7fb
[18]N. Xu, R. Qin, and S. Song, “Point cloud registration for LiDAR and photogrammetric data: A critical synthesis and performance analysis on classic and deep learning algorithms,” ISPRS open journal of photogrammetry and remote sensing, vol. 8, pp. 100032–100032, Feb. 2023, doi: https://doi.org/10.1016/j.ophoto.2023.100032.
[19]Gary et al., “Registration of 3D Point Clouds and Meshes: A Survey from Rigid to Nonrigid,” IEEE Transactions on Visualization and Computer Graphics, vol. 19, no. 7, pp. 1199–1217, Jul. 2013, doi: https://doi.org/10.1109/tvcg.2012.310.
[20]C. Wu, Y. Yuan, Y. Tang, and B. Tian, “Application of Terrestrial Laser Scanning (TLS) in the Architecture, Engineering and Construction (AEC) Industry,” Sensors, vol. 22, no. 1, p. 265, Dec. 2021, doi: https://doi.org/10.3390/s22010265.
[21]M. Wang, C. Wang, Samad, and Sisi Zlatanova, “A Systematic Review of Digital Technology Adoption in Off-Site Construction: Current Status and Future Direction towards Industry 4.0,” Buildings, vol. 10, no. 11, pp. 204–204, Nov. 2020, doi: https://doi.org/10.3390/buildings10110204.
[22]F. Dai, Y. Feng, and R. Hough, “Photogrammetric error sources and impacts on modeling and surveying in construction engineering applications,” Visualization in Engineering, vol. 2, no. 1, Apr. 2014, doi: https://doi.org/10.1186/2213-7459-2-2.
[23]Fabio Remondino and Sabry El-Hakim, “Image‐based 3D Modelling: A Review,” ResearchGate, Sep. 2006. https://www.researchgate.net/publication/227786426_Image-based_3D_Modelling_A_Review (accessed Apr. 26, 2023).
[24]Katsushi Ikeuchi and Y. Sato, “Modeling from Reality,” ResearchGate, 2001. https://www.researchgate.net/publication/321600628_Modeling_from_Reality (accessed Apr. 26, 2023).
[25]F. Tombari, S. Salti, and Luigi Di Stefano, “Performance Evaluation of 3D Keypoint Detectors,” International Journal of Computer Vision, vol. 102, no. 1–3, pp. 198–220, Mar. 2013, doi: https://doi.org/10.1007/s11263-012-0545-4.
[26]J. Yang, K. Xian, P. Wang, and Y. Zhang, “A Performance Evaluation of Correspondence Grouping Methods for 3D Rigid Data Matching,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 43, no. 6, pp. 1859–1874, Jun. 2021, doi: https://doi.org/10.1109/tpami.2019.2960234.
[27]R. Djahel, B. Vallet, and P. Monasse, “TOWARDS EFFICIENT INDOOR/OUTDOOR REGISTRATION USING PLANAR POLYGONS,” ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. V–22021, pp. 51–58, Jun. 2021, doi: https://doi.org/10.5194/isprs-annals-v-2-2021-51-2021.
[28]L. Ma, T. A. Whelan, Egor Bondarev, and J. F. McDonald, “Planar simplification and texturing of dense point cloud maps,” European Conference on Mobile Robots, Sep. 2013, doi: https://doi.org/10.1109/ecmr.2013.6698837.
[29]J. Liu, S. Azhar, D. Willkens, and B. Li, “Static Terrestrial Laser Scanning (TLS) for Heritage Building Information Modeling (HBIM): A Systematic Review,” Virtual Worlds, vol. 2, no. 2, pp. 90–114, Apr. 2023, doi: https://doi.org/10.3390/virtualworlds2020006.
[30]F. Dai, Y. Feng, and R. Hough, “Photogrammetric error sources and impacts on modeling and surveying in construction engineering applications,” Visualization in Engineering, vol. 2, no. 1, Apr. 2014, doi: https://doi.org/10.1186/2213-7459-2-2.
[31]“Accuracy assessment of RTK/PPK UAV-photogrammetry projects using differential corrections from multiple GNSS fixed base stations,” Geocarto International, 2023. https://www.tandfonline.com/doi/full/10.1080/10106049.2023.2197507 (accessed Apr. 27, 2023).
[32]R. Volk, J. Stengel, and F. Schultmann, “Building Information Modeling (BIM) for existing buildings — Literature review and future needs,” Automation in Construction, vol. 38, pp. 109–127, Mar. 2014, doi: https://doi.org/10.1016/j.autcon.2013.10.023.
[33]A. Shabani, M. Skamantzari, S. Tapinaki, A. Georgopoulos, Vagelis Plevris, and Mahdi Kioumarsi, “3D simulation models for developing digital twins of heritage structures: challenges and strategies,” Procedia structural integrity, vol. 37, pp. 314–320, Jan. 2022, doi: https://doi.org/10.1016/j.prostr.2022.01.090.
[34]Guzden Varinlioglu and Ö. Balaban, “Artificial intelligence in architectural heritage research,” ResearchGate, Mar. 18, 2021. https://www.researchgate.net/publication/350169674_Artificial_intelligence_in_architectural_heritage_research (accessed Apr. 28, 2023).

How to Cite This Article:
Subhadha Battina, Siva Jaganathan .AI and Digital Twin Applications in 3D Information Models for Heritage Buildings: A Systematic Review . ijetms;7(3):122-131. DOI: 10.46647/ijetms.2023.v07i03.017