Microsoft Word - numero_72_art_09_5273.docx D. H. Nguyen et alii, Fracture and Structural Integrity, 72 (2025) 121-136; DOI: 10.3221/IGF-ESIS.72.09 121 A digital twin framework with MobileNetV2 for damage detection in slab structures Duong Huong Nguyen Middlesex University, London, U.K Hanoi University of Civil Engineering, Hanoi, Vietnam duongnh2@huce.edu.vn, https://orcid.org/0000-0002-8575-6282 Huan Nguyen Middlesex University, London, U.K International School, Vietnam National University, Hanoi, Vietnam h.nguyen@mdx.ac.uk Xiaohong Gao Middlesex University, London, U.K X.Gao@mdx.ac.uk KEYWORDS. Digital twin, Damage detection, Wavelet theory, Vibration-based damage detection, SHM, Slab structure. Citation: Nguyen, D. H., Nguyen, H., Gao, X., A digital twin framework with MobileNetV2 for damage detection in slab structures, Fracture and Structural Integrity, 72 (2025) 121-136. Received: 29.11.2024 Accepted: 27.01.2025 Published: 08.02.2025 Issue: 04.2025 Copyright: © 2025 This is an open access article under the terms of the CC-BY 4.0, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. https://youtu.be/sbrm3A3yc0U D. H. Nguyen et alii, Fracture and Structural Integrity, 72 (2025) 121-136; DOI: 10.3221/IGF-ESIS.72.09 122 INTRODUCTION he Structural Health Monitoring (SHM) of civil structures is one of the most popular subjects in structural engineering. SHM can be defined as the process of monitoring and measuring the structural response in real-time to detect anomalies in the early stages of damage in structures based on data from instrumentation installed in the structure [5]. This process can be divided into four different phases: instrumentation, monitoring, analysis, and management. The most popular employed sensors in structural are accelerometers, strain gauges, LVDTs. All these sensors and data acquisition systems correspond to the measurement of the physical parameters. The set of techniques is employed to analysis structural measurement response to understand structural behaviour and detect damage. Finally, this real-time information is transferred to the right people for decision-making in the management phases. The recent advanced SHM technology involved the development of machine learning, digital twin, internet of things, sensor networks, etc [3]. Digital twin concepts use a digital reconstruction of a real-life structure which can automatically update identified uncertainties parameters based on data produced by sensors. The digital twin is more than a FE model because it is updated and calibrated with data measured from the physical model. The potential of Digital twin integration into SHM through deep learning is becoming increasingly significant. Applying deep learning in machine health monitoring systems is discussed in [24]. A digital twin based SHM framework based on cloud computing and deep learning is proposed and demonstrated via case studies with high accuracy in damage detection [6]. The pros of implementing Digital Twin are functionalities for updates, an overview history of a structure, timely interceptions of damage, and decision-making support. Whereas, the cons are technological immaturity, lack of standards and guidelines, and the operation cost [3]. Moreover, the outlook of digital-based SHM, applications related is highlighted in [20]. Nowadays, the combination of machine learning and digital twin is becoming the core of SHM [13]. Vibration-based monitoring is on destructive method that tracks the dynamic response of the structure [2]. Digital twin coupling with machine learning will analyse vibration data extracted from monitoring techniques such as acceleration, deflection, strain, etc. Moreover, many research works targeted the evaluation of modal parameters such as natural frequency, mode shape, and damping ratio. Some identified uncertainties parameters of the structure will be updated in the virtual model if the difference between measured and calculated values is significant [23]. From measured, simulated data obtained from the updated virtual model, the appropriate deep learning models will be developed for SHM applications. Hielscher et al. [8] propose a method that uses Fibre Bragg Grating (FBG) sensors to measure the strain and temperature at discrete locations along the bridge. A deep neural network is then developed to convert the strain data into an interactive digital twin visualization and is used to predict the reinforced concrete bridge health. The digital twin of a bridge is calibrated using data collected from sensors and the support vector machine algorithms used to ensure the safety of the bridge are proposed [1]. A decision tree framework is proposed to perform anomaly detection multiclass classification of acceleration data collected from a real-life bridge [21]. Modern monitoring technologies include, among others, smart sensors, wireless sensors, Global Positioning Systems (GPS), Fiber Sensors (OFS), radars, Micro Electro Mechanical Systems (MEMS) are the evidence of the potential of this monitoring tool for SHM applications [3]. This paper uses deflection data collected from measurement as the input data set. Wavelet transform is then used to analysis the response data. Only the response of the damaged structure is required to detect damage in a structure [7]. The review and discussion of using wavelet-based method applied to various civil and mechanical structures are presented in the articles [12]. The authors pointed out that the measurement of damage severity is still a concern. For slab structure, a two- dimensional wavelet transform extracted from deflection data needs to be composed. Therefore, in this research, a two- dimensional continuous wavelet transform for the slab will be converted into a picture and used to train the convolutional neural networks for damage location and severity. The training data set is created by using the digital twin model. The classification in this study is provided with deep learning algorithms through image classification methods: traditional CNN and MobileNetV2. The contributions of this work are as follows:  We utilise defection data to facilitate the Wavelet transform based analysis where only the response is required to detect damage. This technique does not require the response data of intact structure which is hard to collect in many cases.  We develop a signal processing algorithm to prepare for the digital twin model based on the dynamic characteristics of the physical model of a slab in the laboratory. In this algorithm, natural frequencies are used as the objective function while GWO and Cuckoo search methods are used for optimization.  We create a digital twin framework to help train the convolutional neural networks for the detection of damage location and severity, employing a two-dimensional continuous wavelet transform for the slab converting into a picture. The classification is conducted with deep learning algorithms through image classification methods: traditional CNN and MobileNetV2. We found that the accuracy of the framework to detect damage location is more than 80% and the T D. H. Nguyen et alii, Fracture and Structural Integrity, 72 (2025) 121-136; DOI: 10.3221/IGF-ESIS.72.09 123 severity is more than 90%. The traditional CNN provides higher accuracy however the number of training parameters is more than the MobileNetV2 and requires more time and effort to train.  We successfully use MobileNetV2 as a deep learning base model and transfer learning. This is the first step of further implementation on mobile devices. With the help of transfer learning, the digital twin framework can be built with less training data set and high accuracy. METHODOLOGY Wavelet theory avelet was first introduced by Mallat in 1989 [14] . The basic function of wavelet analysis is two parameters: scale and translation. Wavelets can be real or complex functions. The basic function of mother wavelet analysis can be the function of time t or space x. In this paper, the independent variable x will be considered. The discrete wavelet transform (DWT) uses a discrete set of the wavelet scale and translation and must satisfy some rules. The basic function of a wavelet at level j of order N can be represented as [4]: Ψ n = ∑ (-1) j cj (2n+j-N+1)N-1 j=0 (1) where: cj is the coefficient. Two following conditions should be satisfied: Ψ t d t =0 ∞ -∞ (2) |Ψ t |2d t <∞ ∞ -∞ (3) The condition presented in Eqn.(2) is to suggest that the basic function is oscillatory or wave shape. Whereas Eqn. (3) implies that most of the energy in the basis function is confined to a finite duration. The two important properties of a basic function are ‘orthogonality’ and ‘biorthogonality’, which make it possible to calculate the coefficient very efficiently. In DWT, the signals can be presented by approximations and details. At level j, the details can be expressed as below: Dj t =∑ Dj,kk∈Z Ψj,k(t) (4) where 𝐷 , is the wavelet coefficients at level j and Z is a set of positive integers. The approximation at level j is presented as: AJ=∑ Djj>J (5) Finally, the signal f(t) can be presented as: f t =AJ+∑ Djj> /ColorImageDict << /QFactor 0.15 /HSamples [1 1 1 1] /VSamples [1 1 1 1] >> /JPEG2000ColorACSImageDict << /TileWidth 256 /TileHeight 256 /Quality 30 >> /JPEG2000ColorImageDict << /TileWidth 256 /TileHeight 256 /Quality 30 >> /AntiAliasGrayImages false /CropGrayImages true /GrayImageMinResolution 300 /GrayImageMinResolutionPolicy /OK /DownsampleGrayImages true /GrayImageDownsampleType /Bicubic /GrayImageResolution 300 /GrayImageDepth -1 /GrayImageMinDownsampleDepth 2 /GrayImageDownsampleThreshold 1.50000 /EncodeGrayImages true /GrayImageFilter /DCTEncode /AutoFilterGrayImages true /GrayImageAutoFilterStrategy /JPEG /GrayACSImageDict << /QFactor 0.15 /HSamples [1 1 1 1] /VSamples [1 1 1 1] >> /GrayImageDict << /QFactor 0.15 /HSamples [1 1 1 1] /VSamples [1 1 1 1] >> /JPEG2000GrayACSImageDict << /TileWidth 256 /TileHeight 256 /Quality 30 >> /JPEG2000GrayImageDict << /TileWidth 256 /TileHeight 256 /Quality 30 >> /AntiAliasMonoImages false /CropMonoImages true /MonoImageMinResolution 1200 /MonoImageMinResolutionPolicy /OK /DownsampleMonoImages true /MonoImageDownsampleType /Bicubic /MonoImageResolution 1200 /MonoImageDepth -1 /MonoImageDownsampleThreshold 1.50000 /EncodeMonoImages true /MonoImageFilter /CCITTFaxEncode /MonoImageDict << /K -1 >> /AllowPSXObjects false /CheckCompliance [ /None ] /PDFX1aCheck false /PDFX3Check false /PDFXCompliantPDFOnly false /PDFXNoTrimBoxError true /PDFXTrimBoxToMediaBoxOffset [ 0.00000 0.00000 0.00000 0.00000 ] /PDFXSetBleedBoxToMediaBox true /PDFXBleedBoxToTrimBoxOffset [ 0.00000 0.00000 0.00000 0.00000 ] /PDFXOutputIntentProfile () /PDFXOutputConditionIdentifier () /PDFXOutputCondition () /PDFXRegistryName () /PDFXTrapped /False /CreateJDFFile false /Description << /ARA /BGR /CHS /CHT /CZE /DAN /DEU /ESP /ETI /FRA /GRE /HEB /HRV (Za stvaranje Adobe PDF dokumenata najpogodnijih za visokokvalitetni ispis prije tiskanja koristite ove postavke. Stvoreni PDF dokumenti mogu se otvoriti Acrobat i Adobe Reader 5.0 i kasnijim verzijama.) /HUN /ITA /JPN /KOR /LTH /LVI /NLD (Gebruik deze instellingen om Adobe PDF-documenten te maken die zijn geoptimaliseerd voor prepress-afdrukken van hoge kwaliteit. De gemaakte PDF-documenten kunnen worden geopend met Acrobat en Adobe Reader 5.0 en hoger.) /NOR /POL /PTB /RUM /RUS /SKY /SLV /SUO /SVE /TUR /UKR /ENU (Use these settings to create Adobe PDF documents best suited for high-quality prepress printing. Created PDF documents can be opened with Acrobat and Adobe Reader 5.0 and later.) >> /Namespace [ (Adobe) (Common) (1.0) ] /OtherNamespaces [ << /AsReaderSpreads false /CropImagesToFrames true /ErrorControl /WarnAndContinue /FlattenerIgnoreSpreadOverrides false /IncludeGuidesGrids false /IncludeNonPrinting false /IncludeSlug false /Namespace [ (Adobe) (InDesign) (4.0) ] /OmitPlacedBitmaps false /OmitPlacedEPS false /OmitPlacedPDF false /SimulateOverprint /Legacy >> << /AddBleedMarks false /AddColorBars false /AddCropMarks false /AddPageInfo false /AddRegMarks false /ConvertColors /ConvertToCMYK /DestinationProfileName () /DestinationProfileSelector /DocumentCMYK /Downsample16BitImages true /FlattenerPreset << /PresetSelector /MediumResolution >> /FormElements false /GenerateStructure false /IncludeBookmarks false /IncludeHyperlinks false /IncludeInteractive false /IncludeLayers false /IncludeProfiles false /MultimediaHandling /UseObjectSettings /Namespace [ (Adobe) (CreativeSuite) (2.0) ] /PDFXOutputIntentProfileSelector /DocumentCMYK /PreserveEditing true /UntaggedCMYKHandling /LeaveUntagged /UntaggedRGBHandling /UseDocumentProfile /UseDocumentBleed false >> ] >> setdistillerparams << /HWResolution [2400 2400] /PageSize [612.000 792.000] >> setpagedevice