Sample volume length and registration accuracy assessment in quality controls of PW Doppler diagnostic systems: a comparative study ACTA IMEKO ISSN: 2221-870X June 2023, Volume 12, Number 2, 1 - 7 ACTA IMEKO | www.imeko.org June 2023 | Volume 12 | Number 2 | 1 Sample volume length and registration accuracy assessment in quality controls of PW Doppler diagnostic systems: a comparative study Giorgia Fiori1, Gabriele Bocchetta1, Silvia Conforto1, Salvatore A. Sciuto1, Andrea Scorza1 1 Department of Industrial, Electronic and Mechanical Engineering, Roma TRE University, Via della Vasca Navale 79, 00146 Rome, Italy Section: RESEARCH PAPER Keywords: Quality controls; PW Doppler; sample volume; ultrasound diagnostic systems; comparative study Citation: Giorgia Fiori, Gabriele Bocchetta, Silvia Conforto, Salvatore A. Sciuto, Andrea Scorza, Sample volume length and registration accuracy assessment in quality controls of PW Doppler diagnostic systems: a comparative study, Acta IMEKO, vol. 12, no. 2, article 6, June 2023, identifier: IMEKO-ACTA-12 (2023)- 02-06 Section Editor: Alfredo Cigada, Politecnico di Milano, Italy, Roberto Montanini, UniversitΓ  degli Studi di Messina, Italy Received December 5, 2022; In final form April 21, 2023; Published June 2023 Copyright: This is an open-access article distributed under the terms of the Creative Commons Attribution 3.0 License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Corresponding author: Giorgia Fiori, e-mail: giorgia.fiori@uniroma3.it 1. INTRODUCTION Pulsed Wave (PW) Doppler is extensively used in diagnostic imaging since it allows displaying and quantifying the velocity of both arterial and venous flow through time. Ultrasound (US) diagnostic systems provide a real-time spectral Doppler display by performing the spectral analysis of the Doppler signal from the blood vessel [1], [2]. This signal is detected within a sensitive region, known as Sample Volume (SV), whose length and depth (from the interface between the patient skin and the US probe) can be adjusted by the operator on the B-mode anatomical image [2], [3]. In the literature, two main parameters were used to characterize the sample volume, i.e., size and range gate registration accuracy [4], [5]. In particular, SV size depends on both the effective sample duration and the width of the US beam [6], and it affects the PW Doppler spatial resolution. In turn, sample volume size can be split into two main contributions [7]: lateral and axial resolution. Nowadays, SV axial resolution is included by the UK's Institute of Physics and Engineering in Medicine (IPEM) among the basic functional checks for Spectral Doppler designed for control functioning assessment and faults detection [8]. As regards the range gate registration accuracy, it quantifies the error due to the difference between the SV position displayed on the grayscale image and the actual one. Such parameter is one of the Quality Control (QC) Doppler tests recommended by the American Institute for Ultrasound in Medicine (AIUM) [9]. It is worth noting that the majority of the scientific literature that focused on sample volume size [7], [10]-[12] and range gate registration accuracy [12], [13] dates back to the last years of the XX century. Moreover, the QC test procedures recommended by the two international organizations are affected by operator subjectivity. In this regard, performance evaluation of Doppler ABSTRACT In clinical diagnostics, Pulsed Wave (PW) Doppler is one of the most used spectral Doppler techniques since it provides quantitative information about the severity of several cardiac disorders. Therefore, routine quality control tests should be scheduled to check whether a proper level of performance is maintained over time. Despite continuous research in the field, performance evaluation of Doppler equipment is still an open issue. Therefore, the present study is focused on the comparative investigation based on a test parameter for the automatic analysis of faults in sample volume length and range gate registration accuracy. The Velocity Profile Discrepancy Index (VPDI) provides a quantitative estimation according to the agreement between the theoretical parabolic velo city profile and the measured one. The index was assessed through an automatic method that post-processes PW spectrogram images acquired at six sample volume depths with respect to the vessel radius of a Doppler reference device. Tests were repeated for three brand-new ultrasound diagnostic systems, equipped with convex and phased array probes, in two working conditions. From the analysis of the results, a lower discrepancy between the measured and the theoretical velocity profile was found for the convex array probes as well as a lower uncertainty contribution. mailto:giorgia.fiori@uniroma3.it ACTA IMEKO | www.imeko.org June 2023 | Volume 12 | Number 2 | 2 systems is still an open issue in the scientific research field [4], [14]-[17], despite the increasing demand for proper QC programs. Nonetheless, the measurement of blood flow peak velocity is of particular relevance in clinical applications since several clinical parameters are evaluated from the peak velocity envelope. PW Doppler provides quantitative information about the severity of many cardiac disorders [18], including the degree of stenosis [19], [20], arterial wall shear stress [21], [22], and pressure drops across cardiac valves [23]. Therefore, inaccurate measurements can impact diagnosis and clinical therapy: overestimations ranging from 12 % to 50 % have been estimated as regards the measurement of blood peak velocities [24], [25]. From the abovementioned considerations, the present study would give a contribution to the field of QCs for Doppler equipment testing, by proposing a comparative investigation of the Velocity Profile Discrepancy Index (VPDI), a quality parameter developed for the objective assessment of both SV length and range gate registration accuracy. The index, preliminarily defined and tested in [26], is estimated from the processing of PW Doppler spectrograms by means of a custom- written image analysis method developed in MATLAB environment. Three brand-new US diagnostic systems, each of them equipped with two ultrasound probes (convex and phased array) were tested in two working conditions. In Section 2, the estimation rationale underlying the definition of the proposed quality index will be provided. In Section 3, the experimental setup components and their main specifications will be described together with the image analysis-based method implemented for VPDI assessment. In Section 4, experimental results with their associated measurement uncertainty will be presented and discussed, focusing on the comparison among the US diagnostic systems under test. Finally, in the concluding section, the major achievements and future developments will be outlined. 2. VELOCITY PROFILE DISCREPANCY INDEX By considering a cylindrical tube of infinitesimal length d𝑦 exhibiting fully developed laminar flow in the reference system shown in Figure 1, the well-known parabolic velocity profile 𝑣(π‘Ÿ) of the Hagen-Poiseuille flow [27], [28] can be written as: 𝑣(π‘Ÿ) = βˆ’ 1 4 πœ‡ d𝑃 d𝑦 (𝑅2 βˆ’ π‘Ÿ2) , (1) where 𝑅 is the tube radius, πœ‡ is the dynamic viscosity coefficient, d𝑃 is the infinitesimal pressure drop and 𝑦-axis is the flow direction. From (1), the maximum velocity value 𝑣max can be reached for π‘Ÿ = 0, while for π‘Ÿ = |𝑅| the no-slip boundary condition applies, i.e., the relative tangential and normal velocities between the flow and the tube walls are zero: { 𝑣(π‘Ÿ)|π‘Ÿ=0 = βˆ’ 1 4 πœ‡ d𝑃 d𝑦 𝑅2 = 𝑣max 𝑣(π‘Ÿ)|π‘Ÿ=|𝑅| = 0 . (2) From these considerations, it is possible to derive the mathematical expression of the parabolic velocity profile 𝑣(π‘₯) as a function of 𝑣max and 𝑅, as follows: { 𝑣(π‘₯) = 𝑣max (1 βˆ’ π‘₯ 2 𝑅2 ) |π‘₯| ≀ 𝑅 𝑣(π‘₯) = 0 |π‘₯| > 𝑅 , (3) where π‘₯ is the radial coordinate. By subdividing 𝑣(π‘₯) into a fixed number of bins and assuming the limits of the 𝑛-th bin (𝑛 = 1, …, 𝑁) as the SV boundaries (Figure 2a), the theoretical velocity οΏ½Μ…οΏ½th for each bin can be derived from (3) as follows: { οΏ½Μ…οΏ½th = 𝑣max (1 βˆ’ π‘₯SV 2 𝑅2 + 𝑙2 12 𝑅2 ) |π‘₯SV| ≀ 𝑅 οΏ½Μ…οΏ½th = 0 |π‘₯SV| > 𝑅 , (4) where π‘₯SV is the SV position with respect to the tube radius and 𝑙 is the sample volume length (Figure 2b). Finally, the Velocity Profile Discrepancy Index (VPDI) for the objective assessment of both sample volume length and registration accuracy is derived as [26]: 𝑉𝑃𝐷𝐼 = βˆ‘ 𝑉𝑃𝐷𝐼𝑛 𝑁 𝑛=1 = βˆ‘ (οΏ½Μ…οΏ½s,𝑛 βˆ’ οΏ½Μ…οΏ½th,𝑛) 2 𝜎tot,𝑛 2 𝑁 𝑛=1 , (5) Figure 1. Steady laminar flow in a cylindrical tube of infinitesimal length. a b Figure 2. (a) Parabolic velocity profile v(x) subdivided in N bins: the limits of each bin are assumed as the SV boundaries; (b) graphical schematization of the SV length and positioning inside the cylindrical tube. ACTA IMEKO | www.imeko.org June 2023 | Volume 12 | Number 2 | 3 where οΏ½Μ…οΏ½s,𝑛 is the mean peak velocity estimated from the Doppler spectrogram collected at pre-set sample volume depth and length, οΏ½Μ…οΏ½th,𝑛 is the corresponding theoretical velocity value retrieved by applying (4) for each bin, while 𝜎tot,𝑛 is the total standard deviation estimated for the 𝑛-th bin as follows: { 𝜎tot,𝑛 = √𝜎s,𝑛 2 + 𝜎r,𝑛 2 + 𝜎p,𝑛 2 |π‘₯𝑆𝑉 | ≀ 𝑅 𝜎tot,𝑛 = 𝜎r,𝑛 |π‘₯𝑆𝑉 | > 𝑅 , (6) where 𝜎s is the standard deviation (SD) of the peak velocities in the Doppler spectrogram because of the intrinsic flow dispersion, 𝜎r is the standard deviation of a random distribution associated with the electronic noise superimposed on the PW spectrogram, and 𝜎p is the SD due to the assumption of parabolic profile: 𝜎p = 𝜎SV 2 𝑣max 𝑅2 |π‘₯SV| , (7) where 𝜎SV is the SD associated to the sample volume position with respect to R. According to the definition proposed in (5), VPDI is expected to be 0, i.e., the acquired PW spectrograms are not affected by any variation of the sample volume length with respect to the set value and any SV registration error. On the contrary, if VPDI deviates from 0, the PW spectrograms are affected by at least one of the two error sources, i.e., unwanted SV size variation and/or a low SV registration accuracy. 3. MATERIALS AND METHODS 3.1. Experimental setup The experimental setup was constituted by three high technology level US diagnostic systems, equipped with a convex and a phased array probe each, and a reference test device whose main specifications are listed in Table 1. The test device used is a commercial flow phantom model (Sun Nuclear, Doppler 403TM flow phantom [29]) consisting of a continuous flow loop vessel with a horizontal and a diagonal segment having the same inside diameter. A pump and a flow controller are designed by the manufacturer to provide user-selectable flow rates in the range (1.7-12.5) mlΒ·s-1. Doppler spectrograms were collected on the phantom diagonal segment set at a constant flow rate of 7.0 mlΒ·s-1 corresponding to a nominal peak velocity of 71.3 cmΒ·s-1. Tests were repeated at two different US system working conditions (Table 2): the best configuration setting provided by the product specialist (set 1), and the raw configuration setting by reducing pre- and post-processing settings (set 2). The three ultrasound diagnostic systems, manufactured by different companies, were anonymously addressed as system A, system B and system C. The main setting that distinguishes the two working conditions is the wall filter, a dedicated high-pass filter designed to reject the intense and low-frequency echoes coming from the vessel walls movement (clutter signal) [2]. In the raw configuration setting it was always set at the minimum adjustable Table 1. Technical specifications of the reference test device. Characteristic Specification Phantom model Sun Nuclear, Doppler 403TM flow phantom Attenuation coefficient (0.70 Β± 0.05) dBΒ·cm-1Β·MHz-1 TMM (a) sound speed (1540 Β± 10) mΒ·s-1 BMF (b) sound speed (1550 Β± 10) mΒ·s-1 Scanning material Aluminium-film composite Vessel nominal inside diameter (5.0 Β± 0.2) mm Horizontal segment depth (2.0 Β± 0.3) cm Diagonal segment depth from 2.0 to 16.0 cm (Β± 0.3 cm) at 40Β° Flow mode constant and pulsatile Continuous flow mode range [(1.7 – 12.5) Β± 0.4] mlΒ·s-1 (a) TMM = Tissue Mimicking Material; (b) BMF = Blood Mimicking Fluid. Table 2. Main B-mode and PW Doppler settings according to the probe model of each ultrasound diagnostic system. B-mode and PW Doppler setting Probe System A System B System C set 1 set 2 set 1 set 2 set 1 set 2 B-mode frequency range (MHz) B (a) resolution resolution resolution resolution resolution resolution Field of view (cm) B 12 12 12 12 12 12 Post-processing B linear linear linear linear linear linear Doppler frequency (MHz) C (b) 2.2 2.2 2.0 2.0 2.2 2.2 P (c) 1.6 1.6 2.0 2.0 1.8 1.8 Wall filter (Hz) C medium (d) min (d,e) 120 50 (e) 70 50 (e) P medium (d) min (d,e) 200 50 (e) 125 75 (e) Pulse repetition frequency (kHz) C 2.63 2.63 2.3 2.3 – (d) – (d) P 2.50 2.50 2.3 2.3 – (d) – (d) Nominal SVL (mm) B 1 1 1 1 1 1 Nominal SVDC Β± SVD (cm) C 11.0 Β± 0.1 11.0 Β± 0.1 11.0 Β± 0.1 11.0 Β± 0.1 11.0 Β± 0.1 11.0 Β± 0.1 P 10.0 Β± 0.1 10.0 Β± 0.1 10.0 Β± 0.1 10.0 Β± 0.1 10.0 Β± 0.1 10.0 Β± 0.1 Nominal SVDB Β± SVD (cm) C 10.7 Β± 0.1 10.7 Β± 0.1 10.7 Β± 0.1 10.7 Β± 0.1 10.7 Β± 0.1 10.7 Β± 0.1 P 9.7 Β± 0.1 9.7 Β± 0.1 9.7 Β± 0.1 9.7 Β± 0.1 9.7 Β± 0.1 9.7 Β± 0.1 Insonation angle (Β°) C 43 43 35 35 40 40 P 45 45 36 36 44 44 Spectrogram duration (s) B ~ 11 ~ 11 ~ 12 ~ 12 ~ 12 ~ 12 (a) B = both convex and phased array probe models; (b) C = convex array probe model; (c) P = phased array probe model; (d) Value not provided; (e) Minimum adjustable wall filter value. ACTA IMEKO | www.imeko.org June 2023 | Volume 12 | Number 2 | 4 value. Conversely, the pulse repetition frequency (PRF), i.e., the rate at which US pulses are transmitted [2], was, in turn, determined by the US system since its value depends on the other settings. Among the latter, the insonation angle was varied according to both the probe positioning on the scanning surface and the probe model so as to keep the sample volume parallel to the flow axis throughout the acquisitions, while the spectrogram duration was set to at least 10 s (depending on the system availability) in order to allow the comparison of the results retrieved from different system-probe pairs. In addition, the sample volume length (SVL) was maintained constant throughout the measurement campaign, while the sample volume depth (SVD) was adjusted on the vessel diagonal segment to collect N = 6 Doppler spectrograms for each probe- system pair as listed in Table 2. First, the sample volume was placed in the centre of the segment diameter, 𝑆𝑉𝐷C in Figure 3a, and then it was adjusted at 𝑆𝑉𝐷C Β± βˆ†π‘†π‘‰π· (Figure 2a), by considering βˆ†π‘†π‘‰π· the minimum sample volume depth variation that can be set in most of the ultrasound systems currently on the market. The sample volume was subsequently placed on the segment boundary, 𝑆𝑉𝐷B in Figure 3b, as well as at 𝑆𝑉𝐷B Β± βˆ†π‘†π‘‰π· (Figure 2b). As in [26], SVD was adjusted along the 𝑧-axis by assuming that the velocity does not vary along the flow axis of the tube. 3.2. VPDI assessment The velocity profile discrepancy index defined in [26] was assessed through an image analysis-based method that post- processes PW Doppler images acquired at different sample volume depths. The main steps of the measurement method are described in the following and shown in Figure 4, while the specifications assumed in this study are listed in Table 3. As a first step, each PW image is cropped to extract the box containing the spectrogram image only, i.e., excluding the patient information, the B-mode grayscale image and the ultrasound settings details. This processing step is automatically carried out based on the metadata included in the DICOM (Digital Imaging and Communications in Medicine) file. a b Figure 3. Graphical schematization of the sample volume adjusted (a) at SVDC and (b) at SVDB on the diagonal segment of the phantom vessel. Figure 4. Block diagram of the image analysis-based method for velocity profile discrepancy index assessment. ACTA IMEKO | www.imeko.org June 2023 | Volume 12 | Number 2 | 5 Then, an adaptive grey level threshold π‘‘β„Žg is applied to the spectrogram image to detect the pixels associated with the peak velocities. The corresponding mono-dimensional signal 𝑣s through time is retrieved as in [30], [31] and the mean peak velocity οΏ½Μ…οΏ½s is computed together with the standard deviation 𝜎s over 𝑀 samples (i.e., spectral lines). On the other hand, the total standard deviation 𝜎tot is estimated. In this study, the following assumptions were made for the estimation of 𝜎tot as in [26]. The standard deviation 𝜎r in (6) was estimated from a randomly generated gaussian distribution consisting of a number of elements equal to 15 % of 𝑀 and mean value half of the spectrogram full scale. In addition, 𝜎SV in (7) was estimated from a uniform distribution within the range [βˆ’βˆ†π‘™ 2⁄ ; βˆ†π‘™ 2⁄ ] by considering βˆ†π‘™ as the minimum SVL increment. Finally, both 𝜎s and 𝜎p in (6) were taken equal to 0 if the number of peak velocities 𝑣s at 0 cmΒ·s -1 was higher than 85 % of 𝑀. Therefore, when the above condition occurred, the detected velocities were assumed as electronic noise, i.e., 𝜎tot = 𝜎r. Otherwise, the uncertainty propagation law was applied including 𝜎s and 𝜎p in the computation of 𝜎tot even if outside of the vessel segment, i.e., 𝑆𝑉𝐷 at 𝑆𝑉𝐷B βˆ’ βˆ†π‘†π‘‰π·. The processing steps described above are repeated for all the 𝑁 acquisitions corresponding to different sample volume depths. At this point, the theoretical velocity οΏ½Μ…οΏ½th is determined for each SVD by applying (4), in which the maximum velocity 𝑣max was chosen as the mean peak velocity determined at 𝑆𝑉𝐷C, as in [26]. In the last step, the velocity profile discrepancy index is computed according to (5). VPDI uncertainty can be estimated as the standard deviation of the data distribution obtained through the Monte Carlo Simulation (MCS), a useful tool for the measurement uncertainty estimation of image analysis-based methods [32]-[36]. In this study, a MCS with 104 iterations was run for each probe-system pair in both working conditions. A uniform distribution with Β± 2 % bounds was assigned to the adaptive threshold π‘‘β„Žg and the 𝑀 spectral lines to be processed were randomized, at each cycle without repetition, among all the spectral lines detected in the spectrogram image. In particular, the uniform distribution was assigned to π‘‘β„Žg because, in terms of standard deviation, it is a more cautious approach for the uncertainty estimation, whilst the distribution range was assumed as the maximum threshold dispersion allowing to distinguish the velocity signal from the background noise displayed in the spectrogram, as already experienced in previous studies [31], [37]. 4. RESULTS AND DISCUSSION VPDI experimental outcomes for systems A, B and C equipped with convex and phased array probes at different working conditions are listed in Table 4 in terms of mean Β± 𝑆𝐷 and shown in Figure 5. By comparing the two probe models, the convex array probes showed the best VPDI outcomes (closest to 0) in both working conditions as well as the lowest uncertainty contributions. This suggests that the PW spectrograms acquired through the phased array probes could be most affected by an error in sample volume length (with respect to the pre-set value) and in its registration, (i.e., a low SV registration accuracy). Such issue seems to be supported by flow velocity trends still visible outside of the phantom vessel segment, as shown in Figure 6. On the other hand, by comparing the two working conditions, higher uncertainty contributions were globally found at raw configuration settings (set 2) independently of the probe model. Moreover, higher VDPI values were found in set 2 for both the probe models of system A and system C, while a specific behaviour cannot be inferred for system B. The discrepancy in results between set 1 and set 2 is mostly due to the different filtering of the clutter signal (i.e., wall filter setting in Table 2). Table 3. Parameters setting for VPDI assessment. Parameter Symbol Setting Adaptive threshold thg 10 % of maximum gray level value (a) Number of spectral lines M 1000 Minimum SVL increment l 1 mm Maximum velocity vmax vsΜ„ at SVDC (a) The threshold setting at 10 % allows to properly distinguish the velocity signal from the background noise displayed in the spectrogram [30], [31]. Table 4. VPDI outcomes (mean ο‚± SD) for the three ultrasound diagnostic systems equipped with convex and phased array probes at different working conditions. Probe model Working condition System A System B System C Convex set 1 0.14 ο‚± 0.01 0.69 ο‚± 0.04 0.28 ο‚± 0.04 set 2 0.23 ο‚± 0.03 0.68 ο‚± 0.12 0.58 ο‚± 0.12 Phased set 1 3.36 ο‚± 0.24 3.46 ο‚± 0.13 1.64 ο‚± 0.18 set 2 4.61 ο‚± 0.37 1.40 ο‚± 0.06 5.71 ο‚± 0.21 a b Figure 5. VPDI results for (a) convex and (b) phased array probes according to the ultrasound system and the working condition. Figure 6. PW spectrogram acquired through system A equipped with the phased array probe in set 2: sample volume depth adjusted at SVDB–SVD. ACTA IMEKO | www.imeko.org June 2023 | Volume 12 | Number 2 | 6 Finally, by focusing on the comparison among the three ultrasound diagnostic systems, it should be noticed that system A equipped with the convex array probe in set 1, and system B equipped with the phased array probe in set 2 showed VPDI outcomes closer to 0. 5. CONCLUSIONS In the study herein proposed, a comparative investigation on the Velocity Profile Discrepancy Index was carried out. The index, preliminarily investigated by the Authors, was developed for the objective assessment of sample volume length and range gate registration accuracy. It relies on the assumption of a fully developed laminar flow in order to quantify the discrepancy between the theoretical parabolic profile and the actual velocities. According to the definition, VDPI is expected to be 0 when the processed PW spectrograms are not affected by any variation of the SVL with respect to the pre-set nominal value and any range gate registration error. An automatic image analysis-based method post-processes PW spectrograms acquired at different sample volume depths with respect to the vessel radius of a Doppler reference device. Three brand-new US diagnostic systems, equipped with a convex and phased array probe each, were tested in two working conditions. A commercial reference test device constituted by a continuous flow loop vessel with a horizontal and a diagonal segment was set at a constant flow rate of 7.0 mlΒ·s-1. Experimental data were collected on the diagonal segment of the phantom vessel. From the analysis of the results, convex array probes showed VDPI outcomes closer to 0 in both working conditions as well as the lowest uncertainty contributions. On the basis of the promising outcomes obtained and their limitations, further studies and method improvements are going to be carried out to estimate the two error sources separately. Moreover, further investigations should be performed including a higher number of diagnostic systems and probe models (e.g., linear array probes). ACKNOWLEDGEMENT The Authors wish to thank Jan Galo of the Clinical Engineering Service at I.R.C.C.S. Children Hospital Bambino GesΓΉ for administrative and technical support; SAMSUNG Healthcare, PHILIPS Healthcare and MINDRAY Medical for hardware supply and technical assistance in data collection. REFERENCES [1] D. H. Evans, W. N. McDiken, Doppler Ultrasound: Physics, Instrumentation and Signal Processing, Wiley, New York, 2nd edition, 2000, ISBN 9780471970019, pp. 97-118. [2] P. R. Hoskins, K. Martin, A. Thrush, Diagnostic Ultrasound: Physics and Equipment, CRC Press, Boca Raton, FL, USA, 3rd edition, 2019, ISBN 9781138892934, pp. 171-189. [3] International Electrotechnical Commission, IEC 61895:1999-10, Ultrasonics – Pulsed Doppler diagnostic systems – Test procedures to determine performance, 1999. [4] J. E. Browne, A review of Doppler ultrasound quality assurance protocols and test devices, Phys. Med. 30 (2014), pp. 742-751. DOI: 10.1016/j.ejmp.2014.08.003 [5] P. R. Hoskins, Simulation and validation of arterial ultrasound imaging and blood flow, Ultrasound Med. Biol. 34 (2008), pp. 693- 717. DOI: 10.1016/j.ultrasmedbio.2007.10.017 [6] T. van Merode, P. Hick, A. P. Hoeks, R. S. Reneman, Limitations of Doppler spectral broadening in the early detection of carotid artery disease due to the size of the sample volume, Ultrasound Med. Biol. 9 (1983), pp. 581-586. DOI: 10.1016/0301-5629(83)90002-9 [7] A. P. Hoeks, C. J. Ruissen, P. Hick, R. S. Reneman, Methods to evaluate the sample volume of pulsed Doppler systems, Ultrasound Med. Biol. 10 (1984), pp. 427-434. DOI: 10.1016/0301-5629(84)90197-2 [8] IPEM Report no.102, Quality assurance of ultrasound imaging systems, 2010, ISBN 9781903613436. [9] AIUM, Performance criteria and measurements for Doppler ultrasound devices, 2002, ISBN 1930047835. [10] T. L. Poepping, H. N. Nikolov, R. N. Rankin, M. Lee, D. W. Holdsworth, An in vitro system for Doppler ultrasound flow studies in the stenosed carotid artery bifurcation, Ultrasound Med. Biol. 28 (2002), pp. 495-506. DOI: 10.1016/s0301-5629(02)00479-9 [11] D. W. Baker, W. G. Yates, Technique for studying the sample volume of ultrasonic Doppler devices, Med. Biol. Eng. 11 (1973), pp. 766-770. DOI: 10.1007/BF02478666 [12] A. Goldstein, Performance tests of Doppler ultrasound equipment with a string phantom, J. Ultrasound Med. 10 (1991) pp. 125-139. DOI: 10.7863/jum.1991.10.3.125 [13] E. J. Boote, J. A. Zagzebski, Performance tests of Doppler ultrasound equipment with a tissue and blood-mimicking phantom, J. Ultrasound Med. 7 (1988) pp. 137-147. DOI: 10.7863/jum.1988.7.3.137 [14] Z. F. Lu, N. J. Hangiandreou, P. Carson, Clinical ultrasonography physics: state of practice, in: Clinical Imaging Physics: Current and Emerging Practice. E. Samei, D. E. Pfeiffer (editors). Wiley Blackwell, Hoboken, NJ, 2020, ISBN 9781118753453, pp. 261- 286. [15] S. Balbis, T. Meloni, S. Tofani, F. Zenone, D. Nucera, C. Guiot, Criteria and scheduling of quality control of B-mode and Doppler ultrasonography equipment, J. Clin. Ultrasound 40 (2012), pp. 167-173. DOI: 10.1002/jcu.21897 [16] F. Marinozzi, F. P. Branca, F. Bini, A. Scorza, Calibration procedure for performance evaluation of clinical Pulsed Doppler systems, Measurement 45 (2012), pp. 1334-1342. DOI: 10.1016/j.measurement.2012.01.052 [17] A. Scorza, G. Lupi, S. A. Sciuto, F. Bini, F. Marinozzi, A novel approach to a phantom based method for maximum depth of penetration measurement in diagnostic ultrasound: a preliminary study. Proc. of the 2015 IEEE International Symposium on Medical Measurements and Applications (MeMeA), Turin, Italy, 7 – 9 May 2015. DOI: 10.1109/MeMeA.2015.7145230 [18] M. A. QuiΓ±ones, C. M. Otto, M. Stoddard, A. Waggoner, W. A. Zoghbi, Doppler Quantification Task Force of the Nomenclature and Standards Committee of the American Society of Echocardiography, Recommendations for quantification of Doppler echocardiography: a report from the Doppler quantification task force of the nomenclature and standards committee of the American society of echocardiography, J. Am. Soc. Echocardiogr. 15 (2002), pp. 167-184. DOI: 10.1067/mje.2002.120202 [19] C. M. Gross, J. KrΓ€mer, O. WeingΓ€rtner, F. Uhlich, F. C. Luft, J. Waigand, R. Dietz, Determination of renal arterial stenosis severity: comparison of pressure gradient and vessel diameter, Radiology 220 (2001), pp. 751-756. DOI: 10.1148/radiol.2203001444 [20] E. G. Grant, C. B. Benson, G. L. Moneta, A. V. Alexandrov, J. D. Baker, E. I. Bluth, B. A. Carroll, M. Eliasziw, J. Gocke, B. S. Hertzberg, S. Katanick, L. Needleman, J. Pellerito, J. F. Polak, K. S. Rholl, D. L. Wooster, R. E. Zierler. Carotid artery stenosis: gray- scale and Doppler US diagnosis–society of radiologists in ultrasound consensus conference, Radiology 229 (2003), pp. 340- 346. DOI: 10.1148/radiol.2292030516 https://doi.org/10.1016/j.ejmp.2014.08.003 https://doi.org/10.1016/j.ultrasmedbio.2007.10.017 https://doi.org/10.1016/0301-5629(83)90002-9 https://doi.org/10.1016/0301-5629(84)90197-2 https://doi.org/10.1016/s0301-5629(02)00479-9 https://doi.org/10.1007/BF02478666 https://doi.org/10.7863/jum.1991.10.3.125 https://doi.org/10.7863/jum.1988.7.3.137 https://doi.org/10.1002/jcu.21897 https://doi.org/10.1016/j.measurement.2012.01.052 https://doi.org/10.1109/MeMeA.2015.7145230 https://doi.org/10.1067/mje.2002.120202 https://doi.org/10.1148/radiol.2203001444 https://doi.org/10.1148/radiol.2292030516 ACTA IMEKO | www.imeko.org June 2023 | Volume 12 | Number 2 | 7 [21] D. Yigang, A. Goddi, C. Bortolotto, Y. Shen, A. Dell’Era, F. Calliada, L. Zhu, Wall shear stress measurements based on ultrasound vector flow imaging, J Ultrasound Med. 39 (2020), pp. 1649-1664. DOI: 10.1002/jum.15253 [22] J. P. Mynard, B. A. Wasserman, D. A. Steinman, Errors in the estimation of wall shear stress by maximum Doppler velocity, Atherosclerosis 227 (2013), pp. 259-266. DOI: 10.1016/j.atherosclerosis.2013.01.026 [23] A. A. Oglat, M.Z. Matjafri, N. Suardi, M.A. Oqlat, M.A. Abdelrahman, A.A. Oqlat, A review of medical doppler ultrasonography of blood flow in general and especially in common carotid artery, J Med Ultrasound 26 (2018), pp. 3-13. DOI: 10.4103/JMU.JMU_11_17 [24] S. Ambrogio, J. Ansell, E. Gabriel, G. Aneju, B. Newman, M. Negoita, F. Fedele, K. V. Ramnarine, Pulsed wave Doppler measurements of maximum velocity: dependence on sample volume size, Ultrasound Med. Biol. 48 (2022), pp. 68-77. DOI: 10.1016/j.ultrasmedbio.2021.09.006 [25] S. Cournane, A. J. Fagan, J. E. Browne, An audit of a hospital- based Doppler ultrasound quality control protocol using a commercial string Doppler phantom, Physica Medica 30(2014), pp. 380-384. DOI: 10.1016/j.ejmp.2013.10.001 [26] G. Fiori, A. Scorza, M. Schmid, J. Galo, S. Conforto, S. A. Sciuto, A preliminary study on a novel approach to the assessment of the sample volume length and registration accuracy in PW Doppler quality control. Proc. of the 2022 IEEE International Symposium on Medical Measurements and Applications (MeMeA), Messina, Italy, 22 – 24 June 2022. DOI: 10.1109/MeMeA54994.2022.9856474 [27] Y. C. Fung, Biomechanics: Circulation, Springer, New York, 2nd edition, 1997, ISBN 9780387943848, pp. 114-118. [28] W. W. Nichols, M. F. O’Rourke, C. Vlachopoulos, McDonald’s blood flow in arteries, CRC Press, London, 6th edition, 2011, ISBN 9780340985014, pp. 14-19. [29] Sun Nuclear Corporation, Doppler 403β„’ & Mini-Doppler 1430β„’ Flow Phantoms. Online [Accessed 20 February 2023] https://www.sunnuclear.com/uploads/documents/datasheets/ Diagnostic/DopplerFlow_Phantoms_113020.pdf [30] G. Fiori, F. Fuiano, A. Scorza, M. Schmid, J. Galo, S. Conforto, S. A. Sciuto, A novel sensitivity index from the flow velocity variation in quality control for PW Doppler: a preliminary study. Proc. of the 2021 IEEE International Symposium on Medical Measurements and Applications (MeMeA), Lausanne, Switzerland, 23 – 25 June 2021. DOI: 10.1109/MeMeA54994.2022.9856474 [31] G. Fiori, F. Fuiano, A. Scorza, M. Schmid, S. Conforto, S. A. Sciuto, Doppler flow phantom failure detection by combining empirical mode decomposition and independent component analysis with short time Fourier transform, ACTA IMEKO 10 (2021), pp. 185-193. DOI: 10.21014/acta_imeko.v10i4.1150 [32] G. Fiori, A. Pica, S. A. Sciuto, F. Marinozzi, F. Bini, A. Scorza. A comparative study on a novel quality assessment protocol based on image analysis methods for Color Doppler ultrasound diagnostic systems, Sensors 22 (2022). DOI: 10.3390/s22249868 [33] G. Fiori, F. Fuiano, A. Scorza, J. Galo, S. Conforto, S. A. Sciuto, A preliminary study on an image analysis based method for lowest detectable signal measurements in Pulsed Wave Doppler ultrasounds, ACTA IMEKO 10 (2021), pp. 126-132. DOI: 10.21014/acta_imeko.v10i2.1051 [34] G. Bocchetta, G. Fiori, A. Scorza, S. A. Sciuto, Image quality comparison of two different experimental setups for MEMS actuators functional evaluation: a preliminary study. Proc. of the 25th IMEKO TC4 International Symposium & 23rd International Workshop on ADC and DAC Modelling and Testing, Brescia, Italy, 12 – 14 September 2022, pp. 320-324. DOI: 10.21014/tc4-2022.59 [35] G. Bocchetta, G. Fiori, A. Scorza, N. P. Belfiore, S. A. Sciuto, First results on the functional characterization of two rotary comb-drive actuated MEMS microgripper with different geometry. Proc. of the 25th IMEKO TC4 International Symposium & 23rd International Workshop on ADC and DAC Modelling and Testing, Brescia, Italy, 12 – 14 September 2022, pp. 151-155. DOI: 10.21014/tc4-2022.28 [36] G. Fiori, A. Scorza, M. Schmid, J. Galo, S. Conforto, S. A. Sciuto, A preliminary study on the blind angle estimation for quality assessment of Color Doppler ultrasound diagnostic systems. Proc. of the 25th IMEKO TC4 International Symposium & 23rd International Workshop on ADC and DAC Modelling and Testing, Brescia, Italy, 12 – 14 September 2022, pp. 325-329. DOI: 10.21014/tc4-2022.60 [37] G. Fiori, F. Fuiano, A. Scorza, M. Schmid, J. Galo, S. Conforto, S. A. Sciuto, Doppler flow phantom stability assessment through STFT technique in medical PW Doppler: a preliminary study. Proc. of the 2021 IEEE International Workshop on Metrology for Industry 4.0 & IoT (MetroInd4.0&IoT), Rome, Italy, 7 – 9 June 2021. DOI: 10.1109/MetroInd4.0IoT51437.2021.9488513 https://doi.org/10.1002/jum.15253 https://doi.org/10.1016/j.atherosclerosis.2013.01.026 https://doi.org/10.4103/JMU.JMU_11_17 https://doi.org/10.1016/j.ultrasmedbio.2021.09.006 https://doi.org/10.1016/j.ejmp.2013.10.001 https://doi.org/10.1109/MeMeA54994.2022.9856474 https://www.sunnuclear.com/uploads/documents/datasheets/Diagnostic/DopplerFlow_Phantoms_113020.pdf https://www.sunnuclear.com/uploads/documents/datasheets/Diagnostic/DopplerFlow_Phantoms_113020.pdf https://doi.org/10.1109/MeMeA54994.2022.9856474 https://doi.org/10.21014/acta_imeko.v10i4.1150 https://doi.org/10.3390/s22249868 https://doi.org/10.21014/acta_imeko.v10i2.1051 https://doi.org/10.21014/tc4-2022.59 https://doi.org/10.21014/tc4-2022.28 https://doi.org/10.21014/tc4-2022.60 https://doi.org/10.1109/MetroInd4.0IoT51437.2021.9488513