Random noise test of analog-to-digital converters ACTA IMEKO ISSN: 2221-870X June 2023, Volume 12, Number 2, 1 - 8 ACTA IMEKO | www.imeko.org June 2023 | Volume 12 | Number 2 | 1 Random noise test of analog-to-digital converters Francisco Alegria1 1 Instituto de Telecomunicaçáes and Instituto Superior TΓ©cnico/Universidade de Lisboa, Av. Rovisco Pais 1, 1049-001 Lisbon,Portugal Section: RESEARCH PAPER Keywords: analog to digital converter; testing; noise; estimation; error analysis; random; applied mathematics Citation: Francisco Alegria, Random noise test of analog-to-digital converters, Acta IMEKO, vol. 12, no. 2, article 27, June 2023, identifier: IMEKO-ACTA- 12 (2023)-02-27 Section Editor: Laura Fabbiano, Politecnico di Bari, Italy Received March 11, 2023; In final form May 7, 2023; Published June 2023 Copyright: This is an open-access article distributed under the terms of the Creative Commons Attribution 3.0 License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Corresponding author: Francisco Alegria, e-mail: francisco.alegria@tecnico.ulisboa.pt 1. INTRODUCTION The standard deviation of the random noise present in an analog to digital converter (ADC) is an important parameter used to describe the performance of ADCs and to choose the proper ADC to use in a given application. The knowledge of the noise standard deviation in a test setup is also needed when performing other ADC tests, namely the Standard Static Test [1], [2] and the Standard Histogram Test [3]-[11]; the Small Waves Histogram Test [12]-[16]; the Sinefitting Test [17]-[23] and the Jitter Test; [24]-[26] for the determination of the error; and precision of the ADC parameters estimated with them. In some cases, random noise is used, with great advantage, as a stimulus signal [27]. The issue of quantifying the uncertainty of the estimates of ADC characteristics does not concern only the tests recommended in the IEEE 1057 standard but are common to all ADC tests, like the ones in the IEC 62008 standard [28]-[29], and the IEEE 1241_2000 standard [30], for example. In [31] an analysis off the precision of the estimates obtained with this test has been carried out. There, an expression for the minimum number of samples required to guarantee a certain bound on the uncertainty of the results, was presented. This is important in order to minimize the duration of the test because the exact number of samples required can be calculated. The presence of phase noise in the stimulus signal generator as well as jitter in the sampling instants also affect electronic systems in general and are important to quantify [1], [31] [34]. The test, as described in [1], section 8.6.2, consists in synchronously acquiring two sets of a certain number of samples (𝑀). The noise standard deviation (𝜎) is then estimated from the root mean square of the difference between the output codes of those two sets (mse – mean square error). If the noise standard deviation is high enough, a null input voltage is sufficient to perform the test, if not, a triangular stimulus signal should be used. In section 3, the error in the estimation of the random noise standard deviation due to the use of the heuristically derived estimator recommended in the IEEE standard is analyzed. In section 4 we show how to use a sinusoidal stimulus signal instead of a triangular shaped one. A study about the influence of the stimulus signal amplitude and offset on the estimation of the random noise standard deviation is then presented. This will allow the derivation of an expression for the minimum value of stimulus signal amplitude that guarantees an upper bound on the random noise estimator bias. An expression that allows the exact computation of the random noise standard deviation when necessary is going to be presented. This approach is computationally intensive and not appropriate for hand computation but can be easily implemented in a computer if necessary. 2. DC STIMULUS SIGNAL Random additive noise in ADCs, as described in [1], is a non- deterministic fluctuation of the ADC output and is described by ABSTRACT The random noise test of analog to digital converters recommended by the IEEE 1057 Standard for digitizing waveform recorders is studied. The heuristically derived expression presented for the estimation of the random noise standard deviation is experimentally validated. The standard suggests a triangular stimulus signal. Here we will show how to use a sinusoidal stimulus signal to carry out the test. The influence of stimulus signal offset and amplitude on the estimation error is also analyzed and an expression is presented to compute the minimum amplitude value that guarantees an upper bound on the estimator bias. mailto:francisco.alegria@tecnico.ulisboa.pt ACTA IMEKO | www.imeko.org June 2023 | Volume 12 | Number 2 | 2 its frequency spectrum and statistical properties. It is usually considered that the noise present is white (flat frequency spectrum), with a stationary probability density function. Also, it considered that the noise is additive and independent of the stimulus signal. Due to the presence of random noise at the ADC input, the output code (π‘˜) can be considered a discrete random variable which can assume any value between 0 and 2𝑛𝑏 βˆ’ 1 for a 𝑛𝑏-bit ADC. When the additive noise standard deviation is higher than the ADC ideal code bin width (𝑄) the suggested method in [1] is to short circuit the ADC input and acquire two sets of samples (π‘˜π‘Žπ‘— and π‘˜π‘π‘—) and subtract the codes obtained. This eliminates fixed errors of the ADC but preserves the random nature of the output codes. Considering that the additive noise present has a null mean (a non-null value would be accounted as an offset error), the average of the output codes will also be null. Therefore, the mean square error (π‘šπ‘ π‘’) is just: π‘šπ‘ π‘’ = 1 𝑀 βˆ‘(π‘˜π‘Žπ‘— βˆ’ π‘˜π‘π‘—) 2 π‘€βˆ’1 𝑗=0 . (1) The mean square error obtained is twice the variance of each set since they are independent of each other. According to [20] the expected value of the mean square error determined by (1) is twice the variance of the output codes: 𝐸{π‘šπ‘ π‘’} = πœŽπ‘˜π‘Ž 2 + πœŽπ‘˜π‘ 2 = 2πœŽπ‘˜ 2 . (2) Taken this into account, and considering that the variance of the output codes is equal to that of the additive noise, the estimated variance of the latter is just πœŽπ‘Ÿ 2Μ‚ = π‘šπ‘ π‘’ 2 , (3) where πœŽπ‘Ÿ is the normalized noise standard deviation πœŽπ‘Ÿ = 𝜎/𝑄. However, this only works when the additive noise standard deviation is higher than the ADC ideal code bin width as we will show next. It is chosen here to use normalized voltages, expressed in LSB (least significant bits) units, by dividing the voltages with the ideal ADC code bin width 𝑄. The normalized stimulus signal voltage is represented by 𝑦 and the normalized random noise voltage is represented by π‘Ÿ. The normalized sampled voltage at instant 𝑑𝑗 is thus given by 𝑒(𝑑𝑗) = 𝑦(𝑑𝑗) + π‘Ÿ(𝑑𝑗) . (4) Considering that the normalized additive noise has a null mean and a standard deviation represented by πœŽπ‘Ÿ, we have for the sampled voltage, which is also a random variable: πœ‡π‘’ = 𝑦, πœŽπ‘’ = πœŽπ‘Ÿ . (5) Being the additive noise normally distributed, the sampled voltage probability density function is 𝑓𝑒(𝑒|𝑦) = 1 √2 Ο€ πœŽπ‘Ÿ β‹… 𝑒 βˆ’ (π‘’βˆ’π‘¦)2 2 πœŽπ‘Ÿ 2 (6) and its distribution function is 𝐹𝑒(π‘ˆ|𝑦) = ∫ 𝑓𝑒(𝑒) β‹… d𝑒 π‘ˆ βˆ’βˆž = 1 √2 Ο€ πœŽπ‘Ÿ β‹… ∫ 𝑒 βˆ’ (π‘’βˆ’π‘¦)2 2β‹…πœŽπ‘Ÿ 2 β‹… d𝑒 π‘ˆ βˆ’βˆž = 1 2 + 1 2 β‹… erf( π‘ˆ βˆ’ 𝑦 √2 β‹… πœŽπ‘Ÿ ) . (7) Due to the subtraction of the codes obtained with the two sample sets in (1), we can consider the ADC as having an ideal behavior since any fixed errors were eliminated by the subtraction and random errors can be considered as being present in the stimulus signal input. The probability π‘π‘˜ of a sample having output code π‘˜ is equal to the probability of the sampled voltage being equal to or lower than the transition voltage 𝑇[π‘˜ + 1] and equal to or greater than transition voltage 𝑇[π‘˜] (for the middle codes): π‘π‘˜ = 𝑃{π‘ˆ[π‘˜] ≀ 𝑒 ≀ π‘ˆ[π‘˜ + 1]} , π‘˜ = 1, . . . ,2 𝑛𝑏 βˆ’ 2 (8) where we used the normalized transition voltage 𝑝0 = π‘ˆ[π‘˜] = 𝑇[π‘˜]/𝑄. Additionally, for the first code we have 𝑝0 = 𝑃{𝑒 ≀ π‘ˆ[1]} (9) and for the last code we have 𝑝2π‘›π‘βˆ’1 = 𝑃{π‘ˆ[2 𝑛𝑏 βˆ’ 1] ≀ 𝑒} . (10) The probability π‘π‘˜ can thus be expressed with the help of the sampled voltage distribution function: π‘π‘˜(𝑦) = { 𝐹𝑒(π‘ˆ[1]|𝑦) , π‘˜ = 0 𝐹𝑒(π‘ˆ[π‘˜ + 1]|𝑦) βˆ’ 𝐹𝑒(π‘ˆ[π‘˜]|𝑦), π‘˜ = 1,2, . . . ,2 𝑛𝑏 βˆ’ 2 1 βˆ’ 𝐹𝑒(π‘ˆ[2 𝑛𝑏 βˆ’ 1]|𝑦) , π‘˜ = 2𝑛𝑏 βˆ’ 1 . (11) In Figure 1, the noise probability function and the probability of occurring code π‘˜ (shaded area) is represented. The mean, second moment and variance of the output codes are, by definition [20]: πœ‡π‘˜|𝑦 = βˆ‘ π‘˜ β‹… π‘π‘˜(𝑦) 2π‘›π‘βˆ’1 π‘˜=0 , π‘š2π‘˜|𝑦 = βˆ‘ π‘˜ 2 β‹… π‘π‘˜(𝑦) 2π‘›π‘βˆ’1 π‘˜=0 πœŽπ‘˜|𝑦 2 = π‘š2π‘˜|𝑦 βˆ’ πœ‡π‘˜|𝑦 2 . (12) In Figure 2 the standard deviation of π‘˜ as a function of the noise standard deviation for two different values of stimulus signal is represented. It was calculated using (7), (11) and (12). For values of noise standard deviation much greater than the ideal code bin width (πœŽπ‘Ÿ ≫ 1), the standard deviation of the U[k+1]U[k] u f u 0 Figure 1. Representation of the noise probability function and the probability of occurring code k (shaded area). ACTA IMEKO | www.imeko.org June 2023 | Volume 12 | Number 2 | 3 output codes is the same as the standard deviation of noise (not clearly seen in Figure 2 because the horizontal axis only goes to 1 LSB). This corresponds to the case 𝑄 β†’ 0. In these circumstances the discrete variable π‘˜ becomes a continuous variable whose probability density function tends to the probability density function of noise. In this case the test can be used to estimate the noise standard deviation: πœŽπ‘Ÿ β†’ ∞ β‡’ πœŽπ‘˜|𝑦 β†’ πœŽπ‘Ÿ . (13) In the opposite situation, when the noise standard deviation is lower than 1 LSB (πœŽπ‘Ÿ < 1), it can be observed in Figure 2 that πœŽπ‘˜ is not equal to πœŽπ‘Ÿ anymore, becoming even independent of πœŽπ‘Ÿ when it goes to 0 (the curve becomes horizontal). This makes it impossible to estimate the noise standard deviation from the output code’s standard deviation. With the goal of justifying the analytical expression presented in [1] for the relation between πœŽπ‘Ÿ and πœŽπ‘˜ we are going to analyze the case πœŽπ‘Ÿ β‰ͺ 1. In Figure 3 it can be seen the case where only two output codes, π‘˜ βˆ’ 1 and π‘˜, have a significant probability of occurring for any value 𝑦 of stimulus signal. The index of the transition voltage closest to 𝑦 determines the value of π‘˜ and consequently which two codes occur for that particular value of 𝑦. Since the normalized transition voltages are integer values (considering an ADC transfer function with no true zero), the difference π‘ˆ[π‘˜] βˆ’ 𝑦 will always be between -0.5 and 0.5: π‘ˆ[π‘˜] βˆ’ 𝑦 = 𝑦 βˆ’ βŒŠπ‘¦ + 0.5βŒ‹ , (14) where ⌊π‘₯βŒ‹ represents the highest integer lower than π‘₯. The probability that the output code of a sample is π‘˜ βˆ’ 1 is π‘π‘˜βˆ’1(𝑦) = ∫ 𝑓𝑒(𝑒|𝑦) β‹… d𝑒 π‘ˆ[π‘˜] π‘ˆ[π‘˜βˆ’1] . (15) Because we are considering the case where the probability density function of the sampled voltage is negligible for voltages lower than π‘ˆ[π‘˜ βˆ’ 1], we can write π‘π‘˜βˆ’1(𝑦) = ∫ 𝑓𝑒(𝑒|𝑦) β‹… 𝑑𝑒 π‘ˆ[π‘˜] βˆ’βˆž = 𝐹𝑒(π‘ˆ[π‘˜]|𝑦) . (16) The probability of occurring code π‘˜ is obviously π‘π‘˜(𝑦) = 1 βˆ’ π‘π‘˜βˆ’1(𝑦) = 1 βˆ’ 𝐹𝑒(π‘ˆ[π‘˜]|𝑦) (17) since we considered that only codes π‘˜ and π‘˜ βˆ’ 1 could occur. The mean of the output codes is thus πœ‡π‘˜|𝑦 = (π‘˜ βˆ’ 1) β‹… π‘π‘˜βˆ’1(𝑦) + π‘˜ β‹… π‘π‘˜(𝑦) (18) and the variance πœŽπ‘˜|𝑦 2 = (π‘˜ βˆ’ 1)2 β‹… π‘π‘˜βˆ’1(𝑦) + π‘˜ 2 β‹… π‘π‘˜(𝑦) βˆ’ πœ‡π‘˜|𝑦 2 = π‘π‘˜βˆ’1(𝑦) βˆ’ π‘π‘˜βˆ’1 2 (𝑦) . (19) From (7) and (16) this variance can be written as πœŽπ‘˜|𝑦 2 = [ 1 2 + 1 2 β‹… erf( π‘ˆ[π‘˜] βˆ’ 𝑦 √2 β‹… πœŽπ‘Ÿ )] β‹… [ 1 2 βˆ’ 1 2 β‹… erf( π‘ˆ[π‘˜] βˆ’ 𝑦 √2 β‹… πœŽπ‘Ÿ )], πœŽπ‘Ÿ β‰ͺ 1 , (20) which can be rewritten as πœŽπ‘˜|𝑦 2 = 1 4 βˆ’ 1 4 β‹… erf2 ( π‘ˆ[π‘˜] βˆ’ 𝑦 √2 β‹… πœŽπ‘Ÿ ) , πœŽπ‘Ÿ β‰ͺ 1 . (21) This conditional variance is represented in Figure 4 as a function of the DC input voltage. Note that this function is periodic because the transition voltage π‘ˆ[π‘˜] in [21] is the closest to 𝑦, and has a period of 1 because the voltage 𝑦 is normalized to the ideal code bin width (𝑄). To justify the values of code standard deviation in the absence of noise (πœŽπ‘Ÿ β†’ 0) consider the following two situations. First the DC input voltage is equal to one of the transition voltages (π‘ˆ[π‘˜]), as represented in Figure 5a. Half of the represented curve is to the left of the transition voltage and the other to the right. The probability of having code π‘˜ βˆ’ 1 is equal to the probability of having code π‘˜ (50%) so the variance is 1/4 and the standard deviation is 1/2 as seen by the dashed line in Figure 2 for πœŽπ‘Ÿ β‰ͺ 1. In Figure 5b, the case where Figure 2. Representation of the code variance as a function of the additive noise standard deviation. The dashed line represents the situation where the input DC voltage is exactly equal to one of the ADC transition voltages and the solid line represents the case where the DC input voltage is exactly between two consecutive transition voltages. U[k+1]U[k] u f u U[kβˆ’1] p k-1 y p k Figure 3. Representation of the probability density function of noise. Figure 4. Representation of the conditional variance of the output codes as a function of the DC input voltage. ACTA IMEKO | www.imeko.org June 2023 | Volume 12 | Number 2 | 4 the DC input voltage is exactly between two consecutive transition voltages is represented. When the noise standard deviation goes to 0, the probability of having code π‘˜ is 1, so the standard deviation is 0 (solid line in Figure 2). For intermediate cases the curve is between the two lines in Figure 2. In conclusion, the use of a DC input signal is not appropriate when estimating small values of additive noise because the output codes of the acquired samples do not vary enough to make their standard deviation directly related to the additive noise standard deviation, as stated in [1]. 3. TRIANGULAR STIMULUS SIGNAL To overcome the problem referred in the previous section, the IEEE standard [1] suggests the use of a triangular stimulus signal that spans several ADC codes (about 10). Due to the subtraction of the codes obtained from the two sets of samples, the mean square error is still twice that of the additive noise if the sets are acquired synchronously in order for the samples of both sets to have the same phase. The variance of the output codes can be calculated from the amplitude distribution, 𝑓𝑦, of the stimulus signal [20]. πœŽπ‘˜ 2 = ∫ πœŽπ‘˜|𝑦 2 (𝑦) β‹… 𝑓𝑦(𝑦) d𝑦 ∞ βˆ’βˆž . (22) For a triangular stimulus signal, with an amplitude 𝐴 and an offset 𝐢, normalized by the ideal code bin width (𝐴𝑄 = 𝐴/𝑄 and 𝐢𝑄 = 𝐢/𝑄) the amplitude distribution is 𝑓𝑦(𝑦) = { 1 2 𝐴𝑄 , |𝑦 βˆ’ 𝐢𝑄| < 𝐴𝑄 0 , otherwise . (23) The output codes variance is thus πœŽπ‘˜ 2 = 1 2 𝐴𝑄 ∫ πœŽπ‘˜|𝑦 2 (𝑦) d𝑦 𝐢𝑄+𝐴𝑄 πΆπ‘„βˆ’π΄π‘„ . (24) Inserting (21) leads to πœŽπ‘˜ 2 = 1 2 𝐴𝑄 ∫ [ 1 4 βˆ’ 1 4 β‹… erf2 ( π‘ˆ[π‘˜] βˆ’ 𝑦 √2 β‹… πœŽπ‘Ÿ )]d𝑦 𝐢𝑄+𝐴𝑄 πΆπ‘„βˆ’π΄π‘„ , πœŽπ‘Ÿ β‰ͺ 1 . (25) The corresponding standard deviation is represented in Figure 6 by a solid line. Equation (24) states that the variance πœŽπ‘˜ 2 is the average of the curve in Figure 4, which is the representation of (21), in an interval with length 2𝐴𝑄 centered at𝐢𝑄. 3.1. Low Noise Approximation The integral in (24) does not have a closed form. We can, however, obtain an approximated expression. To achieve that we look into the case where we have a small value of noise standard deviation. In this situation the individual bell-shaped curves in Figure 4 do not overlap each other. Furthermore, when 𝐴𝑄 goes to ο‚₯ the result of (24) is the same as integrating the curve in Figure 4 from βˆ’1 to 1. In this case the result in the value of (24) is independent on the triangular wave offset 𝐢. Mathematically this statement can be expressed as πœŽπ‘˜ 2 = 1 2𝐴𝑄 ∫ πœŽπ‘˜|𝑦 2 (𝑦) d𝑦 𝐢𝑄+𝐴𝑄 πΆπ‘„βˆ’π΄π‘„ | π΄π‘„β†’βˆž = 1 2 βˆ«πœŽπ‘˜|𝑦 2 (𝑦) d𝑦 1 βˆ’1 . (26) Using (21) we can write lim π΄π‘„β†’βˆž πœŽπ‘˜ 2 = √2 β‹… πœŽπ‘Ÿ 4 ∫[1 βˆ’ erf2(π‘₯)]𝑑π‘₯ ∞ βˆ’βˆž , πœŽπ‘Ÿ β‰ͺ 1 . (27) This integral can be numerically calculated leading to a value of √8 π⁄ . The variance is thus lim πœŽπ‘Ÿβ†’0 π΄π‘„β†’βˆž πœŽπ‘˜ 2 = 1 βˆšΟ€ πœŽπ‘Ÿ . (28) This approximation is represented in Figure 6 by the dashed- dot line. It can be seen that, in fact, it approximates the solid thin line for small values of πœŽπ‘Ÿ. 3.2. High Noise Approximation We will look now into the case of a noise standard deviation much higher than the ideal code bin width(πœŽπ‘Ÿ β†’ ∞). When carrying out the test with a DC stimulus signal with normalized voltage 𝑦, the variance of π‘˜ conditional to 𝑦 does not depend on the value of 𝑦 and is equal to the random noise variance as stated in (13). In the case of a triangular stimulus signal this leads, from (24), to lim πœŽπ‘Ÿβ†’βˆž πœŽπ‘˜ 2 = πœŽπ‘Ÿ 2 . (29) U[k+1]U[k] u U[kβˆ’1] f u p k-1 =0.5 p k =0.5 U[k+1]U[k] u f u p k =1 a) b) Figure 5. Representation of the probability density function of noise and the probability of occurring code k βˆ’ 1 and code k. Figure 6. Representation of the code standard deviation as a function of the additive noise standard deviation (solid line) for a triangular stimulus signal with amplitude Q/2. The dashed and the dot-dashed lines represent the approximation for small and large additive noise standard deviation given by (28) and (29) respectively. The circles represent the uncertainty of the codes standard deviation obtained experimentally. ACTA IMEKO | www.imeko.org June 2023 | Volume 12 | Number 2 | 5 This situation is represented by the dotted line in Figure 6. The goal of the Random Noise Test is to be able to estimate the random noise standard deviation, πœŽοΏ½Μ‚οΏ½ from the measured mean square error (π‘šπ‘ π‘’). 3.3. IEEE 1057 Noise Estimator As we have demonstrated in the previous sections, the expected value of the mean square error is a function of the random noise standard deviation. Combining (28) and (29) with (2), leads to lim πœŽπ‘Ÿβ†’0 π΄π‘„β†’βˆž πœ‡mse = 2 βˆšπœ‹ πœŽπ‘Ÿ lim πœŽπ‘Ÿβ†’βˆž πœ‡mse = πœŽπ‘Ÿ 2 . (30) From these approximations the IEEE standard [1] presents a heuristically derived expression for the random noise standard deviation estimation: πœŽοΏ½Μ‚οΏ½ = [(√ π‘šπ‘ π‘’ 2 ) βˆ’π‘… + (βˆšΟ€ π‘šπ‘ π‘’ 2 ) βˆ’π‘… ] βˆ’ 1 𝑅 , 𝑅 = 4. (31) Note that the variables 𝜎 and π‘šπ‘ π‘’ used in [1] are expressed in volt and squared volt respectively while the variables πœŽπ‘Ÿ and π‘šπ‘ π‘’ used here are dimensionless. The error of the additive noise standard deviation estimation, represented in Figure 7, is given by π‘’πœŽοΏ½Μ‚οΏ½ = πœŽοΏ½Μ‚οΏ½ βˆ’ πœŽπ‘Ÿ . (32) It can be seen that the error is always smaller, in absolute value, than 0.022 LSB. When πœŽπ‘Ÿ β†’ ∞ the error goes to 0. The factor 4 used in (31) is very close to the value of 3.8203 which leads to the optimum approximation for an expression of the kind of (31) and corresponds to the position of the minimum in Figure 8. We have, so far, showed how the expression for the estimation of the random noise standard deviation from the measured mean square error recommended in the IEEE 1057- 94 standard was derived. the remaining of this paper we will go a step further by showing how this test can be carried out with a sinusoidal stimulus signal as well. We will also focus on the influence that the stimulus signal amplitude and offset have on the test results. As we saw in this section, the expression for the random noise estimator was heuristically derived from approximations for which an infinite stimulus signal amplitude is assumed. Furthermore, in the IEEE standard a value of 5 LSB for the stimulus signal amplitude is recommended without any justification. In test conditions where the stimulus signal generator has low accuracy on the wave amplitude and has offset error or the ADC under test has high resolution, it is difficult to have a stimulus signal amplitude exactly equal to 5 LSB. It is thus important to know how different values of stimulus signal amplitude and offset affect the bias of the estimated random noise standard deviation. This will be carried out here for both types of stimulus signal shapes – triangular and sinusoidal. As it will be shown, the higher the amplitude the lower the bias. The goal will be to have an expression that will tell us what should be the minimum value to use in order to guarantee an upper bound on the estimator bias. 4. SINUSOIDAL STIMULUS SIGNAL Although the IEEE 1057 standard recommends the use of a triangular wave signal for the cases where the random noise to be measured is small compared to the quantization step, this test can also be carried out with a sine wave as we will show here. Since sine wave generators are more common than triangular wave ones, this will benefit those wanting to measure small values of random noise but without having to look for a triangular wave generator. The variance of the output codes can be calculated the same way as in the case of triangular wave stimulus, using (22), but with a different amplitude distribution, 𝑓𝑦. For a sine wave, one has [8]: 𝑓𝑦(𝑦) = { 1 Ο€βˆšπ΄π‘„ 2 βˆ’ (𝑦 βˆ’ 𝐢𝑄) 2 , |𝑦 βˆ’ 𝐢𝑄| < 𝐴𝑄 0 , otherwise . (33) Inputting this into (22) leads to πœŽπ‘˜ 2 = ∫ πœŽπ‘˜|𝑦 2 (𝑦) 1 πœ‹βˆšπ΄π‘„ 2 βˆ’ (𝑦 βˆ’ 𝐢𝑄) 2 d𝑦 𝐢𝑄+𝐴𝑄 πΆπ‘„βˆ’π΄π‘„ . (34) The strategy used in the case of the triangular stimulus signal was to derive two expressions for the asymptotic cases of high and low random noise standard deviation and then heuristically construct an expression for the estimator. As it turns out, those two asymptotic expressions are the same regardless of the stimulus signal shape. For large values of random noise we concluded earlier that the variance of the output codes is independent of the DC stimulus signal value. Using eq. (13) in (34) leads to Figure 7. Representation of the estimation error of the additive noise standard deviation, obtained with (31), as a function of the actual standard deviation. Figure 8. Representation of the estimation error of the additive noise standard deviation, obtained with (31), as a function of the parameter R. ACTA IMEKO | www.imeko.org June 2023 | Volume 12 | Number 2 | 6 πœŽπ‘˜ 2|πœŽπ‘Ÿβ†’βˆž = πœŽπ‘Ÿ 2 β‹… ∫ 1 Ο€βˆšπ΄π‘„ 2 βˆ’ (𝑦 βˆ’ 𝐢𝑄) 2 d𝑦 𝐢𝑄+𝐴𝑄 πΆπ‘„βˆ’π΄π‘„ = πœŽπ‘Ÿ 2 (35) which is the same as the one obtained for the triangular shaped stimulus signal (eq. (29)). For small values of random noise standard deviation, we made an extra approximation that was to consider an infinite stimulus signal amplitude. The ADC input range will thus only cover the middle of the stimulus signal range. There the sinusoidal shape can be approximated by a straight line which makes it similar to a triangular wave and thus will lead to the same approximation for the output codes variance: πœŽπ‘˜ 2|πœŽπ‘Ÿβ†’0 π΄π‘„β†’βˆž = 1 βˆšΟ€ πœŽπ‘Ÿ . (36) It is thus shown that the same heuristically derived expression for the triangular stimulus case, eq. (31), can be employed when using a sinusoidal stimulus signal. 5. EXPERIMENTAL VALIDATION A triangular stimulus signal, with amplitude 39.216 mV and frequency 10 Hz, was applied to a 12-bit data acquisition board (Keithley DAS 1601) in the ο‚±10 V range and two sets of 10000 samples were acquired at a sampling frequency of 100 kHz. Only the 8 most significant bits were used so that the ADC would present an almost ideal behavior. This was validated by testing the data acquisition board (using all 12 bits) with the Standard Histogram Test and obtaining an integral non-linearity (INL) and differential non-linearity (DNL) lower than 0.5 LSB. A Stanford DS360 function generator was used to generate the additive noise and a Wavetek 9100 calibrator was used to generate the triangular wave. The data acquisition board used possesses 16 single-ended or 8 differential inputs. It was one of those differential inputs that was used (CH0). The Stanford DS360 function generator was connected between pins 37 (β€œCH0 HI IN”) and 19 (β€œLL GND”) and the Wavetek 9100 calibrator was connected between pins 18 (β€œCH0 LOW IN”) and 19 (β€œLL GND”). This way the gaussian noise and the triangular wave were added (actually, subtracted) internally. The results are represented in Figure 6 were a good agreement with the theoretical curve, represented by the thin solid line is observed. 6. STIMULUS SIGNAL AMPLITUDE In the previous sections we addressed the problem of determining an estimator for the random noise standard deviation when using a triangular and a sinusoidal stimulus signal. As observed in equation (24), the code standard deviation depends on the stimulus signal amplitude. This can be verified in Figure 9 where two cases are plotted, one for 𝐴𝑄 = 0.5 (dotted line) and another for 𝐴𝑄 = 0.75 (solid line). The difference is highest for values of noise standard deviation smaller than 0.5 LSB. That dependence can be also observed in Figure 10 for two different values of triangular wave offset. The case of null amplitude (𝐴𝑄 = 0) corresponds to the DC input case represented in Figure 2. The higher the triangular wave amplitude the less influence it has on the output code standard deviation. Whenever the amplitude 𝐴 is a multiple of 𝑄/2, that is, 2𝐴𝑄 is integer, the code standard deviation has the same value. When performing the test to estimate the random noise standard deviation, a value of triangular wave amplitude has to be chosen. This choice will influence the estimated value, however, observing Figure 10, there are some values that seem more advantageous than others, namely the odd multiples of 𝑄/2 (𝐴𝑄 = 0.5,1.5,2.5,…) because the slope of the curve in those points is smaller making the estimate less sensible to errors in the triangular wave amplitude that in practical conditions are sure to exist. Also, in that case, the output code variance becomes practically independent of the stimulus signal offset. The higher the triangular wave amplitude, the higher will be the additive noise introduced by the function generator (because of its different ranges with higher amplification) making very high values of amplitude not advisable. The IEEE standard [1] suggests the use of 𝐴𝑄 = 5 without explaining the reason. We hope the work presented here sheds some light on the subject. As seen here, a marginally better choice would be, for instance, 𝐴𝑄 = 5.5 since the slope of the curve in that point is smaller than at 𝐴𝑄 = 5 and consequently the test would be less affected by eventual inaccuracies in the signal amplitude. Figure 9. Representation of the code standard deviation as a function of the additive noise standard deviation for a triangular stimulus signal with amplitude Q/2 (dotted line) and an amplitude 0.75Q (solid line). Figure 10. Representation of the code standard deviation as a function of the triangular wave amplitude divided by the ideal code bin width. The solid line represents the situation of an offset equal to an ADC transition voltage and the dotted line a situation where the offset value is exactly between two consecutive transition voltages. The dotted line represents the value taken by the code standard deviation when the triangular amplitude is Q/2. A normalized value of noise standard deviation of 0.1 (one tenth of the ideal ADC code bin width) was used. 0 0,1 0,2 0,3 0,4 0,5 0 0,5 1 1,5 2 2,5 3 3,5 4 4,5 5 A Q (LSB) sk (LSB) ACTA IMEKO | www.imeko.org June 2023 | Volume 12 | Number 2 | 7 7. CONCLUSIONS In this paper, the test method proposed by the IEEE 1057 standard [1] to estimate the random noise standard deviation was analyzed in detail. The expression presented there to calculate the additive noise standard deviation from the ADC output codes mean square error is explained here from a different perspective. The influence of both triangular wave amplitude and offset on the estimation error was studied. In Figure 11, the maximum estimation error for different values of triangular stimulus signal amplitude and offset is represented. It can be seen that for small values of amplitude the maximum error depends strongly on the triangular wave offset. The actual error on estimating the noise standard deviation when using the expression presented in [1] is calculated and it was concluded that it was smaller than 2.2% of the ideal ADC code bin width (0.022 LSB). The choice of triangular stimulus amplitude is studied and a justification for the value proposed in [1] is given. We suggest here that in the case were a triangular or sinusoidal wave generator is not available the test be carried out with a DC stimulus signal, with any value inside the ADC range, and that the noise standard deviation be estimated as being equal to the code root mean square error, divided by 2. If the value obtained is smaller than Q/2 the value used as the noise standard deviation estimative should be Q/2. Of course, the standard deviation could be smaller, but, as shown here, it could not be higher. In summary, we propose, just for the case where a triangular or sine wave generator cannot be used, the following expression for the estimation: πœŽοΏ½Μ‚οΏ½ = min( 1 2 ,√ π‘šπ‘ π‘’ 2 ) . (37) Experimental results were presented that validate the approach taken. REFERENCES [1] IEEE Standard for Digitizing Waveform Recorders, IEEE Std 1057-2007 (Revision of IEEE 1057-1994) (Full-Use), vol., no., pp.1-168, 18 April 2008: DOI: 10.1109/IEEESTD.2008.8291822 [2] A. J. GinΓ©s, E. J. PeralΓ­as, A. Rueda, An adaptive BIST for INL estimation of ADCs without histogram evaluation, in Proceedings 2010 IEEE 16th International Mixed-Signals, Sensors and Systems Test Workshop (IMS3TW), La Grande Motte, France, 07-09 June 2010, pp. 1-6. DOI: 10.1109/IMS3TW.2010.5502997 [3] L. Michaeli, Fast dynamic methods of the systematic error autocorrection, Proceedings of 5th IMEKO TC-4 International Symposium, Vienna, April 1992, 1992, pp. 247 249. [4] F. C. Alegria, A. Cruz Serra, Standard Histogram Test Precision of ADC Gain and Offset Error Estimation, IEEE Transactions on Instrumentation and Measurement 56(5) (2007), pp. 1527-1531. DOI: 10.1109/TIM.2007.907978 [5] V. PΓ‘lfi, An improved sine wave histogram test method for ADC characterization, IEEE Transactions on Instrumentation and Measurement 68(10) (2019), pp. 3446-3455. DOI: 10.1109/TIM.2018.2878593 [6] F. C. Alegria, P. Arpaia, A. M. da Cruz Serra, P. Daponte, ADC histogram test by triangular small-waves, IMTC 2001. Proceedings of the 18th IEEE Instrumentation and Measurement Technology Conference. Rediscovering Measurement in the Age of Informatics (Cat. No.01CH 37188), Budapest, Hungary, 21-23 May 2001, pp. 1690-1695 vol.3. DOI: 10.1109/IMTC.2001.929490 [7] K. Y. Tan, J. Q. Q. Cheng, J. H. Chuah, Investigation of static analog-to-digital converter nonlinearity measurement using histogram and servo-loop method, 2018 IEEE 5th International Conference on Smart Instrumentation, Measurement and Application (ICSIMA), Songkhla, Thailand, 28-30 November 2018, pp. 1-4. DOI: 10.1109/ICSIMA.2018.8688768 [8] F. C. Alegria, A. C. Serra, Influence of frequency errors in the variance of the cumulative histogram, Conference on Precision Electromagnetic Measurements. Conference Digest. CPEM 2000 (Cat. No.00CH37031), Sydney, NSW, Australia, 14-19 May 2000, pp. 585-586. DOI: 10.1109/CPEM.2000.851145 [9] T. Moosazadeh, M. Yavari, A calibration technique for Pipelined ADCs using self-measurement and histogram-based test methods, IEEE Transactions on Circuits and Systems II: Express Briefs 62(9) (2015), pp. 826-830. DOI: 10.1109/TCSII.2015.2435851 [10] A. C. Serra, F. Alegria, L. Michaeli, P. Michalko, J. Saliga, Fast ADC testing by repetitive histogram analysis, Proceedings of the 2006 IEEE Instrumentation and Measurement Technology Conference, Sorrento, Italy, 24-27 April 2006. DOI: 10.1109/IMTC.2006.328161 [11] F. CorrΓͺa Alegria, A. Cruz Serra, Uncertainty in the ADC transition voltages determined with the histogram method, Proceedings of the 6th Workshop on ADC Modeling and Testing, Lisbon, Portugal, September 13-14, 2001, pp. 28-32. Online [Accessed 30 April 2023] https://www.imeko.org/publications/tc4-2001/IMEKO-TC4- 2001-091.pdf [12] F. C. Alegria, P. Arpaia, P. Daponte, A. C. Serra, ADC histogram test using small-amplitude input waves, Proceedings of the XVI IMEKO World Congress, Austria, September 25-28, 2000, vol. X, pp. 9-14. Online [Accessed 30 April 2023] https://www.imeko.org/publications/wc-2000/IMEKO-WC- 2000-EWADC-P598.pdf [13] J. Blair, Histogram measurement of ADC nonlinearities using sine waves, IEEE Transactions on Instrumentation and Measurement 43(3) (1994), pp. 373-383. DOI: 10.1109/19.293454 [14] Athanasios Papoulis, Probability, random variables and stochastic processes, McGraw-Hill, 3rd edition, 1991, ISBN 9780070484771. [15] F. C. Alegria, A. M. da Cruz Serra, Uncertainty of ADC random noise estimates obtained with the IEEE 1057 standard test, in IEEE Transactions on Instrumentation and Measurement 54(1) (2005), pp. 110-116. DOI: 10.1109/TIM.2004.840226 Figure 11. Representation of the maximum estimation error of the additive noise standard deviation, obtained with (31), as a function of the triangular wave amplitude and offset. https://reference.globalspec.com/standard/13122595/1057-2007 https://doi.org/10.1109/IMS3TW.2010.5502997 https://doi.org/10.1109/TIM.2007.907978 https://doi.org/10.1109/TIM.2018.2878593 https://doi.org/10.1109/IMTC.2001.929490 https://doi.org/10.1109/ICSIMA.2018.8688768 https://doi.org/10.1109/CPEM.2000.851145 https://doi.org/10.1109/TCSII.2015.2435851 https://doi.org/10.1109/IMTC.2006.328161 https://www.imeko.org/publications/tc4-2001/IMEKO-TC4-2001-091.pdf https://www.imeko.org/publications/tc4-2001/IMEKO-TC4-2001-091.pdf https://www.imeko.org/publications/wc-2000/IMEKO-WC-2000-EWADC-P598.pdf https://www.imeko.org/publications/wc-2000/IMEKO-WC-2000-EWADC-P598.pdf https://doi.org/10.1109/19.293454 https://doi.org/10.1109/TIM.2004.840226 ACTA IMEKO | www.imeko.org June 2023 | Volume 12 | Number 2 | 8 [16] S. Shariat-Panahi, F. C. Alegria, A. Manuel, A. C. Serra, IEEE 1057 jitter test of waveform recorders, IEEE Transactions on Instrumentation and Measurement 58(7) (2009), pp. 2234-2244. DOI: 10.1109/TIM.2009.2013674 [17] A. C. Serra, F. C. Alegria, R Martins, M. F. da Silva, Analog-to- digital converter testingβ€”new proposals, Computer Standards & Interfaces 26 (1) (2004), pp. 3-13. [18] D. Belega, D. Petri, Statistical performance of the effective- number-of-bit estimators provided by the sine-fitting algorithms, IEEE Transactions on Instrumentation and Measurement 62(3) (2013), pp. 633-640. DOI: 10.1109/TIM.2012.2218679 [19] F. C. Alegria, A. Moschitta, P. Carbone, A. M. da Cruz Serra and D. Petri, Effective ADC linearity testing using sinewaves, IEEE Transactions on Circuits and Systems I: Regular Papers 52(7) (2005), pp. 1267-1275. DOI: 10.1109/TCSI.2005.851393 [20] B. Renczes, I. KollΓ‘r, T. DabΓ³czi, Efficient implementation of least squares sine fitting algorithms, IEEE Transactions on Instrumentation and Measurement 65(12) (2016), pp. 2717-2724. DOI: 10.1109/TIM.2016.2600998 [21] F. C. Alegria, P. Girao, V. Haasz, A. C. Serra, Performance of data acquisition systems from the user's point of view, IEEE Transactions on Instrumentation and Measurement 53(4) (2004), pp. 907-914. DOI: 10.1109/TIM.2004.830757 [22] F. Alegria, P. Silva GirΓ£o, V. Haasz, A. Serra, Performance of data acquisition systems from the user's point of view, IEEE Instrumentation and Measurement Technology Conference, 940-945, Vail, Colorado, USA, pp. 940-945, 20-22, May 2003. DOI: 10.1109/IMTC.2003.1207891 [23] F. C. Alegria, A. C. Serra, Uncertainty of the estimates of sine wave fitting of digital data in the presence of additive noise, 2006 IEEE Instrumentation and Measurement Technology Conference Proceedings, Sorrento, Italy, 24-27 April 2006, pp. 1643-1647. DOI: 10.1109/IMTC.2006.328187 [24] J. M. Janik, D. Bloyet, B. Guyot, Measurement of timing jitter contributions in a dynamic test setup for A/D converters, IEEE Transactions on Instrumentation and Measurement 50(3), pp. 786-791. DOI: 10.1109/19.930455 [25] J. M. Janik, D. Bloyet, Timing uncertainties of A/D converters: theoretical study and experiments, IEEE Transactions on Instrumentation and Measurement 53(2) (2004), pp. 561-565. DOI: 10.1109/TIM.2003.820461 [26] G. Chiorboli, M. Fontanili, Cross-correlation noise measurements in A/D converters, IEEE Transactions on Instrumentation and Measurement 48(6) (1999), pp. 1282-1286. DOI: 10.1109/19.816149 [27] J. Holub, J. Vedral, Stochastic testing of ADCβ€”Step-Gauss method, Computer Standards & Interfaces 26(3) (2004), pp. 251-257. DOI: 10.1016/j.csi.2003.09.001 [28] F. C. Alegria, A. C. Serra, Gaussian jitter-induced bias of sine wave amplitude estimation using three-parameter sine fitting, IEEE Transactions on Instrumentation and Measurement 59(9) (2010), pp. 2328-2333. DOI: 10.1109/TIM.2009.2034576 [29] IEC, Performance characteristics and calibration methods for digital data acquisition systems and relevant software – IEC 62008:2005, July 2005. [30] IEEE Standard for Terminology and Test Methods for Analog- to-Digital Converters, IEEE Std 1241-2000, pp.1-98, 22 June 2001. DOI: 10.1109/IEEESTD.2001.92771 [31] M. Emmenegger, F. Jenni, R. Kunzi, H. Jaeckle, S. Schnabel, Analysis and calibration of a high precision AD converter, 2007 European Conference on Power Electronics and Applications, Aalborg, Denmark, 02-05 September 2007, pp. 1-10 DOI: 10.1109/EPE.2007.4417276 [32] L. Xu, D. Chen, A low cost jitter estimation and ADC spectral testing method, 2015 IEEE International Symposium on Circuits and Systems (ISCAS), Lisbon, Portugal, 24-27 May 2015, pp. 2277-2280. DOI: 10.1109/ISCAS.2015.7169137 [33] V. PΓ‘lfi, I. KollΓ‘r, Efficient execution of ADC test with sine fitting with verification of excitation signal parameter settings, 2012 IEEE International Instrumentation and Measurement Technology Conference Proceedings, Graz, Austria, 13-16 May 2012, pp. 2662-2667. DOI: 10.1109/I2MTC.2012.6229502 [34] D. Belega, D. Petri, Analog-to-digital converter dynamic testing by linearized four-parameter sine-fit algorithm, 2021 IEEE 6th International Forum on Research and Technology for Society and Industry (RTSI), Naples, Italy, 06-09 September 2021, pp. 502- 506. DOI: 10.1109/RTSI50628.2021.9597328 https://doi.org/10.1109/TIM.2009.2013674 https://doi.org/10.1109/TIM.2012.2218679 https://doi.org/10.1109/TCSI.2005.851393 https://doi.org/10.1109/TIM.2016.2600998 https://doi.org/10.1109/TIM.2004.830757 https://doi.org/10.1109/IMTC.2003.1207891 https://doi.org/10.1109/IMTC.2006.328187 https://doi.org/10.1109/19.930455 https://doi.org/10.1109/TIM.2003.820461 https://doi.org/10.1109/19.816149 https://doi.org/10.1016/j.csi.2003.09.001 https://doi.org/10.1109/TIM.2009.2034576 https://doi.org/10.1109/IEEESTD.2001.92771 https://doi.org/10.1109/EPE.2007.4417276 https://doi.org/10.1109/ISCAS.2015.7169137 https://doi.org/10.1109/I2MTC.2012.6229502 https://doi.org/10.1109/RTSI50628.2021.9597328