Acta IMEKO, Title ACTA IMEKO ISSN: 2221-870X March 2018, Volume 7, Number 1, 42-49 ACTA IMEKO | www.imeko.org March 2018 | Volume 7 | Number 1 | 42 Analysis of the RBF ANN-based classifier for the diagnostics of electronic circuit Bartosz Połok, Piotr Bilski Institute of Radioelectronics and Multimedia Technology, Warsaw University of Technology, ul. Nowowiejska 15/19 00-665 Warsaw, Poland Section: RESEARCH PAPER Keywords: fault identification; RBF networks; classification Citation: Bartosz Połok, Piotr Bilski, Analysis of the RBF ANN-based classifier for the diagnostics of electronic circuit, Acta IMEKO, vol. 7, no. 1, article 8, March 2018, identifier: IMEKO-ACTA-07 (2018)-01-08 Section Editor: Lorenzo Ciani, University of Florence, Italy Received October 4, 2017; In final form January 6, 2018; Published March 2018 Copyright: © 2018 IMEKO. This is an open-access article distributed under the terms of the Creative Commons Attribution 3.0 License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited Funding: This work was partially financed from the statutory grant, Institute of Radioelectronics and Multimedia Technology, Warsaw University of Technology Corresponding author: Piotr Bilski, e-mail: pbilski@ire.pw.edu.pl 1. INTRODUCTION Artificial Neural Networks (ANN) are currently the most popular Artificial Intelligence (AI) tools used in the diagnostics of analog systems [1]-[3]. Their numerous advantages include the ability to extract generalized knowledge from the available measurement data, autonomous operation (making them useful in the automated online diagnostics) and the ability to accurately process data in uncertainty conditions. Limited memory usage and high processing efficiency make them useful in embedded applications (implemented in the digital signal processor or the FPGA array [4]). Their disadvantage is the obscure form of stored knowledge (illegible for the human operator), making the explanation of generated decisions difficult. However, this is not crucial as long as the diagnostic system accurately detects and identifies faults. Despite introducing hybrid approaches (such as hierarchical or convolutional ANN [5]), traditional architectures are still in use, due to their simple operation principle and high efficiency proven in multiple cases. The most popular ANN is the Multilayered Perceptron (MLP), successfully applied to solve biomedical, financial and technical problems [6], [7]. Their implementations in the diagnostics cover power lines [8] or electrical machines [9]. They are currently widely exploited and work as the standard diagnostic tool, or the self-diagnostic module [10]. Training the MLP classifier consists in selecting one of available algorithms (such as error backpropagation or Levenberg-Marquardt) and adjusting the available data to the predefined architecture. It is defined by the specific number of layers that contain the selected type of neurons (computational units). Optimizing these parameters is the main design challenge, as the optimal MLP architecture has to be determined individually for each ABSTRACT The paper presents the application of the Radial Basis Function (RBF) Artificial Neural Network (ANN) to the diagnostics of analog circuits. Such networks are in most cases useful in the approximation tasks as the alternative to multilayered perceptrons (MLP) or Support Vector Machines (SVM). In this work the analysis of various RBF ANN-based classifier configurations for the fault detection and identification module is conducted. The considered parameters included the optimal number of neurons in the hidden layer, coding schemes for the output layer and operation duration during the training and testing of the classifier. The efficiency of the diagnostic system was verified using the electronic circuit, i.e. the fifth order lowpass filter. It was analyzed in terms of testability, depending on the set of accessible nodes, confronted against the availability of the output node only. Experiments also covered accuracy comparison between the RBF, MLP and SVM classifiers. Results show advantages and drawbacks of the RBF ANN-based diagnostic module, compared to other available solutions. ACTA IMEKO | www.imeko.org March 2018 | Volume 7 | Number 1 | 43 problem. Similar issues are encountered during the application of Support Vector Machines (SVM) to the classification task. They are considered the optimal ANN-based classifiers in the uncertainty conditions [11]. Their disadvantage is the time consuming process of selecting the optimal kernel and its parameters [12]. Despite such challenges, SVM are also popular in diagnostics, used to identify faults in electrical machinery [13], electronic circuits [14] or power plants [15]. On the other hand, Radial Basis Function (RBF) networks are considered simpler in design. Their training is faster and structure simpler, as only the single hidden layer is present. Therefore, the following parameters are to be determined: • the number of hidden computational units, depending on the size of training data; • the number of output neurons, depending on the number of categories to distinguish and the selected coding scheme; • the activation function width (identical for all hidden neurons). In most cases the RBF network is used for the approximation task, as it has linear neurons in the output layer. Its application to classification may require substituting computational units with their sigmoidal counterparts. Such approaches are rare and not well described in the literature [16]. This calls for the thorough investigation of the RBF ANN classification characteristics during the fault detection and identification in analog systems. The aim of this paper is to assess performance of various RBF ANN configurations during the fault detection and location in analog circuits. The presented work is an extension of the research published in [17]. All introduced parameters of the classifier were tested to find the optimal configuration maximizing the diagnostic accuracy, verified on the model of the 5th order electronic lowpass filter. The testability of the circuit was checked by changing the set of accessible nodes (at which system responses can be measured). The accuracy of the AI-based diagnostic module depends on the quality of the training data extracted from the system. Increasing the number of accessible nodes leads to the improvement of the diagnostic module. On the other hand, the number of pins in the circuit casing should be minimized. Therefore, a compromise between these two goals must be made. Finally, the RBF ANN-based classifier is compared to its well-established counterparts, i.e. MLP and SVM to determine in which situations it outperforms its rivals and should be selected for the task. The structure of the paper is as follows. Section 2 presents the applied diagnostic architecture. Details of the implemented network are described here. Training and testing data sets structure is presented in Section 3. The analysed circuit is introduced in Section 4, while experimental results are in Section 5. Conclusions about the conducted analysis are in Section 6. 2. ANN-BASED DIAGNOSTIC ARCHITECTURE The typical diagnostic scheme using any type of the ANN- based classifier is presented in Figure 1. Here the System Under Test (SUT) is monitored by the hardware/software module, which performs data acquisition on the accessible nodes. In this way the extraction of the vector of features (symptoms) e={s1, …, sm} (also called examples) from measured signals is performed. They are subsequently processed to make the diagnostic decision (hypothesis) h. It is assumed that knowledge stored by the module allows for the automatic fault detection and identification. This requires implementation of the machine learning algorithms. During this operation the ANN-based classifier produces the binary output, in which every fault category is represented by the unique sequence of values {0,1} or {-1,1}, depending on the used type of sigmoidal neurons. Application of the RBF network for the fault classification task requires adjusting its structure to the specific problem. This involves selection of the number of neurons in the hidden layer and the coding scheme for binary units in the output layer. As opposed to MLP and similarly to SVM, the RBF network contains only one hidden layer with the Gaussian activation function φ(si) units (1). The function width (defined as the standard deviation σ, where c is the centre, usually set to 0 for all neurons) determines the network performance. These parameters are optimized during the design stage. ( ) ⋅ − −= 2 2 2 exp σ ϕ cσ σ ii (1) 2.1. Minimization of the number of hidden neurons The number of neurons k in the hidden layer (usually greater for the RBF ANN than for MLP) is automatically adjusted in the result of the training. Although there are approaches to find it during one training sweep [18], in most cases the predetermined network structure is trained and validated, then the process is repeated for another structure. During this time consuming (though automated) process, the maximum acceptable value is determined. It is initially equal to the overall number of examples in the set L (2), which ensures the high classification accuracy, but makes the network large and slow. To avoid this, the number of hidden neurons should be minimized. The training examples are obtained after simulating the SUT, which allows for connecting its behaviour with the internal configuration of parameters. In the presented work, the clustering of examples was applied to group the most similar ones. It is assumed that training data from the SUT simulation is redundant, caused by the following factors: • low sensitivity of the SUT for changes of the specific parameter, which results in multiple examples describing the same category, as they are close to each other (in terms of distance). Such a group can easily be substituted by the single example representing all original members. It becomes their centroid. • existence of ambiguity groups (AG) [19], which contain examples belonging to different categories that are close to each other. In this case examples cannot be replaced by the single representative and must all remain in the set. Figure 1. ANN-based diagnostic system architecture. ACTA IMEKO | www.imeko.org March 2018 | Volume 7 | Number 1 | 44 Data preprocessing aims at discovering all groups of similar examples by the cluster analysis, which results in the set of groups G1 easily distinguishable from each other, based on the similarity calculations. The detailed scheme is presented in Figure 2. Redundancy in the set L may be exploited in two ways. The first one consists in providing the original data set for the RBF network training, but limiting the maximum number of neurons in the hidden layer to the number of clusters nc. Alternatively, the reduced data set L’ may be provided for training. The distance-based similarity calculation was used in the presented case. Its only parameter is the threshold θ, below which two examples ei and e j are considered close to each other (2). The measure applied to create clusters exploits Euclidean dE (3) and cosine dc (4) distances, treating every example as the point in the m-dimensional space. This way groups located close to each other are easily identified. Thresholds θ1 and θ2 for both distances should be selected adaptively to minimize the number of clusters containing examples belonging to different classes (i.e. forming AG). ( ) ( ) 21 ,,, θθ <∧<⇔∈ jiEjiElji eedeedGee (2) ( ) ( )∑ = −= m k jkikjiE σσeed 1 2, (3) ∑∑ ∑ == = ⋅ ⋅ = m k jk m k ik m k jkik c σσ σσ d 1 2 1 2 1 (4) The illustration of the clustering method for m=2 is presented in Figure 3. 2.2. Output layer coding schemes The important issue during the design of the ANN-based classifier is the representation of multiple categories by binary- valued neurons in the output layer. Among multiple coding schemes, three were selected for experiments [20]. It is assumed that only single faults are considered (the most probable case). Schemes differ in the number of output neurons o: • One-vs-All (OvA) – here each output unit is responsible for a separate category. The number of fault codes l determines the number of neurons o in the output layer (see Table 1). During the fault identification, only one neuron should be active. If multiple neurons become active, they can be interpreted as fault candidates in the uncertainty conditions. This scheme makes the classifier suitable for the multiple fault diagnostics (i.e. when more than one parameter is out of tolerance margins). • One-vs-One (OvO) – each neuron is responsible for distinguishing between the pair of categories. This time o classifiers with one output neuron are created and simultaneously trained. Their number is determined by the number of distinct fault code pairs: l·(l-1)/2. In this scheme both active and inactive neuron determines the specific fault. The diagnostic decision is made based on the majority voting – the category pointed by the greatest number of networks supporting it. Note that each network in this scheme is trained on a different subset, extracted from L. In each, only examples belonging to two fault categories are present. For instance, three fault codes require the following units (trained on the corresponding subsets): 1: c1 vs c2, 2: c1 vs c3, 3: c2 vs c3. • Minimum Output Coding (MOC) – the minimal set of neurons, which represents each fault code by the unique combination of active units. The subsequent codes are represented by the binary representation of integer numbers (see Table 2). The more sophisticated coding schemes, such as Error Correcting Output Coding (ECOC) [21] were excluded from experiments, as their implementation would complicate the output layer even more, not necessarily increasing diagnostic accuracy. ANN was implemented using the Matlab environment including the Neural Networks Toolbox. 3. DATA SETS DESCRIPTION Learning L and testing T datasets are required to train the RBF network classifier and verify its accuracy. Both have the Figure 2. Learning data set preprocessing for the RBF classifier training. Table 1. Applied OvA coding scheme. Category Coding scheme c1 1,0,0, …,0 c2 0,1,0, …,0 … … cl 0, …,0,0,1 Table 2. Applied MOC coding scheme. Category Coding scheme c1 0,0,0, … ,0,1 c2 0,0,0, … 1,0 c3 0,0,0, … 1,1 … … Figure 3. Illustration of the clustering method. L clustering L’ nc RBF training RBF training knowledge knowledge ACTA IMEKO | www.imeko.org March 2018 | Volume 7 | Number 1 | 45 same structure, containing n feature vectors e with m attributes (symptoms s), supplemented by the fault code, describing the state of the SUT. The generic form of the set (5) is the table, whose structure is identical for L and T. =≡ lnmn m cσσ cσσ TL 1 1111 (5) The single example is generated after simulating the SUT model with the fault introduced to its structure. This way the effect of the fault on the responses measured in accessible nodes can be observed. The key issue is the generation of the fault code for each example, based on the actual value of the faulty parameter. As before [22], it is the integer number, being the combination of the parameter identifier and its deviation from the nominal value. The code contains the identifier of the faulty parameter and the discrete degree of its change, both negative and positive (for values greater and smaller than the nominal one). The number of parameter states depends on the assumed thresholds for deviations. For instance, if the parameter value is above ten percent of nominal, the degree is labeled with “1” or “-1“, indicating it being “larger than” or “smaller than”, respectively (depending on the direction of deviation). Additional intervals may be introduced to increase the resolution of the diagnostic module. For instance, if the value of the parameter is above fifty percent of the nominal one, the degree “2” may be assigned. This way the second parameter with the value larger than the nominal one is represented by the code “21”, while the first parameter with the value much smaller than the nominal one obtains the code “- 12”. The exception is the nominal state, encoded with the value “0”. The number of simulated parameter states depends on the expected data set size and the accuracy of the SUT modeling. In the presented work, both sets are of the same size, containing mutually exclusive examples. This way the generalization of the ANN RBF-based diagnostic module may be verified. Diagnostic accuracy acc of the classifier is measured using the set T, for which the number of incorrectly classified examples (i.e. the ones for which the hypothesis h(e) is not equal to the fault code c(e)) determines the sample error es: ( ) ( ) T hcT eacc σ eee ≠∈ −=−= : 11 (6) Each SUT simulation was performed after changing the single parameter value beyond the tolerance margins (here 10% of the nominal value) with all other parameters remaining nominal. A subset of fault-free examples was also prepared to check the resilience of the module to false alarms. 4. ANALYZED SUT The fifth-order analog filter is a good example to implement the data processing methods. Similar active circuits are still popular in military or acoustic applications, therefore their analysis is justified [23]. It is complex (because of the large number of nodes and SUT elements) and difficult to diagnose based only on the analysis of the output node. Therefore, multiple symptoms are needed to identify the state of all elements (resistances and capacitances). The circuit in Figure 4 contains ten elements with the following nominal values: R1=R2=R3=R4=R5=1 kΩ, C1=16 nF, C2=19 nF, C3=13 nF, C4=51 nF and C5=49 nF. Subsequent resistances were labelled with numbers from 1 to 5 respectively, while capacitances were referred to as parameters No. 6 to 10. The cutoff frequency of the filter for such values is 10 kHz. The model of the circuit was implemented in the Simulink environment with the operational amplifiers realized as equivalent circuits with controlled voltage source. Simulations were performed to obtain examples of the SUT behaviour for different values of elements (changed up to 90 percent of the nominal value). The excitation signal provided at node No. 1 was a sinusoid with 9 kHz frequency (i.e. close to the cutoff frequency). The filter was analysed in the time domain, where at the accessible nodes sinusoidal responses were recorded. Measurements were taken at nodes 2, 3, 5, 6, 8 and 9. From each response the first three maximal and minimal values of the signal with their time instants and time instants of zero crossings are extracted (Figure 5). This gives the total number of 54 symptoms for each example (nine for each node), assuming all discussed nodes are accessible. To evaluate the dependency between the size of the set and the accuracy of RBF-based classifier, various sizes of the sets were prepared, starting from 70 examples (7 simulations for each parameter, including the nominal state) for the set L1 to 180 (18 simulations for each parameter) for the set L2. To consider tolerances, additional sets were created with results of simulations affected by the random value added to the actual parameter. This allows for verifying if random deviations of parameter values influence the ability of the diagnostic module to distinguish faults. The number of different fault codes to distinguish was 41, as not all 5 were used for each parameter due to their smaller sensitivity. 5. EXPERIMENTAL RESULTS Conducted experiments consisted of four stages. First, coding schemes were compared. Next, relation between the size Figure 5. Examples of responses from the filter for various values of the resistor R1. Figure 4. Scheme of the 5th order lowpass filter. ACTA IMEKO | www.imeko.org March 2018 | Volume 7 | Number 1 | 46 of the data set and the diagnostic accuracy was determined. The testability of the circuit, depending on the number of analysed nodes, was also verified. Finally, comparison between RBF, SVM and MLP (also implemented in Matlab) was performed to determine efficiency of all classifiers and find their advantages and drawbacks. The ANN training is a random procedure, consisting in the adjustment of weights between neurons to the training data. Knowledge structure depends on the initial (randomly selected) values of weights, therefore every training sweep results in different content of weights matrices. Therefore, to gain the general information about the ANN efficiency, training and testing experiments were repeated ten times for each architecture and data set. Results presented in the following subsections refer to average accuracy values. 5.1. Coding schemes verification Coding schemes presented in Section 2.2 were implemented to design the RBF network, train it on the set L and test using the set T. The first operation is done according to the Simulation Before Test (SBT) [24], [25] paradigm, i.e. when knowledge is extracted prior to the diagnostic module implementation in the industrial environment. Duration of the operation is of secondary importance here. The trained network is then used to process measurement data and make decisions. As the operation duration of ANN in the testing phase is negligible, there are virtually no restraints, even for their on-line application (where the diagnostic decision must be made within the specific time limitations). Optimal results for all configurations (regarding the width of the RBF σ, number of output neurons o, number of hidden neurons k, the maximum achieved training error e and obtained accuracy on the set T) for the set L2 (180 examples) are in Table 3. In most considered cases, the OvO coding is the best scheme, producing the minimum error for all network configurations. This method is the most complex, requiring multiple ANN, each responsible for only two faults. This leads to many networks, but with relatively simple structure. The average number of hidden neurons for the optimal OvO network structure was 8. The most complex is MOC, as multiple output neurons have to participate in producing the fault category. For each coding the best width of the Gaussian function was also determined. The full sweep optimization procedure was applied to obtain it (although more sophisticated approaches, such as simulated annealing [12] or genetic algorithm can be used). The optimal RBF width and the number of hidden neurons are in all cases in the middle of the verified range (for σ it is between 0.1 and 2.0). Figure 6 shows the relation between σ and the obtained accuracy (with all other parameters set as in Table 3). For all coding schemes, there is the best σ value, for which the minimum error is obtained. Results show that narrow Gaussian functions are preferred (like σ =0.5 for OvA). The cost of the highest OvO accuracy is the greater computation effort, caused by the large number of trained networks in comparison to the single network used for remaining coding schemes. The experiments with the optimization of the number of hidden neurons show similar effects as during the selection of the Gaussian function width. The discrete sweep was implemented here to train and test the network while the number of hidden neurons was incremented (i.e. increased by one). At the specific point the maximum accuracy is reached. Adding more computational units does not improve the ANN efficiency but increases the training duration. This concludes the structure optimization stage, with results of the OvO coding presented in Figure 7. As each network distinguishes between two categories only, it is simpler than the ones implementing other coding schemes. The detailed analysis of the network performance shows that most diagnostic errors are made because of mistaking the first element (R1) with the sixth one (C1). In such a case, the direction of changes is correct (for instance, the typical error is producing the code “-62” instead of “-12”). Changes in elements for which the SUT has low sensitivity (especially R2, R3 and C3) are difficult to detect and the classifier regards the circuit as nominal. In such cases (when all symptoms are within tolerance margins) categories of such examples should be changed to “0”. There are also errors of minor importance, i.e. the incorrect identification of the intensity of changes, although the element is correctly located (for instance, when the code “- 52” instead of “-51” is generated). Such mistakes should be treated as less important and regarded with smaller weights during the accuracy (6) calculation. 5.2. Data set size Experiments regarding the size of the training set L were divided into two steps. In the first one, various numbers of Figure 6. Influence of the RBF width on the diagnostic accuracy. Table 3. Comparison of performance of RBF network output coding schemes. Coding scheme σ k o e acc [%] OvA 0.5 82 41 0.0 81.11 OvO 0.6 8 820 0.0 83.33 MOC 0.3 95 6 0.02 80.56 Figure 7. Influence of the number of hidden neurons on the diagnostic accuracy (OvO coding). ACTA IMEKO | www.imeko.org March 2018 | Volume 7 | Number 1 | 47 examples were inserted to the set and then used to train the RBF classifier (starting from the set L1 with the minimal number of symptom vectors, through the medium set with added some new examples, and ending with the maximal set L2). The initial diagnostic results for L1 are significantly improved by introducing additional examples, provided they carry useful information. Table 4 compares the diagnostic accuracy for data sets of different sizes. As in other applications, the amount of training data influences the accuracy of the classifier, which may be a problem if they are difficult to collect (for example, when the model of the SUT does not exist or requires large amount of calculations). During the second stage, the original set is processed to group the most similar examples (see Section 2.1) to compress their number. Additionally, dependency between the training duration and the size of processed data should be established. This is done using the clustering algorithm. In this way it is possible to eliminate redundant examples, which in turn would be represented by the single vector of symptoms. Results of the diagnostic procedure for the RBF ANN trained on the minimized version of the set are presented in Table 5. Increasing the number of examples improves the fault detection and identification performance, but to obtain the accuracy equal to the RBF trained on the L2 set, the density of clustering must not be large. Comparable diagnostic results are obtained on data sets with size close to L2. Again, the most effective is the OvO scheme. Relation between the RBF network structure and training duration for the OvA and MOC coding is in Figure 8. All computations were performed on the computer equipped with the AMD FX-8320 processor (eight cores, 3.50 GHz) and 16 GB of RAM. The processing time for both mentioned coding schemes depends on the number of hidden neurons in the network structure. The relation between the size of the data set and the number of neurons is more complex, as even larger data sets may be optimally processed by smaller networks. The training duration of the RBF ANN-based classifier with OvO coding is significantly longer, requiring between 10 and 20 minutes to complete on the same hardware configuration. The time curves are close to linear, which is the positive effect. The OvO RBF classifier requires the greatest amount of time to train because of a large amount of networks to process. This calls for the parallel implementation of the training procedure [26], where each network would be processed by a separate processor, core or computer. As this procedure is implemented off-line, its duration is of secondary importance, although considering the thorough values optimization of σ and k for each network will complicate the process even more. Another problem is the testing duration, as it determines the usability of the diagnostic module in the on-line mode. Average times required by the RBF ANN with subsequent coding schemes to process the single set of symptoms are in Figure 9 (on the same computer configuration as before). Although much faster for all schemes, the processing time for OvO coding is significantly longer, making it difficult to implement in the embedded system working under strict time limited conditions. 5.3. Testability verification Experiments presented so far were conducted on the complete data sets, i.e. containing symptoms extracted from all circuit nodes, as discussed in Section 4. Because of practical reasons it is rarely possible to use all of them (especially in the integrated system). Therefore, the number of diagnostic pins available from the circuit casing should be minimal. The compromise between the accuracy and the set of accessible nodes must be made. Figure 10 presents comparison between different coding schemes of the optimal RBF network structure for different sets of accessible nodes. Besides the node 9 (always observable, therefore usable in the input-output analysis [24]), all others can be theoretically made accessible. Because the filter has the sequential structure, it is reasonable to assume Figure 8. Training duration of the RBF network (OvA and MOC coding schemes). Table 4. Influence of the data set size on the RBF classifier performance. Data set size accOvA [%] accMOC [%] accOvO [%] 70 68.57 67.14 65.71 120 75.78 73.86 75.54 180 81.12 80.56 83.33 Table 5. Influence of the data clustering on the RBF classifier performance. Data set size accOvA [%] accMOC [%] accOvO [%] 70 68.57 67.14 65.71 88 70.67 69.56 68.23 103 72.23 68.34 71.12 109 70.00 70.56 71.12 136 75.89 73.45 75.78 153 76.67 72.23 77.42 162 81.12 72.78 81.89 180 81.12 80.56 83.33 Figure 9. Duration of processing the single vector of symptoms by the RBF ANN-based diagnostic module. ACTA IMEKO | www.imeko.org March 2018 | Volume 7 | Number 1 | 48 that more information can be recovered from the nodes close to the output of the SUT. Therefore, the order of adding them to the analysis was as follows: 8, 6, 5, 3, and 2. The key step for improving the accuracy was the addition of the nodes 5 and 8. Further extensions led to only small change in diagnostic outcomes. Again, in all experiments the OvO coding proved to be the most effective. The procedure for other similar circuits (such as other filters) should be the same. If the system is more complex, more sophisticated node selection method should be used [27]. 5.4. Comparison against other classifiers Besides the RBF-based network classifier, also SVM and MLP can be used to process the same data sets. In Tab. 6 diagnostic outcomes of the optimal network configurations for the largest set T2 are presented. Performance of classifiers is comparable, the main difference lies in the training time, which is the longest for the MLP and comparable for RBF and SVM. In the latter case, additional parameters must be determined (such as the kernel function and its parameters), which significantly increases the training duration. The RBF ANN- based classifier is the fastest one to design and has simpler training algorithm than competitors. Its optimization is also less complex than SVM. This classifier can then be used during the fault analysis of SUTs, which are moderately difficult to diagnose. In the case of wide element tolerances (for cheap circuits) or high level of noise, more sophisticated ANN (such as SVM) may be preferred. 6. CONCLUSIONS The paper presented analysis and optimization of various RBF network-based classifier in the diagnostics of analog circuits. Multiple parameters, including the width of the activation function, number of neurons in the hidden layer and coding scheme in the output layer were verified. The testability of the circuit was also analysed. The networks with OvO scheme were the best in most cases, but required the greatest amount of time to be trained. This is because this scheme requires creating a large number of simple networks, distinguishing between only two fault categories. The MOC, although requiring the smallest number of output neurons is more susceptible to random classification errors. The OvA scheme is the most popular one. Its accuracy is similar to OvO, but it is much faster trained. Selection of the scheme is a compromise between the expected accuracy and available time for training and processing the testing vector of symptoms (when the on-line diagnostics is considered). The optimization of the RBF training process is similar to other ANN-based classifiers. The supervised learning is implemented here as the standard parameterized algorithm. The designer’s task is to configure the network (by determining the number of hidden neurons or values of the activation function parameters) to ensure the highest diagnostic accuracy. This process is time consuming, but results in the improvement in the diagnostic accuracy. Multiple continuous or discrete optimization methods may be used for this purpose, regarding both network structure and the SUT testability. Future research should cover analysis of other systems belonging to various technical domains. Successful implementation of the presented diagnostic scheme to their analysis would confirm usefulness of the RBF ANN in the fault detection and identification task. Also, more sophisticated approaches should be developed for the selection of the accessible nodes, especially in complex systems [10] with many parameters to determine. Finally, parallel implementations of the OvO coding scheme would eliminate its main disadvantage i.e. the long duration of both training and testing phases. REFERENCES [1] M.-Y. Chow, R.N. Sharpe, and J.C. Hung, "On the application and design of artificial neural networks for motor fault detection," IEEE Transactions on Industrial Electronics, Vol. 40, No. 2, 1993, pp. 181 - 188. [2] Y. Cheng, R. Wang, and M. Xu, "A Combined Model-Based and Intelligent Method for Small Fault Detection and Isolation of Actuators," IEEE Transactions on Industrial Electronics, Vol. 63, No. 4, 2016, pp. 2403-2413. [3] B. Aubert, J. Régnier, S. Caux, and D. Alejo, “Stator Winding Fault Diagnosis in Permanent Magnet Synchronous Generators Based on Short-Circuited Turns Identification Using Extended Kalman Filter”, Acta IMEKO, Dec. 2014, Vol. 3, No. 4, pp. 4-9. [4] S. Shreejith, B. Anshuman, and S.A. Fahmy, "Accelerated Artificial Neural Networks on FPGA for fault detection in automotive systems," Design, Automation & Test in Europe Conference & Exhibition (DATE), 14-18 March 2016, Dresden, Germany. [5] L. Jing, M. Zhao, P. Li, and X. Xu, "A convolutional neural network based feature learning and fault diagnosis method for the condition monitoring of gearbox," Measurement, Vol. 111, 2017, pp. 1-10. [6] A.S. Volosnikov and A.L. Shestakov, “Neural network approach to reduce dynamic measurement errors”, Acta IMEKO, Nov. 2016, Vol. 5, No. 3, pp. 24-31. [7] T.M. Kwon and E.H. Feroz, "A multilayered perceptron approach to prediction of the SEC's investigation targets," IEEE Trans. Neural Networks, Vol. 7, No. 5, Sep 1996, pp. 1286-1290. [8] M.N. Mahmud, M.N. Ibrahim, M.K. Osman, and Z. Hussain, "Selection of suitable features for fault classification in transmission line," IEEE International Conference on Control System, Computing and Engineering (ICCSCE), 27-29 Nov. 2015, DOI: 10.1109/ICCSCE.2015.7482253. [9] J. Penman, C.M. Yin, "Feasibility of using unsupervised learning, artificial neural networks for the condition monitoring of electrical machines," IEE Proceedings - Electric Power Figure 10. Testability analysis for various sets of ANN coding schemes. Table 6. Comparison of the ANN-based diagnostic modules (trained on the set L2). Data set size accOvA [%] accMOC [%] accOvO [%] RBF 81.12 80.56 83.33 MLP 80.75 80.56 79.80 SVM 81.12 81.12 79.80 ACTA IMEKO | www.imeko.org March 2018 | Volume 7 | Number 1 | 49 Applications, Vol. 141, No. 6, Nov 1994, pp. 317-322. [10] D. Zaleski, R. Zielonko, “Two-functional µBIST for Testing and Self-Diagnosis of Analog Circuits in Electronic Embedded Systems”, Acta IMEKO, Dec. 2014, Vol. 3, No. 4, pp. 10-16. [11] H. Ma, T.K. Saha, and C. Ekanayake, "Power transformer insulation diagnosis under measurement originated uncertainties," IEEE Power and Energy Society General Meeting, 25-29 July 2010, DOI: 10.1109/PES.2010.5589395. [12] P. Bilski, “Automated selection of kernel parameters in diagnostics of analog systems,” Przegląd Elektrotechniczny, No. 5, 2011, pp. 9-13. [13] R. Fang and H. Ma, "Application of MCSA and SVM to Induction Machine Rotor Fault Diagnosis," Sixth World Congress on Intelligent Control and Automation, 21-23 June 2006, DOI: 10.1109/WCICA.2006.1714134. [14] F. Ye, Z. Zhang, K. Chakrabarty, and X. Gu, "Board-Level Functional Fault Diagnosis Using Multikernel Support Vector Machines and Incremental Learning," IEEE Tran Computer- Aided Design of Int. Circuits and Systems, Vol. 33, No. 2, Feb. 2014, pp. 279-290. [15] M. Berahman, A.A. Safavi and M.R. Shahrbabaki, "Fault detection in Kerman combined cycle power plant boilers by means of support vector machine classifier algorithms and PCA," 3rd International Conference on Control, Instrumentation, and Automation (ICCIA), 28-30 Dec. 2013, DOI: 10.1109/ICCIAutom.2013.6912851. [16] I. Samy, I.-S. Fan and S. Perinpanayagam, "Fault diagnosis of rolling element bearings using an EMRAN RBF neural network- demonstrated using real experimental data," Sixth International Conference on Natural Computation (ICNC), 10-12 Aug. 2010, DOI: 10.1109/ICNC.2010.5583833. [17] B. Połok, P. Bilski, “Optimization of the neural RBF classifier for the diagnostics of electronic circuit,” 15th IMEKO TC10 Workshop, 6-7 July, 2017, Budapest, Hungary, pp. 121-126 [18] Y. LeCun, J. Denker, and S. Solla, “Optimal brain damage,” Advances in NIPS2, Morgan Kaufman, San Mateo, 1900, pp. 598-605. [19] G.N. Stenbakken, T.M. Souders, and G.W. Stewart, 1989, "Ambiguity groups and testability," IEEE Trans. Instr. and Meas., Vol. 38, Issue 5, 1989, pp. 941-947. [20] N. Garcia-Pedrajas and C. Fyfe, "Evolving Output Codes for Multiclass Problems," IEEE Trans. Evol. Comp., Vol. 12, No. 1, Feb. 2008, pp. 93-106. [21] S. Escalera, O. Pujol and P. Radeva, "On the Decoding Process in Ternary Error-Correcting Output Codes," IEEE Trans. Pattern Anal. and Machine Intel., Vol. 32, No. 1, Jan. 2010, pp. 120-134. [22] P. Bilski, J. Wojciechowski,” Automated Diagnostics of Analog Systems Using Fuzzy Logic Approach”, IEEE Trans. Instr. and Meas., Dec. 2007, Vol. 56, Issue 6, pp. 2175-2185. [23] M. Catelani and S. Giraldi, "A measurement system for fault detection and fault isolation of analog circuits," Measurement, Vol. 25, No. 2, 1999, pp. 115-122. [24] M. Catelani, A. Fort, V. Grande, M. Mugnaini, and I. Trotta, "Automatic Fault Diagnosis System for a Gas Turbine using a Simulation before Test Approach," Proc. IEEE Instrumentation and Measurement Technology Conference (IMTC), 24-27 April 2006, Sorrento, Italy. [25] L. Chruszczyk, J. Rutkowski, and D. Grzechca, "Optimal Excitation in Fault Diagnosis of Analog Electronic Circuits," Proc. 14th International Conf. Mixed Design of Integrated Circuits and Systems (MIXDES), 21-23 June 2007, Ciechocinek, Poland, DOI: 10.1109/MIXDES.2007.4286218. [26] J. Bilski and J. Smoląg, "Parallel Architectures for Learning the RTRN and Elman Dynamic Neural Networks," IEEE Trans. Parallel and Distributed Systems, 2015, Vol. 26, No. 9, pp. 2561- 2570. [27] A. Bilski and J. Wojciechowski, “Automatic parametric fault detection in complex analog systems based on a method of minimum node selection,” Int. J. Appl. Math. Comput. Sci., 2016, Vol. 26, No. 3, pp. 655–668. Analysis of the RBF ANN-based classifier for the diagnostics of electronic circuit << /ASCII85EncodePages false /AllowTransparency false /AutoPositionEPSFiles true /AutoRotatePages /None /Binding /Left /CalGrayProfile (Dot Gain 20%) /CalRGBProfile (sRGB IEC61966-2.1) /CalCMYKProfile (U.S. Web Coated \050SWOP\051 v2) /sRGBProfile (sRGB IEC61966-2.1) /CannotEmbedFontPolicy /Error /CompatibilityLevel 1.4 /CompressObjects /Tags /CompressPages true /ConvertImagesToIndexed true /PassThroughJPEGImages true /CreateJobTicket false /DefaultRenderingIntent /Default /DetectBlends true /DetectCurves 0.0000 /ColorConversionStrategy /CMYK /DoThumbnails false /EmbedAllFonts true /EmbedOpenType false /ParseICCProfilesInComments true /EmbedJobOptions true /DSCReportingLevel 0 /EmitDSCWarnings false /EndPage -1 /ImageMemory 1048576 /LockDistillerParams false /MaxSubsetPct 100 /Optimize true /OPM 1 /ParseDSCComments true /ParseDSCCommentsForDocInfo true /PreserveCopyPage true /PreserveDICMYKValues true /PreserveEPSInfo true /PreserveFlatness true /PreserveHalftoneInfo false /PreserveOPIComments true /PreserveOverprintSettings true /StartPage 1 /SubsetFonts true /TransferFunctionInfo /Apply /UCRandBGInfo /Preserve /UsePrologue false /ColorSettingsFile () /AlwaysEmbed [ true ] /NeverEmbed [ true ] /AntiAliasColorImages false /CropColorImages true /ColorImageMinResolution 300 /ColorImageMinResolutionPolicy /OK /DownsampleColorImages true /ColorImageDownsampleType /Bicubic /ColorImageResolution 300 /ColorImageDepth -1 /ColorImageMinDownsampleDepth 1 /ColorImageDownsampleThreshold 1.50000 /EncodeColorImages true /ColorImageFilter /DCTEncode /AutoFilterColorImages true /ColorImageAutoFilterStrategy /JPEG /ColorACSImageDict << /QFactor 0.15 /HSamples [1 1 1 1] /VSamples [1 1 1 1] >> /ColorImageDict << /QFactor 0.15 /HSamples [1 1 1 1] /VSamples [1 1 1 1] >> /JPEG2000ColorACSImageDict << /TileWidth 256 /TileHeight 256 /Quality 30 >> /JPEG2000ColorImageDict << /TileWidth 256 /TileHeight 256 /Quality 30 >> /AntiAliasGrayImages false /CropGrayImages true /GrayImageMinResolution 300 /GrayImageMinResolutionPolicy /OK /DownsampleGrayImages true /GrayImageDownsampleType /Bicubic /GrayImageResolution 300 /GrayImageDepth -1 /GrayImageMinDownsampleDepth 2 /GrayImageDownsampleThreshold 1.50000 /EncodeGrayImages true /GrayImageFilter /DCTEncode /AutoFilterGrayImages true /GrayImageAutoFilterStrategy /JPEG /GrayACSImageDict << /QFactor 0.15 /HSamples [1 1 1 1] /VSamples [1 1 1 1] >> /GrayImageDict << /QFactor 0.15 /HSamples [1 1 1 1] /VSamples [1 1 1 1] >> /JPEG2000GrayACSImageDict << /TileWidth 256 /TileHeight 256 /Quality 30 >> /JPEG2000GrayImageDict << /TileWidth 256 /TileHeight 256 /Quality 30 >> /AntiAliasMonoImages false /CropMonoImages true /MonoImageMinResolution 1200 /MonoImageMinResolutionPolicy /OK /DownsampleMonoImages true /MonoImageDownsampleType /Bicubic /MonoImageResolution 1200 /MonoImageDepth -1 /MonoImageDownsampleThreshold 1.50000 /EncodeMonoImages true /MonoImageFilter /CCITTFaxEncode /MonoImageDict << /K -1 >> /AllowPSXObjects false /CheckCompliance [ /None ] /PDFX1aCheck false /PDFX3Check false /PDFXCompliantPDFOnly false /PDFXNoTrimBoxError true /PDFXTrimBoxToMediaBoxOffset [ 0.00000 0.00000 0.00000 0.00000 ] /PDFXSetBleedBoxToMediaBox true /PDFXBleedBoxToTrimBoxOffset [ 0.00000 0.00000 0.00000 0.00000 ] /PDFXOutputIntentProfile () /PDFXOutputConditionIdentifier () /PDFXOutputCondition () /PDFXRegistryName () /PDFXTrapped /False /CreateJDFFile false /Description << /ARA <FEFF06270633062A062E062F0645002006470630064700200627064406250639062F0627062F0627062A002006440625064606340627062100200648062B062706260642002000410064006F00620065002000500044004600200645062A064806270641064206290020064406440637062806270639062900200641064A00200627064406450637062706280639002006300627062A0020062F0631062C0627062A002006270644062C0648062F0629002006270644063906270644064A0629061B0020064A06450643064600200641062A062D00200648062B0627062606420020005000440046002006270644064506460634062306290020062806270633062A062E062F062706450020004100630072006F0062006100740020064800410064006F006200650020005200650061006400650072002006250635062F0627063100200035002E0030002006480627064406250635062F062706310627062A0020062706440623062D062F062B002E0635062F0627063100200035002E0030002006480627064406250635062F062706310627062A0020062706440623062D062F062B002E> /BGR <FEFF04180437043f043e043b043704320430043904420435002004420435043704380020043d0430044104420440043e0439043a0438002c00200437043000200434043000200441044a0437043404300432043004420435002000410064006f00620065002000500044004600200434043e043a0443043c0435043d04420438002c0020043c0430043a04410438043c0430043b043d043e0020043f044004380433043e04340435043d04380020043704300020043204380441043e043a043e043a0430044704350441044204320435043d0020043f04350447043004420020043704300020043f044004350434043f0435044704300442043d04300020043f043e04340433043e0442043e0432043a0430002e002000200421044a04370434043004340435043d043804420435002000500044004600200434043e043a0443043c0435043d044204380020043c043e0433043004420020043404300020044104350020043e0442043204300440044f0442002004410020004100630072006f00620061007400200438002000410064006f00620065002000520065006100640065007200200035002e00300020043800200441043b0435043404320430044904380020043204350440044104380438002e> /CHS <FEFF4f7f75288fd94e9b8bbe5b9a521b5efa7684002000410064006f006200650020005000440046002065876863900275284e8e9ad88d2891cf76845370524d53705237300260a853ef4ee54f7f75280020004100630072006f0062006100740020548c002000410064006f00620065002000520065006100640065007200200035002e003000204ee553ca66f49ad87248672c676562535f00521b5efa768400200050004400460020658768633002> /CHT <FEFF4f7f752890194e9b8a2d7f6e5efa7acb7684002000410064006f006200650020005000440046002065874ef69069752865bc9ad854c18cea76845370524d5370523786557406300260a853ef4ee54f7f75280020004100630072006f0062006100740020548c002000410064006f00620065002000520065006100640065007200200035002e003000204ee553ca66f49ad87248672c4f86958b555f5df25efa7acb76840020005000440046002065874ef63002> /CZE <FEFF005400610074006f0020006e006100730074006100760065006e00ed00200070006f0075017e0069006a007400650020006b0020007600790074007600e101590065006e00ed00200064006f006b0075006d0065006e0074016f002000410064006f006200650020005000440046002c0020006b00740065007200e90020007300650020006e0065006a006c00e90070006500200068006f006400ed002000700072006f0020006b00760061006c00690074006e00ed0020007400690073006b00200061002000700072006500700072006500730073002e002000200056007900740076006f01590065006e00e900200064006f006b0075006d0065006e007400790020005000440046002000620075006400650020006d006f017e006e00e90020006f007400650076015900ed007400200076002000700072006f006700720061006d0065006300680020004100630072006f00620061007400200061002000410064006f00620065002000520065006100640065007200200035002e0030002000610020006e006f0076011b006a016100ed00630068002e> /DAN <FEFF004200720075006700200069006e0064007300740069006c006c0069006e006700650072006e0065002000740069006c0020006100740020006f007000720065007400740065002000410064006f006200650020005000440046002d0064006f006b0075006d0065006e007400650072002c0020006400650072002000620065006400730074002000650067006e006500720020007300690067002000740069006c002000700072006500700072006500730073002d007500640073006b007200690076006e0069006e00670020006100660020006800f8006a0020006b00760061006c0069007400650074002e0020004400650020006f007000720065007400740065006400650020005000440046002d0064006f006b0075006d0065006e0074006500720020006b0061006e002000e50062006e00650073002000690020004100630072006f00620061007400200065006c006c006500720020004100630072006f006200610074002000520065006100640065007200200035002e00300020006f00670020006e0079006500720065002e> /DEU <FEFF00560065007200770065006e00640065006e0020005300690065002000640069006500730065002000450069006e007300740065006c006c0075006e00670065006e0020007a0075006d002000450072007300740065006c006c0065006e00200076006f006e002000410064006f006200650020005000440046002d0044006f006b0075006d0065006e00740065006e002c00200076006f006e002000640065006e0065006e002000530069006500200068006f006300680077006500720074006900670065002000500072006500700072006500730073002d0044007200750063006b0065002000650072007a0065007500670065006e0020006d00f60063006800740065006e002e002000450072007300740065006c006c007400650020005000440046002d0044006f006b0075006d0065006e007400650020006b00f6006e006e0065006e0020006d006900740020004100630072006f00620061007400200075006e0064002000410064006f00620065002000520065006100640065007200200035002e00300020006f0064006500720020006800f600680065007200200067006500f600660066006e00650074002000770065007200640065006e002e> /ESP <FEFF005500740069006c0069006300650020006500730074006100200063006f006e0066006900670075007200610063006900f3006e0020007000610072006100200063007200650061007200200064006f00630075006d0065006e0074006f00730020005000440046002000640065002000410064006f0062006500200061006400650063007500610064006f00730020007000610072006100200069006d0070007200650073006900f3006e0020007000720065002d0065006400690074006f007200690061006c00200064006500200061006c00740061002000630061006c0069006400610064002e002000530065002000700075006500640065006e00200061006200720069007200200064006f00630075006d0065006e0074006f00730020005000440046002000630072006500610064006f007300200063006f006e0020004100630072006f006200610074002c002000410064006f00620065002000520065006100640065007200200035002e003000200079002000760065007200730069006f006e0065007300200070006f00730074006500720069006f007200650073002e> /ETI <FEFF004b00610073007500740061006700650020006e0065006900640020007300e4007400740065006900640020006b00760061006c006900740065006500740073006500200074007200fc006b006900650065006c007300650020007000720069006e00740069006d0069007300650020006a0061006f006b007300200073006f00620069006c0069006b0065002000410064006f006200650020005000440046002d0064006f006b0075006d0065006e00740069006400650020006c006f006f006d006900730065006b0073002e00200020004c006f006f0064007500640020005000440046002d0064006f006b0075006d0065006e00740065002000730061006100740065002000610076006100640061002000700072006f006700720061006d006d006900640065006700610020004100630072006f0062006100740020006e0069006e0067002000410064006f00620065002000520065006100640065007200200035002e00300020006a00610020007500750065006d006100740065002000760065007200730069006f006f006e00690064006500670061002e000d000a> /FRA <FEFF005500740069006c006900730065007a00200063006500730020006f007000740069006f006e00730020006100660069006e00200064006500200063007200e900650072002000640065007300200064006f00630075006d0065006e00740073002000410064006f00620065002000500044004600200070006f0075007200200075006e00650020007100750061006c0069007400e90020006400270069006d007000720065007300730069006f006e00200070007200e9007000720065007300730065002e0020004c0065007300200064006f00630075006d0065006e00740073002000500044004600200063007200e900e90073002000700065007500760065006e0074002000ea0074007200650020006f007500760065007200740073002000640061006e00730020004100630072006f006200610074002c002000610069006e00730069002000710075002700410064006f00620065002000520065006100640065007200200035002e0030002000650074002000760065007200730069006f006e007300200075006c007400e90072006900650075007200650073002e> /GRE <FEFF03a703c103b703c303b903bc03bf03c003bf03b903ae03c303c403b5002003b103c503c403ad03c2002003c403b903c2002003c103c503b803bc03af03c303b503b903c2002003b303b903b1002003bd03b1002003b403b703bc03b903bf03c503c103b303ae03c303b503c403b5002003ad03b303b303c103b103c603b1002000410064006f006200650020005000440046002003c003bf03c5002003b503af03bd03b103b9002003ba03b103c42019002003b503be03bf03c703ae03bd002003ba03b103c403ac03bb03bb03b703bb03b1002003b303b903b1002003c003c103bf002d03b503ba03c403c503c003c903c403b903ba03ad03c2002003b503c103b303b103c303af03b503c2002003c503c803b703bb03ae03c2002003c003bf03b903cc03c403b703c403b103c2002e0020002003a403b10020005000440046002003ad03b303b303c103b103c603b1002003c003bf03c5002003ad03c703b503c403b5002003b403b703bc03b903bf03c503c103b303ae03c303b503b9002003bc03c003bf03c103bf03cd03bd002003bd03b1002003b103bd03bf03b903c703c403bf03cd03bd002003bc03b5002003c403bf0020004100630072006f006200610074002c002003c403bf002000410064006f00620065002000520065006100640065007200200035002e0030002003ba03b103b9002003bc03b503c403b103b303b503bd03ad03c303c403b503c103b503c2002003b503ba03b403cc03c303b503b903c2002e> /HEB <FEFF05D405E905EA05DE05E905D5002005D105D405D205D305E805D505EA002005D005DC05D4002005DB05D305D9002005DC05D905E605D505E8002005DE05E105DE05DB05D9002000410064006F006200650020005000440046002005D405DE05D505EA05D005DE05D905DD002005DC05D405D305E405E105EA002005E705D305DD002D05D305E405D505E1002005D005D905DB05D505EA05D905EA002E002005DE05E105DE05DB05D90020005000440046002005E905E005D505E605E805D5002005E005D905EA05E005D905DD002005DC05E405EA05D905D705D4002005D105D005DE05E605E205D505EA0020004100630072006F006200610074002005D5002D00410064006F00620065002000520065006100640065007200200035002E0030002005D505D205E805E105D005D505EA002005DE05EA05E705D305DE05D505EA002005D905D505EA05E8002E05D005DE05D905DD002005DC002D005000440046002F0058002D0033002C002005E205D905D905E005D5002005D105DE05D305E805D905DA002005DC05DE05E905EA05DE05E9002005E905DC0020004100630072006F006200610074002E002005DE05E105DE05DB05D90020005000440046002005E905E005D505E605E805D5002005E005D905EA05E005D905DD002005DC05E405EA05D905D705D4002005D105D005DE05E605E205D505EA0020004100630072006F006200610074002005D5002D00410064006F00620065002000520065006100640065007200200035002E0030002005D505D205E805E105D005D505EA002005DE05EA05E705D305DE05D505EA002005D905D505EA05E8002E> /HRV (Za stvaranje Adobe PDF dokumenata najpogodnijih za visokokvalitetni ispis prije tiskanja koristite ove postavke. Stvoreni PDF dokumenti mogu se otvoriti Acrobat i Adobe Reader 5.0 i kasnijim verzijama.) /HUN <FEFF004b0069007600e1006c00f30020006d0069006e0151007300e9006701710020006e0079006f006d00640061006900200065006c0151006b00e90073007a00ed007401510020006e0079006f006d00740061007400e100730068006f007a0020006c006500670069006e006b00e1006200620020006d0065006700660065006c0065006c0151002000410064006f00620065002000500044004600200064006f006b0075006d0065006e00740075006d006f006b0061007400200065007a0065006b006b0065006c0020006100200062006500e1006c006c00ed007400e10073006f006b006b0061006c0020006b00e90073007a00ed0074006800650074002e0020002000410020006c00e90074007200650068006f007a006f00740074002000500044004600200064006f006b0075006d0065006e00740075006d006f006b00200061007a0020004100630072006f006200610074002000e9007300200061007a002000410064006f00620065002000520065006100640065007200200035002e0030002c0020007600610067007900200061007a002000610074007400f3006c0020006b00e9007301510062006200690020007600650072007a006900f3006b006b0061006c0020006e00790069007400680061007400f3006b0020006d00650067002e> /ITA <FEFF005500740069006c0069007a007a006100720065002000710075006500730074006500200069006d0070006f007300740061007a0069006f006e00690020007000650072002000630072006500610072006500200064006f00630075006d0065006e00740069002000410064006f00620065002000500044004600200070006900f900200061006400610074007400690020006100200075006e00610020007000720065007300740061006d0070006100200064006900200061006c007400610020007100750061006c0069007400e0002e0020004900200064006f00630075006d0065006e007400690020005000440046002000630072006500610074006900200070006f00730073006f006e006f0020006500730073006500720065002000610070006500720074006900200063006f006e0020004100630072006f00620061007400200065002000410064006f00620065002000520065006100640065007200200035002e003000200065002000760065007200730069006f006e006900200073007500630063006500730073006900760065002e> /JPN <FEFF9ad854c18cea306a30d730ea30d730ec30b951fa529b7528002000410064006f0062006500200050004400460020658766f8306e4f5c6210306b4f7f75283057307e305930023053306e8a2d5b9a30674f5c62103055308c305f0020005000440046002030d530a130a430eb306f3001004100630072006f0062006100740020304a30883073002000410064006f00620065002000520065006100640065007200200035002e003000204ee5964d3067958b304f30533068304c3067304d307e305930023053306e8a2d5b9a306b306f30d530a930f330c8306e57cb30818fbc307f304c5fc59808306730593002> /KOR <FEFFc7740020c124c815c7440020c0acc6a9d558c5ec0020ace0d488c9c80020c2dcd5d80020c778c1c4c5d00020ac00c7a50020c801d569d55c002000410064006f0062006500200050004400460020bb38c11cb97c0020c791c131d569b2c8b2e4002e0020c774b807ac8c0020c791c131b41c00200050004400460020bb38c11cb2940020004100630072006f0062006100740020bc0f002000410064006f00620065002000520065006100640065007200200035002e00300020c774c0c1c5d0c11c0020c5f40020c2180020c788c2b5b2c8b2e4002e> /LTH <FEFF004e006100750064006f006b0069007400650020016100690075006f007300200070006100720061006d006500740072007500730020006e006f0072011700640061006d00690020006b0075007200740069002000410064006f00620065002000500044004600200064006f006b0075006d0065006e007400750073002c0020006b00750072006900650020006c0061006200690061007500730069006100690020007000720069007400610069006b007900740069002000610075006b01610074006f00730020006b006f006b007900620117007300200070006100720065006e006700740069006e00690061006d00200073007000610075007300640069006e0069006d00750069002e0020002000530075006b0075007200740069002000500044004600200064006f006b0075006d0065006e007400610069002000670061006c006900200062016b007400690020006100740069006400610072006f006d00690020004100630072006f006200610074002000690072002000410064006f00620065002000520065006100640065007200200035002e0030002000610072002000760117006c00650073006e0117006d00690073002000760065007200730069006a006f006d00690073002e> /LVI <FEFF0049007a006d0061006e0074006f006a00690065007400200161006f00730020006900650073007400610074012b006a0075006d00750073002c0020006c0061006900200076006500690064006f00740075002000410064006f00620065002000500044004600200064006f006b0075006d0065006e007400750073002c0020006b006100730020006900720020012b00700061016100690020007000690065006d01130072006f00740069002000610075006700730074006100730020006b00760061006c0069007401010074006500730020007000690072006d007300690065007300700069006501610061006e006100730020006400720075006b00610069002e00200049007a0076006500690064006f006a006900650074002000500044004600200064006f006b0075006d0065006e007400750073002c0020006b006f002000760061007200200061007400760113007200740020006100720020004100630072006f00620061007400200075006e002000410064006f00620065002000520065006100640065007200200035002e0030002c0020006b0101002000610072012b00200074006f0020006a00610075006e0101006b0101006d002000760065007200730069006a0101006d002e> /NLD (Gebruik deze instellingen om Adobe PDF-documenten te maken die zijn geoptimaliseerd voor prepress-afdrukken van hoge kwaliteit. De gemaakte PDF-documenten kunnen worden geopend met Acrobat en Adobe Reader 5.0 en hoger.) /NOR <FEFF004200720075006b00200064006900730073006500200069006e006e007300740069006c006c0069006e00670065006e0065002000740069006c002000e50020006f0070007000720065007400740065002000410064006f006200650020005000440046002d0064006f006b0075006d0065006e00740065007200200073006f006d00200065007200200062006500730074002000650067006e0065007400200066006f00720020006600f80072007400720079006b006b0073007500740073006b00720069006600740020006100760020006800f800790020006b00760061006c0069007400650074002e0020005000440046002d0064006f006b0075006d0065006e00740065006e00650020006b0061006e002000e50070006e00650073002000690020004100630072006f00620061007400200065006c006c00650072002000410064006f00620065002000520065006100640065007200200035002e003000200065006c006c00650072002000730065006e006500720065002e> /POL <FEFF0055007300740061007700690065006e0069006100200064006f002000740077006f0072007a0065006e0069006100200064006f006b0075006d0065006e007400f300770020005000440046002000700072007a0065007a006e00610063007a006f006e00790063006800200064006f002000770079006400720075006b00f30077002000770020007700790073006f006b00690065006a0020006a0061006b006f015b00630069002e002000200044006f006b0075006d0065006e0074007900200050004400460020006d006f017c006e00610020006f007400770069006500720061010700200077002000700072006f006700720061006d006900650020004100630072006f00620061007400200069002000410064006f00620065002000520065006100640065007200200035002e0030002000690020006e006f00770073007a0079006d002e> /PTB <FEFF005500740069006c0069007a006500200065007300730061007300200063006f006e00660069006700750072006100e700f50065007300200064006500200066006f0072006d00610020006100200063007200690061007200200064006f00630075006d0065006e0074006f0073002000410064006f0062006500200050004400460020006d00610069007300200061006400650071007500610064006f00730020007000610072006100200070007200e9002d0069006d0070007200650073007300f50065007300200064006500200061006c007400610020007100750061006c00690064006100640065002e0020004f007300200064006f00630075006d0065006e0074006f00730020005000440046002000630072006900610064006f007300200070006f00640065006d0020007300650072002000610062006500720074006f007300200063006f006d0020006f0020004100630072006f006200610074002000650020006f002000410064006f00620065002000520065006100640065007200200035002e0030002000650020007600650072007300f50065007300200070006f00730074006500720069006f007200650073002e> /RUM <FEFF005500740069006c0069007a00610163006900200061006300650073007400650020007300650074010300720069002000700065006e007400720075002000610020006300720065006100200064006f00630075006d0065006e00740065002000410064006f006200650020005000440046002000610064006500630076006100740065002000700065006e0074007200750020007400690070010300720069007200650061002000700072006500700072006500730073002000640065002000630061006c006900740061007400650020007300750070006500720069006f006100720103002e002000200044006f00630075006d0065006e00740065006c00650020005000440046002000630072006500610074006500200070006f00740020006600690020006400650073006300680069007300650020006300750020004100630072006f006200610074002c002000410064006f00620065002000520065006100640065007200200035002e00300020015f00690020007600650072007300690075006e0069006c006500200075006c0074006500720069006f006100720065002e> /RUS <FEFF04180441043f043e043b044c04370443043904420435002004340430043d043d044b04350020043d0430044104420440043e0439043a043800200434043b044f00200441043e043704340430043d0438044f00200434043e043a0443043c0435043d0442043e0432002000410064006f006200650020005000440046002c0020043c0430043a04410438043c0430043b044c043d043e0020043f043e04340445043e0434044f04490438044500200434043b044f00200432044b0441043e043a043e043a0430044704350441044204320435043d043d043e0433043e00200434043e043f0435044704300442043d043e0433043e00200432044b0432043e04340430002e002000200421043e043704340430043d043d044b04350020005000440046002d0434043e043a0443043c0435043d0442044b0020043c043e0436043d043e0020043e0442043a0440044b043204300442044c002004410020043f043e043c043e0449044c044e0020004100630072006f00620061007400200438002000410064006f00620065002000520065006100640065007200200035002e00300020043800200431043e043b043504350020043f043e04370434043d043804450020043204350440044104380439002e> /SKY <FEFF0054006900650074006f0020006e006100730074006100760065006e0069006100200070006f0075017e0069007400650020006e00610020007600790074007600e100720061006e0069006500200064006f006b0075006d0065006e0074006f0076002000410064006f006200650020005000440046002c0020006b0074006f007200e90020007300610020006e0061006a006c0065007001610069006500200068006f0064006900610020006e00610020006b00760061006c00690074006e00fa00200074006c0061010d00200061002000700072006500700072006500730073002e00200056007900740076006f00720065006e00e900200064006f006b0075006d0065006e007400790020005000440046002000620075006400650020006d006f017e006e00e90020006f00740076006f00720069016500200076002000700072006f006700720061006d006f006300680020004100630072006f00620061007400200061002000410064006f00620065002000520065006100640065007200200035002e0030002000610020006e006f0076016100ed00630068002e> /SLV <FEFF005400650020006e006100730074006100760069007400760065002000750070006f0072006100620069007400650020007a00610020007500730074007600610072006a0061006e006a006500200064006f006b0075006d0065006e0074006f0076002000410064006f006200650020005000440046002c0020006b006900200073006f0020006e0061006a007000720069006d00650072006e0065006a016100690020007a00610020006b0061006b006f0076006f00730074006e006f0020007400690073006b0061006e006a00650020007300200070007200690070007200610076006f0020006e00610020007400690073006b002e00200020005500730074007600610072006a0065006e006500200064006f006b0075006d0065006e0074006500200050004400460020006a00650020006d006f0067006f010d00650020006f0064007000720065007400690020007a0020004100630072006f00620061007400200069006e002000410064006f00620065002000520065006100640065007200200035002e003000200069006e0020006e006f00760065006a01610069006d002e> /SUO <FEFF004b00e40079007400e40020006e00e40069007400e4002000610073006500740075006b007300690061002c0020006b0075006e0020006c0075006f00740020006c00e400680069006e006e00e4002000760061006100740069007600610061006e0020007000610069006e006100740075006b00730065006e002000760061006c006d0069007300740065006c00750074007900f6006800f6006e00200073006f00700069007600690061002000410064006f0062006500200050004400460020002d0064006f006b0075006d0065006e007400740065006a0061002e0020004c0075006f0064007500740020005000440046002d0064006f006b0075006d0065006e00740069007400200076006f0069006400610061006e0020006100760061007400610020004100630072006f0062006100740069006c006c00610020006a0061002000410064006f00620065002000520065006100640065007200200035002e0030003a006c006c00610020006a006100200075007500640065006d006d0069006c006c0061002e> /SVE <FEFF0041006e007600e4006e00640020006400650020006800e4007200200069006e0073007400e4006c006c006e0069006e006700610072006e00610020006f006d002000640075002000760069006c006c00200073006b006100700061002000410064006f006200650020005000440046002d0064006f006b0075006d0065006e007400200073006f006d002000e400720020006c00e4006d0070006c0069006700610020006600f60072002000700072006500700072006500730073002d007500740073006b00720069006600740020006d006500640020006800f600670020006b00760061006c0069007400650074002e002000200053006b006100700061006400650020005000440046002d0064006f006b0075006d0065006e00740020006b0061006e002000f600700070006e00610073002000690020004100630072006f0062006100740020006f00630068002000410064006f00620065002000520065006100640065007200200035002e00300020006f00630068002000730065006e006100720065002e> /TUR <FEFF005900fc006b00730065006b0020006b0061006c006900740065006c0069002000f6006e002000790061007a006401310072006d00610020006200610073006b013100730131006e006100200065006e0020006900790069002000750079006100620069006c006500630065006b002000410064006f006200650020005000440046002000620065006c00670065006c0065007200690020006f006c0075015f007400750072006d0061006b0020006900e70069006e00200062007500200061007900610072006c0061007201310020006b0075006c006c0061006e0131006e002e00200020004f006c0075015f0074007500720075006c0061006e0020005000440046002000620065006c00670065006c0065007200690020004100630072006f006200610074002000760065002000410064006f00620065002000520065006100640065007200200035002e003000200076006500200073006f006e0072006100730131006e00640061006b00690020007300fc007200fc006d006c00650072006c00650020006100e70131006c006100620069006c00690072002e> /UKR <FEFF04120438043a043e0440043804410442043e043204430439044204350020044604560020043f043004400430043c043504420440043800200434043b044f0020044104420432043e04400435043d043d044f00200434043e043a0443043c0435043d044204560432002000410064006f006200650020005000440046002c0020044f043a04560020043d04300439043a04400430044904350020043f045604340445043e0434044f0442044c00200434043b044f0020043204380441043e043a043e044f043a04560441043d043e0433043e0020043f0435044004350434043404400443043a043e0432043e0433043e0020043404400443043a0443002e00200020042104420432043e04400435043d045600200434043e043a0443043c0435043d0442043800200050004400460020043c043e0436043d04300020043204560434043a0440043804420438002004430020004100630072006f006200610074002004420430002000410064006f00620065002000520065006100640065007200200035002e0030002004300431043e0020043f04560437043d04560448043e04570020043204350440044104560457002e> /ENU (Use these settings to create Adobe PDF documents best suited for high-quality prepress printing. Created PDF documents can be opened with Acrobat and Adobe Reader 5.0 and later.) >> /Namespace [ (Adobe) (Common) (1.0) ] /OtherNamespaces [ << /AsReaderSpreads false /CropImagesToFrames true /ErrorControl /WarnAndContinue /FlattenerIgnoreSpreadOverrides false /IncludeGuidesGrids false /IncludeNonPrinting false /IncludeSlug false /Namespace [ (Adobe) (InDesign) (4.0) ] /OmitPlacedBitmaps false /OmitPlacedEPS false /OmitPlacedPDF false /SimulateOverprint /Legacy >> << /AddBleedMarks false /AddColorBars false /AddCropMarks false /AddPageInfo false /AddRegMarks false /ConvertColors /ConvertToCMYK /DestinationProfileName () /DestinationProfileSelector /DocumentCMYK /Downsample16BitImages true /FlattenerPreset << /PresetSelector /MediumResolution >> /FormElements false /GenerateStructure false /IncludeBookmarks false /IncludeHyperlinks false /IncludeInteractive false /IncludeLayers false /IncludeProfiles false /MultimediaHandling /UseObjectSettings /Namespace [ (Adobe) (CreativeSuite) (2.0) ] /PDFXOutputIntentProfileSelector /DocumentCMYK /PreserveEditing true /UntaggedCMYKHandling /LeaveUntagged /UntaggedRGBHandling /UseDocumentProfile /UseDocumentBleed false >> ] >> setdistillerparams << /HWResolution [2400 2400] /PageSize [612.000 792.000] >> setpagedevice