Microsoft Word - Paper 1 Dec.doc Optimisation of Construction Process Inspection Rates using a Learning Approach by Swapan Saha et al The Australian Journal of Construction Economics & Building Page 1 OPTIMISATION OF CONSTRUCTION PROCESS INSPECTION RATES USING A LEARNING APPROACH Swapan Saha, Colin J Greville and Trevor A Mullins, the University of Western Sydney, New South Wales, Australia Introduction In a construction process, inspection/tests are an important activity. Without inspection a task cannot be completed successfully. Inspections/tests are normally carried out before and after the execution of a task. To prevent occurrence of errors in a construction process inspections are considered as an essential activity. The Construction Industry Development Agency in Australia (CIDA, 1995) has estimated the direct cost of rework in construction to be grater than 10% of project cost. Blyth (1995) comments in a compilation of existing case studies, that construction company, Sinclair Knights Merz’s, rough estimate of quality system cost is 2% of turnover. Blyth’s (1995) study also suggested that actual cost incurred on the quality system is difficult to determine. Davis et al. (1989) reported that the cost of providing quality assurance and quality control in engineered construction was estimated to be approximately up to 5%. Therefore total cost of quality, including rework, can be up to 15% of the total project cost. According to Love and Li (2000), cost incurred on appraisal in construction (eg. inspection and testing cost) is approximately 30% of the total quality cost or approximately up to 4.5% (30% of 15% of total project cost) of the total project cost. The total value of the annual turnover of the Australian construction industry was estimated, in 1996, to be $43.5 billion (DIST 1998). Thus, if a 4.5% of the appraisal (inspection & testing) value applied to this total annual turnover, then the approximate cost of inspection and testing could be estimated to be $2.0 billion per annum. According to above findings a significant proportion of the project cost savings can be achieved with the optimisation of inspection policy. To achieve a 100% quality level for a constructed facility, effort and time spent on inspection may not be cost effective. Therefore, optimisation of inspection costs based on certain quality levels would be valuable. The 100% inspection is the common practice in the construction industry. With the modernisation and repetition of the construction activity a lower inspection rate (the less than 100% inspection) in a construction is more realistic and cost effective. There are a number of sampling methods which are utilised to optimise the inspection cost in the manufacturing industries. Methods that are available include the single sampling plan, double sampling plan, multiple sampling plan, acceptance sampling, operating characteristic curve, and attribute proportional sampling (APS) (Grant and Leavenworth 1988, Hines and Montogomery 1990 and Chan and Hsie 1995, Dhillon 1985 and Leitch, 1988). In this paper suitable sampling plans for the construction industry are briefly discussed. For a stable process, acceptance-sampling plan is invalid because the number of defectives in a sample is not correlated with the number of defective items in the remainder of the lot. A proof of this theory is given by Gitlow et al. (1987). For a cost effective inspection policy acceptance sampling does not include the calculation of optimum sample size. Minimum cost Method is discussed in this study to overcome this limitation. The minimum cost model (MCM) is developed using different categories of quality costs, namely prevention cost, appraisal cost and failure/rectification cost. A systematic breakdown of these costs is given in this study. An example is presented to clarify how the number of tests, or inspections to be performed per construction task is dependent on the cost Optimisation of Construction Process Inspection Rates using a Learning Approach by Swapan Saha et al Page 2 The Australian Journal of Construction Economics & Building of inspection/test and the probability of occurrence of defects. Determination of Sample Size This section discusses the number of samples that need to be inspected to establish the level of confidence that the owner is seeing. In order to limit sampling errors the average proportion of defective constructed products which the owner is willing to accept will have to be specified. This will be in the form of p ± Z()s where p is the average proportion defective (error rate), Z() is the value found in normal distribution table for a specified confidence interval and s is the standard deviation for a binomial distribution expressed as follows: s = p(1 − p) n (1) where, n is sample size This will help set the minimum value of n required and, if the desired defective values are not obtained, indicate the maximum value of n required. The limits of accuracy on the number tests can be calculated using the equation (2): UL = p ± Z()s (2) Where, UL is the limits of acceptable proportion defective. The calculation of sample size depends on a number of factors including criteria of acceptance and rejection and cost of inspection and rejection. Criteria of Acceptance and Rejection In the construction industry inspection/testing of every item is often done. This however is not always possible, particularly when inspection/testing is expensive and time consuming. In the case of batch construction, the inspection/testing of a few items that are selected randomly can minimise the overall construction cost including the project duration. In this case there is a degree of risk attached to both the contractor and the owner. The accept/reject criteria for the batch under inspection/testing can be based on the following hypothesis. If p ≤ Q accept If p> Q reject Where, p is the estimated average proportion defective and Q is the allowable maximum proportion defective for the lot, p and Q can be defined as below: p = r/n Q = c/n where r the number of non-conforming items in a sample and c is the maximum allowable non-conforming items in the sample. The sample size, n and acceptable number of defective items has to be agreed by the owner and the contractor. There are a number of sampling plans available to determine the sample size including single sampling plan, double sampling plan, multiple sampling plan, & attribute proportional sampling plan. The sampling plans are pictorially represented by the operating characteristics curve (OC curve). The characteristics of an OC curve are outlined below. Operating Characteristics Curve In an OC curve the probability of accepting the batch, Pa is plotted against the proportion of defective items (p). The distribution for p can be selected based on the sample size. The popular probability distributions available for the calculation of p include the hyper-geometric, the Binomial and the Poisson's distributions. Further details about the OC curve can be found in Hines and Montogomery (1990) and Grant and Leavenworth (1988). Optimisation of Construction Process Inspection Rates using a Learning Approach by Swapan Saha et al The Australian Journal of Construction Economics & Building Page 3 There are several parameters for a typical OC Curve as represented in Figure 1. These parameters are defined as below: • the contractor's risk (α): α is the risk of rejection of a lot where the proportion of defective is p1, • the owner's risk (β):β is the risk of acceptance of a lot where the proportion of defective is p2, • the lot tolerance proportion defective (LTPD): proportion defective in a lot of items is at unacceptable quality level, at which the acceptance probability is very low. It is associated with the Principal's risk, and, • the acceptance quality level (AQL): the maximum proportion of defective items. Figure 1 Typical OC curve P a p A Q L L T P D α = C o n tra c to r's ris k β = O w n e r's ris k If p1, p2, α and β are known then n and c can be calculated using Poisson's and binomial distributions. From the OC curve it is clear that a high probability of acceptance means high quality. Selection of the values of n and c are important here. Values of n and c must be chosen in a way which will satisfy both principal and contractor. The contractor's risk is the chance that a high number of good quality products will be rejected. The principal 's risk is the chance that a high number of poor quality products will be accepted. The OC curve is plotted based on particular values of n and c. A higher c value gives rise to a higher risk for the principal. On the other hand higher n value introduces higher cost for the contractor. In order to satisfy both the principal and the contractor it is necessary to set optimum values for n and c, which will result in minimum risk for both the principal and the contractor. The following section will describe the suitable sampling plans which can be used in the construction industry specifically the double sampling plan and the attribute proportional sampling plan. Double Sampling Plan The double sampling plan is considered to be more appropriate and cost-effective for the construction process in comparison to the single sampling plan. An example is presented below clarifying the double sampling plan. The example also discusses the concept of average outgoing quality (Grant and Leavenworth, 1988) and demonstrates that the double sampling plan is more cost effective and reliable than the single sampling plan. Figure 2 outlines the details of the double sampling plan. In the double sampling plan a random sample size of n1 is taken from the lot size, N, and the number of defectives is say r1. If r1 ≤ c1 the lot is accepted without further sampling. If Optimisation of Construction Process Inspection Rates using a Learning Approach by Swapan Saha et al Page 4 The Australian Journal of Construction Economics & Building c1c2 r1c2 r1+r2Q then reject. The probability of accepting LTPD quality is Z(β) = (Q − LTPD) (LTPD(1 − LTPD) n (9) The probability of rejecting AQL quality is given in equation (10) Z(α) = (Q − AQL ) ( AQL(1− AQL) n (10) Z() can be found from a normal distribution table available in any statistics text book. By solving equations (9) and (10) the value of n and Q can be derived using equation (11) and (12): n Z AQL AQL Z LTPD LTPD AQL LTPD = − + − − [ ( ) ( ) ( ) ( ) ( ) ] α β1 1 2 (11) n )LTPD1(LTPD )(ZLTPDQ or n )AQL1(AQL )(ZAQLQ − β−= − α+= (12) where, Q is the limits of average proportion defective, which is governed by the minimum value obtained from equation (12) Example Assume the owner would like to set the following conditions for a construction task: AQL = 10%, LTPD=30%; control of the contractor's risk (α), = 5%; and the owner's risk (β) = 5%. In this task the owner has specified lot size, N is quite large compare to n, where n, the sample size is 30. Applying Equation (12) the upper limit of percentage defective (Q) is found to be 19.04%. As we know the percentage defective (p) is calculated by r/n, (r = non-conforming items); if p is smaller or equal to Q then accept and if p>Q then reject. Say, r =5 for the above task, therefore, percentage defective is (5/30)*100 = 16.67% which is lower than Q = 19.04% and is acceptable. Limitations of Acceptance Sampling Plan Acceptance sampling plans do not minimise the following: i) the total cost of inspection/testing of incoming and intermediary constructed items or services plus the cost to repair (rework) and inspect/test of these items or services in process or ii) the total cost of inspection/testing of final constructed products or services that fail to meet the specifications because of defective goods or services used in production. Acceptance sampling plans place an emphasis on inspection/testing, not on process improvement, in order to remove the need for inspection/testing when the process is stable. If the process involves the inspection/testing of a stream of lots, ie. the population sampled is infinite, then the binomial distribution can be used to determine p. In the case of an isolated lot or if quality is important, then the use of the hyper-geometric distribution is appropriate. Optimisation of Construction Process Inspection Rates using a Learning Approach by Swapan Saha et al Page 8 The Australian Journal of Construction Economics & Building For a stable process, acceptance sampling is invalid because the number of defectives in a sample is not correlated with the number of defective items in the remainder of the lot. A proof of this theory is given by Gitlow et al. (1987). For a cost effective inspection policy acceptance sampling does not include the calculation of optimum sample size. Minimum cost method is discussed in this paper to overcome this limitation. Using this method by knowing a defective proportion and ratio of cost of inspection to cost of failure, optimum sample size can be calculated Optimal Inspection Policy Another consideration in determining the number of tests/inspections is the cost of inspection and the cost of replacement of defective products in the future. It is obvious that, the larger the number of inspection, the greater the confidence in the quality of the product. However, if the inspection cost is high compared with the replacement cost, then the number of inspections needs to be minimised. The number of inspections should be limited to the extent that gives the owner enough confidence that the product is of a desired/specified quality. The term ‘enough confidence’ can be expressed in statistical terms as the confidence interval. The Owner will have to be satisfied with a lesser number of inspections as the ratio of Ct/Cf increases, where Ct and Cf are the cost of prevention/appraisal and the cost of failure, respectively. A model is developed below to determine the optimal inspection policy. This model establishes a relationship between cost parameters, the sample size (n), the lot size (N) and the percentage defective (p). The Minimum Cost Method (MCM) Model There is a minimum total cost for a certain quality level. This is illustrated in the classic quality cost trade-off model (Ittner, 1992) and is shown in Figure 6. Total cost represents the sum of prevention and appraisal (conformance) costs and failure/rectification (non-conformance) costs. This concept can be applied to determine the optimum sample size at which the total cost is minimised. Figure 6 The classic quality cost trade off model C ost failure C o st o f pre ve nti o n T o ta l c o s t Q u a lity L e v e l C o s t Optimisation of Construction Process Inspection Rates using a Learning Approach by Swapan Saha et al The Australian Journal of Construction Economics & Building Page 9 Table 2 Different elements of inspection and rejection costs Prevention Costs Appraisal Costs Failure/rectification costs • Quality system development • Quality system management • Assessment of suppliers and subcontractors and maintenance of master lists • Quality consultant's fee • Fees of certifying agent • Audit planning • Quality circles and other system improvement initiative • Development and management of job description • Personnel selection • All training and professional development • Preparation of project quality plans including inspection and test plans • All costs associated with fulfilling the requirements of procedure which are extra-over those carried out before the quality system was in place. • Internal generic audits (eg of training or auditing), including attendance by staff on auditor and audit reporting • Attendance on external auditors for certification • Management review • Inspection • Testing • Calibration and maintenance of inspection and test equipment • Checking • Review of own work • Independent review of work • Review meetings • Other verification activities • Internal audits of projects • Attendance on project audits by second parties • External audits of suppliers and subcontractors (where applicable) • Validation activities such as prototype testing and commissioning • Debriefing • Demolition and reconstruction of contractor’s work including wastage, scrap and replacement costs and all costs associated with attendance on this work and delays arising from the work. • All costs associated with attendance and delays related to sub contractors’ re-work • Internal re-work of documents as a result of review including project quality, plans, calculations, sketches, shop drawings, variation claims, progress claims, programs and resourcing schedules • Re-work of issued documents such as those listed above • Re-printing and processing of documents • Re-inspection, re-checking or review of rework • Project nonconformance and corrective action not covered above • Dealing with client complaints • Dissatisfied client pacification • Project litigation including attendance on lawyers and barristers and professional indemnity insurance excess payment • Reduction or non payment of contract sum • Late payment and bad debts and interest on borrowing • The on-cost emergency resourcing of projects • Unnecessary duplication of filing system • Communication breakdown in head office and between head office and sites • Nonconformance and corrective action not project related • Client dissatisfaction which is not known • Prime consultant dissatisfaction • Supplier and subcontractor dissatisfaction • Loss of client as a result of the above • Loss of reputation as a result of the above • Project indemnity insurance premiums • New staff getting to know “the way the firm works" Optimisation of Construction Process Inspection Rates using a Learning Approach by Swapan Saha et al Page 10 The Australian Journal of Construction Economics & Building Cost of inspection and rejection Costs related to construction errors are generally divided into three categories: • Prevention • Appraisal • Failure/Rectification Prevention costs are all those costs associated with minimising or preventing failure from occurring. Appraisal costs are those costs associated with quality control and system review of a project. Failure /rectification costs are costs associated with the service (or product) not meeting client requirements. Despite the fact that failure/rectification costs are the most substantial costs of all, they are often overlooked. Components of these cost items are presented in Table 2 Development of the Model In the minimum cost method (MCM) model the sum of prevention and appraisal (conformance) costs and failure/rectification (non-conformance) costs are minimised at a certain quality level. This quality level has a minimum sample size. Using the minimum cost model we can determine the optimum fraction of a lot size for a specified ratio of cost of failure to cost of prevention and appraisal. Let, Ct = the cost of prevention and appraisal (for detail refer table 2) Cf = the cost of failure/rectification (for detail refer table 2) N = lot size n = sample size r = non-conforming items in a sample size, n p = average proportion defective (error rate) Inspection/testing cost = Ct * n (13) Failure cost = (r/n) * N* Cf (14) Therefore, Total cost, C= Ct * n + (r/n) * N * Cf (15) For minimum n, (dC/dn) = 0, After solving equation (15) n2 = (r*N*Cf)/Ct (16) n = (r/n) * N * (Cf/Ct) (17) replacing r/n = p, equation (17) becomes n/N = p*(Cf/Ct) (18) By using equation (18) the sample size can be determined for a particular lot size if the cost ratio is known for the construction process. An example of how to determine the optimal lot size is discussed below. Example In this example the number of defective items (r) for a sample has been generated by using a Random Number Generator. An average value of proportion defective (p) can be obtained from a set of p values, which are obtained from the random values of r using Poisson’s distribution. In this particular example, assuming values of average proportion defective (p) equal to 0.1 and maximum allowable proportion defective (Q) equal to 0.194 (based on 95% confidence interval) and for an arbitrary series of (Cf/Ct) values (0,0.5,1.0,1.5, etc.), n/N can be calculated using equation (18). These n/N and Cf/Ct values are plotted in figure 7. This figure illustrates an envelope, which is obtained for average p and Q values. For example, for a cost ratio of 3.0 at lower confidence level, n/N is 0.36 and at upper confidence level, n/N is 0.57. This implies that the number of samples to be inspected or tested per lot depends on the average fraction defective (p) and the ratio of cost of failure (Cf) to cost of prevention and appraisal (Ct). In this example, if n = 30, then the upper limit of the N value for a cost ratio of 3.0 is 83. If the cost ratio is lower the percentage of inspection will be lower. For higher failure cost 100% inspection will be required to satisfy the confidence of owner and contractor. Optimisation of Construction Process Inspection Rates using a Learning Approach by Swapan Saha et al The Australian Journal of Construction Economics & Building Page 11 Figure 7 Fraction of sample size versus ratio of cost of failure to initial cost 0 0.2 0.4 0.6 0.8 1 1.2 0 0. 7 1. 5 2. 2 3 3. 7 4. 5 5. 2 6 6. 7 7. 5 Cf/Ct n/ N p(avg) Q value Construction industry related example The minimum cost method can be used for the calculation of optimum inspection rate for the repetitive tasks in construction. Due to mechanisation and use of same design in construction projects, construction processes are becoming repetitive. Data collected from the Sydney harbour tunnel construction project, shows that a number of tasks were subdivided into lots in a manner that they became repetitive. For example, in the north shore driven tunnel, 2400 meter long ceiling works were divided into 264 reinforced concrete slabs (each slab is approximately 12m long 7.6 m wide). Cost data on this slab construction was collected, including the cost of rework and the cost of inspection/testing. The average ratio of the cost of rework and the cost of inspection/testing was found to be approximately 5.0 ($5000/$1000). The proportion defective (error rate) for this sort of work (eg. reinforced concrete construction) can be found from previous studies and historical data, is 0.118 (Stewart 1992). Therefore, using equation (18), the number of slabs to be inspected for the tunnel job (for p=0.118 and N =264) worked out to be 156. According to the records available all slabs were inspected and tested for this job. Therefore, if this method was used, a substantial amount of money could have been saved on inspection and testing without affecting the final quality of the product. Discussion and Conclusion A number of sampling plans are available for the calculation of number of tests/inspections to be performed for a construction task. All the plans are not suitable for the construction industry. In this paper the double sampling plan and the attribute proportional sampling plan are presented with illustrated examples. There are, however, some limitations of these acceptance-sampling methods. These sampling plans do not provide the optimum number of tests at which the cost of tests will be minimised. An alternative method for the calculation of optimal sample size has been developed. This method is based on minimising total costs including prevention costs, appraisal costs and failure/rectification costs. An example has been presented to illustrate the application of the method. The example has shown that the number of samples to be inspected or tested per lot is not only depended on the average fraction defective but also on the cost of failure and the cost of prevention and appraisal. The example presented on the construction of repetitive slabs for the Sydney Harbour Tunnel construction project, suggests that a saving can be made using the Minimum Cost Method by determining optimum inspection rate. In this project a number of activities were subdivided into lots. In large Optimisation of Construction Process Inspection Rates using a Learning Approach by Swapan Saha et al Page 12 The Australian Journal of Construction Economics & Building construction projects this is the norm for effective handling and controlling of construction activities in terms of cost and quality. The construction processes are also becoming more repetitive in residential construction due to the use of the same design and the same construction methods in a number of projects. In the Australian residential construction industry residential builders are involved in construction of project homes. These project homes are of a ‘standard’ design with inflexible contractual arrangements which make design changes costly and/or impractical. Anecdotal evidence suggests that medium to large residential builders in Australia need to complete in the range of 100 to 200 houses of (relatively) same design scale per annum to provide sufficient return to the business. Therefore, the application of the Minimum Cost Method can be useful for the determination of optimum inspection rate for a number repetitive trade works (eg. foundation work, brickwork, framing, painting, etc.) involved to build these project homes. The average error rate (proportion defective) for a repetitive construction task is not constant throughout the project. It varies from organisation to organisation and project to project depending on a number of factors. These factors include, site management, experience and skill of the workers and inspectors, site conditions, environment and task complexity (Saha et al., 1999 and Saha, 1998). In future research, modelling of these factors by applying appropriate tools, (eg. fault tree analysis, event tree analysis, and learning curve model), will further enhance the effects of error rate, which may be utilised in predicting realistic inspection rate in construction. References A. A. Auff. Preliminary acceptance criteria for some road dimensions. Proceedings of Applications of Statistics & Probability in Soil and Structural Engineering, Third International Conference, Sydney, Australia, pp. 352-363, 1975. A.W. Manton-Hall and R. Sym. Operating characteristics of overlapping and non- overlapping "means of n" compliance criteria - A detail comparison. Proceedings of Applications of Statistics & Probability in Soil and Structural Engineering, Second International Conference, Aachen, Germany, pp. 278-291, 1975. B. Dale. Counting up the Cost, Journal of Total Quality Management, Oct 1991, pp 22-34, 1991. B.S. Dhillon. Quality control, reliability and engineering design. Marcel and Decker Inc., New York, 1985. C.D. Ittner. The economics and measurement of quality costs: An empirical investigation, PhD thesis, Graduate School of Business Administration, Harvard University, USA, 1992. CIDA, Measuring Up or Muddling Through: Best Practice in the Australian Non-Residential Construction Industry, Construction Industry Development Agency, Australia, Master Builders Association, Sydney Australia, pp 59-63. 1995. DIST. Building for growth: A draft strategy for the building and construction industry, Department of Industry, Science and Tourism, Commonwealth of Australia Publication, February, Canberra, Australia, 1998. N. Doganaksoy and G.J. Hahn. Moving from every lot inspection to audit sampling. Journal of Quality Technology, Vol. 26, No.4, pp261-273. E. L. Grant and R. S. Leavenworth. Statistical Quality Control, McGraw-Hill, New York, 1988. H. Gitlow, A. Oppenheim and R. Oppenheim. Tools and methods for the improvement of quality. Irwin, USA, 1989. H.Y. Fang. Sampling plan and construction control. Proceedings of Applications of Statistics & Probability in Soil and Structural Engineering, Second International Optimisation of Construction Process Inspection Rates using a Learning Approach by Swapan Saha et al The Australian Journal of Construction Economics & Building Page 13 Conference, Aachen, Germany, pp. 323- 337, 1975. I. Blyth, QA sharing the experience, The Building Economist, March 1995, pp9-12. L. Chang and M. Hsie. Developing acceptance sampling methods for quality construction. Journal of Construction Engineering and management, Vol. 121, No. 2, pp. 246-253, 1995. P.E.D. Love, and H. Li, Quantifying the causes and costs of rework in construction, Journal of Construction Management and Economics, UK, .vol. 18, pp 479-490 2000 R.D. Leitch. Basic reliability engineering analysis. Butterworths & Co. Ltd., London, 1988. S.K. Saha, Mathematical Modelling of Construction Error and Optimal Inspection Policy, The Sixth East Pacific Conference on Structural Engineering and Construction, January 14-16, 1998, The National University of Taiwan, Taipei, pp. 1155-1160, 1998. M.G. Stewart, The Occurrence and Detection of Errors in Reinforced Concrete Beam Construction. The Department of Civil Engineering and Surveying, research report no. 063.05.1992. The University of Newcastle, NSW,1992. S. K Saha., , C. Greville, T. Mullins, Simulation Experiment: The effects of experience and interruption in predicting error rate for a construction inspection task. International Congress on Modelling and Simulation Proceedings, The University of Waikato, New Zealand, December 6-9, pp. 1003 –1008, 1999 W.W. Hines and D. C. Montgomery. Probability and statistics in engineering and management science. John Wiley & Sons, Singapore, 1990.