IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 228 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 INTEGRATIONS AND APPLICATIONS OF ANALYTIC HIERARCHY PROCESS WITH DATA ENVELOPMENT ANALYSIS – A LITERATURE REVIEW Saurabh Pradhan Birla Institute Of Management Technology, Greater Noida, Uttar Pradesh, India saurabh.pradhan_fpm17@bimtech.ac.in Maryam Olfati School of Mathematics and Information Science, Guangzhou University, Guangzhou, China maryam.olfati@vsb.cz Prof. Gokulananda Patel* Birla Institute Of Management Technology, Greater Noida, Uttar Pradesh, India gn.patel@bimtech.ac.in ABSTRACT The scope of the AHP (Analytic Hierarchy Process) and the DEA (Data Envelopment Analysis) is widened when they are integrated to create the DEAHP. This method has boundless flexibility and varied applicability. Furthermore, the scope, flexibility, and applicability are also increased when DEAHP is integrated with other approaches and methods. This paper reviews the literature that discusses this integration with DEAHP. On the basis of a defined search criterion, related articles appearing in international journals from 2000 to 2018 were collected and analyzed so that the following five questions could be answered: (1) Which approach out of the various integrated-DEAHP approaches was most prevalent and got the utmost attention?, (2) Which of the areas of application were most often studied and found their application with integrated DEAHP approaches?, (3) Which of the specific problems were most frequently applied to integrated DEAHP approaches?, (4) What are the publication trends for the papers considering the integrated DEAHP approaches?, and (5) Which jourmals of international standards published what number of journal articles and among them which has the highest number of articles on the approach of integrated DEAHP? This literature review shows that the integrated DEAHPs are able to tackle the inadequacies of the stand-alone DEAHPs. This article allows the researcher to think about new application areas and specific problem areas where an integrated DEAHP approach could be effectively and efficiently applied. The novelty of this paper lies in the fact that this is a one of a kind literature review that considers the integrated DEAHP approach along with stand-alone DEAHP with its applications. mailto:saurabh.pradhan_fpm17@bimtech.ac.in mailto:maryam.olfati@vsb.cz mailto:gn.patel@bimtech.ac.in IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 229 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 Keywords: Integrated Data Envelopment Analysis-Analytic Hierarchy Process; AHP; DEA; DEAHP; literature review 1. Introduction Lately, there have been many application-based papers developed in the field of integrated approaches of the Analytic Hierarchy Process and Data Envelopment Analysis (DEA/AHP). In this globalized society, changing business scenarios demand the most efficient and effective ways to manage an organization’s business operations in every application area related to multi-criteria decision making (MCDM). This paper will aid academic and industry researchers and decision makers in utilizing the integrated DEAHP approach for various business problems in different application areas. This literature review identifies advances and new trends of the stand-alone and integrated DEAHP and its applications and problems from the business perspective between 2000 to 2018. This integration of AHP/DEA with other approaches is widely applied in the field of performance and efficiency measurement and optimization. Besides these, it also finds its application in quality measurement and ranking of different products or services in every sector namely education, engineering, manufacturing, government, management, industry, social, political, personal and even sports. For every organization, performance is a multi-dimensional phenomenon that addresses the quality, efficiency, cost, delivery, and flexibility aspects of the organization which relate to its improved performance. Organizational performance needs to be flexible, robust and competitive enough for the organization to survive and grow and gain an edge over competitors in the dynamic and vibrant scenario of the global and national economy. For instance, measurements of efficiency, quality, performance, and rank have been addressed using numerous approaches by a number of different researchers with diversified levels and dimensions for consideration. A various number of tools and techniques for the aforementioned indicators have been used which include the Analytic Network Process (ANP), Analytic Hierarchy Process (AHP), Data Envelopment Analysis (DEA), goal programming (GP), linear programming (LP), Slacks-Based Measure (SBM), Assurance Region (AR), Grey Relational Analysis (GRA), Technique for Ordering Preference by Similarity to Ideal Solution (TOPSIS), Total Cost of Ownership (TCO) Quality Deployment Function (QFD), Balanced Scorecard (BSC), and Suppy Chain Operations Reference (SCOR) model, to name a few. Some structural modeling approaches include Interpretive Structural Modelling (ISM), Decision Making Trial and Evaluation Laboratory (DEMATEL), and Structural Equation Modelling (SEM). Benchmarking of performance emphasizes both the inter and intra-organizational levels. Recently, integrated approaches (AHP- DEA model, Delphi-AHP-TOPSIS, Fuzzy-AHP-Fuzzy-TOPSIS, BSC-ANP- DEMATEL, BSC-AHP, BSC-ISM-ANP, SCOR-BSC, DEMATEL- ANP- VIKOR, and Dependence-based interval-valued evidential reasoning (DIER)-BSC) have also been propounded for the measurement of performance and analysis. The most popular set of tools for managers engaged in multi-criteria decision making are DEA, AHP, and ANP. There have been quite a few examples in the past literature of integrated approaches with DEAHP, such as DEAHP-Fuzzy, DEAHP-LP, DEAHP- GP, DEAHP-Simulation, DEAHP-ABC, EAHP-SBM, DEAHP-TCO, DEA-VAHP, DEAHP-AR, DEAHP-Gower plot, DEAHP-GRA, Delphi-DEAHP-LP, DEAHP- IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 230 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 Fuzzy-QFD-LP, DEAHP-TOPSIS-Fuzzy, and 2-level SOM-DEAHP-AR, to name a few. Before the integrated DEA/AHP was introduced, the stand-alone AHP was sufficient for a wide variety of fields which are related to MCDM (multi-criteria decision- making). Thomas L. Saaty introduced AHP in the 1970s. The AHP was developed by many researchers such as Sinuany-Stern, Mehrez, and Hadad (Sinuany-Stern et al., 2000) and Thomas L. Saaty (Saaty, 2004). The AHP is a subjective method which helps analyze both qualitative and quantitative criteria to generate important weights of the decision criterias and the relative performance measures of the alternatives in terms of each individual’s decision criteria. Ho (2008) noticed that when the AHP is integrated with other approaches, it leads to a far more practical and trustworthy decisions than with the stand-alone AHP. Hence, the attention shifted in the direction of integrated-AHP and its realistic applications. There have been only 5 publications which reviewed the literature about AHP in the last decade (2007-2016), which is quite limited in number. Ho (2008) reviewed 66 papers from 1997 to 2006, and concluded that approaches like integrated-AHP-QFD and integrated-AHP-GP were the most extensively applied approaches. The paper also observed that the logistics sector was the most diverse area of application for the integrated-AHP approach. Ho & Ma (2018) followed the previous work by comparing the papers in the 2008 article with the 88 papers published between 2007 and 2016. According to Ho (2008), the AHP is one of the most widespread MCDM approaches. However, the AHP has been criticized to a great extent for the problem of rank reversal. The eigenvector method, which is used for determing the priorities in AHP, has been criticized by Bana e Costa and Vansnick (2008) because it violates the condition of order-preservation (COP). The numerical examples given by Bana e Costa and Vansnick were examined by Wang, Chin, and Luo (2009). They re- examined the concept of oveall judgements, and it was clearly shown that the criticisms were not justified. The criticism of Bana e Costa and Vansnick has also been argued by Kulakowski (2015). This article argued that the problem of the prioritization procedure followed in the AHP was not inherent, rather the issue arose because of the inconsistencies which were found between the elements of the pairwise-comparison matrix. The inconsistency measurement which was taken for the matrix as a wholes does not detect the inconsistencies that are present between the elements of the pairwise-comparison matrix (Kulakowski, 2015). However, on the contrary, the DEA is a data-oriented approach which is in a way based on mathematical programming. Charnes et. al. (1978) introduced DEA, and it is one of the most efficient methods that is primarlily used for evaluating the relative efficiency of DMUs (Decision Making Units). The performance evaluations of scale efficiency, technical efficiency, allocative efficiency, and cost efficiency are usually carried out using this approach. The objective function value of a linear programming model is basically efficiency. There are many bibliographies in the area of DEA in the existing literature, e.g. Emrouznejad et al. (2008), Emrouznejad and Thanassoulis (1996a, 1996b, 1997), Seiford (1994, 1997), Gattoufi et al. (2004a, 2004b), and Tavares (2002). From 1978 to 2016, there were 9881 DEA-related articles which were published only in journals (excluding any articles published as a chapter, book or working paper). 94% of the IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 231 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 papers related to DEA were published by less than four authors, and about 34% of the papers have two authors. Energy, industry, banking, education, and healthcare were found to be the most popular application areas of DEA (Emrouznejad & Yang, 2017). Sinuany-Stern et al. (2000) claimed that the key objective of the AHP-DEA model is to eliminate the subjective evaluation of AHP and to overcome the ranking inefficiency of DEA. With the AHP-DEA approach, the judgment matrix is formed using basic AHP models and then DEA is used to rank the DMUs (Decision Making Units). As per the aforementioned paper, this method eliminates the subjective evaluation of AHP and overcomes the ranking inefficiency of DEA. First, the DEA is run separately for each of the units. Second, the pairwise-evaluation matrix which was generated in stage one is utilized to rank-scale the units using the AHP. Both the AHP and DEA are commonly used and have limitations. The evolution of the AHP was comprehensively detailed in Ho (2008). Similarly, the literature review in Seiford (1996) outlines the evolution of the DEA. Even though Ho (2008) and Seiford (1996) have made a significant contribution to the AHP and DEA literature as stand-alone approaches, there are two significant knowledge gaps that were the motivation for conducting this study. First, all of the works mentioned in the two previous studies include approaches that are integrated with AHP and DEA in a stand-alone manner. With the onset of DEA/AHP (DEAHP), which overcomes the limitations of AHP, several other approaches seem to fit with DEAHP streamlined to various problem areas and application areas. Second, both of the review articles mentioned previously primarily emphasize the commonly studied AHP with the integration of other approaches and the stand-alone AHP approach during a particular time period. Also, these review articles do not show a relative comparative analysis and do not analyze the integrated approaches application-wise, problem-wise, trend- wise, journal-wise, and even popularity-wise. In order to fill these two gaps, an exhaustive review of highly relevant journal articles between 2000 to 2018 have been presented by this paper to analyze the applications and integrations of DEAHP. In this paper, we consider the literature concerning DEA/AHP between 2000 and 2018. Therefore, 72 papers have been studied with varied approaches and applications that include a diverse set of practical problems. The application area is very wide because of the flexibility and ease of use with a variety of specific problems. This combination of different approaches with DEAHP (also referred to as integrated DEAHP approaches) is able to make a decision with more accurately than the stand-alone DEAHP. These approaches were selected because of their wide applicability, popularity, and accomplishment in making decisions. The mechanism of the DEAHP is described briefly in the next section. The tools integrated with the DEAHP and their applications are critically explained in the subsequent sections. Analysis of the stand-alone-DEAHP approaches and integrated- DEAHP approaches, suggestions which are applicable for future work, and conclusions for this work on literature are discussed in the last few sections. 2. DEAHP The DEAHP consists of six stages, which are developed into a flowchart as shown in Figure 1. Stage 1 breaks down a complex MCDM problem into its constituent parts. In these parts, every criterion, sub-criteria, and the alternatives are arranged into IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 232 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 multiple hierarchical levels. Subsequently, in stage 2, each cluster is compared in the same level in a pairwise manner which may be based on the decision-maker’s knowledge and experience. Some degree of inconsistency may occur in it since the comparisons are carried out through personal or subjective judgments. Stage 3 constructs the DEA problem where the efficiency is calculated for each criterion taken as DMU. Stage 4 identifies if all the hierarchical levels (criteria, sub-criteria, and alternatives) have finished comparision. If the answer is “No”, then a pairwise comparison matrix is developed again. If the answer is “Yes”, then it moves to stage 5 of synthetization, where the efficiency of the alternatives is calculated. Finally, stage 6 develops the overall priority ranking where the judgments can then be synthesized to determine the priority ranking of each criterion and its alternatives. Figure 1 Flowchart of the DEAHP (Data Envelopment Analysis – Analytic Hierarchy Process) IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 233 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 3. Research methodology Since this literature review focuses on the recently created integrated approach of the stand-alone DEAHP, all the journal articles are published between 2000 to 2018. The following illustration in Figure 2 represents the research methodology. Figure 2 Flowchart of the research methodology published by Ho & Ma (2018) This paper followed a very lucid search, inclusion, exclusion, shortlisting and review given by Ho & Ma (2018). Initially, the search terms were defined, and then keywords/abstracts/titles were searched using the terms “Integrated Data Envelopment Analysis-Analytic Hierarchy Process” (shortened to keywords like DEAHP, AHP/DEA, integrated DEAHP, integrated AHP/DEA, integrated DEA/AHP) which were utilized in the process of searching within the databases. Second, a wide variety of academic databases were used to find relevant journal articles. These databases included Emerald, EBSCOhost, Elsevier, ScienceDirect, JSTOR, Taylor & Francis, ProQuest, World Scientific, Scientific Research, IEEExplore, MDPI, MetaPress, Ingenta, Wiley, and Springer. Only PRPs (peer- reviewed papers) which were printed and published in English and in international level journals were chosen to ensure an elevated relevance level. Conference papers, book chapters, textbooks, dissertations of doctoral and master’s level, and notes were not considered for this process of review. In the third step, the journal articles were screened on the basis of a determined criterion. Using the criterion, all the abstracts of the articles along with relevant informative portions of the papers were scrutinized to identify whether the article addressed the integrated-DEAHP approach or the stand-alone-DEA/AHP approach with its applications rather than addressing only AHP or DEA or integrated AHP without DEA or integrated DEA without AHP. However, it must be kept in mind that IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 234 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 the journal articles which proposed approaches for re-modifying DEAHP, like a linear programming method for the generation of weights from a pairwise- comparison matrix which tends to be the most favorable (Wang et. al., 2008); weight derivation in the case of DEA and aggregation in the case of AHP (Ramanathan, 2006); and ranking decision-making units (DMUs) using approach of integrated fuzzy-DEA-fuzzy-AHP (Alem et. al., 2013) were also considered as these papers were well-tested and evaluated on a few hypothetical examples which did not follow any specific applications. The authors successfully demonstrated their work based on these hypothetical examples. Also, an application-based literature review paper by Ho (2008) was considered for this paper. We tried to include the maximum number of papers because this paper deals with the focused approach of DEAHP. The state-of- the-art and prominent integrated-DEAHP approach and its varied applications can be studied by enabling this filtering criterion. The criteria for filtration screened out those journal articles which did not achieve even one of these criteria of filtration. In the fourth step, a careful evaluation of all the lists of references of these shortlisted articles was carried out to make sure that any other related and highly relevant articles were not missed in the search process. Finally, an exhaustive review of the content of each journal article was done to make sure that the paper was aligned with the context and was fit in the context of the integrated-DEAHP approaches and stand-alone DEAHP approach. This analysis resulted in 72 journal articles for this study. Five questions were asked of the 72 collected articles, which include: (i) which of the integrated-DEAHP approaches were most prevalent and widely appreciated?, (ii) in which fields/areas did the integrated-DEAHP approaches find a varied number of applications?, (iii) which kind of specific problems were addressed using integrated- DEAHP approaches?, (iv) what are the publication trends for the papers considering the integrated DEAHP approaches?, and (v) which jourmals of international standards published how many journal articles and among them which have the highest number of articles on the approach of integrated DEAHP? 4. Stand-alone DEAHP approaches and applications There are many papers that demonstrate the method and more specifically the applications of the DEAHP in its stand-alone form. It should be noted that even the stand-alone DEAHP is a combination of AHP and DEA. In the DEAHP, the DEA part removes the limitations of AHP which are rank reversal, element dominance, and row dominance issues. Therefore, this method produces better output weights that can be applied to different business scenarios. Forty-one journal articles were identified that applied the stand-alone DEAHP without the integration of any other approaches with their categorization of application areas and specific problems as shown in Table 1. These journal articles focus on specific problem statements such as supplier evaluation and selection (Sevkli et al, 2007; Moon & Kang, 2015; Aji & Hariga, 2013; Yadav & Sharma, 2015), economic performance assessment (Lin et al., 2011) that comes under performance evaluation and efficiency measurement, and the problem of evaluation and selection of a warehouse (Korpela et al., 2007) that comes under business unit evaluation. The results of DEA and AHP have been combined by IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 235 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 Sueyoshi et al. (2009) to tackle the problem of critical business-unit selection and evaluation in a rental car business. Table 1 The stand-alone DEAHP approach and its application areas and specific problems Approach Authors Application areas Specific Problems DEA-AHP (General) William Ho (2008) Literature Review Literature Review Antonio et al. (2012) Higher education Performance evaluation & Efficiency measurement Pakkar (2015) Banking Multiplicative aggregation of financial ratios Ahmad (2006) Manufacturing Business unit evaluation Aji & Hariga (2013) E-Commerce Supplier evaluation and section Pakkar (2014) Iron / Steel Performance evaluation & Efficiency measurement Amin & Toloo (2007) Manufacturing Facility Layout Selection Azadeh et al. (2011) Banking / Mining Personal productivity evaluation Cai & Wu (2001) Financial Process evaluation Omid & Zegordi (2015) Manufacturing Performance evaluation & Efficiency measurement Moon & Kang (2015) Defence Industry Supplier evaluation and section Giokas & Pentzaropoulos (2008) Telecommunication Performance evaluation & Efficiency measurement Hadad & Hanani (2011) Manufacturing Product evaluation and selection Banwet & Deshmukh (2008) R & D Performance evaluation & Efficiency measurement Kasap & Kiriş (2013) Energy Business unit evaluation Kavurmaci & Üstün (2016) Environment Quality evaluation Kengpol & Tuammee (2015) Logistics Business unit evaluation Korpela et al. (2007) Process Business unit evaluation Lin et al. (2011) Government Performance evaluation & Efficiency measurement Lozano & Villa (2009) Logistics Business unit evaluation Zarei et al. (2012) Manufacturing Performance evaluation & Efficiency measurement Foroughia & Esfahani (2012) Airlines Business unit evaluation IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 236 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 Pakkar (2016) Government Performance evaluation & Efficiency measurement Ramanathan (2006) Multiple Industries Performance evaluation & Efficiency measurement Saleeshya & Babu (2012) Manufacturing Business unit evaluation Sevkli et al. (2007) Manufacturing Supplier evaluation and section Shirouyehzad et al. (2013) Hotel Business unit evaluation Singh & Aggarwal (2014) Human resource Performance evaluation & Efficiency measurement Sinuany-Stern et al. (2000) Manufacturing Performance evaluation & Efficiency measurement Sueyoshi et al. (2009) Rental cars Business unit evaluation Tseng & Lee (2009) Electronics Process evaluation Wang et al. (2008) Manufacturing Risk assessment Yadav & Sharma (2015) Manufacturing Supplier evaluation and section Yang & Kuo (2003) Electronics Facility Layout Selection Zhang & Fu (2012) Logistics Performance evaluation & Efficiency measurement Ertay et al. (2006) Manufacturing Facility Layout Selection Saen et al. (2005) Government Performance evaluation & Efficiency measurement Takamura & Tone (2003) Government Location Evaluation Wang et al. (2008) Higher education Expert evaluation and selection Wang & Chin (2009) Higher education Expert evaluation and selection Mirhedayatian & Saen (2011) Higher education Expert evaluation and selection Total 41 It was clearly shown by Wang et al. (2008), Mirhedayatian and Saen (2011), and Wang and Chin (2009) that the approach of integrated-DEAHP for derivation and aggregation of weights in the AHP was erroneous. Sometimes, the method resulted in counter-intuitive priority vectors for inconsistent pairwise-comparison matrices which highly restricted its application. Therefore, to address these drawbacks, the above researchers reassessed the integrated DEAHP approach by using examples such as research fellow recruitment (Wang et al., 2008), and university president recruitment (Wang & Chin, 2009; Mirhedayatian & Saen, 2011), all of which fall under expert evaluation and selection. The other problems studied included facility layout design selection (Yang & Kuo, 2003; Amin & Toloo, 2007; Ertay et al., 2006), government agency location selection IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 237 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 and evaluation (Takamura & Tone, 2003), a supplier efficiency and productivity measurement problem that falls under performance evaluation and efficiency measurement (Sinuany-Stern et al., 2000; Zarei et al., 2012; Omid & Zegordi, 2015; Giokas & Pentzaropoulos, 2008), assessment and optimization of personal productivity (Azadeh, 2011), financial performance assessment (Pakkar, 2014), agility-enablers identification and agility measurement that falls under business unit evaluation (Saleeshya & Babu, 2012), bridge risk assessment (Wang et al., 2008), emerging logistics performance evaluation and efficiency measurement (Zhang & Fu, 2012), evaluation and selection of business firm unit (Ahmad et al., 2006; Kasap & Kiris, 2013), institutional efficiency measurement that falls under performance evaluation and efficiency measurement (Antonio et al., 2012), service units evaluation as in the case of business unit evaluation (Shirouyehzad & Lofti, 2013), ground water quality evaluation (Kavurmaci & Üstün, 2016), comparison of appropriate decision support of HR practices on organizational performance which falls under process evaluation (Tseng & Lee, 2009), manpower performance evaluation and efficiency measurement (Singh & Aggarwal, 2014), multiplicative aggregation of financial ratios (Pakkar, 2015), port logistics performance as in the case of business unit evaluation (Lozano & Villa, 2009), quantitative risk assessment in multi-modal green logistics (Kengpol & Tuammee, 2015), relative efficiency measurement (Foroughia & Esfahani, 2012), road safety performance (Pakkar, 2016), selection of best alternative for forklifts purchase (Hadad & Hanani, 2011), synthetic financial evaluation (Cai & Wu, 2001) and performance evaluation (Saen et al., 2005; Banwet & Deshmukh, 2008). Ramanathan (2006) demonstrated performance evaluation and efficiency measurement on a few hypothetical examples where DEA (data envelopment analysis) was propounded. Here, the DEA was used for the generation of local weights of alternatives from the pair-wise comparison judgment matrices which is used in the AHP. A literature review paper, Ho (2008) concentrated on literature from 1997 to 2006 with a wide view and huge number of diversified applications of AHP/DEA. 5. Integrated DEAHP approaches and applications 5.1 Integrated-DEAHP and fuzzy-set theory The concept of fuzzy-set theory empowers decision-makers to consider uncertainty or fuzziness by rendering interval judgments. According to Table 2, the fuzzy (DEAHP- fuzzy) approach has been applied in 14 articles. The table shows their categorization of application areas and specific problems. IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 238 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 Table 2 The integrated DEAHP-fuzzy set theory approach and its applications Approach Authors Application areas Specific Problems DEAHP-Fuzzy Li et al. (2016) Logistics Business unit evaluation Loron et al. (2015) Construction Project/program evaluation and selection Alem et al. (2013) Multiple Industries Performance evaluation & Efficiency measurement Huang & Chi (2015) Tourism Location Evaluation Che et al. (2010) Financial Process evaluation Çalik et al. (2018) Government Performance evaluation & Efficiency measurement Gupta et al. (2018) Logistics Project/program evaluation and selection Hadi-Vencheh & Mohamadghasemi (2011) Manufacturing Inventory control (multiple criteria ABC inventory classification) Kumar et al. (2014) Telecommunication Expert evaluation and selection Kuo et al. (2010) Manufacturing Supplier evaluation and section Lee et al. (2010) Energy Process evaluation Lee et al. (2011) Energy Technological evaluation Lee et al. (2013) Energy Resource allocation Parameshwaran et al. (2009) Manufacturing Business unit evaluation Total 14 The integrated DEAHP-fuzzy approach has been applied to efficiency measurement and performance evaluation (Lee et al., 2010; Lee et al., 2011; Alem et al., 2013; Çalik, 2018) along with benchmarking (Parameshwaran, 2009). Alem et al. (2013) demonstrated his work using a few hypothetical examples. Several articles applied the integrated DEA/AHP-fuzzy approach for efficiency allocation (Lee et al., 2013), customers’ preference analysis and relative efficiency measurement (Kumar et al., 2014), efficiency measurement (Li et al., 2016), supplier evaluation and selection/performance evaluation (Kuo et al., 2014), inventory control (multiple criteria ABC inventory classification) (Hadi-Vencheh & Mohamadghasemi, 2011), efficient loaning decision making (Che et al., 2010), intelligent building assessment (Loron et al., 2015), competitiveness evaluation (Huang & Chi, 2015) and extended capacitated sustainable transportation problem (Gupta et al., 2018). 5.2 Integrated DEAHP and mathematical programming The integrated DEAHP approach combined with mathematical programming approaches was used in four articles from 2008 to 2018 as shown in Table 3 with their categorization of application areas and specific problems. These mathematical programming approaches were LP (linear programming) and GP (goal programming). In these approaches, the relative importance of criteria and alternatives was evaluated and quantified by the DEAHP. The objective function or constraints of a mathematical programming model were then incorporated with the DEAHP-derived weights. Apart from these, there are other mathematical IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 239 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 programming approaches like MOLP (multi-objective linear programming), DP (dynamic programming) and, MILP (mixed-integer linear programming) which have not been integrated with DEAHP. Table 3 The integrated DEAHP-mathematical programming approaches and their applications Approach Authors Application areas Specific Problems DEAHP-GP Jatuphatwarodom et al. (2018) Manufacturing Supplier evaluation and section DEAHP-GP Kumar & Babu (2012) Manufacturing Supplier evaluation and section DEAHP-LP Falsini et al. (2012) Logistics Supplier evaluation and section DEAHP-LP Wang et al. (2008) Multiple Industries Multiple Problem Areas Total 4 5.2.1 Integrated DEAHP-GP approach Kumar and Babu (2012) used the integrated DEAHP-GP approach. This framework makes use of a multi-stage process which is comprised of approaches, namely DEA, AHP and PGP (pre-emptive goal programming) applied to the problem of supplier selection and evaluation in IT service and general manufacturing sectors. First, this framework makes use of an AHP-based methodology to decide whether to choose outsourcing or not and then from whom to outsource. After this, a DEA-based method was followed, where the relative efficiencies of the priority sources, identified by AHP were determined. Finally, the best source from the given number of sources for the given targets of the outsourcer was identified by an AHP-PGP formulation. Jatuphatwarodom et al. (2018) exhibited extended goal programming (EGP) along with the combined approach of AHP and DEA so that managerial decision support could be provided. Initially, the DEA was used in a descriptive sense to provide information regarding the efficiency for a set of units. After that, the AHP was used to determine the importance of criteria which arises from decision problem(s) which are in turn related to the improvement of unit-efficiency. In the final stage, in order to improve unit-efficiency, EGP was used in a prescriptive sense for the selection of a set of specific actions. Two specific multi-objective situations in the Thai silk industry were used as case studies for the proposed methodology. These involved supplier selection and inventory management with multiple conflicting goals and objectives. In the aforementioned case studies, the DEA was used to provide efficiency estimates of current suppliers and processes. After that, the AHP was used to determine the relative importance of criteria for the improvement of efficiency in the supply chain processes. In order to deal with high levels of inconsistency, adaptations were made to an automated inconsistency reduction algorithm. The relationship between the decision maker’s confidence and consistency was then investigated. In the final stage, an EGP model was built to recommend actions for improvement to the supply chain processes. IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 240 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 5.2.2 Integrated DEAHP-LP approach Falsini et al. (2012) applied the integrated DEAHP-LP approach in supplier evaluation and selection which proposed an evaluation method in the logistics sector that aims at providing an efficient and effective decision support system to select suppliers. This system is easy to use, avoids limitations in the application field and is able to effectively manage multi-criterion complexity. An integrated-DEAHP-LP method for generating the most favorable weights from a pairwise-comparison matrix was demonstrated by Wang et al. (2008). A LP (linear programming method) for the generation of the most favorable weights (LP-GFW) from pairwise-comparison matrices was given by this article. The variable-weight concept of DEA into the priority scheme of the AHP was incorporated by this method to generate the most favorable weights for the underlying criteria and alternatives based on a crisp pairwise comparison matrix. Precise weights for perfectly consistent pairwise comparison matrices and approximate weights for inconsistent pairwise comparison matrices were generated by this LP-GFW method. These weights are not significantly different than Saaty’s principal right eigenvector weights. In the article, rank preservation methods and the issue of aggregation of local but the most favorable weights are also discussed. To demonstrate its significant advantages and potential applications over some of the previously prevailing priority methods, four hypothetical numerical examples were examined using the LP-GFW method. 5.3 Integrated DEAHP and simulation One article was found that applied the integrated DEAHP and simulation (DEAHP- simulation) approach for performance evaluation and efficiency measurement in the railway sector as shown in Table 4 with the categorization of application area and specific problem. Table 4 The integrated DEAHP-simulation approach and application Approach Authors Application areas Specific Problems DEAHP- Simulation Azadeh et al. (2008) Railways Performance evaluation & Efficiency measurement Total 1 To improve and optimize the railway system by means of efficiency assessment and performance optimization an integrated simulation, multiple decision analysis, and multivariate analysis were presented by Azadeh et al. (2008). Moreover, the integrated model was based on the AHP and DEA which was integrated with computer simulation. The optimum alternatives can be selected by considering multiple qualitative and quantitative outputs and inputs when using the integrated AHP and DEA model with simulation. To begin with, the system being studied was model verified and validated by the computer simulation. After that, the weight of any qualitative criteria (outputs or input) was determined by the AHP methodology. In the end, the multi-objective model was solved by using the DEA model. This allows the best alternative(s) as well as the mechanism for optimizing the current system to be identified. 5.4 Integrated DEAHP and other approaches Seven papers were found that applied the integrated DEAHP with other approaches as shown in Table 5 with their categorization of application areas and specific problems, such as ABC (Activity Based Costing), SBM (Slacks-Based Measure), IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 241 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 TCO (Total cost of ownership), VAHP (Voting AHP), Assurance Region (AR), Grey Relational Analysis (GRA), and Gower Plot. Table 5 The integrated DEAHP-other approaches and their applications Approach Authors Application areas Specific Problems DEAHP-ABC Zhang et al. (2012) Electronics Supplier evaluation and section DEAHP-SBM Yuan et al. (2013) Environment Resource allocation DEAHP-TCO Ramanathan (2007) Supply chain management Supplier evaluation and section DEA-VAHP Soltanifar & Lotfi (2011) Healthcare Performance evaluation & Efficiency measurement DEAHP-AR Lai et al. (2015) Airlines Performance evaluation & Efficiency measurement DEAHP-Gower plot Li & Ma (2008) Business Administration Location Evaluation DEAHP-GRA Prasad et al. (2017) Iron / Steel Supplier evaluation and section Total 7 The first paper by Zhang et al. (2012) applied the integrated DEAHP-ABC for supplier evaluation and selection in the electronics sector. This article suggested a hybrid and integrated model, based on DEAHP and ABC (activity-based costing) so that the overall efficiency of suppliers and costs (which includes indirect costs and direct costs) could be evaluated. Comprehensive decision support for the selection and evaluation of suppliers can be derived with the help of this model. The order quantity from the preferred suppliers can be integrated with the decision regarding the selection of suppliers by using this hybrid model. Simultaneously, in a single model, a few factors of relevance like the past delivery performance of suppliers, the purchasing budget of the buyer and capacity constraints were considered. The second article by Yuan et al. (2013) applied integrated DEAHP-SBM which focused on disaster vulnerability assessment and resource allocation. This article developed an integrated index which contained sensitivity, exposure, and adaptive capacity so that regional vulnerability to the drought in China could be measured. The same indicator was calculated by the approach which integrated the SBM (slacks- based measure) model with the DEA along with AHP which was in turn based on a genetic algorithm. The reasons behind drought vulnerability were provided by the calculated integrated index with the integrated-DEAHP approach. Consequently, the proposal for available mitigation strategies for different drought-vulnerable areas was given. The third article discussed the outcomes of combining AHP and TCO (Total cost of ownership) along with the application of DEA as a way to combine subjective and objective information. This article has been suggested by Ramanathan (2007) which integrates the DEA-TCO-AHP model and applies it to the supplier selection problem. This model is the first work to find its application in the problem of supplier selection. IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 242 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 The fourth article by Soltanifar & Lotfi (2001) applied DEA-Voting AHP for benchmarking, efficiency assessment and performance optimization in healthcare (nursing home) and commercial banks. This article presents a method for ranking efficient DMUs by means of the Voting-Analytic Hierarchy Process (VAHP). A few ranking models in DEA were reviewed in this article along with their strengths and weaknesses. Next, a method for ranking efficient DMUs by VAHP was presented. The fifth journal article by Lai et al. (2015) applied integrated DEAHP-AR for evaluating the performance efficiency of airports. This article used the AHP and MCDM method for integrating the weightings of output and input variables into AR (Assurance Region) and DEA. In the empirical analysis, 24 major international airports were taken into consideration. This article concluded that the discriminatory power in the suggested model of DEAHP-AR is greater and better than the basic DEA model while the efficiency of airports was being measured. The comparison of operational efficiency between airports can be done effectively by practitioners and policy-makers using this approach. This will help in the generation of more informed decisions. The sixth paper by Li & Ma (2008) used DEAHP and the Gower plot technique to rank decision alternatives in space/location selection and evaluation. With the integration of AHP, DEA, and Gower plot techniques, an iterative method of ranking decision alternatives was developed. To narrow the range of preferences of the decision maker, a DEA model with modification was first used by this developed method. Then, in order to demonstrate the ordinal and cardinal inconsistencies of these preferences, the decision alternatives’ tentative ranks which were computed by embedding the preferences of the decision maker were depicted by means of Gower plots. After that, until the inconsistencies come within the tolerance, the decision maker keeps adjusting the preferences in an iterative manner. The seventh paper by Prasad et al. (2017) applied DEAHP-GRA for supplier evaluation and selection in the steel manufacturing sector. This article offered a hybrid methodology using AHP, DEA and Grey Relational Analysis (GRA) for assessing suppliers and for picking the best supplier for an organization. In this work, the suppliers’ performance scores and efficiencies were discovered using the DEA methods of cross-efficiency and super-efficiency, respectively. The total list of efficient suppliers showing high-performance levels was based on cross-efficiency scores and super-efficiency scores. The best supplier was discovered using GRA methodology. 5.5 Integrated DEAHP and multiple approaches Five articles found their applications with the integration of DEAHP with more than one approach or method (DEAHP-multiple approach), as illustrated in Table 6 with their categorization of application areas and specific problems. Two of the papers combined the fuzzy-set theory and the DEAHP with other different methods or approaches like TOPSIS (Rezaei-Shouroki et al., 2017) and QFD-LP (Kamvysi et al., 2014). There are three other journal articles that combined the DEAHP with multiple approaches, but have not considered fuzzy-set theory for integration with DEAHP. Moreover, these three other papers have integrated DEAHP with 2-Level SOM & AR (Yu & Lee, 2013), Delphi-LP (Raut, 2014) and QFD-DEANP (Kamvysi et al., 2010). Hence, two papers by Kamvysi et al. (2014) and Raut (2014) used the integrated DEAHP approach and LP approach along with other approaches. Again, there are IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 243 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 two papers about QFD-DEANP that used the integrated DEAHP approach and QFD approach along with other approaches (Kamvysi et al., 2010; Kamvysi et al. 2014). Table 6 The integrated DEAHP-multiple approaches and their applications Approach Authors Application areas Specific Problems DEAHP, FUZZY, QFD, LP Kamvysi et al. (2014) Higher education Course design evaluation and selection DEAHP, Delphi, LP Raut (2014) Pharmaceuticals Supplier evaluation and section DEAHP, 2-Level SOM, AR Yu & Lee (2013) Nano Technology Technological evaluation DEAHP, TOPSIS, FUZZY Rezaei-Shouroki et al. (2017) Energy Location Evaluation DEAHP, QFD, DEANP Kamvysi et al. (2010) Banking Service evaluation and selection Total 5 Yu & Lee (2013) applied the integrated DEAHP with 2 Level SOM & AR for the evaluation and selection of nano-technology. A method of AHP-rating was used for assessing the importance of emerging technology alternatives rather than pairwise comparison since there are a large number of alternatives that are independent to each other. The importance value was termed as the AHP score within this paper. Finally, the cumulative score of each emerging technology alternative was calculated using the suggested method by means of the addition of the scores of AHP and of DEA of the alternatives. The emerging technology alternatives’ cumulative scores indicate the most promising emerging technology. Rezaei-Shouroki et al. (2017) used integrated DEAHP with TOPSIS for evaluating and selecting locations for wind farm/wind energy. The method of DEA and a list of technical, economic and geological factors were utilized in this paper for prioritization and ranking of thirteen cities in the Fars’ province with respect to their appropriateness for the building of a wind farm. The validity of the obtained results was evaluated using FTOPSIS and AHP. Kamvysi et al. (2014) applied the integrated DEAHP-Fuzzy-QFD-LP in higher education to evaluate and select course design. The usage of a substitute alternate framework to prioritize the requirements of students was suggested and tested using QFD (quality density function). More explicitly, to account for the inherent subjectivity of human judgments, a Fuzzy-AHP and LP (LP-GW-AHP) method which is based on DEA was integrated with QFD (QFD-LP-GW-Fuzzy-AHP). Capturing and prioritizing the requirements of students with respect to the learning outcomes of courses within the academic course design’s process was evaluated on the effectiveness of the proposed framework. The robustness of the prioritization solution was assessed with a sensitivity analysis. The implications were discussed for the specifications of the design of the course. Kamvysi et al. (2010) applied the integrated DEAHP as QFD-DEAHP-DEANP in the Greek banking sector to evaluate the banking services so that the best selection could be presented to help customers choose their bank according to their preference of banking services mix. This article used DEAHP so that the relationship-matrix of IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 244 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 HOQ (house of quality) was completed. Also, a methodological framework to complete the roof matrix of HOQ was developed while using the DEAHP approach, and it was based on the DEA and ANP techniques which gave rise to DEANP. The implementation of QFD along with the abovementioned quantitative approaches was studied utilizing data from the Greek banking sector and a comparative analysis was conducted. The paper by Raut (2014) was applied to the pharmaceutical sector where the DEAHP was combined with the Delphi-LPP multi-criteria decision-making approach to select a supplier and to allocate a system for order quantity. The methodology which was based on integrated-Delphi-AHP-DEA-LPP (DADLP) was used. This methodology was organized into a four phases. The initial phase was the Delphi- method. In the Delphi method, a new and consistent scale for measurement was developed after identifying, synthesizing and prioritizing important factors and sub- factors of performance. The AHP and DEA-LP based MCDM was developed for both quantitative and qualitative factors in the selection of suppliers. The product characteristics were matched with supplier characteristics (using supplier ratings derived from pair wise comparisons) by the AHP method to determine the strategy of the supply-chain qualitatively. The efficient suppliers were evaluated and determined from the selected suppliers, mathematically using DEA. The variations of pair-wise comparisons in AHP will affect the final order quantity because AHP ratings are taken as input by LP and DEA. 6. Observations and discussions This literature review looked at 72 journal articles published between 2000 and 2018 that studied the stand-alone DEAHP approach and integrated DEAHP with other approaches. 31 articles were identified that applied the integrated DEAHP approach with other approaches, and the rest of the 41 articles concentrated on the stand-alone DEA/AHP approach without being associated with a third approach. Methods such as simulation, mathematical programming, fuzzy-set theory, and others were found to have been combined with the integrated DEAHP approach. Some of the articles used more than one approach (multiple approaches). The stand-alone DEAHP approach and integrated DEAHP along with other approaches are summarized in Tables 1 – 6 with their categorization of application areas and specific problems. Based on the categorization of these 72 journal articles, five questions can be answered: (1) Which integrated-DEAHP approach was most prevalent and received the utmost attention?, (2) Which areas of application were most often studied and found their application with integrated DEAHP approaches?, (3) Which of the specific problems were most frequently applied to integrated DEAHP approaches?, (4) What are the publications trends for the papers considering the integrated DEAHP approaches?, and (5) Which jourmals of international standards published how many journal articles and among them which have the highest number of articles on the approach of integrated DEAHP? Over and above answering these queries, this journal article also seeks to reiterate the work in Ho (2008) and, in some manner to further extend its work from integrated AHP to integrated DEAHP. 6.1 The most prevalent integrated-DEAHP approach The foremost query seeks to identify the most prevalent approach of integrated- DEAHP. As tabulated in Tables 2–5, 26 articles out of a total of 72 used the integrated DEAHP approach with only one method. However as shown in Table 6, in 5 of the articles two or more methods were integrated with the DEAHP approach IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 245 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 (also known as integrated DEAHP-multiple approaches). As observed in Tables 2–5, the fuzzy-set theory (14 out of 26 articles) was the most prevalent method integrated with the DEAHP, followed by mathematical programming (4 articles), simulation (1 article), and some others (7 articles), including VAHP (Voting AHP), TCO (Total cost of ownership), Gower plot, ABC (Activity Based Costing), SBM (Slacks-Based Measure), Assurance Region (AR), and Grey Relational Analysis (GRA). It can be seen from Table 6 that a varied number of integrated DEAHP-multiple approaches exist. A major part of these selected studies integrated the DEAHP with 2 methods (4 out of 5 articles), followed by 3 methods (1 article). As no single approach overpowers another in the combination, the most prevalent method applied in the integrated DEAHP-multiple approaches was determined by developing Table 7. The top three methods were fuzzy-set theory (2 out of 5 articles), LP which is a subset of mathematical programming (2 articles) and QFD (2 articles) which is followed by TOPSIS (1 article), AR (1 article), Delphi (1 article), DEANP (1 article) and 2-Level SOM (1 article) as shown in Table 7. Table 7 Summary of methods (other than DEAHP) used in the integrated DEAHP-multiple approaches Methods Number of Articles Authors Fuzzy set theory 2 Kamvysi et al. (2014), Rezaei-Shouroki et al. (2017) LP 2 Kamvysi et al. (2014), Raut (2014) QFD 2 Kamvysi et al. (2010), Kamvysi et al. (2014) TOPSIS 1 Rezaei-Shouroki et al. (2017) AR 1 Yu & Lee (2013) Delphi 1 Raut (2014) DEANP 1 Kamvysi et al. (2010) 2-Level SOM 1 Yu & Lee (2013) Based on the written and tabulated observations above, it can be seen that the integrated DEAHP-fuzzy approach gained major attraction and attention between 2009 and 2018. Furthermore, linear mathematical programming (LP), quality density function (QFD) and fuzzy-set theory were found to be commonly integrated with the DEAHP in the integrated DEAHP-multiple approaches. From Table 2, fuzzy set theory was integrated with DEAHP in 14 out of 31 journal articles. The key rationale is that the crisp pairwise-comparison in conventional DEAHP is unable to bear ambiguity or vagueness. Thus, in an uncertain pairwise-comparison environment, fuzzy-numbers and linguistic terms have been extensively used (Lee, 2009; Liang, 2015). Unambiguously, the fuzzy-set theory has the additional benefit of being similar to human-reasoning in its use of approximate information and uncertainty to address MCDM problems when information is incomplete and imprecise (Chan & Kumar, 2007). 6.2 The most frequently studied area of application The next query aimed to find out the most frequently studied area of application. As illustrated in Table 8, there are 28 application areas and 1 literature review that has IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 246 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 been applied to different fields. Among the application areas mentioned in Table 8, manufacturing has attracted the maximum attention, followed by logistics, government, energy, higher education, electronics, multiple industries, airlines, banking, environment, iron/steel, financial, telecommunications, business administration, construction, defence industry, e-commerce, healthcare, hotel industry, human resource, nano-technology, pharmaceuticals, process, R & D, railways, rental cars, supply chain management and tourism sectors. One paper was a literature review paper. Among 16 articles dedicated to the manufacturing sector, the approach of the fuzzy- set theory was extensively used in combination with DEAHP, including 3 integrated DEAHP-fuzzy approaches and 2 integrated DEAHP-goal programming approach (DEAHP-mathematical programming). Table 8 Summary of application areas Application areas Approaches Number of articles Sub-Total Authors Airlines DEA-AHP (General) 1 2 Foroughia & Esfahani (2012) DEAHP-AR 1 Lai et al. (2015) Banking DEA-AHP (General) 2 3 Pakkar (2015) Omid & Zegordi (2011) DEAHP-QFD- DEANP 1 Kamvysi et al. (2010) Business Administration DEAHP-Gower Plot 1 1 Li & Ma (2008) Construction DEAHP-Fuzzy 1 1 Loron et al. (2015) Defence Industry DEA-AHP (General) 1 1 Moon & Kang (2015) E-Commerce DEA-AHP (General) 1 1 Aji & Hariga (2013) Electronics DEA-AHP (General) 2 3 Tseng & Lee (2009) Yang & Kuo (2003) DEAHP-ABC 1 Zhang et al. (2011) Energy DEA-AHP (General) 1 5 Kasap & Kiriş (2010) DEAHP-Fuzzy 3 Lee et al. (2011) Lee et al. (2013) Lee et al. (2017) DEAHP- TOPSIS-Fuzzy 1 Rezaei-Shouroki et al. (2013) IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 247 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 Environment DEA-AHP (General) 1 2 Kavurmaci & Üstün (2016) DEAHP-SBM 1 Yuan et al. (2013) Financial DEA-AHP (General) 1 2 Cai & Wua (2001) DEAHP-Fuzzy 1 Che et al. (2010) Government DEA-AHP (General) 4 5 Lin et al. (2011) Pakkar (2016) Saen et al. (2018) Takamura & Tone (2005) DEAHP-Fuzzy 1 Çalik et al. (2003) Healthcare DEA-VAHP 1 1 Soltanifar & Lotfi (2011) Higher education DEA-AHP (General) 4 5 Antonio et al. (2014) Wang et al. (2008) Wang & Chin (2009) Mirhedayatian & Saen (2011) DEAHP-Fuzzy- QFD-LP 1 Kamvysi et al. (2012) Hotel DEA-AHP (General) 1 1 Shirouyehzad et al. (2013) Human resource DEA-AHP (General) 1 1 Singh & Aggarwal (2014) Iron / Steel DEA-AHP (General) 1 2 Pakkar (2014) DEAHP-GRA 1 Prasad et al. (2017) Literature Review DEA-AHP (General) 1 1 Ho (2008) Logistics DEA-AHP (General) 3 6 Kengpol & Tuammee (2015) Lozano & Villa (2009) Zhang & Fu (2012) DEAHP-Fuzzy 2 Li et al. (2016) Gupta et al. (2018) DEAHP-LP 1 Falsini et al. (2012) Manufacturing DEA-AHP (General) 11 16 Ahmad et al. (2006) Amin & Toloo (2007) Omid & Zegordi (2015) IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 248 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 Hadad & Hanani (2011) Zarei et al. (2012) Saleeshya & Babu (2012) Sevkli et al. (2007) Sinuany-Stern et al. (2000) Wang et al. (2008) Yadav & Sharma (2015) Ertay et al. (2011) DEAHP-Fuzzy 3 Hadi-Vencheh & Mohamadghasemi (2010) Kuo et al. (2009) Parameshwaran et al. (2012) DEAHP-GP 2 Jatuphatwarodom et al. (2018) Kumar & Babu (2012) Multiple Industries DEA-AHP (General) 1 3 Ramanathan (2006) DEAHP-Fuzzy 1 Alem et al. (2013) DEAHP-LP 1 Wang et al. (2008) Nano Technology DEAHP-AR-2 Level SOM 1 1 Yu & Lee (2013) Pharmaceuticals DEAHP- Delphi-LPP 1 1 Raut (2014) Process DEA-AHP (General) 1 1 Korpela et al. (2007) R & D DEA-AHP (General) 1 1 Banwet & Deshmukh (2008) Railways DEAHP- Simulation 1 1 Azadeh et al. (2008) Rental cars DEA-AHP (General) 1 1 Sueyoshi et al. (2009) Supply chain management DEAHP-TCO 1 1 Ramanathan (2007) Telecommunication DEA-AHP (General) 1 2 Giokas & Pentzaropoulos (2008) DEAHP-Fuzzy 1 Kumar et al. (2014) Tourism DEAHP-Fuzzy 1 1 Huang & Chi (2015) Total 72 72 IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 249 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 A graphical representation of the application areas and corresponding number of articles is summarized below. Figure 3 Summary of application areas and their corresponding number of articles 6.3 The most frequently studied specific problem The third query aimed to discover the most frequently studied specific problem. Table 9 shows that 1 literature review and 19 problems were studied. The problem of performance evaluation & efficiency measurement gained the maximum attention, followed by evaluation and supplier selection, evaluation of a business unit, evaluation of a process, evaluation and selection of an expert, evaluation of a location, selection of a facility layout, allocation of resources, evaluation and selection of a project/program, evaluation and selection of a product, evaluation and selection of a service, technological evaluation, multiplicative aggregation of financial ratios, course design evaluation and selection, inventory control (multiple criteria ABC inventory classification), multiple problem areas, personal productivity evaluation, quality evaluation and risk assessment. One paper was developed as a literature review. 18 of 72 articles addressed performance evaluation and efficiency measurement out of which 5 articles applied integrated DEAHP which includes 2 papers with integrated DEAHP-fuzzy approach, 1 paper with integrated DEAHP-AR, 1 paper with integrated DEA-VAHP and 1 paper with integrated DEAHP-simulation. 2 3 1 1 1 1 3 5 2 2 5 1 5 1 1 2 1 6 16 3 1 1 1 1 1 1 1 2 1 0 2 4 6 8 10 12 14 16 18 A ir li n e s B a n k in g B u si n e ss A d m in is tr a ti o n C o n st ru ct io n D e fe n ce I n d u st ry E -C o m m e rc e E le ct ro n ic s E n e rg y E n v ir o n m e n t F in a n ce G o v e rn m e n t H e a lt h ca re H ig h e r e d u ca ti o n H o te l H u m a n r e so u rc e Ir o n / S te e l Li te ra tu re R e v ie w Lo g is ti cs M a n u fa ct u ri n g M u lt ip le I n d u st ri e s N a n o T e ch n o lo g y P h a rm a ce u ti ca ls P ro ce ss R & D R a il w a y s R e n ta l ca rs S u p p ly c h a in m a n a g e m e n t T e le co m m u n ic a ti o n T o u ri sm N u m b e r o f A rt ic le s Application areas IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 250 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 Table 9 Summary of specific problems Specific Problems Approaches Number of articles Sub-Total Authors Business unit evaluation DEA-AHP (General) 9 11 Foroughia & Esfahani (2012) Ahmad et al. (2006) Korpela et al. (2007) Kasap & Kiriş (2013) Shirouyehzad et al. (2013) Kengpol & Tuammee (2015) Lozano & Villa (2009) Saleeshya & Babu (2012) Sueyoshi et al. (2009) DEAHP- Fuzzy 2 Li et al. (2016) Parameshwaran et al. (2009) Course design evaluation and selection DEAHP- Fuzzy-QFD- LP 1 1 Kamvysi et al. (2014) Expert evaluation and selection DEA-AHP (General) 3 4 Wang et al. (2008) Wang & Chin (2009) Mirhedayatian & Saen (2011) DEAHP- Fuzzy 1 Kumar et al. (2014) Facility Layout Selection DEA-AHP (General) 3 3 Yang & Kuo (2003) Amin & Toloo (2007) Ertay et al. (2006) Inventory control (multiple criteria ABC inventory classification) DEAHP- Fuzzy 1 1 Hadi-Vencheh & Mohamadghasemi (2011) Literature Review DEA-AHP (General) 1 1 Ho (2008) Location Evaluation DEA-AHP (General) 1 4 Takamura & Tone (2003) DEAHP- Fuzzy 1 Huang & Chi (2015) DEAHP- TOPSIS- Fuzzy 1 Rezaei-Shouroki et al. (2017) IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 251 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 DEAHP- Gower plot 1 Li & Ma (2008) Multiple Problem Areas DEAHP-LP 1 1 Wang et al. (2008) Multiplicative aggregation of financial ratios DEA-AHP (General) 1 1 Pakkar (2015) Performance evaluation & Efficiency measurement DEA-AHP (General) 13 18 Lin et al. (2011) Pakkar (2016) Saen et al. (2005) Antonio et al. (2012) Singh & Aggarwal (2014) Pakkar (2014) Zhang &Fu (2012) Omid & Zegordi (2015) Zarei et al. (2012) Sinuany-Stern et al. (2000) Ramanathan (2006) Banwet & Deshmukh (2008) Giokas & Pentzaropoulos (2008) DEAHP- Fuzzy 2 Çalik et al. (2018) Alem et al. (2013) DEAHP-AR 1 Lai et al. (2015) DEA-VAHP 1 Soltanifar & Lotfi (2011) DEAHP- Simulation 1 Azadeh et al. (2008) Personal productivity evaluation DEA-AHP (General) 1 1 Azadeh et al. (2011) Process evaluation DEA-AHP (General) 2 4 Tseng & Lee (2009) Cai & Wua (2001) DEAHP- Fuzzy 2 Lee et al. (2010) Che et al. (2010) Product evaluation and selection DEA-AHP (General) 1 1 Hadad & Hanani (2011) IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 252 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 Service evaluation and selection DEAHP- QFD- DEANP 1 1 Kamvysi et al. (2010) Project/program evaluation and selection DEAHP- Fuzzy 2 2 Loron et al. (2015) Gupta et al. (2018) Quality evaluation DEA-AHP (General) 1 1 Kavurmaci & Üstün (2016) Resource allocation DEAHP- Fuzzy 1 2 Lee et al. (2013) DEAHP- SBM 1 Yuan et al. (2013) Risk assessment DEA-AHP (General) 1 1 Wang et al. (2008) Supplier evaluation and selection DEA-AHP (General) 4 12 Moon & Kang (2015) Aji & Hariga (2013) Sevkli et al. (2007) Yadav & Sharma (2015) DEAHP- Fuzzy 1 Kuo et al. (2010) DEAHP-LP 1 Falsini et al. (2012) DEAHP-GP 2 Jatuphatwarodom et al. (2018) Kumar & Babu (2012) DEAHP- Delphi-LPP 1 Raut (2014) DEAHP- ABC 1 Zhang et al. (2011) DEAHP- GRA 1 Prasad et al. (2017) DEAHP- TCO 1 Ramanathan (2007) Technological evaluation DEAHP- Fuzzy 1 2 Lee et al. (2011) DEAHP- AR-2 Level SOM 1 Yu & Lee (2013) Total 72 72 IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 253 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 A graphical representation of specific problems and corresponding number of articles is summarized below. Figure 4 Summary of specific problems and their corresponding number of articles 6.4 Publication trends Table 10 presents the distribution of the 72 journal papers over the last two decades (19 years to be precise) for both stand-alone DEAHP and integrated DEAHP with other approaches. 11 1 4 3 1 1 4 1 1 18 1 4 1 1 2 1 2 1 12 2 0 2 4 6 8 10 12 14 16 18 20 B u si n e ss u n it e va lu a ti o n C o u rs e d e si g n e v a lu a ti o n a n d s e le ct io n E xp e rt e v a lu a ti o n a n d s e le ct io n F a ci li ty L a y o u t S e le ct io n In v e n to ry c o n tr o l Li te ra tu re R e v ie w Lo ca ti o n E va lu a ti o n M u lt ip le P ro b le m A re a s M u lt ip li ca ti v e a g g re g a ti o n o f fi n a n ci a l ra ti o s P e rf o rm a n ce e v a lu a ti o n & E ff ic ie n cy m e a su re m e n t P e rs o n a l p ro d u ct iv it y e v a lu a ti o n P ro ce ss e v a lu a ti o n P ro d u ct e v a lu a ti o n a n d s e le ct io n S e rv ic e e v a lu a ti o n a n d s e le ct io n P ro je ct /p ro g ra m e v a lu a ti o n a n d s e le ct io n Q u a li ty e va lu a ti o n R e so u rc e a ll o ca ti o n R is k a ss e ss m e n t S u p p li e r e v a lu a ti o n a n d s e le ct io n T e ch n o lo g ic a l e v a lu a ti o n N u m b e r o f A rt ic le s Specific Problems IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 254 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 Table 10 Distribution of the number of journal articles since 2000 Number of articles Standalone DEA/AHP approach Integrated DEAHP approach Years Integration with no method Integration with one method Integration with multiple methods Total 2000 1 0 0 1 2001 1 0 0 1 2002 0 0 0 0 2003 2 0 0 2 2004 0 0 0 0 2005 1 0 0 1 2006 3 0 0 3 2007 3 1 0 4 2008 5 3 0 8 2009 4 1 0 5 2010 0 3 1 4 2011 4 4 0 8 2012 5 2 0 7 2013 3 3 1 7 2014 2 1 2 5 2015 5 3 0 8 2016 2 1 0 3 2017 0 1 1 2 2018 1 3 0 2 Total 26 5 72 41 31 There are 41 articles that considered stand-alone DEAHP with the integration of no other approach to be sufficient to address the paper’s problem definition. However, there are 31 journal articles that specifically applied integrated DEAHP approaches. Out of these 31 articles which have applied integrated DEAHP, there are 26 articles which have integrated DEAHP with only one method. 5 papers found the need for more than one approach to be integrated with DEAHP to satisfy the problem definition. The articles for the stand-alone DEAHP were published between 2000 to 2018. There are 31 journal articles for the integrated DEAHP approach from 2007 to 2018. Based on Table 10, it is clearly visible that stand-alone DEAHP has been equally used in terms of numbers of articles published in both decades. It cannot be overlooked that there were no papers published before 2006 for the integrated DEAHP approach, but this fact is substantiated with the increase in the number of publications on the subject after 2007. Also, in 2010, papers with the integration of multiple approaches to DEAHP began to be published. Papers with integrated DEAHP approaches have attracted more attention since 2007 and it is estimated that it will continue to do the same after 2018 with the changing needs of the competitive business environment. IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 255 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 A graphical representation of publication trends and corresponding number of articles is summarized below. Figure 5 Summary of publication trends and their corresponding number of articles 1 1 2 1 3 3 5 4 4 5 3 2 5 2 1 3 1 3 4 2 3 1 3 1 1 3 1 1 2 1 0 1 2 3 4 5 6 2 0 0 0 2 0 0 1 2 0 0 2 2 0 0 3 2 0 0 4 2 0 0 5 2 0 0 6 2 0 0 7 2 0 0 8 2 0 0 9 2 0 1 0 2 0 1 1 2 0 1 2 2 0 1 3 2 0 1 4 2 0 1 5 2 0 1 6 2 0 1 7 2 0 1 8 N u m b e r o f A rt ic le s Year of Publication Standalone DEA/AHP approach (Integration with no method) Integration with one method IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 256 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 6.5 The most frequently published journal Table 11 lists all of the international journals in which integrated DEAHP and stand- alone DEAHP approaches were published. Table 11 Summary of journals Journals Number of articles Authors African Journal of Business Management 1 Antonio et al. (2012) American Journal of Operations Research 1 Pakkar (2014) Annals of Operations Research 1 Jatuphatwarodom et al. (2018) Applied Mathematics and Computation 2 Saen et al. (2005), Azadeh et al. (2008) Computers & Industrial Engineering 3 Amin & Toloo (2007), Wang et al. (2008), Soltanifar & Lotfi (2011) Computers & Operations Research 3 Ramanathan (2006), Wang et al. (2008), Lozano & Villa (2009) Decision Science Letters 1 Omid & Zegordi (2015) Decision Support Systems 1 Wang et al. (2008) Energy Sources, Part B: Economics, Planning, and Policy 1 Kasap & Kiriş (2013) Environmental Monitoring and Assessment 1 Kavurmaci & Üstün (2016) European Journal of Industrial Engineering 1 Parameshwaran et al. (2009) European Journal of Operational Research 6 Yang & Kuo (2003), Ho (2008), Sueyoshi et al. (2009), Wang & Chin (2009), Lin et al. (2011), Kamvysi et al. (2014) Expert Systems with Applications 5 Tseng & Lee (2009), Che et al. (2010), Hadi-Vencheh & Mohamadghasemi (2011), Azadeh et al. (2011), Yu & Lee (2013) Information Sciences 1 Ertay et al. (2006) International Journal of Applied Decision Sciences 1 Aji & Hariga (2013) International Journal of Business and Systems Research 1 Saleeshya & Babu (2012) International Journal of Hydrogen Energy 3 Lee et al. (2010), Lee et al. (2011), Rezaei-Shouroki et al. (2017) International Journal of Information Technology & Decision Making 2 Ahmad et al. (2006), Li & Ma (2008) International Journal of Logistics Systems and Management 2 Hadad & Hanani (2011), Raut (2014) International Journal of Operational Research 1 Alem et al. (2013) IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 257 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 International Journal of Production Economics 1 Korpela et al. (2007) International Journal of Production Research 4 Sevkli et al. (2007), Zhang et al. (2011), Falsini et al. (2012), Kengpol & Tuammee (2015) International Journal of Productivity and Performance Management 1 Banwet & Deshmukh (2008) International Journal of Productivity and Quality Management 1 Shirouyehzad et al. (2013) International Journal of Services and Operations Management 1 Kumar & Babu (2012) International Journal of Simulation: Systems, Science & Technology 1 Huang & Chi (2015) International Journal On Advances in Information Sciences and Service Sciences 1 Zhang & Fu (2012) International Transactions in Operational Research 2 Sinuany-Stern et al. (2000), Cai & Wua (2001) Journal of Applied Operational Research 1 Pakkar (2015) Journal of Enterprise Information Management 1 Yadav & Sharma (2015) Journal of Information and Communication Convergence Engineering 1 Moon & Kang (2015) Journal of the Operational Research Society 1 Mirhedayatian & Saen (2011) Journal of the Operations Research Society of China 1 Singh & Aggarwal (2014) Journal of Traffic and Transportation Engineering 1 Li et al. (2016) Management Science Letters 2 Foroughia & Esfahani (2012), Zarei et al. (2012) Mitigation and Adaptation Strategies for Global Change 1 Yuan et al. (2013) Production Planning & Control: The Management of Operations 1 Kuo et al. (2010) Renewable and Sustainable Energy Reviews 1 Lee et al. (2013) Resources Policy 1 Gupta et al. (2018) Socio-Economic Planning Sciences 1 Takamura & Tone (2003) Supply Chain Management 1 Ramanathan (2007) Systems 1 Pakkar (2016) Technological and Economic Development of Economy 1 Çalik et al. (2018) Telecommunications Policy 1 Giokas et al. (2008) Telematics and Informatics 1 Kumar et al. (2014) The Journal Tehnički vjesnik – Technical Gazette (TV-TG) 1 Loron et al. (2015) TheTQM Journal 1 Kamvysi et al. (2010) Transport Policy 1 Lai et al. (2015) Uncertain Supply Chain Management 1 Prasad et al. (2017) Total 72 IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 258 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 Of the existing 49 journals, 26 have published articles that applied integrated DEAHP and 31 have published articles that applied stand-alone DEAHP. The top three highlighted journals for publication of works related to DEAHP and integrated DEAHP are European Journal of Operational Research, followed by Expert Systems with Applications, and International Journal of Production Research. There is a clear indication that stand-alone DEAHP and integrated DEAHP are spreading their wings in journals of different fields while exploring different application areas. 7. Future work There is still space for integrated-DEAHP approaches, mainly when the integrations are with multiple methods. There are many areas where integrated DEAHP can be applied to the marketing sector which have not yet been touched by the integrated DEAHP approach. Hence, some recommendations can be pushed for newer applied working areas of the integrated DEAHP approaches. For example, risk management in the supply-chain is considered one of the trending research topics in the field of supply-chain management/operations and it has gained a substantial amount of attention (Ho et al., 2015). Yet, the amalgamation of both downstream and upstream strategies of risk-mitigation in the selection of suppliers has not been studied to a great extent (Ho et al., 2015). Hence, we propose to apply the integration of DEAHP with other approaches in unexplored application areas. For instance, integrated DEAHP approaches could be explored in retail space optimization and allocation for better and more efficiently performing stores. The ultimate aim is to maximize the utilization of the total space available in the planning period and minimize the total cost. Furthermore, we propose the application of the integration of DEAHP to TCO (total cost of ownership), green initiatives, and CSR (corporate social responsibility) for developing a sustainability performance management model which will be holistic in nature for the assessment of suppliers of sustainable SMEs (small and medium- sized enterprise) in emerging economies. Additionally, a procurement contract could be designed by a game model so that the mutual benefits of both the suppliers and the manufacturers could be maximized. 8. Conclusion This paper reviewed the literature on the approaches with integrated-DEAHP and stand-alone DEAHP along with their applications which were published between 2000 and 2018. This paper uses the criteria for search and filtration which was previously used in Ho (2008). Researchers were able to gain insights about the noteworthy and state-of-the-art integrated-DEAHP approaches and their respective applications from this criterion. Moreover, they can be equipped with valuable acumen for the application, development and publishing of novel integrated-DEAHP approaches in high-ranking journals. The summarized findings of this article, in a nutshell, can be outlined as follows. First, the integrated-DEAHP-fuzzy approach became the most prevalent between 2000 and 2018. Second, the most widespread area of application is the manufacturing sector. Third, the problem area of performance evaluation and efficiency measurement is the most commonly studied problem. This is predictable, but also logical that integration of DEAHP with more than one method will gain more academic attraction and attention. In the the end, it is recommended that a few nascent areas of applications for newer integrations of IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 259 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 DEAHP be explored. These areas and integrations could assist researchers in filling research gaps in the available literature. IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 260 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 REFERENCES Ahmad, N., Berg, D., & Simons, G. R. (2006). The integration of Analytical Hierarchy Process and Data Envelopment Analysis in a Multi-Criteria Decision- Making problem. International Journal of Information Technology & Decision Making, 5(2), 263-276. Doi: 10.1142/S0219622006001940 Aji, Y., & Hariga, M. (2013). An AHP-DEA-based vendor selection approach for an online trading platform. International Journal of Applied Decision Sciences, 6(1), 2013. Doi: https://doi.org/10.1504/IJADS.2013.052633 Alem, S. M., Jolai, F., & Shirkouhi, S. N. (2013). An integrated fuzzy DEA-fuzzy AHP approach: a new model for ranking decision-making units. International Journal of Operational Research, 17(1), 2013. Doi: https://doi.org/10.1504/IJOR.2013.053187 Amin, G. R. & Toloo, M. (2007). Finding the most efficient DMUs in DEA: An improved integrated model. Computers and Industrial Engineering, 52(2), 71-77. Doi: https://doi.org/10.1016/j.cie.2008.07.014 Antonio, A. C., Domingo, G. M., Humberto, B. O., Alvaro, L. L., Alvaro, L. R. & Rebeca del Rocío, P. V. (2012). Measuring the institutional efficiency using data envelopment analysis and analytic hierarchy process: The case of a Mexican University. African Journal of Business Management, 6(50), 11923–11930. Doi: https://doi.org/10.5897/AJBM10.770 Azadeh, A., Ghaderi, S. F., & Izadbakhsh, H. (2008). Integration of DEA and AHP with computer simulation for railway system improvement and optimization. Applied Mathematics and Computation, 195(2), 775–785. Doi: https://doi.org/10.1016/j.amc.2007.05.023 Azadeh, A., Ghaderi, S. F., Mirjalili, M., & Moghaddam, M. (2011). Integration of analytic hierarchy process and data envelopment analysis for assessment and optimization of personnel productivity in a large industrial bank. Expert Systems with Applications, 38(5), 5212-5225. Doi: https://doi.org/10.1016/j.eswa.2010.10.038 Bana e Costa, C. A., & Vansnick, J. C. (2008). A critical analysis of the eigenvalue method used to derive priorities in AHP. European Journal of Operational Re- search, 187(3), 1422–1428. Banwet, J. D. K., Deshmukh, S. G. (2008). Evaluating performance of national R&D organizations using integrated DEA-AHP technique. International Journal of Productivity and Performance Management, 57, 405–419. Doi: https://doi.org/10.1108/17410400810881836 Cai, Y., & Wu, W. (2001). Synthetic financial evaluation by a method of combining DEA with AHP. International Transactions in Operational Research, 8, 603-609. Doi: http://dx.doi.org/10.1111/1475-3995.00336 Çalik, A., Yapici Pehlivan, N., & Kahraman, C. (2018). An integrated fuzzy AHP/DEA approach for performance evaluation of territorial units in Turkey. Technological and Economic Development of Economy, 24(4), 2018. Doi: IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 261 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 https://doi.org/10.3846/20294913.2016.1230563 Chan, F. T. S. & Kumar, N. (2007). Global supplier development considering risk factors using fuzzy extended AHP-based approach. Omega, 35(4), 417–431. Doi: https://doi.org/10.1016/j.omega.2005.08.004 Charnes, A., Cooper, W. W., & Rhodes, E. (1978). Measuring the efficiency of decision-making units. European Journal of Operational Research, 2(6), 429-444. Doi: https://doi.org/10.1016/0377-2217(78)90138-8 Che, Z. H., Wang, H. S., & Chuang, C. L. (2010). A fuzzy AHP and DEA approach for making bank loan decisions for small and medium enterprises in Taiwan. Expert Systems with Applications, 37(10),7189-7199. Doi: https://doi.org/10.1016/j.eswa.2010.04.010 Emrouznejad, A., Parker, B.R., Tavates, G. (2008). Evaluation of research in efficiency and productivity: A survey and analysis of the first 30 years of scholarly literature in DEA. Socio-Economic Planning Sciences, 42, 151–157. Doi: https://doi.org/10.1016/j.seps.2007.07.002 Emrouznejad A, Thanassoulis E. (1996a). An extensive bibliography of Data Envelopment Analysis (DEA), Vol. I: Working Paper 244, 1–55. Emrouznejad A, Thanassoulis E. (1996b). An extensive bibliography of Data Envelopment Analysis (DEA), Vol. II: Working Paper 245, 1–21. Emrouznejad A, Thanassoulis E. (1997). An extensive bibliography of Data Envelopment Analysis (DEA), Vol. III: Supplement 1, Working Paper 258, 1–24. Emrouznejad, A., & Yang, G. L., (2017). A survey and analysis of the first 40 years of scholarly literature in DEA: 1978–2016. Socio-Economic Planning Sciences, 61(2018), 4-8. Doi: http://dx.doi.org/10.1016/j.seps.2017.01.008 Ertay, T., Ruan, D., & Tuzkaya, U. R. (2006). Integrating data envelopment analysis and analytic hierarchy for the facility layout design in manufacturing systems. Information Sciences, 176(3), 237-262. Doi: https://doi.org/10.1016/j.ins.2004.12.001 Falsini, D., Fondi, F., & Schiraldi, M. M. (2012). A logistics provider evaluation and selection methodology based on AHP, DEA and linear programming integration. International Journal of Production Research, 50(17), 4822-4829. Doi: https://doi.org/10.1080/00207543.2012.657969 Foroughi, A., & Esfahani, M. J. (2012). A robust AHP-DEA method for measuring the relative efficiency: An application of airport industry. Management Science Letters, 2(2012), 93-100. Doi: https://doi.org/10.5267/j.msl.2011.09.018 Gattoufi, S., Oral, M.,& Reisman, A. (2004a). A taxonomy for Data Envelopment Analysis. Socio-Economic Planning Sciences, 38(2–3), 141–158. Doi: https://doi.org/10.1016/s0038-0121(03)00022-3 Gattoufi, S., Oral, M., & Reisman, A. (2004b). Data Envelopment Analysis literature: a bibliography update (1996–2001). Socio-Economic Planning Sciences, 38(2–3), IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 262 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 122–159. Doi: https://doi.org/10.1016/s0038-0121(03)00023-5 Giokas, D. I., & Pentzaropoulos, G. C. (2008). Efficiency ranking of the OECD member states in the area of telecommunications: A composite AHP/DEA study. Telecommunications Policy, 32(9-10), 672-685. Doi: https://doi.org/10.1016/j.telpol.2008.07.007 Gupta, P., Mehlawat, M. K., Aggarwal, U., & Charles, V. (2018). An integrated AHP-DEA multi-objective optimization model for sustainable transportation in mining industry. Resources Policy. Doi: https://doi.org/10.1016/j.resourpol.2018.04.007 Hadad, Y., & Hanani, M. Z. (2011). Combining the AHP and DEA methodologies for selecting the best alternative. International Journal of Logistics Systems and Management, 9(3), 251-267. Doi: https://doi.org/10.1504/IJLSM.2011.041687 Hadi-Vencheh, A., & Mohamadghasemi, A. (2011). A fuzzy AHP-DEA approach for multiple criteria ABC inventory classification. Expert Systems with Applications, 38(4), 3346-3352. Doi: https://doi.org/10.1016/j.eswa.2010.08.119 Ho, W. (2008). Integrated analytic hierarchy process and its applications - A literature review. European Journal of Operational Research, 186(1), 211-228. Doi: https://doi.org/10.1016/j.ejor.2007.01.004 Ho, W., & Ma, X. (2018). The state-of-the-art integrations and applications of the analytic hierarchy process. European Journal of Operational Research, 267(2), 399- 414. Doi: https://doi.org/10.1016/j.ejor.2017.09.007 Ho, W., Zheng, T., Yildiz, H., & Talluri, S. (2015) Supply chain risk management: a literature review. International Journal of Production Research, 53(16), 5031-5069. Doi: https://doi.org/10.1080/00207543.2015.1030467 Huang, D., & Chi, X. (2015). Application of Delphi-AHP-DEA-FCE model in competitiveness evaluation of sports tourism destination. International Journal of Simulation: Systems, Science and Technology, 16(1B), 20.1-20.5. Doi: https://doi.org/10.5013/IJSSST.a.16.1B.20 Jatuphatwarodom, N., Jones, D. F., & Ouelhadj, D. (2018). A mixed-model multi- objective analysis of strategic supply chain decision support in the Thai silk industry. Annals of Operations Research, 267(1-2), 221-247. Doi: https://doi.org/10.1007/s10479-018-2774-6 Kamvysi, K., Gotzamani, K., Georgiou, A. C., & Andronikidis, A. (2010) Integrating DEAHP and DEANP into the quality function deployment. The TQM Journal. 22 (3), 293-316. Doi: https://doi.org/10.1108/17542731011035532 Kamvysi, K., Gotzamani, K., Andronikidis, A., & Georgiou, A. C. (2014). Capturing and prioritizing students’ requirements for course design by embedding Fuzzy-AHP and linear programming in QFD. European Journal of Operational Research, 237(1), 177-195. Doi: https://doi.org/10.1016/j.ejor.2014.02.041 Kasap, Y., & Kiriş, Ş. (2013). An AHP-DEA approach for evaluating electricity IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 263 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 generation firms of OECD countries. Energy Sources, Part B: Economics, Planning and Policy, 8(2), 200-208. Doi: https://doi.org/10.1080/15567249.2011.647241 Kavurmaci, M., & Üstün, A. K. (2016). Assessment of groundwater quality using DEA and AHP: a case study in the Sereflikochisar region in Turkey. Environmental Monitoring and Assessment, 188, 258. Doi: https://doi.org/10.1007/s10661-016-5259- 6 Kengpol, A., & Tuammee, S. (2015). The development of a decision support framework for a quantitative risk assessment in multimodal green logistics: an empirical study. International Journal of Production Research, 54(4), 1020-1048. Doi: https://doi.org/10.1080/00207543.2015.1041570 Korpela, J., Lehmusvaara, A., & Nisonen, J. (2007). Warehouse operator selection by combining AHP and DEA methodologies. International Journal of Production Economics, 108(1-2), 135-142. Doi: https://doi.org/10.1016/j.ijpe.2006.12.046 Kulakowski, K. (2015). Notes on order preservation and consistency in AHP. European Journal of Operational Research, 245(1), 333–337. Doi: https://doi.org/10.1016/j.ejor.2015.03.010 Kumar, A., Debnath, R. M., Shankar, R., & Prabhu, J., (2014). Analyzing customer preference and measuring relative efficiency in telecom sector: A hybrid fuzzy AHP/DEA study. Telematics and Informatics, 32(3), 447-462. Doi: https://doi.org/10.1016/j.tele.2014.10.003 Kumar, K. S., & Babu, A. S. (2012). An integrated method using AHP, DEA and GP for evaluating supply sources. International Journal of Services and Operations Management, 11(2), 123-150. Doi: https://dx.doi.org/10.1504/IJSOM.2012.045196 Kuo, R. J., Lee, L. Y., & Hu, T. L. (2010). Developing a supplier selection system through integrating fuzzy AHP and fuzzy DEA: A case study on an auto lighting system company in Taiwan. Production Planning and Control: The Management of Operations, 21(5), 468-484.Doi: https://doi.org/10.1080/09537280903458348 Lai, P. L., Potter, A., Beynon, M., & Beresford, A. (2015). Evaluating the efficiency performance of airports using an integrated AHP/DEA-AR technique. Transport Policy, 42(2015), 75-85. Doi: https://doi.org/10.1016/j.tranpol.2015.04.008 Lee, A. H. I. (2009). A fuzzy AHP evaluation model for buyer–supplier relationships with the consideration of benefits, opportunities, costs and risks. International Journal of Production Research, 47(15), 4255–4280. Doi: https://doi.org/10.1080/00207540801908084 Lee, S. K., Mogi, G., & Hui, K. S. (2013). A fuzzy analytic hierarchy process (AHP)/data envelopment analysis (DEA) hybrid model for efficiently allocating energy R&D resources: In the case of energy technologies against high oil prices. Renewable and Sustainable Energy Reviews, 21(2013), 347- 355. Doi: https://doi.org/10.1016/j.rser.2012.12.067 Lee, S. K., Mogi, G., Lee, S. K., Hui, K. S., Kim, J. W. (2010). Econometric analysis of the R&D performance in the national hydrogen energy technology development IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 264 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 for measuring relative efficiency: The fuzzy AHP/DEA integrated model approach. International Journal of Hydrogen Energy, 35(6), 2236-2246. Doi: https://doi.org/10.1016/j.ijhydene.2010.01.009 Lee, S. K., Mogi, G., Li, Z., Hui, K. S., Lee S. K., Hui, K. N., Park, S. Y., Ha, Y. J., & Kim, J. W. (2011). Measuring the relative efficiency of hydrogen energy technologies for implementing the hydrogen economy: An integrated fuzzy AHP/DEA approach. International Journal of Hydrogen Energy, 36(20), 12655- 12663. Doi: https://doi.org/10.1016/j.ijhydene.2011.06.135 Li, H. L., & Ma, L. C. (2008). Ranking decision alternatives by integrated DEA, AHP and Gower Plot Techniques. International Journal of Information Technology & Decision Making,7(2), 241-258. Doi: https://doi.org/10.1142/S0219622008002922 Li, X., Liu, Y., Wang, Y., & Gao, Z. (2016). Evaluating transit operator efficiency: An enhanced DEA model with constrained fuzzy-AHP cones. Journal of Traffic and Transportation Engineering (English Edition, 3(3), 215-225. Doi: https://doi.org/10.1016/j.jtte.2016.05.004 Liang, Y. H. (2015). Performance measurement of interorganizational information systems in the supply chain. International Journal of Production Research, 53(18), 5484–5499. Doi: https://doi.org/10.1080/00207543.2015.1026614 Lin, M. I., Lee, Y. D., & Ho, T. N. (2011). Applying integrated DEA/AHP to evaluate the economic performance of local governments in China. European Journal of Operational Research, 209(2), 129-140. Doi: https://doi.org/10.1016/j.ejor.2010.08.006 Loron, A. S., Loron, M. S., & Peyvandi, G. (2015) An integrated Fuzzy Analytic Hierarchy Process-Fuzzy Data Envelopment Analysis (FAHP-FDEA) method for intelligent building assessment. The Journal Tehnički vjesnik – Technical Gazette (TV-TG), 2(2015), 383-389. Doi: https://doi.org/10.17559/TV-20140418223907 Lozano, S., & Villa, G. (2009). Multiobjective target setting in data envelopment analysis using AHP. Computers & Operations Research, 36(2), 549-564. Doi: https://doi.org/10.1016/j.cor.2007.10.015 Mirhedayatian, S. M., & Saen, R. F. (2011). A new approach for weight derivation using data envelopment analysis in the analytic hierarchy process. Journal of the Operational Research Society, 62, 1585–1595. Doi: https://doi.org/10.1057/jors.2010.105 Moon, J. & Kang S. (2015). An integrated DEA -AHP model for the acquisition of weapon system: Selection of a next-generation fighter system in Korea. Journal Of Information And Communication Convergence Engineering, 13(2), 97-108. Doi: https://doi.org/10.6109/jicce.2015.13.2.097 Omid, A., & Zegordi, S. H. (2015). Integrated AHP and network DEA for assessing the efficiency of Iranian handmade carpet industry. Decision Science Letters, 4(2015), 477-486. Doi: https://doi.org/10.5267/j.dsl.2015.6.002 Pakkar, M. S. (2014). Using DEA and AHP for Ratio Analysis. American Journal of IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 265 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 Operations Research, 4, 268–279. Doi: https://doi.org/10.4136/ajor.2014.44026 Pakkar, M. S. (2015). Using data envelopment analysis and analytic hierarchy process for multiplicative aggregation of financial ratios. Journal of Applied Operational Research, 7(1), 23–35. Pakkar, M. S. (2016). A hierarchical aggregation approach for indicators based on Data Envelopment Analysis and Analytic Hierarchy Process. Systems, 4(1), 6. Doi: https://doi.org/10.3390/systems4010006 Parameshwaran, R., Srinivasan, P. S. S., Punniyamoorthy, M., Charunyanath, S. T., & Ashwin, C. (2009). Integrating fuzzy analytical hierarchy process and data envelopment analysis for performance management in automobile repair shops. European Journal of Industrial Engineering, 3(4), 450-467. Doi: https://doi.org/10.1504/ejie.2009.027037 Prasad, K. G. D., Subbaiah, K. V., & Prasad, M. V. (2017). Supplier evaluation and selection through DEA-AHP-GRA integrated approach-A case study. Uncertain Supply Chain Management, 5, 369–382. Doi: https://doi.org/10.5267/j.uscm.2017.4.001 Ramanathan, R. (2006). Data envelopment analysis for weight derivation and aggregation in the analytic hierarchy process. Computers and Operations Research, 33(5), 1289-1307. Doi: https://doi.org/10.1016/j.cor.2004.09.020 Ramanathan, R. (2007). Supplier selection problem: Integrating DEA with the approaches of total cost of ownership and AHP. Supply Chain Management : An International Journal, 12(4), 258-261. Doi: https://doi.org/10.1108/13598540700759772 Raut, R. D. (2014). An integrated Delphi-AHP-DEA-LPP multi criteria decision making approach for supplier selection and order quantity allocation system. International Journal of Logistics Systems and Management, 18(3), 366-393. Doi: https://doi.org/10.1504/IJLSM.2014.062823 Rezaei-Shouroki, M., Mostafaeipour, A., & Qolipour, M. (2017). Prioritizing of wind farm locations for hydrogen production: A case study. International Journal of Hydrogen Energy, 42(15), 9500-9510. Doi: https://doi.org/10.1016/j.ijhydene.2017.02.072 Saen, R. F., Memariani, A., & Lotfi, F. H. (2005). Determining relative efficiency of slightly non-homogeneous decision making units by data envelopment analysis: a case study in IROST. Applied Mathematics and Computation, 165, 313–328. Doi: https://doi.org/10.1016/j.amc.2004.04.050 Saleeshya, P. G., Babu, A. S. (2012). A combined AHP-and DEA-based approach to measure agility of manufacturing systems. International Journal of Business and Systems Research, 6, 431-455. Doi: https://doi.org/10.1504/ijbsr.2012.049472 Saaty, T. L. (2004) Decision making: the analytic hierarchy and network processes (AHP/DEA), Journal of Systems Science and Systems Engineering, 1-34. IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 266 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 Seiford L. M. (1994). A DEA bibliography (1978–1992). In A. Charnes, W. W. Cooper, A. Y. Lewin and L. M. Seiford (Eds.). Data envelopment analysis: Theory, methodology and applications (437-469) Boston, USA: Kluwer. Seiford, L. M. (1996). Data Envelopment Analysis: The evolution of the state of the art (1978-1995). The Journal of Productivity Analysis, 7(2/3), 99-137. Doi: https://doi.org/10.1007/bf00157037 Seiford L. M. (1997). A bibliography for Data Envelopment Analysis (1978–1996). Annals of Operations Research, 73, 393–438 Sevkli, M., Lenny Koh, S. C., Zaim, S., Demirbag, M., & Tatoglu, E. (2007). An application of data envelopment analytic hierarchy process for supplier selection: a case study of BEKO in Turkey. International Journal of Production Research, 45(9), 1973-2003. Doi: https://doi.org/10.1080/00207540600957399 Shirouyehzad, H., Lotfi, F. H., Arabzad, S. M., & Dabestani, R. (2013). An AHP/DEA ranking method based on service quality approach: a case study in hotel industry. International Journal of Productivity and Quality Management, 11(4), 434- 445. Doi: https://doi.org/10.1504/IJPQM.2013.054169 Singh, S., & Aggarwal, R. (2014). DEAHP Approach for Manpower Performance Evaluation. Journal of the Operations Research Society of China, 2(3), 317-332. Doi: https://doi.org/10.1007/s40305-014-0050-2 Sinuany-Stern, Z., Mehrez, A., & Hadad, Y. (2000). An AHP/DEA methodology for ranking decision making units. International Transactions in Operational Research, 7(2), 109-124. Doi: https://doi.org/10.1111/j.1475-3995.2000.tb00189.x Soltanifar, M., & Hosseinzadeh Lotfi, F. (2011). The voting analytic hierarchy process method for discriminating among efficient decision making units in data envelopment analysis. Computers and Industrial Engineering, 60(4), 585-592. Doi: https://doi.org/10.1016/j.cie.2010.12.016 Sueyoshi, T., Shang, J., & Chiang, W. C. (2009). A decision support framework for internal audit prioritization in a rental car company: A combined use between DEA and AHP. European Journal of Operational Research, 199(1), 219-231. Doi: https://doi.org/10.1016/j.ejor.2008.11.010 Takamura, Y., & Tone, K. (2003). A comparative site evaluation study for relocating Japanese government agencies out of Tokyo. Socio-Economic Planning Sciences, 37(2), 85-102. Doi: https://doi.org/10.1016/S0038-0121(02)00049-6 Tavares G. (2002). A bibliography of Data Envelopment Analysis (1978–2001). RUTCOR, Rutgers University. Retrieved from http://rutcor.rutgers.edu/pub/rrr/reports2002/1_2002.pdf. Tseng, Y. F., & Lee, T. Z. (2009). Comparing appropriate decision support of human resource practices on organizational performance with DEA/AHP model. Expert Systems with Applications, 36(3), 6548-6558. Doi: https://doi.org/10.1016/j.eswa.2008.07.066 IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 267 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 Wang, Y. M., & Chin, K. S. (2009). A new data envelopment analysis method for priority determination and group decision making in the analytic hierarchy process. European Journal of Operational Research, 195(1), 239-250. Doi: https://doi.org/10.1016/j.ejor.2008.01.049 Wang, Y. M. , Chin, K. S. , & Luo, Y. (2009). Aggregation of direct and indirect judgments in pairwise comparison matrices with a re-examination of the criticisms by Bana e Costa and Vansnick. Information Sciences, 179(3), 329–337. Wang, Y. M., Chin, K. S., & Poon, G. K. K. (2008). A data envelopment analysis method with assurance region for weight generation in the analytic hierarchy process. Decision Support Systems, 45(4), 913-921. Doi: https://doi.org/10.1016/j.dss.2008.03.002 Wang, Y. M., Liu, J., & Elhag, T. M. S. (2008). An integrated AHP-DEA methodology for bridge risk assessment. Computers and Industrial Engineering, 54(3), 514-525. Doi: https://doi.org/10.1016/j.cie.2007.09.002 Wang, Y. M., Parkan, C., & Luo, Y. (2008). A linear programming method for generating the most favorable weights from a pairwise comparison matrix. Computers and Operations Research, 35(12), 3918-3930. Doi: https://doi.org/10.1016/j.cor.2007.05.002 Yadav, V., & Sharma, M. K. (2015), An application of hybrid data envelopment analytical hierarchy process approach for supplier selection. Journal of Enterprise Information Management, 28(2), 218 - 242 Yang, T., & Kuo, C. (2003). A hierarchical AHP/DEA methodology for the facilities layout design problem. European Journal of Operational Research, 147(1),128-136. Doi: https://doi.org/10.1016/S0377-2217(02)00251-5 Yu, P., & Lee, J. H. (2013). A hybrid approach using two-level SOM and combined AHP rating and AHP/DEA-AR method for selecting optimal promising emerging technology. Expert Systems with Applications, 40(1), 300-314. Doi: https://doi.org/10.1016/j.eswa.2012.07.043 Yuan, X. C., Wang, Q., Wang, K., Wang, B., Jin, J. L., Wei, Y. M. (2013) China’s regional vulnerability to drought and its mitigation strategies under climate change: data envelopment analysis and analytic hierarchy process integrated approach. Mitigation and Adaptation Strategies for Global Change, 20(3), 341-359. Doi: https://doi.org/10.1007/s11027-013-9494-7 Zarei, A., Mehdiabadi, A., & Javidnia, M. (2012). Measuring the units efficiency using an integrated DEA–AHP method: A case study of rivet producer. Management Science Letters, 2(2012), 189-196. Doi: https://doi.org/10.5267/j.msl.2011.09.006 Zhang, J., & Fu, S. (2012). An effective DEA-AHP algorithm for evaluation of emergency logistics performance. International Journal On Advances in Information Sciences and Service Sciences, 14(12) https://doi.org/10.4156/AISS Zhang, X., Lee, C. K. M., & Chen, S. (2012). Supplier evaluation and selection: a hybrid model based on DEAHP and ABC. International Journal of Production IJAHP Article: Pradhan, Olfati, Patel/Integrations and applications of Analytic Hierarchy Process with Data Envelopment Analysis- a literature review International Journal of the Analytic Hierarchy Process 268 Vol. 11 Issue 2 2019 ISSN 1936-6744 https://doi.org/10.13033/ijahp.v11i2.632 Research, 50(7), 1877-1889. Doi: https://doi.org/10.1080/00207543.2011.560908