Microsoft Word - ETASR_V13_N1_pp10121-10127


Engineering, Technology & Applied Science Research Vol. 13, No. 1, 2023, 10121-10127 10121  
 

www.etasr.com Nguyen: The Improved CURLI Method for Multi-Criteria Decision Making 

 

The Improved CURLI Method for Multi-

Criteria Decision Making 
 

Anh-Tu Nguyen 

Faculty of Mechanical Engineering, Hanoi University of Industry, Vietnam 

tuna@haui.edu.vn 

(corresponding author)  
 

Received: 5 December 2022 | Revised: 26 December 2022 | Accepted: 31 December 2022 

 

ABSTRACT 

Multi-Criteria Decision Making (MCDM) investigates the best available choice in the presence of multiple 

conflicting criteria, whereas the Collaborative Unbiased Rank List Integration (CURLI) method has been 

proposed recently and has been applied in various fields of daily life. However, most previous works 

concentrated on analyzing cases in which the factor of a criterion is a specific quantity. The present paper 

proposes an approach developed from the original CURLI method, named Improved CURLI. This 

improvement helps solve a problem when the factors of the criteria can be linguistic variables or a data set. 

The proposed method is applied to rank the alternatives for two case studies: choosing the best grinding 

wheel and the best service suppliers. The ranking results are compared to those obtained using other 

methods. Furthermore, sensitivity analysis is also conducted to examine the stability and reliability of the 

ranking results in various scenarios. The results demonstrate the validity of the Improved CURLI method 

and prove that it is applicable for making decisions in various fields. 

Keywords-MCDM; CURLI method; improved CURLI method; data set 

I. INTRODUCTION  

The concept of MCDM is increasingly being used in 
various fields [1, 2]. MCDM problems are mentioned as 
MCDA or MADM. The essence of MCDM is evaluating and 
ranking the available options in order to select the best and 
avoid the worst. Researchers have suggested different MCDM 
approaches, and many of them have been applied in a variety 
of contexts [1, 3]. However, the original versions of the 
MCDM approaches are deemed inadequate for circumstances 
in which the criteria are expressed as a set of factors or 
linguistic variables [4, 5]. The main reason for this 
phenomenon is that the uncertainty about the object depends on 
a lot of factors, like experts’ opinions, time, location, the way 
of data collection, etc. [6]. To deal with this issue, approaches 
that combine the fuzzy method with MCDM have been 
proposed. That combination is referred to as fuzzy - MCDM. 
Many studies are progressively employing the fuzzy - MCDM 
methods. For instance, TOPSIS integrated with fuzzy is used in 
many applications such as supplier selection [7], project 
selection [8], healthcare software [9], supply chain 
management [10], manager selection [11], etc. In [12], a fuzzy 
VIKOR – MDCM is proposed to analyze and evaluate the 
quality of information security policies as well as the content of 
press agencies in Gulf countries. Realizing this method’s 
exploitation potential, numerous investigations have been 
launched in different tasks like warehouse location selection 
[13], mobile services [14], and sustainable development in 
Islamic countries [15]. In other approaches, the fuzzy 
MARCOS method is utilized for road traffic risk analysis [16], 

assessment of drone-based city logistics [17], e-service quality 
in airline industry [18], and so on.  

When applying fuzzy MCDM, it is necessary to determine 
the weights of the criteria which play an important role to make 
the final decision [19-21]. In this manner, calculating the 
weights for the criteria is relatively complex, time-consuming, 
and difficult in situations requiring prompt decision-making. 
Furthermore, the ambiguity of the decision makers (or 
surveyed experts) regarding the research object influences the 
weights determined by these methods. Hence, the accuracy of 
the weights after the calculation is not guaranteed. As a result, 
no longer will the ranking of the options be certain [22-24]. In 
addition, most fuzzy MCDM methods still inherit some stages 
from the original MCDM methods, one of which is data 
normalization. But the data normalization processes of the 
MCDM methods are also not the same, leading to the ranking 
results of the alternatives also being highly dependent on the 
data normalization and sensitive to change [25-27]. 

Generally, despite the widespread application of fuzzy 
MCDM approaches, they still have limitations to some extent. 
If a suggested MCDM method can solve two major problems, 
it will make significant contributions to this field. Due to the 
mentioned limitations associated with the right determination 
for the criteria and the normalization of data, it is necessary to 
propose an MCDM approach that does not require the 
determination of weights for the criteria and the metric 
normalization. To overcome these issues, the CURLI method 
was first introduced in 2016. It is used to rank applicants for 
medical programs [28]. Despite the fact that it has existed for 



Engineering, Technology & Applied Science Research Vol. 13, No. 1, 2023, 10121-10127 10122  
 

www.etasr.com Nguyen: The Improved CURLI Method for Multi-Criteria Decision Making 

 

six years, only a handful of research projects about this 
technique have been carried out. The applying CURLI method 
is proposed to inspect the quality of the X12 steel grinding 
process [29]. A turning test progress based on the CURLI 
approach was designed in [30]. The result reveals that the 
proposed method is as precise as the PEG method and better 
than the PSI method. In addition, recent works have shown that 
the CURLI method is just as accurate as the R and CODAS 
approaches to ranking robots, just as accurate as the R, SAW, 
WASPAS, TOPSIS, VIKOR, MOORA, COPRAS, and PIV 
approach to rating the turning process, and just as accurate as 
the R and MABAC approaches to ranking bridge construction 
[31]. However, all the above mentioned studies are only 
considered when the criteria are clearly defined (not fuzzy set). 
In this paper, an approach based on the original CURLI 
method, which allows overcoming the mentioned drawbacks is 
proposed. The key contributions of the current paper are: 

 This paper proposes an improved CURLI method to allow 
solving the MCDM problems, when the factors of the 
criteria can be linguistic variables or a data set. 

 The proposed method does not need the input data to be 
normalized or the weights of the criteria to be evaluated. 

 The proposed approach is the first step towards enhancing 
the CURLI method to optimize MDCM problems as well as 
applying it to various fields of daily life. 

II. THE IMPROVED CURLI METHOD 

The original CURLI method involves four steps as follows 
[28-31]: 

Step 1: Establish a decision-making matrix with m options 
and n criteria as in Table I. Cij is the factor of criterion j

th
 in 

option i
th
, where i = 1 ÷ m, j = 1 ÷ n. 

TABLE I.  DECISION-SCORE MATRIX 

Alternatives 
Criteria 

C1 C2 Cj Cn 

A1 C11 C12 C1j C1n 

A2 C21 C22 C2j C2n 

Ai Ci1 Ci2 Cij Cin 

Am Cm1 Cm2 Cmj Cmn 

 

Step 2: Create score-point matrices of level m. In criterion 
j, the entry corresponding to row t and column v (1  t, v  m) 
is determined based on the following regulations: 

 If the factor of criterion j in alternative At is worse than that 
of alternative Av, the entry in the corresponding row and 
column will be scored as -1. 

 If the factor of criterion j in alternative At is better than that 
of alternative Av, the entry in the corresponding row and 
column will be scored as 1. 

 If the factor of criterion j in alternative At is equal to that of 
alternative Av, the entry in the corresponding row and 
column will be scored as 0. 

All the entries on the main diagonal will be blank. After 
this step, n square score-point matrices are established in total.  

Step 3: Create the process score-point matrix. The entries 
of this matrix are calculated by summing all the corresponding 
entries of the score-point matrix in step 2. 

Step 4: Rearrange the process score-point matrix. The 
arrangement will be performed by moving the rows and 
columns of the process score-point matrices by the following 
rules: the order of columns from the left to the right 
corresponding to the order of the rows from the top to the 
bottom. The number of the negative and zero entries above the 
main diagonal is maximal. After sorting, the solution in the first 
row will be the best choice. Priority of selection reduces from 
the first to the last row. 

The CURLI approach has been used extensively to solve 
optimization problems in several disciplines, in which the 
factors of each criterion at an alternative are a specific quantity. 
However, in reality, a criterion may be represented by 
linguistic variables or a data set. This paper proposes an 
approach based on the original CURLI method for handling 
these issues as follows: 

Step 1: Establish a decision-making matrix as in Table II. 

Step 2: Create score-point matrices. This step is 
implemented similarly to the original CURLI. However, the 
score-point matrices will be determined with every factor of the 
criteria. The score point of each criterion is denoted as pf  
(1 f  k), where k is the number of factors of a criterion.  

TABLE II.  DECISION-MAKING MATRIX WITH MULTI-
CHOICE OF CRITERIA IN EACH SOLUTION 

Alternatives 
Criteria 

C1 C2 Cj Cn 

A1 
(C

1
11, C

2
11,…, 

C
k
11) 

(C
1

12, C
2
12,…, 

C
k
12) 

(C
1
1j, C

2
1j,…, 

C
k

1j) 

(C
1

1n, C
2

1n,…, 

C
k
1n) 

A2 
(C

1
21, C

2
21,…, 

C
k
21) 

(C
1

22, C
2
22,…, 

C
k
22) 

(C
1
2j, C

2
2j,…, 

C
k

2j) 

(C
1

2n, C
2

2n,…, 

C
k
2n) 

Ai 
(C

1
i1, C

2
i1,…, 

C
k
i1) 

(C
1

i2, C
2

i2,…, 

C
k
i2) 

(C
1

ij, C
2

ij,…, 

C
k
ij) 

(C
1

in, C
2

in,…, 

C
k
in) 

Am 
(C

1
m1, C

2
m1,…, 

C
k
m1) 

(C
1

m2, C
2

m2,…, 

C
k
m2) 

(C
1

mj, C
2

mj,…, 

C
k

mj) 

(C
1

mn, C
2

mn,…, 

C
k
mn) 

 

Step 3: Build the process score-point matrix. The entries of 
this matrix are calculated based on the sum of all points in 
corresponding marking point matrices. The detailed 
formulation is expressed as: 

1

k
f
j

j

p

p
k




     (1) 

Step 4: Rearrange the process score-point matrix. This step 
is the same as in the original CURLI method. 

III. VERIFICATION STUDY AND DISCUSSION 

A. Case Study 1 

In this sub-section, the proposed method is applied to 
determine which grinding wheel to choose in an MCDM 
problem [32, 33]. There are 8 different types of grinding 
wheels (A1 ÷ A8), and each wheel is described by 7 criteria 
(C1 ÷ C7). Each criterion has 3 alternatives. The decision is 



Engineering, Technology & Applied Science Research Vol. 13, No. 1, 2023, 10121-10127 10123  
 

www.etasr.com Nguyen: The Improved CURLI Method for Multi-Criteria Decision Making 

 

made to satisfy the conditions: (a) for C7 the smallest is the 
best and (b) for the other criteria, the biggest is the best. The 
objective of MCDM is to identify the alternative that 
simultaneously assures that C7 is the smallest and the 
remaining criteria (from C1 to C6) are maximal. This work has 
also been accomplished by employing the Fuzzy TOPSIS 
method [33] and 6 variations of the VIKOR method [32]. The 
results of rating the alternatives using these two ways will be 
compared to the results of ranking the alternatives using the 
proposed method in this study. 

In the first step, the decision-making matrix is composed as 
in Table III. In the second step, scoring for the criteria will be 
performed. In this case, the value of each criterion at each 
alternative has three levels of values. The number of 

alternatives that need to be ranked is 8. Thus, the score for each 
alternative (for each criterion) is a set of numbers as shown in 
(2): 

   1 2 3P P , P , P  with  1 8fj j j j j j   N   (2) 

After the scoring process, the decision-score matrixes are 
illustrated from Table IV to Table X. In the next step, the 
process score-point matrix is determined based on (1) and is 
presented in Table XI. The process score-point matrix is 
rearranged based on the mentioned rules in Section 2. 
Following the arranging procedure, the alternative in the first 
row could be seen as the best choice. The final arrangement is 
shown in Table XII. 

TABLE III.  DECISION-SCORE MATRIX FOR CHOOSING A GRINDING WHEEL [32, 33] 

Alternatives 
Criteria 

C1 C2 C3 C4 C5 C6 C7 

A1 (2700, 3200, 3700) (391, 451, 511) (2925, 3475, 4025) (581, 756, 931) (12, 17, 22) (2.65, 4.15, 5.65) (12, 18, 24) 

A2 (2000, 2400, 2800) (590, 690, 790) (4275, 4975, 5675) (1099, 1324, 1549) (68, 98, 128) (2.2, 3, 3.8) (45, 60, 75) 

A3 (4400, 5000, 5600) (725, 850, 975) (6000, 6900, 7800) (1282, 1532, 1782) (9, 13, 17) (3.55, 4.5, 5.45) (714, 864, 1014) 

A4 (2600, 3000, 3400) (350, 400, 450) (3200, 3800, 4400) (729, 879, 1029) (21, 30, 39) (3.15, 4, 4.85) (107, 152, 197) 

A5 (7300, 8000, 8700) (818, 953, 1088) (5900, 6700, 7500) (4188, 4688, 5188) (950, 1200, 1450) (6.45, 8.6, 10.8) (1050, 1300, 1550) 

A6 (2150, 2550, 2950) (370, 440, 510) (3950, 4600, 5250) (400, 480, 560) (150, 200, 250) (2.6, 3.1, 3.6) (6.5, 10, 13.5) 

A7 (2400, 2800, 3200) (385, 460, 535) (1421, 1721, 2021) (425, 600, 775) (55, 90, 125) (1.95, 2.5, 3.05) (36, 50, 64) 

A8 (900, 1200, 1500) (115, 160, 205) (1350, 1750, 2150) (495, 620, 745) (1.4, 2.2, 3) (5.75, 8.2, 10.7) (33, 45, 57) 

TABLE IV.  SCORE-POINT MATRIX FOR CRITERION C1 

Alternatives 
Points 

P1 P2 P3 P4 P5 P6 P7 P8 

A1 
 

-1, -1, -1 1, 1, 1 -1, -1, -1 1, 1, 1 -1, -1, -1 -1, -1, -1 -1, -1, -1 

A2 1, 1, 1 
 

1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 -1, -1, -1 

A3 -1, -1, -1 -1, -1, -1 
 

-1, -1, -1 1, 1, 1 -1, -1, -1 -1, -1, -1 -1, -1, -1 

A4 1, 1, 1 -1, -1, -1 1, 1, 1 
 

1, 1, 1 -1, -1, -1 -1, -1, -1 -1, -1, -1 

A5 -1, -1, -1 -1, -1, -1 -1, -1, -1 -1, -1, -1 
 

-1, -1, -1 -1, -1, -1 -1, -1, -1 

A6 1, 1, 1 -1, -1, -1 1, 1, 1 1, 1, 1 1, 1, 1 
 

1, 1, 1 -1, -1, -1 

A7 1, 1, 1 -1, -1, -1 1, 1, 1 1, 1, 1 1, 1, 1 -1, -1, -1 
 

-1, -1, -1 

A8 1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 
 

TABLE V.  SCORE-POINT MATRIX FOR CRITERION C2 

Alternatives 
Points 

P1 P2 P3 P4 P5 P6 P7 P8 

A1 
 

1, 1, 1 1, 1, 1 -1, -1, -1 1, 1, 1 -1, -1, -1 -1, 1, 1 -1, -1, -1 

A2 -1, -1, -1 
 

1, 1, 1 -1, -1, -1 1, 1, 1 -1, -1, -1 -1, -1, -1 -1, -1, -1 

A3 -1, -1, -1 -1, -1, -1 
 

-1, -1, -1 1, 1, 1 -1, -1, -1 -1, -1, -1 -1, -1, -1 

A4 1, 1, 1 1, 1, 1 1, 1, 1 
 

1, 1, 1 1, 1, 1 1, 1, 1 -1, -1, -1 

A5 -1, -1, -1 -1, -1, -1 -1, -1, -1 -1, -1, -1 
 

-1, -1, -1 -1, -1, -1 -1, -1, -1 

A6 1, 1, 1 1, 1, 1 1, 1, 1 -1, -1, -1 1, 1, 1 
 

1, 1, 1 -1, -1, -1 

A7 1, -1,-1 1, 1, 1 1, 1, 1 -1, -1, -1 1, 1, 1 -1, -1, -1 
 

-1, -1, -1 

A8 1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 
 

TABLE VI.  SCORE-POINT MATRIX FOR CRITERION C3 

Alternatives 
Points 

P1 P2 P3 P4 P5 P6 P7 P8 

A1 
 

1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 -1, -1, -1 -1, -1, -1 

A2 -1, -1, -1 
 

1, 1, 1 -1, -1, -1 1, 1, 1 -1, -1, -1 -1, -1, -1 -1, -1, -1 

A3 -1, -1, -1 -1, -1, -1 
 

-1, -1, -1 -1, -1, -1 -1, -1, -1 -1, -1, -1 -1, -1, -1 

A4 -1, -1, -1 1, 1, 1 1, 1, 1 
 

1, 1, 1 1, 1, 1 -1, -1, -1 -1, -1, -1 

A5 -1, -1, -1 -1, -1, -1 1, 1, 1 -1, -1, -1 
 

-1, -1, -1 -1, -1, -1 -1, -1, -1 

A6 -1, -1, -1 1, 1, 1 1, 1, 1 -1, -1, -1 1, 1, 1 
 

-1, -1, -1 -1, -1, -1 

A7 1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 
 

-1, 1, 1 

A8 1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 1, -1, -1 
 

 



Engineering, Technology & Applied Science Research Vol. 13, No. 1, 2023, 10121-10127 10124  
 

www.etasr.com Nguyen: The Improved CURLI Method for Multi-Criteria Decision Making 

 

TABLE VII.  SCORE-POINT MATRIX FOR CRITERION C4 

Alternatives 
Points 

P1 P2 P3 P4 P5 P6 P7 P8 

A1 
 

1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 -1, -1, -1 -1, -1, -1 -1, -1, -1 

A2 -1, -1, -1 
 

1, 1, 1 -1, -1, -1 1, 1, 1 -1, -1, -1 -1, -1, -1 -1, -1, -1 

A3 -1, -1, -1 -1, -1, -1 
 

-1, -1, -1 1, 1, 1 -1, -1, -1 -1, -1, -1 -1, -1, -1 

A4 -1, -1, -1 1, 1, 1 1, 1, 1 
 

1, 1, 1 -1, -1, -1 -1, -1, -1 -1, -1, -1 

A5 -1, -1, -1 -1, -1, -1 -1, -1, -1 -1, -1, -1 
 

-1, -1, -1 -1, -1, -1 -1, -1, -1 

A6 1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 
 

1, 1, 1 1, 1, 1 

A7 1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 -1, -1, -1 
 

1, 1, -1 

A8 1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 -1, -1, -1 -1, -1, 1 
 

TABLE VIII.  SCORE-POINT MATRIX FOR CRITERION C5 

Alternatives 
Points 

P1 P2 P3 P4 P5 P6 P7 P8 

A1 
 

1, 1, 1 -1, -1, -1 1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 -1, -1, -1 

A2 -1, -1, -1 
 

-1, -1, -1 -1, -1, -1 1, 1, 1 1, 1, 1 -1, -1, -1 -1, -1, -1 

A3 1, 1, 1 1, 1, 1 
 

1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 -1, -1, -1 

A4 -1, -1, -1 1, 1, 1 -1, -1, -1 
 

1, 1, 1 1, 1, 1 1, 1, 1 -1, -1, -1 

A5 -1, -1, -1 -1, -1, -1 -1, -1, -1 -1, -1, -1 
 

-1, -1, -1 -1, -1, -1 -1, -1, -1 

A6 -1, -1, -1 -1, -1, -1 -1, -1, -1 -1, -1, -1 1, 1, 1 
 

-1, -1, -1 -1, -1, -1 

A7 -1, -1, -1 1, 1, 1 -1, -1, -1 -1, -1, -1 1, 1, 1 1, 1, 1 
 

-1, -1, -1 

A8 1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 
 

TABLE IX.  SCORE-POINT MATRIX FOR CRITERION C6 

Alternatives 
Points 

P1 P2 P3 P4 P5 P6 P7 P8 

A1 
 

-1, -1, -1 1, 1, -1 1, -1, -1 1, 1, 1 -1, -1, -1 -1, -1, -1 1, 1, 1 

A2 1, 1, 
 

1, 1, 1 1, 1, 1 1, 1, 1 1, 1, -1 -1, -1, -1 1, 1, 1 

A3 -1, -1 , 1 -1, -1, -1 
 

-1, -1, -1 1, 1, 1 -1, -1, -1 -1, -1, -1 1, 1, 1 

A4 -1, 1, 1 -1, -1, -1 1, 1, 1 
 

1, 1, 1 -1, -1, -1 -1, -1, -1 1, 1, 1 

A5 -1, -1, -1 -1, -1, -1 -1, -1, -1 -1, -1, -1 
 

-1, -1, -1 -1, -1, -1 -1, -1, -1 

A6 1, 1, 1 -1, -1, 1 1, 1, 1 1, 1, 1 1, 1, 1 
 

-1, -1, -1 1, 1, 1 

A7 1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 
 

1, 1, 1 

A8 -1, -1, -1 -1, -1, -1 -1, -1, -1 -1, -1, -1 1, 1, 1 -1, -1, -1 -1, -1, -1 
 

TABLE X.  SCORE-POINT MATRIX FOR CRITERION C7 

Alternatives 
Points 

P1 P2 P3 P4 P5 P6 P7 P8 

A1 
 

-1, -1, -1 -1, -1, -1 -1, -1, -1 -1, -1, -1 1, 1, 1 -1, -1, -1 -1, -1, -1 

A2 1, 1, 1 
 

-1, -1, -1 -1, -1, -1 -1, -1, -1 1, 1, 1 1, 1, 1 1, 1, 1 

A3 1, 1, 1 1, 1, 1 
 

1, 1, 1 -1, -1, -1 1, 1, 1 1, 1, 1 1, 1, 1 

A4 1, 1, 1 1, 1, 1 -1, -1, -1 
 

-1, -1, -1 1, 1, 1 1, 1, 1 1, 1, 1 

A5 1, 1, 1 1, 1, 1 1, 1, 1 1, 1, 1 
 

1, 1, 1 1, 1, 1 1, 1, 1 

A6 -1, -1, -1 -1, -1, -1 -1, -1, -1 -1, -1, -1 -1, -1, -1 
 

-1, -1, -1 -1, -1, -1 

A7 1, 1, 1 -1, -1, -1 -1 -1, -1, -1 -1, -1, -1 1, 1, 1 
 

1, 1, 1 

A8 1, 1, 1 -1, -1, -1 -1 -1, -1, -1 -1, -1, -1 1, 1, 1 -1, -1, -1 
 

TABLE XI.  SCORE-POINT MATRIX FOR THE EVALUATION PROCESS 

Alternatives 
Points 

P1 P2 P3 P4 P5 P6 P7 P8 

A1 
 

1 2.3333 -0.333 5 -1 -3.6667 -5 

A2 -1 
 

3 -3 5 0.3333 -3 -3 

A3 -2.3333 -3 
 

-3 3 -3 -3 -3 

A4 0.3333 3 3 
 

5 1 -1 -3 

A5 -5 -5 -3 -5 
 

-5 -5 -5 

A6 1 -0.3333 3 -1 5 
 

-1 -3 

A7 3.6667 3 3 1 5 1 
 

-0.3333 

A8 5 3 3 3 5 3 0.3333 
 

 

Table XII indicates that all the entries above the principal 
diagonal are negative, therefore A5 is the best choice and A8 is 
the worst one. The rank of alternatives is as follows: A5 > A3 > 

A6 > A2 > A1 > A4 > A7 > A8. In Table XIII, the ranking 
results of the present study are compared to Fuzzy TOPSIS 
method [33] and 6 variants of the VIKOR method. 



Engineering, Technology & Applied Science Research Vol. 13, No. 1, 2023, 10121-10127 10125  
 

www.etasr.com Nguyen: The Improved CURLI Method for Multi-Criteria Decision Making 

 

TABLE XII.  THE PROCESS SCORE-POINT MATRIX AFTER REARRANGEMENT 

Alternatives 
Points 

P5 P3 P6 P2 P1 P4 P7 P8 

A5 
 

-3 -5 -5 -5 -5 -5 -5 

A3 3 
 

-3 -3 -2.3333 -3 -3 -3 

A6 5 3 
 

-0.3333 -1 -1 -1 -3 

A2 5 3 0.3333 
 

-1 -3 -3 -3 

A1 5 2.3333 1 1 
 

-0.3333 -3.6667 -5 

A4 5 3 1 3 0.3333 
 

-1 -3 

A7 5 3 1 3 3.6667 1 
 

-0.3333 

A8 5 3 3 3 5 3 0.3333 
 

TABLE XIII.  THE COMPARISON AMONG DIFFERENT METHODS FOR CHOOSING THE GRINDING WHEEL 

Alternatives 

Methods 

Original 

VIKOR  

Comprehensive 

VIKOR 

Fuzzy 

VIKOR 

Regret 

VIKOR  

Modified 

VIKOR 

Interval 

VIKOR  

Fuzzy 

TOPSIS 

Improved 

CURLI 

A1 6 6 6 6 6 5 6 5 

A2 3 3 3 5 3 4 3 4 

A3 2 2 2 2 2 2 2 2 

A4 4 5 4 3 5 3 4 6 

A5 1 1 1 1 1 1 1 1 

A6 5 4 5 4 4 6 5 3 

A7 7 7 7 7 7 8 7 7 

A8 8 8 8 8 8 7 8 8 

 

The comparison results reveal a high degree of correlation 
between the methodologies. All approaches offer the same 
optimal and secondary options. In addition, the proposed 
method produces 7

th
 and 8

th
 alternatives similar to the other 

methods. There is a variation in the arrangement of alternatives 
between the 3

rd
 and 6

th
. However, the difference is small, and 

this does not significantly impact the overall conclusion. It is 
evident that analyzing the sensitivity of the method plays an 
important role in solving the MCDM problem [34]. In this 
article, we inspect the sensitivity of the proposed approach by 
ranking the alternatives in the case of withdrawing at least one 
alternative out of the group randomly. The rank of the 
alternatives then is compared to the ideal order. The term ideal 
means that there is no reverse occurring if an alternative is 
eliminated. In the first scenario, the worst choice A8 is 
withdrawn from the calculation (Figure 1).  

 

 
Fig. 1.  The order of the solution after removing A8. 

 

Fig. 2.  The order of the solution after removing A5. 

 
Fig. 3.  The order of the solution after removing A4. 

After that, the best alternative is eliminated from the list 
(Figure 2), and finally, the alternative in the middle of the rank 
is eliminated (Figure 3). It is observed that in all the considered 
cases, the order of the alternatives is exactly the same as the 
ideal order. This proves that the proposed method is reliable 
and applicable in solving MCDM problems. 

B. Case Study 2  

In the second case study, the proposed method is applied to 
find out the best service suppliers. Each criterion is 
demonstrated by linguistic variables and the decision is made 
based on 5 criteria: product quality (C1), price (C2), delivery 
process (C3), service quality (C4), and past efficiency (C5). 
Each criterion in an alternative row has 3 sub-options and the 
meaning of linguistic variables is illustrated in Table XIV [35]. 
The smallest criterion C2 is the best, and for the others, the 
largest is the best. 

The Fuzzy TOPSIS method is applied to rank the 
alternatives [35]. The statistics of this alternate ranking 
approach will be compared to those of the proposed method. 
Applying the improved CURLI method to estimate the 
alternatives in Table XIV is the same as in the case study 1, and 
the ranking results are compared to the Fuzzy TOPSIS [35] in 
Table XV. 

 



Engineering, Technology & Applied Science Research Vol. 13, No. 1, 2023, 10121-10127 10126  
 

www.etasr.com Nguyen: The Improved CURLI Method for Multi-Criteria Decision Making 

 

TABLE XIV.  DECISION-SCORE MATRIX FOR CHOOSING SERVICE SUPPLIER [35] 

Alternatives 
Criteria 

C1 C2 C3 C4 C5 

A1 (M, G, G) (VG, M, G) (G, G, G) (SB, G, G) (G, SG, VG) 

A2 (G, G, VG) (SG, G, G) (VG, VG, VG) (M, G, G) (G, G, VG) 

A3 (G, G, M) (SG, VG, SG) (G, SG, SB) (G, G, G) (G, VG, SG) 

M – medium; G – good; VG – very good; SG – small good; SB – small bad 

 

TABLE XV.  COMPARISON BETWEEN THE IMPROVED CURLI 
AND THE FUZZY TOPSIS FOR CHOOSING THE SERVICE 

SUPPLIERS 

Alternatives 
Methods 

Fuzzy TOPSIS Improved CURLI 

A1 2 2 

A2 1 1 

A3 3 3 

 

It can be seen that the ranks of the alternatives of the two 
methods are precisely the same: A2 is the best and A3 is the 
worst alternative. This once again confirms the reliability of the 
proposed method. The sensitivity analysis of the alternative 
ranking is also performed and evaluated in detail. Figures 4-6 
indicate the chart of the solution ranking after eliminating A1, 
A2, and A3. 

 

 
Fig. 4.  The order of the solution after removing A1. 

 

Fig. 5.  The order of the solution after removing A2. 

 
Fig. 6.  The order of the solution after removing A3. 

The comparison shows that there is no reverse phenomenon 
appearing in all considered scenarios. This once again confirms 
the success of the proposed improved CURLI method in the 
determination of the priority order. 

IV. CONCLUSION 

This paper proposes the improved CURLI approach based 
on the original CURLI method. Two case studies were 
implemented to evaluate the methodology efficiency with 
different types of variables. The ranking results are compared 
to those of other methods to verify the reliability of the 
proposed method. The following conclusions are drawn: 

 It is notable that there was no major difference between the 
top and bottom positions. Additionally, the sensitivity of the 
improved CURLI was examined in the case of removing 
some random alternatives. The results indicate that there is 
no reverse of rank in any of the considered case studies. 
This is strong evidence that supports the idea that the 
improved CURLI method is better than the old MCDM 
when there are problems with data and uncertainty.  

 It is also interesting that the proposed method can rank 
problems in which multiple factors influence each criterion 
at an alternative level without the requirement that the input 
data should be normalized or the criteria weights be 
evaluated. 

 The improved CURLI method allows solving MCDM 
problems when the factors of the criteria can be linguistic 
variables or a data set. This study is the first step towards 
enhancing the understanding of the CURLI method to 
optimize MDCM problems. 

LIST OF ACRONYMS 

MCDM Multi-Criteria Decision-Making 

CURLI Collaborative Unbiased Rank List Integration 

MCDA Multiple-Criteria Decision Analysis 

MADM Multi-Attribute Decision-Making 

TOPSIS 
Technique for Order Performance by Similarity to Ideal 

Solution 

VIKOR 
Vlsekriterijumska optimizacija i KOmpromisno Resenje (in 

Serbian) 

MARCOS 
Measurement Alternatives and Ranking according to 

Compromise Solution 

PEG Pareto-Edgeworth Grierson 

CODAS COmbinative Distance-based ASsessment 

R Ranking of the attributes and alternatives 

SAW Simple Additive Weighting 

WASPAS Weighted Aggregates Sum Product Assessment 

MOORA Multi-Objective Optimization on the basis of Ratio Analysis 

COPRAS COmplex PRroportional ASsessment 

PIV Proximity Indexed Value 

MABAC Multi-Attributive Border Approximation area Comparison 

REFERENCES 

[1] C. Zopounidis and M. Doumpos, Eds., Multiple Criteria Decision 
Making: Applications in Management and Engineering, 1st ed. New 
York, NY, USA: Springer, 2017. 



Engineering, Technology & Applied Science Research Vol. 13, No. 1, 2023, 10121-10127 10127  
 

www.etasr.com Nguyen: The Improved CURLI Method for Multi-Criteria Decision Making 

 

[2] S. Alshehri, "Multicriteria Decision Making (MCDM) Methods for 
Ranking Estimation Techniques in Extreme Programming," 
Engineering, Technology & Applied Science Research, vol. 8, no. 3, pp. 
3073–3078, Jun. 2018, https://doi.org/10.48084/etasr.2104. 

[3] R. Umar, Sunardi, and Y. B. Fitriana, "Taxonomy of Fuzzy Multi-
Attribute Decision Making Systems in Terms of Model, Inventor and 
Data Type," Engineering, Technology & Applied Science Research, vol. 
8, no. 1, pp. 2568–2571, Feb. 2018, https://doi.org/10.48084/etasr.1747. 

[4] I. Kaya, M. Colak, and F. Terzi, "A comprehensive review of fuzzy 
multi criteria decision making methodologies for energy policy making," 
Energy Strategy Reviews, vol. 24, pp. 207–228, Apr. 2019, 
https://doi.org/10.1016/j.esr.2019.03.003. 

[5] C. Kahraman, B. Oztaysi, I. Ucal Sarı, and E. Turanoglu, "Fuzzy 
analytic hierarchy process with interval type-2 fuzzy sets," Knowledge-
Based Systems, vol. 59, pp. 48–57, Mar. 2014, https://doi.org/ 
10.1016/j.knosys.2014.02.001. 

[6] I. Dzitac, F. G. Filip, and M.-J. Manolescu, "Fuzzy Logic Is Not Fuzzy: 
World-renowned Computer Scientist Lotfi A. Zadeh," International 
Journal of Computers Communications & Control, vol. 12, no. 6, pp. 
748–789, Dec. 2017. 

[7] U. M. Modibbo, M. Hassan, A. Ahmed, and I. Ali, "Multi-criteria 
decision analysis for pharmaceutical supplier selection problem using 
fuzzy TOPSIS," Management Decision, vol. 60, no. 3, pp. 806–836, Jan. 
2022, https://doi.org/10.1108/MD-10-2020-1335. 

[8] A. Shamsuzzoha, S. Piya, and M. Shamsuzzaman, "Application of fuzzy 
TOPSIS framework for selecting complex project in a case company," 
Journal of Global Operations and Strategic Sourcing, vol. 14, no. 3, pp. 
528–566, Jan. 2021, https://doi.org/10.1108/JGOSS-07-2020-0040. 

[9] M. T. J. Ansari, F. A. Al-Zahrani, D. Pandey, and A. Agrawal, "A fuzzy 
TOPSIS based analysis toward selection of effective security 
requirements engineering approach for trustworthy healthcare software 
development," BMC Medical Informatics and Decision Making, vol. 20, 
no. 1, Sep. 2020, Art. no. 236, https://doi.org/10.1186/s12911-020-
01209-8. 

[10] K. Palczewski and W. Salabun, "The fuzzy TOPSIS applications in the 
last decade," Procedia Computer Science, vol. 159, pp. 2294–2303, Jan. 
2019, https://doi.org/10.1016/j.procs.2019.09.404. 

[11] N. H. Baharin, N. F. Rashidi, and N. F. Mahad, "Manager selection 
using Fuzzy TOPSIS method," Journal of Physics: Conference Series, 
vol. 1988, no. 1, Apr. 2021, Art. no. 012057, https://doi.org/ 
10.1088/1742-6596/1988/1/012057. 

[12] A. M. Talib, "Fuzzy VIKOR Approach to Evaluate the Information 
Security Policies and Analyze the Content of Press Agencies in Gulf 
Countries," Journal of Information Security, vol. 11, no. 4, pp. 189–200, 
Aug. 2020, https://doi.org/10.4236/jis.2020.114013. 

[13] S. Emec and G. Akkaya, "Stochastic AHP and fuzzy VIKOR approach 
for warehouse location selection problem," Journal of Enterprise 
Information Management, vol. 31, no. 6, pp. 950–962, Jan. 2018, 
https://doi.org/10.1108/JEIM-12-2016-0195. 

[14] Y. Suh, Y. Park, and D. Kang, "Evaluating mobile services using 
integrated weighting approach and fuzzy VIKOR," PLOS ONE, vol. 14, 
no. 6, May 2019, Art. no. e0217786, https://doi.org/10.1371/journal. 
pone.0217786. 

[15] M. S. Ismail and A. Felix, "Integrated fuzzy VIKOR and TOPSIS 
system for the sustainable development in Islam," AIP Conference 
Proceedings, vol. 2385, no. 1, Jan. 2022, Art. no. 130027, 
https://doi.org/10.1063/5.0070740. 

[16] M. Stankovic, Z. Stevic, D. K. Das, M. Subotic, and D. Pamucar, "A 
New Fuzzy MARCOS Method for Road Traffic Risk Analysis," 
Mathematics, vol. 8, no. 3, Mar. 2020, Art. no. 457, https://doi.org/ 
10.3390/math8030457. 

[17] M. Kovac, S. Tadic, M. Krstic, and M. B. Bouraima, "Novel Spherical 
Fuzzy MARCOS Method for Assessment of Drone-Based City Logistics 
Concepts," Complexity, vol. 2021, Dec. 2021, Art. no. e2374955, 
https://doi.org/10.1155/2021/2374955. 

[18] M. Bakır and O. Atalık, "Application of Fuzzy AHP and Fuzzy 
MARCOS Approach for the Evaluation of E-Service Quality in the 
Airline Industry," Decision Making: Applications in Management and 

Engineering, vol. 4, no. 1, pp. 127–152, Mar. 2021, https://doi.org/ 
10.31181/dmame2104127b. 

[19] S. Miao, R. J. Hammell, T. Hanratty, and Z. Tang, "Comparison of 
Fuzzy Membership Functions for Value of Information Determination," 
in 25th Midwest Artificial Intelligence and Cognitive Science 
Conference, Washington, DC, USA, Apr. 2014, pp. 1–8. 

[20] S. Princy and S. S. Dhenakaran, "Comparison of triangular and 
trapezoidal fuzzy membership function," Journal of Computer Science 
and Engineering, vol. 2, no. 8, pp. 46–51, 2016. 

[21] H. K. Le, "Multi-Criteria Decision Making in the Milling Process Using 
the PARIS Method," Engineering, Technology & Applied Science 
Research, vol. 12, no. 5, pp. 9208–9216, Oct. 2022, https://doi.org/ 
10.48084/etasr.5187. 

[22] D. Duc Trung, "Multi-criteria decision making under the MARCOS 
method and the weighting methods: applied to milling, grinding and 
turning processes," Manufacturing Review, vol. 9, Jan. 2022, Art. no. 3, 
https://doi.org/10.1051/mfreview/2022003. 

[23] R. M. Dawes and B. Corrigan, "Linear models in decision making," 
Psychological Bulletin, vol. 81, pp. 95–106, 1974, https://doi.org/ 
10.1037/h0037613. 

[24] H. J. Einhorn and W. McCoach, "A simple multiattribute utility 
procedure for evaluation," Behavioral Science, vol. 22, no. 4, pp. 270–
282, 1977, https://doi.org/10.1002/bs.3830220405. 

[25] D. D. Trung, "Development of data normalization methods for multi-
criteria decision making: applying for MARCOS method," 
Manufacturing Review, vol. 9, 2022, Art. no. 22, https://doi.org/ 
10.1051/mfreview/2022019. 

[26] N. Vafaei, R. A. Ribeiro, and L. M. Camarinha-Matos, "Normalization 
Techniques for Multi-Criteria Decision Making: Analytical Hierarchy 
Process Case Study," in Doctoral Conference on Computing, Electrical 
and Industrial Systems, Costa de Caparica, Portugal, Apr. 2016, pp. 
261–269, https://doi.org/10.1007/978-3-319-31165-4_26. 

[27] A. Jahan and K. L. Edwards, "A state-of-the-art survey on the influence 
of normalization techniques in ranking: Improving the materials 
selection process in engineering design," Materials & Design, vol. 65, 
pp. 335–342, Jan. 2015, https://doi.org/10.1016/j.matdes.2014.09.022. 

[28] J. R. Kiger and D. J. Annibale, "A new method for group decision 
making and its application in medical trainee selection," Medical 
Education, vol. 50, no. 10, pp. 1045–1053, 2016, https://doi.org/ 
10.1111/medu.13112. 

[29] D. D. Trung, N. N. Ba, and D. H. Tien, "Application of the Curli method 
for multi-critical decision of grinding process," Journal of Applied 
Engineering Science, vol. 20, no. 3, pp. 634–643, 2022, https://doi.org/ 
10.5937/jaes0-35088. 

[30] D. D. Trung, "Multi-criteria decision making of turning operation based 
on PEG, PSI and CURLI methods," Manufacturing Review, vol. 9, 2022, 
Art. no. 9, https://doi.org/10.1051/mfreview/2022007. 

[31] D. D. Trung, "Comparison R and CURLI methods for multi-criteria 
decision making," Advanced Engineering Letters, vol. 1, no. 2, pp. 46–
56, Jul. 2022, https://doi.org/10.46793/adeletters.2022.1.2.3. 

[32] P. Chatterjee and S. Chakraborty, "A comparative analysis of VIKOR 
method and its variants," Decision Science Letters, vol. 5, no. 4, pp. 
469–486, 2016. 

[33] S. R. Maity and S. Chakraborty, "Grinding Wheel Abrasive Material 
Selection Using Fuzzy TOPSIS Method," Materials and Manufacturing 
Processes, vol. 28, no. 4, pp. 408–417, Apr. 2013, https://doi.org/ 
10.1080/10426914.2012.700159. 

[34] D. S. Pamucar, D. Bozanic, and A. Randelovic, "Multi-criteria decision 
making: An example of sensitivity analysis," Serbian Journal of 
Management, vol. 12, no. 1, pp. 1–27, 2017, https://doi.org/ 
10.5937/sjm12-9464. 

[35] A. Ozbek, "Supplier Selection with Fuzzy TOPSIS," Journal of 
Economics and Sustainable Development, vol. 6, no. 18, pp. 114–125, 
Jan. 2015.