Copyright © 2020 The Author(s). Published by VGTU Press This is an Open Access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons. org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. *Corresponding author. E-mail: lukasz.brzezicki@ug.edu.pl Business, Management and Education ISSN 2029-7491 / eISSN 2029-6169 2020 Volume 18 Issue 1: 73–87 https://doi.org/10.3846/bme.2020.11982 Introduction Higher education in 2018 has undergone another reform aimed at increasing quality. It is, therefore, reasonable to assess the effects of the previous system changes in higher educa- tion in 2011. The assumptions to the Act on Higher Education of 2011 indicated that “the MEASUREMENT OF EFFICIENCY OF DIDACTIC ACTIVITIES OF PUBLIC UNIVERSITIES OF TECHNOLOGY IN POLAND: DIRECTIONAL DISTANCE FUNCTION WITH UNDESIRABLE OUTPUT APPROACH Łukasz BRZEZICKI 1*, Robert RUSIELIK 2 1 University of Gdansk, Gdansk, Poland 2 West Pomeranian University of Technology in Szczecin, Szczecin, Poland Received 23 January 2020; accepted 09 March 2020 Abstract. Purpose – The conducted research aimed at estimating the technical efficiency of didactic activity in the group of universities of technology in Poland using the non-parametric Data Envelop- ment Analysis (DEA) method. Research methodology – The measurement was based on the model of directional distance function with undesirable output under variable return-to-scale and output-oriented (DDF BadOutput-V-O). Findings  – The research allowed to group universities in 2010 and 2015 into three categories, i.e. efficient universities and universities above and below the average efficiency. It has been shown that it is justified to use alternative models of efficiency measurement covering different perspectives. The application of the model from a financial and employment perspective showed significant dif- ferences in performance levels in some cases. Research limitations – This study only looks at universities of technology, so the future study should be extended to other universities and compare efficiency of higher education with the level of study effectiveness (dropout rate education, graduation rates). Practical implications – The use of the DDF model with undesirable output allowed to obtain results closer to the actual conditions of teaching in public universities than in the case of using classic DEA models, wich only take the desired output into accoount. Originality/Value  – The originality of the work lies in the use of a more general and flexible DDF approach than the classical DEA models, which made it possible to estimate the efficiency of uni- versities taking into account the desirable (positive) and undesirable (negative) output. Keywords: higher education, efficiency, DEA, DDF, undesirable output. JEL Classification: I22, I23. http://dx.doi.org/10.1016/S0377-2217(03)00091-2 http://dx.doi.org/10.1016/S0377-2217(03)00091-2 https://doi.org/10.3846/bme.2020.11982 https://orcid.org/0000-0002-0761-1109 https://orcid.org/0000-0001-9821-4047 74 Ł. Brzezicki, R. Rusielik. Measurement of efficiency of didactic activities of public universities... proposed changes are primarily of a pro-quality nature and lead to an improvement in the efficiency of spending public funds on higher education” (Ministerstwo Nauki i Szkolnictwa Wyższego [MNiSW], 2009, p. 22). The aforementioned problem has still not been adequately resolved because, in the justification to the draft law on higher education and science from 2017, attention is drawn, inter alia, on “unsatisfactory quality of higher education” (MNiSW, 2017, p. 3). In addition, it is indicated that (MNiSW, 2017, p. 1) “systemic problems in the area of higher education (...) negatively affect (...) the level of education of students and doctoral students. This is a premise for the reform (...), including changes in the function- ing of the system, management, financing and assessment of the quality of the university’s activities”. Nor can one disagree with Leja (2002, p. 16), who emphasizes that “assessing in- stitutional efficiency in higher education is necessary primarily because the financial (public) funds are allocated on the basis of indicators characterizing university achievements and activities”. The above-selected assumptions of the two reforms of the academic education system correspond to the requirements for management control of public entities in terms of efficiency and effectiveness of operations in accordance with art. 68 of the Public Finance Act (Ustawa z 27 sierpnia 2009 r.). These considerations indicate that the problem of measuring the effectiveness of higher education in the field of education is very important and requires in-depth research in this field. The purpose of this research was to assess the level of technical efficiency of teaching ac- tivities of universities of technology using the DEA method, taking into account the desired and undesirable output of the educational process. The article consists of six parts. After the introduction, the second part reviewed the lit- erature on the study of the efficiency of higher education. The next methodical part presents both the essence of measuring efficiency using DEA models that were used in the research and characterizes the empirical research. The fourth part presents the variables adopted for the study, and the next section presents the results of empirical research. The article con- cludes with conclusions and proposals for further research within the considered topic. 1. Review of the scientific literature A query in Polish and foreign literature shows that the non-parametric DEA (Data Envelop- ment Analysis) method (Charnes et al., 1978; Banker et al., 1984) is primarily used to mea- sure the efficiency of higher education. The parametric SFA (Stochastic Frontier Analysis) method is much less frequently used, which dates back to the late 1970s (Aigner et al., 1977; Meeusen & van den Broeck, 1977). Both methods determine the level of efficiency of the audited entity in relation to the efficiency limit. It should be remembered, however, that DEA, unlike SFA, is a deterministic method and does not include the so-called random component, making it more susceptible to measurement errors. Besides, DEA estimates the level of efficiency based on other units in the study group, rather than an independent model in the form of production functions or costs, as in the case of SFA (Brzezicki & Prędki, 2018). Nevertheless, the multitude of models that make up the DEA methodology makes it most commonly used to measure efficiency in higher education. Therefore, when reviewing the Business, Management and Education, 2020, 18(1): 73–87 75 literature on the subject, the focus was mainly on this method. Studies on the efficiency of higher education using the DEA method are carried out at several levels: from international comparisons of higher education systems (Wolszczak-Derlacz, 2015), to the national level of all 59 public universities (Ćwiąkała-Małys, 2010; Świtłyk, 2013) or selected groups universi- ties (Rusielik, 2010; Szuwarzyński & Julkowski, 2014; Brzezicki & Wolszczak-Derlacz, 2015; Brzezicki, 2017), up to the faculties of one (Pietrzak & Brzezicki, 2017) or several universities (Pietrzak, 2016). It is widely accepted that the main areas of activity of universities include: didactics and the scientific sphere. However, more and more often you can see that universities from sci- entific and culture-forming institutions “(...) they are clearly transforming into enterprises and even industrial universities” (Czerepaniak-Walczak, 2013, p. 11). Therefore, the literature on the subject began to use the concept of “entrepreneurial uni- versity” to define a university that functions in many areas, actively and flexibly adapt to the changing market and its needs, is constantly looking for new development opportunities and treats its stakeholders as clients (Wójcicka, 2006). According to the entrepreneurial university paradigm, the university’s areas of activity are teaching, research and cooperation with the socio-economic environment. Bearing these areas in mind, it can be seen in the literature that some of the authors only deal with research on the efficienty of didactics (e.g. Brzezicki & Wolszczak-Derlacz, 2015; Świtłyk, 2013), and some analyse both didactics and scientific re- search (e.g. Wolszczak-Derlacz & Parteka, 2011). However, more and more often, the authors try to capture data from all three areas of higher education (e.g. Pietrzak & Brzezicki, 2017). In the case of analysing didactic activity, the number of students, graduates (Ćwiąkała- Małys, 2010) was included on the results side, and for scientific activity - the number of publications, citations (Wolszczak-Derlacz, 2013), and in relation to activities for the socio- economic environment - the number of research projects, the value of grants (Pietrzak & Brzezicki, 2017; Wolszczak-Derlacz, 2013). However, expenditures were assumed to in- clude the number of academic teachers (Brzezicki & Wolszczak-Derlacz, 2015; Pietrzak & Brzezicki, 2017; Wolszczak-Derlacz & Parteka, 2011), other employees (Brzezicki & Wolszc- zak-Derlacz, 2015; Rusielik, 2010), the value of revenues (Brzezicki & Wolszczak-Derlacz, 2015; Wolszczak-Derlacz & Parteka, 2011) and various types of costs, e.g. consumption of materials and energy, external services, etc. (Rusielik, 2010; Świtłyk, 2013). However, the most commonly used input variables in the field of teaching include the number of aca- demic teachers, other employees, the number of students, graduates and various financial categories. As has already been mentioned earlier, various statistical and financial data were used to test efficient using the DEA method. However, it should be noted that in the case of didactic activity, the carrier of non-material educational services are people, while the very effect of the educational process is stretched in time, which is why it is subject to various perturba- tions (see Pietrzak, 2016). This causes some problems when defining the effects of the area related to education because depending on the purpose of the analysis, students (e.g. Rusielik, 2010) and once graduates (e.g. Wolszczak-Derlacz, 2013) were accepted as the product of the activity. 76 Ł. Brzezicki, R. Rusielik. Measurement of efficiency of didactic activities of public universities... However, as emphasized by Brzezicki (2017), graduates are naturally identified with the final education process, so their choice is logical and closer to the actual assessment of teach- ing activities. At the same time, one cannot disagree with Szuwarzyński (2006, p. 217–218), who indicates that “It is often assumed that a product is a graduate, but no one specifies how he obtained the diploma. Is it by the deadline or a year or two later? (...) These are also products that can be compared with defective products in a production company. They entail specific costs ... ”. Considering the fact that the Ministry of Science and Higher Education is both the owner of public universities and the main one financing the education service by means of a didactic subsidy, it is very important for as many people as possible to complete education in the nominal time provided for the education process and be able to move from the educational to the economic sphere by undertaking work. Taking into account both the perspective of the Ministry of Science and Higher Education, which expends specific public funds, including for didactic activities and for the universities themselves, which resources are used in the education process, it should be assumed that the most important thing is that the expenditure allocated for this purpose is used rationally and effectively (in accordance with the assumptions of management control) in the nominal time foreseen for studies for a given educational cycle. When analysing methodologically the research conducted using the DEA method, devot- ed to Polish higher education, a particular relationship was noticed. Two standard radial CCR and BCC models (e.g. Ćwiąkała-Małys, 2010; Świtłyk, 2013) are usually used for the study, with few exceptions in the form of, e.g. SBM (Rusielik, 2010; Szuwarzyński & Julkowski, 2014; Brzezicki, 2017), non-radial SBM network model (Pietrzak & Brzezicki, 2017), hybrid model with undesirable output (Brzezicki, 2018). Meanwhile, studies in foreign literature are increasingly appearing in which a new approach is used to assess efficiency using the directional distance function model (DDF), or the idea is used as the basis for building a new, much more advanced research methodology. Among the works in this area, it is worth mentioning (Barra & Zotti, 2016; Daraio et al., 2015; Yang et al., 2018; Villano & Tran, 2019). However, only Barra and Zotti (2016), using the function of directional distance, drew at- tention in their research to the so-called undesirable effects of didactic activity, taking into account a simple relational indicator of student resignation between the first and second year of study. According to the authors’ knowledge, the aforementioned problem signalled theoreti- cally by Szuwarzyński (2006) regarding the time of obtaining a diploma by higher education graduates, and the related issue of undesirable output of didactic activity, were first taken in Poland empirically by Brzezicki and Rusielik (2017), who included the number of students after the last year without a diploma, similar to Brzezicki (2018). This topic was also devel- oped by Szuwarzyński (2018), who adopted the student resignation rate between the first and second year of studies as an undesirable output, adopting the research convention of Barra and Zotti (2016). However, all the quoted studies do not fully cover the issue of the undesir- able output of teaching in higher education. This gaps in knowledge found the authors will try to fill empirically later in the article. To date, no analysis has been made in Poland of the issue to which Szuwarzyński (2006) drew attention, using a new approach to efficiency testing using the directional distance Business, Management and Education, 2020, 18(1): 73–87 77 function. In addition, delimiting this to the desired output of teaching activities when the graduate graduated in regular time and undesirable (negative) output of these activities if he exceeded the nominal period of study, which is a practical fulfilment of the assumptions of management control. 2. Research methodology As noted in the previous part of the work, the DEA method is used to study the efficienty of higher education more often than other methods. The beginnings of the DEA method go back to the article by Charnes, Cooper and Rhodes (1978), which presents the first DEA model called CCR, from initials of authors’ surnames, assuming a constant return to scale. However, the paper (Banker et  al., 1984) presents the second, basic BCC model, in which variable return to scale was adopted. The progress in measuring efficiency, caused by the use of a more general and flexible approach, which is the Directional Distance Function (DDF), has made this approach in- creasingly used to measure the efficiency of business entities under the DEA methodology. Färe and Grosskopf (2000), presenting the relationship between the Shephard distance func- tion (1953, 1970), whose idea is used in radial models, and the directional distance func- tion proposed by Chambers, Chung, and Färe (1996), indicate that it is an important tool in production theory. The Shephard distance function is a special case of the directional distance function. Färe and Primont (2006) argue that the functions of directional distance can be considered as an alternative to appropriate concepts for measuring radial efficiency. As already mentioned, the function of the directional distance was formally presented for the first time by Chambers, Chung, and Färe (1996, 1998), who used the work of Luenberger (1992a, 1992b, 1995) and redefined his benefit function and shortage function as measures of efficiency, introducing a new distance function for this purpose, which they called the directional distance function. In addition, they demonstrated the fact that the directional distance function covers other classic cases, including Shephard’s entry and exit functions. The advantage of the directional distance function is that it can be estimated using the same linear programming techniques that are used in the DEA methodology. The classic approach within the DEA methodology allows determining the effectiveness of the tested unit based on the efficiency criterion assuming that the production of a larger number of products (regardless of whether they meet expectations or not), using smaller re- sources is better than generating a smaller number of products. However, the above principle does not quite work in business practice because it does not include undesirable (defective) products of activity that occur during the production process. Most often, the company tries to produce as many desired products as possible and the least undesirable (e.g. due to a production error) that do not meet expectations. Therefore, the economic unit, called DMU (Decision Making Unit), whose production technology allows to generate more desirable products, in line with expectations and less undesirable (defective), using fewer resources, will be more efficient. Only Chung (1996) and Chung, Färe, and Grosskopf (1997) presented the possibilities of using the directional distance function in the situation of both desirable and undesirable 78 Ł. Brzezicki, R. Rusielik. Measurement of efficiency of didactic activities of public universities... output of the enterprise’s activity. The model of the directional distance function with unde- sirable output (DDF BadOutput) is based on the assumption that each DMU unit subjected to the test produces both the desired and unwanted output from the given inputs. This means that three groups of variables are used to estimate efficiency, i.e. input as well as desirable and undesirable (defective) output. The following symbols have been adopted: input vector in the form of Nx R+∈ , undesirable output Jb R+∈ , and desired My R+∈ , then the production technology can be described as: ( ) ( ){ }, , : can produce ,T x y b x y b= . (1) The directional distance function is based on scaling the relevant directional vectors ( ), , I S Kx y bg g g g R R R+ + += − − ∈ × × , which correspond to the individual variables, i.e. inputs ( xg− ) and desirable ( yg ) and undesirable ( bg− ) outputs. The directional distance is de- termined by the formula (Barra & Zotti, 2016, p. 171): ( ) ( ){ }, , , , , : , , x y b x y bD x y b g g g sup x g y g b g T= β −β +β −β   , (2) where β represents the distance between the observation for a given unit and the point on the efficient frontier, taking into account the direction vector determining the direction in which efficiency is measured. The directional distance function with undesired output, assuming a variable return to scale (BadOutput-V), can be estimated within the framework of the DEA methodology, for the object number o = 1, ..., n, as follows: max oβ ; 1 n jo ij io xio j x x g = λ ≤ −β∑ ; 1 n jo sj so yso j y y g = λ ≥ +β∑ ; 1 n jo kj ko bko j b b g = λ = −β∑ ; (3) 1 1 n jo j= λ =∑ ; 0, 1, , ; 1, , ; 1, , ; 1, ,jo i I s S j n k Kλ ≥ = … = … = … = … , where joλ is the intensity factor. However, the condition 1 1 n jo j= λ =∑ indicates that the mea- surement of efficiency will take place under the assumption of a variable return to scale. The β value is a measure of the inefficiency of the DMU being assessed. Therefore, if for a given DMU unit, the value β = 0 means that the tested entity is efficient, while the measure β > 0 indicates the inefficiency of the object. In order to determine the unit’s efficiency as suggested by Ray (2008), subtract the inefficiency index (β) calculated using the directional distance function (DDF), i.e. the level of efficiency = (1–β), from a value of 100% efficiency. The procedure presented by Ray (2008) was used in this study. Business, Management and Education, 2020, 18(1): 73–87 79 The model (3) in general is characterised by a lack of orientation (non-oriented), unlike many “classic” DEA models, including CCR and BCC. By adapting for the purposes of this ar- ticle the research convention of Barra and Zotti (2016), consisting in taking into account rel- evant desirable and undesirable output of didactic activity, it was decided to use the so-called output-oriented radial DDF model with the variable return to scale [DDF BadOutput-V-O]. The lack of orientation, which characterises the initial model, is therefore abandoned (3). This is a particular case of the model (3), which assumes ( ) ( ), , 0, , :x y b o og g g g y b= − − = − max oβ ; 1 n jo ij io j x x = λ ≤∑ ; ( ) 0 1 1 n jo sj s j y y = λ ≥ +β∑ ; ( ) 1 1 n jo kj ko j b b = λ = −β∑ ; (4) 1 1 n jo j= λ =∑ ; 0, 1, , ; 1, , ; 1, , ; 1, ,jo i I s S j n k Kλ ≥ = … = … = … = … . In order to properly perform the test using the DEA method, it is necessary to both de- termine the appropriate number of decision units (in relation to the total number of inputs and output), as well as to select them correctly to ensure the homogeneity of the analysed group of objects. Therefore, purposeful selection of objects subjected to analysis was made, adopting a group of 18 public technical universities supervised by the Ministry of Science and Higher Education (MNiSW): U1 – West Pomeranian University of Technology in Szczecin, U2 – Warsaw University of Technology, U3 – Białystok University of Technology, U4 – Uni- versity of Technology and Humanities in Bielsko-Biała, U5  – Częstochowa University of Technology, U6 – Gdańsk University of Technology, U7 – Silesian University of Technology in Gliwice, U8  – Kielce University of Technology, U9  – Koszalin University of Technology, U10  – Cracow University of Technology Tadeusza Kościuszki, U11  – AGH University of Science and Technology, U12 – Lublin University of Technology, U13 – Łódź University of Technology, U14 – Opole University of Technology, U15 – Poznan University of Technology, U16  – Kazimierz Pulaski University of Technology and Humanities in Radom, U17  – Rz- eszow University of Technology, U18 – Wroclaw University of Technology. 3. Variables adopted for empirical study The basis for the selection of variables for the study was the purpose of this work to analyse the efficiency of teaching activities in a situation of both positive and negative output. In ad- dition, attention was also paid to data used in the literature by other authors. The primary resources of universities include financial resources and employees. Therefore, they focused 80 Ł. Brzezicki, R. Rusielik. Measurement of efficiency of didactic activities of public universities... on defining inputs. Thus, the number of academic teachers (full-time and part-time) con- verted into full-time jobs was assumed as the first circulation  – X1. The second and last expenditure was the total value of teaching income in a given year – X2. Turning to the effects of teaching, two output were adopted, one desired (positive) and the other undesirable (negative). The total number of students (full-time and part-time) after the last year without a diploma who did not complete education in the nominal period, was used to define the undesirable output of didactic activity  – B1. However, the total number of graduates (full-time and part-time, including foreigners) – Y1, who are naturally identi- fied with the final education product, was adopted as the desired output of the educational process. Two empirical models (M-1, M-2) were adopted for the study, consisting of one input and two output (Table 1). Only the number of academic teachers (X1) was assumed for ex- penditure in the first empirical model (M-1), while the second model (M-2) included only the total value of teaching income (X2). The adoption of such a research convention results from the fact that the highest share in teaching income is a subsidy from the state budget, the amount of which depends, among others on the number of teaching staff. Therefore, there is a certain correlation between variables, so to eliminate it, one variable was adopted in both empirical models. On the other hand, the same variables characterizing the undesirable and desired output of didactic activities were adopted as output in the considered models, in the form of the number of students after the last year without a diploma (B1) and the number of graduates (Y1). It was assumed that a higher education institution whose production technol- ogy allows it to obtain more good output and less undesirable in terms of didactic activity is more technically efficient than other units. Table 1. Accepted inputs and output in empirical models (source: authors’ calculations) Name of the variable M-1 M-2 X1 – number of academic teachers (full-time and part-time) + – X2 – total value of teaching income – + B1 – number of students (full-time and part-time) after the last year without a diploma + + Y1 – number of graduates (full-time and part-time) + + Statistical data used in the study were taken from the publication “Higher education – basic data” (MNiSW, 2010, 2015) published by the Ministry of Science and Higher Educa- tion, and financial data from reports on the implementation of the material and financial plan of individual universities published in the public judicial and economic monitor (MS, 2010–2015). The adoption of data from 2010 and 2015, makes it possible to illustrate the situation before and after the introduction of the reform of higher education in Poland in 2011. Business, Management and Education, 2020, 18(1): 73–87 81 4. Results and discussion Table  2 presents a summary of results of measuring the efficiency of teaching activities in 2010 and 2015 for the M-1 model (regarding the number of employees) and the M-2 model (related to the total value of teaching income). Table 2. The efficiency of educational activities of public technical universities in 2010 and 2015 (source: authors’ calculations) Year 2010 2015 2010 2015 Model M-1 M-2 M-1 M-2 Difference [(M-1)– (M-2)] U1 0.87 0.87 0.50 0.50 –0.01 0.00 U2 0.95 0.95 0.71 0.71 0.00 0.00 U3 1.00 1.00 0.64 0.66 0.00 –0.03 U4 1.00 1.00 1.00 1.00 0.00 0.00 U5 1.00 1.00 0.58 0.79 0.00 –0.21 U6 0.62 0.60 0.83 0.77 0.02 0.06 U7 1.00 1.00 0.89 0.90 0.00 –0.01 U8 0.74 0.58 0.89 0.97 0.16 –0.08 U9 1.00 1.00 0.68 0.84 0.00 –0.16 U10 0.76 0.76 0.73 0.75 0.00 –0.02 U11 0.78 0.78 1.00 1.00 0.00 0.00 U12 0.55 0.56 0.71 0.70 0.00 0.01 U13 0.71 0.71 0.58 0.55 0.00 0.03 U14 1.00 0.99 1.00 1.00 0.01 0.00 U15 1.00 1.00 0.88 0.90 0.00 –0.02 U16 0.92 1.00 1.00 1.00 –0.08 0.00 U17 0.88 0.81 1.00 1.00 0.06 0.00 U18 1.00 1.00 0.87 0.84 0.00 0.03 Minimum 0.55 0.56 0.50 0.50 Average 0.88 0.87 0.81 0.83 Maximum 1.00 1.00 1.00 1.00 Std. deviation 0.15 0.16 0.17 0.16 The average technical efficiency in 2010 was 0.88 for the M-1 model, while for the M-2 model, it was 0.87. In turn, in 2015 it was respectively 0.81 for the M-1 model and 0.83 for the M-2 model. It can be stated that in 2015 the overall level of efficiency decreased by a few percentage points. In 2010, the lowest efficiency indicators for both models were recorded at the Lublin University of Technology, while in 2015 it was the West Pomeranian University of Technology. Analysing the differences between the model covering the number of academic teachers (M-1) and the model covering the value of teaching income (M-2), it can be stated that in 2010 in three universities these differences were significant. The biggest difference between 82 Ł. Brzezicki, R. Rusielik. Measurement of efficiency of didactic activities of public universities... the analysed models was found at the Kielce University of Technology, and it was about 16%. In turn, at the University of Technology and Humanities in Radom this difference was  –8%, and at the Rzeszów University of Technology 6%. Generally, it can be stated that the differences between the analysed models (apart from the cases mentioned) are small. This confirms the calculated average efficiency level of both models. It is worth noting that only in the case of the University of Technology and Humanities in Radom the M-2 model had a higher indicator level than the M-1 model. In turn, in 2015, the differences between the two models were definitely larger. The level of performance indicators for the M-2 model is higher than for the M-1 model. In some cases, these differences are very significant, e.g. at the Częstochowa University of Technology, they amounted to  –21%, and at the Koszalin University of Technology  –16%. It can be stated that 2015 is definitely more diverse in this respect than in 2010. In the next step, an attempt was made to group the analysed universities in terms of the efficiency indicator level. The universities were divided into three groups. Group A, i.e. ef- ficient universities where the level of the efficiency ratio is 1.0. Group B, where the level of efficiency is above the average for a given year and model, and group C where the efficiency is below this average. The results of the grouping are included in Table 3. Table 3. Grouping of public technical universities in 2010 and 2015 (source: authors’ calculations) Model M-1 M-2 M-1 M-2 Year 2010 2015 U1 C B C C U2 B B C C U3 A A C C U4 A A A A U5 A A C C U6 C C B C U7 A A B B U8 C C B B U9 A A C B U10 C C C C U11 C C A A U12 C C C C U13 C C C C U14 A B A A U15 A A B B U16 B A A A U17 B C A A U18 A A B B Group Numerosity A 8 8 5 5 B 3 3 5 5 C 7 7 8 8 Business, Management and Education, 2020, 18(1): 73–87 83 Based on the grouping results, it was noticed that there are differences in the level of efficiency between the analysed years. In 2010, there were eight efficient universities, three colleges in group A and seven colleges in group B. In 2015, there were five efficient colleges, in group B there were also five colleges and eight universities in group C. Only one university was recorded, which was fully efficient both in the case of two em- pirical models and in both analysed years. This university was the University of Technology and Humanities in Bielsko-Biała. There were also three universities, which in each of the analysed cases belonged to group C. They were the University of Technology in: Cracow, Lublin and Łódź. Only two universities, i.e. Białystok University of Technology and Częstochowa Univer- sity of Technology “fell” from the efficient A group to the least efficient C group between the analysed years. You can also include the Koszalin University of Technology. However, in the case of AGH, there was a transition from group C to group A. A similar situation occurred at the Rzeszów University of Technology. In other cases, transfers between the groups occurred from group A to B or from group B to C. Comparing the analysed years; one can notice a tendency to move to a lower efficiency category. Conclusions In this study, the level of efficiency of teaching activities of universities in individual years has been analysed. The use of the DDF model with undesirable output allowed to obtain results closer to the actual conditions of teaching in public universities than in the case of using classic DEA models, which take into account only the desired output. On the other hand, the use of two alternative models, in which in one case the number of teachers (M-1) was adopted as an input, and in the other the value of teaching income (M-2) allows to determine the differences in the results obtained for some universities. This indicates the validity of using alternative models to assess the efficiency of individual uni- versities. Such extended analysis, carried out from different perspectives, gives a complete picture of the examined level of efficiency. The analysis showed that the average level of the efficiency ratio in 2015 decreased com- pared to 2010 by 4–6 percentage points. The number of universities considered efficient also decreased. Among the analysed universities, only the University of Technology and Humani- ties in Bielsko-Biała showed full technical efficiency in all analytical variants. On the other hand, three universities were noted, which in all analyses were below average efficiency. Future research directions should take into account the quality of academic education and the links between education and the labour market. The second important research direc- tion should be analysis, which affects the efficiency of studying and reducing the number of people who do not finish education in the nominal duration. Acknowledgements The authors thank the Ministry of Science and Higher Education in Poland for providing the data necessary to conduct this study. 84 Ł. Brzezicki, R. Rusielik. Measurement of efficiency of didactic activities of public universities... Funding This work was not supported by any funding agency. Author contributions ŁB developed the research concept and wrote the following parts of the article: Introduction, Review of the scientific literature, Research methodology, Variables adopted for empirical study. ŁB was responsible for data acquisition and efficiency assessment. RR was responsible for analysing the results and writing the following parts of the article: Results and discussion, Conclusions. Disclosure statement Authors declare they haven’t any competing financial, professional, or personal interests from other parties. References Aigner, D., Lovell, C.  A.  K., & Schmidt, P. (1977). Formulation and estimation of stochastic frontier production function models. Journal of Econometrics, 6, 21–37. https://doi.org/10.1016/0304-4076(77)90052-5 Banker,  R.  D., Charnes, A., & Cooper,  W.  W. (1984). Some models for estimating technical and scale inefficiencies in data envelopment analysis. Management Science, 30, 1078–1092. https://doi.org/10.1287/mnsc.30.9.1078 Barra, C., & Zotti, R. (2016). A directional distance approach applied to higher education: an analysis of teaching-related output efficiency. Annals of Public and Cooperative Economics, 87(2), 145–173. https://doi.org/10.1111/apce.12091 Brzezicki, Ł. (2017). Efektywność działalności dydaktycznej polskiego szkolnictwa wyższego [Efficiency of teaching activity of Polish higher education]. Wiadomości Statystyczne, 11(678), 56–73. Brzezicki, Ł., & Prędki, A. (2018). Zastosowanie metod DEA, SFA oraz StoNED do pomiaru efektywności publicznych szkół wyższych [The use of DEA, SFA and StoNED methods to measure the efficiency of public higher education]. Wiadomości Statystyczne, 5(684), 5–24. https://doi.org/10.5604/01.3001.0014.0648 Brzezicki Ł., & Wolszczak-Derlacz, J. (2015). Ocena efektywności działalności dydaktycznej public- znych szkół wyższych w Polsce wraz z analizą czynników ją determinujących [Evaluation of tech- ing efficiency of Polish public higher education institutions and analysis of its determinants]. Acta Universitatis Nicolai Copernici. Ekonomia, 46(1), 123–139. https://doi.org/10.12775/AUNC_ECON.2015.006 Brzezicki, Ł. (2018). Pomiar efektywności i (nie-)skuteczności pośredniej studiów w polskim public- znym szkolnictwie wyższym [Measuring the efficiency and (in)effectiveness of studies Polish public higher education]. Zeszyty Naukowe Politechniki Śląskiej. Seria: Organizacja i Zarządzanie, 132, 97–117. Brzezicki, Ł., & Rusielik, R. (2017). Pomiar produktywności działalności dydaktycznej polskich uczelni technicznych [Measurement of the education productivity in Polish public technical universities]. Studia Ekonomiczne, 3, 332–354. https://doi.org/10.1016/0304-4076(77)90052-5 https://doi.org/10.1287/mnsc.30.9.1078 https://doi.org/10.1111/apce.12091 https://doi.org/10.5604/01.3001.0014.0648 https://doi.org/10.12775/AUNC_ECON.2015.006 Business, Management and Education, 2020, 18(1): 73–87 85 Chambers,  R.  G., Chung, Y., & Färe, R. (1996). Benefit and distance functions. Journal of Economic Theory, 70, 407–419. https://doi.org/10.1016/0377-2217(79)90229-7 Chambers, R., Chung, Y., & Färe, R. (1998). Profit, directional distance functions, and nerlovian ef- ficiency. Journal of Optimization Theory and Applications, 98, 351–364. https://doi.org/10.1023/a:1022637501082 Charnes, A., Cooper, W. W., & Rhodes, E. (1978). Measuring the efficiency of decision-making units. European Journal of Operational Research, 2, 429–444. https://doi.org/10.1016/0377-2217(79)90229-7 Chung, Y. (1996). Directional distance functions and undesirable outputs (Unpublished doctoral disserta- tion). Southern Illinois University at Carbondale. Chung,  Y.  H., Färe, R., & Grosskopf, S. (1997). Productivity and undesirable outputs: A directional distance function approach. Journal of Environmental Management, 51, 229–240. https://doi.org/10.1006/jema.1997.0146 Czerepaniak-Walczak, M. (2013). Wprowadzenie (Introduction). In M. Czerepaniak-Walczak (Ed.), Fabryki dyplomów czy universitas?(Diploma Factories or the University?) (pp. 10–26). Impuls. Ćwiąkała-Małys, A. (2010). Pomiar efektywności procesu kształcenia w publicznym szkolnictwie aka- demickim [measuring the efficiency of the education process in public academic education]. Wydawnictwo Uniwersytetu Wrocławskiego. Daraio, C., Bonaccorsi, A., & Simar, L. (2015). Efficiency and economies of scale and specialization in European universities: A directional distance approach. Journal of Informetrics, 9(3), 430–448. https://doi.org/10.1016/j.joi.2015.03.002 Färe, R., & Grosskopf, S. (2000). Theory and application of directional distance functions. Journal of Productivity Analysis, 13, 93–103. https://doi.org/10.1023/A:1007844628920 Färe, R., & Primont, D. (2006). Directional duality theory. Economic Theory, 29, 239–247. https://doi.org/10.1007/s00199-005-0008-z Leja, K. (2002). Instytucja akademicka: strategia, efektywność, jakość [Academic institution: Strategy, efficiency, qualit]. Gdańskie Towarzystwo Naukowe. Luenberger, D. G. (1992a). Benefit functions and duality. Journal of Mathematical Economics, 21, 461– 481. https://doi.org/10.1016/0304-4068(92)90035-6 Luenberger, D. (1992b). New optimality principles for economic efficiency and equilibrium. Journal of Optimization Theory and Applications, 75, 221–264. https://doi.org/10.1007/BF00941466 Luenberger, D. (1995). Microeconomic theory. McGraw Hill. Meeusen, W., & van den Broeck, J. (1977). Efficiency estimation from Cobb-Douglas production func- tions with composed error. International Economic Review, 18, 435–444. https://doi.org/10.2307/2525757 Ministerstwo Nauki i Szkolnictwa Wyższego. (2009). Założenia do nowelizacji ustawy – Prawo o szkol- nictwie wyższym oraz ustawy o stopniach naukowych i tytule naukowym oraz o stopniach i tytule w zakresie sztuki [Assumptions to the Amendment of the Law on Higher Education and The Law on Academic Degrees and Title and Degrees and Title in Art]. http://www.bip.nauka.gov.pl/g2/ oryginal/2013_05/a77439f526899374e5924d6156f35dc3.pdf Ministerstwo Nauki i Szkolnictwa Wyższego. (2010). Szkoły wyższe – dane podstawowe [Higher educa- tion institutions – basic data]. Warszawa. Ministerstwo Nauki i Szkolnictwa Wyższego. (2015). Szkoły wyższe – dane podstawowe [Higher educa- tion institutions – basic data]. Warszawa. Ministerstwo Nauki i Szkolnictwa Wyższego. (2017). Uzasadnienie do projektu ustawy prawo o szkol- nictwie wyższym i nauce [Explanatory Memorandum to The Draft Act on Higher Education and https://doi.org/10.1016/0377-2217(79)90229-7 https://doi.org/10.1023/a:1022637501082 https://doi.org/10.1016/0377-2217(79)90229-7 https://doi.org/10.1006/jema.1997.0146 https://doi.org/10.1016/j.joi.2015.03.002 https://doi.org/10.1023/A:1007844628920 https://doi.org/10.1007/s00199-005-0008-z https://doi.org/10.1016/0304-4068(92)90035-6 https://doi.org/10.1007/BF00941466 https://doi.org/10.2307/2525757 http://www.bip.nauka.gov.pl/g2/oryginal/2013_05/a77439f526899374e5924d6156f35dc3.pdf http://www.bip.nauka.gov.pl/g2/oryginal/2013_05/a77439f526899374e5924d6156f35dc3.pdf 86 Ł. Brzezicki, R. Rusielik. Measurement of efficiency of didactic activities of public universities... Science]. http://konstytucjadlanauki.gov.pl/content/uploads/2017/09/uzasadnienie-do-projektu- ustawy-prawo-o-szkolnictwie-wyzszym-i-nauce-16092017.pdf MS. (2010–2015). https://ems.ms.gov.pl/msig/przegladaniemonitorow Pietrzak, P. (2016). Efektywność funkcjonowania publicznych szkół wyższych w Polsce [Efficiency of func- tioning of public higher education institutions in Poland]. Wydawnictwo Szkoły Głównej Gospo- darstwa Wiejskiego w Warszawie. Pietrzak, P., & Brzezicki, Ł. (2017). Wykorzystanie sieciowego modelu DEA do pomiaru efektywności wydziałów Politechniki Warszawskiej [Application of the network DEA method to measure the efficiency of faculties at the Warsaw University of Technology]. Edukacja, 3(142), 83–93. https://doi.org/10.24131/3724.170306 Ray, S. C. (2008). The directional distance function and measurement of super-efficiency: An applica- tion to airlines data. Journal of the Operational Research Society, 59(6), 788–797. https://doi.org/10.1057/palgrave.jors.2602392 Rusielik, R. (2010). Zastosowanie metody DEA do porównania procesów dydaktycznych w szkołach wyższych [Application of DEA method to compare the teaching processes in higher education]. Prace Naukowe Uniwersytetu Ekonomicznego we Wrocławiu, 113, 779–795. Shephard, R. W. (1953). Cost and production functions. Princeton University Press. Shephard, R. W. (1970). Theory of cost and production functions. Princeton University Press. Szuwarzyński, A. (2006). Rola pomiaru efektywności szkoły wyższej w kształtowaniu jej pozycji konkurencyjnej [The role of measuring the efficiency of a university in shaping its competitive posi- tion]. In J. Dietl & Z. Sapijaszka (Eds.), Konkurencja na rynku usług edukacji wyższej (pp. 213–224). Fundacja Edukacyjna Przedsiębiorczości. Szuwarzyński, A., & Julkowski, B. (2014). Wykorzystanie wskaźników złożonych i metod nieparametry- cznych do oceny i poprawy efektywności funkcjonowania wyższych uczelni technicznych [Applica- tion of composite indicators and nonparametric methods to evaluate and improve the efficiency of the technical universities]. Edukacja, 3(128), 54–74. Szuwarzyński, A. (2018). Ocena efektywności procesu dyplomowania na studiach pierwszego stopnia w polskich publicznych uczelniach technicznych [Assessment of the graduation process efficiency on the first degree studies in Polish public technical universities]. Nauka i Szkolnictwo Wyższe, 2(52), 85–111. https://doi.org/10.14746/nisw.2018.2.2 Świtłyk, M. (2013). Efektywność dydaktyki w uczelniach publicznych w Polsce [The efficiency of teach- ing in Polish public universities]. Ekonomia, 1(22), 9–28. Ustawa z 27 sierpnia 2009 r. o finansach publicznych [Public Finance Act of 27 August 2009] (Dz. U. 2009 Nr 157, poz. 1240, ze zm.). Villano,  R.  A., & Tran, C-D.  T.  T. (2019). Technical efficiency heterogeneity of tertiary institutions in Viet Nam: A meta-frontier directional technology approach. Technological and Economic Develop- ment of Economy, 25(6), 1058–1080. https://doi.org/10.3846/tede.2019.7452 Wolszczak-Derlacz, J. (2013). Efektywność naukowa dydaktyczna i wdrożeniowa publicznych szkół wyższych w Polsce – analiza nieparametryczna [Research, teaching and implementation efficiency of public universities in Poland]. Wydawnictwo Politechniki Gdańskiej. Wolszczak-Derlacz, J. (2015). Analiza efektywności działalności uczelni europejskich i amerykańskich – podejście nieparametryczne [Analysis of efficiency of European and American higher education in- stitutions – Nonparametric Approach]. Ekonomia. Rynek, Gospodarka, Społeczeństwo, 40, 109–130. https://doi.org/10.17451/eko/40/2015/76 Wolszczak-Derlacz, J., & Parteka, A. (2011). Efficiency of European public higher education institutions: A two-stage multicountry approach. Scientometrics, 89, 887–917. https://doi.org/10.1007/s11192-011-0484-9 http://konstytucjadlanauki.gov.pl/content/uploads/2017/09/uzasadnienie-do-projektu-ustawy-prawo-o-szkolnictwie-wyzszym-i-nauce-16092017.pdf http://konstytucjadlanauki.gov.pl/content/uploads/2017/09/uzasadnienie-do-projektu-ustawy-prawo-o-szkolnictwie-wyzszym-i-nauce-16092017.pdf https://ems.ms.gov.pl/msig/przegladaniemonitorow https://doi.org/10.24131/3724.170306 https://doi.org/10.1057/palgrave.jors.2602392 https://doi.org/10.14746/nisw.2018.2.2 https://doi.org/10.3846/tede.2019.7452 http://dx.doi.org/10.17451/eko/40/2015/76 https://doi.org/10.1007/s11192-011-0484-9 Business, Management and Education, 2020, 18(1): 73–87 87 Wójcicka, M. (2006). Uniwersytet i jego otoczenie – dwa sposoby podejścia i ich możliwe konsekwencje [The university and its environment – Two approaches and their possible consequences]. In K. Leja (Ed.), Problemy zarządzania w uczelni opartej na wiedzy (pp. 15–24). Wydawnictwo Politechniki Gdańskiej. Yang, G.-L., Fukuyama, H., & Song, Y.-Y. (2018). Measuring the inefficiency of Chinese research uni- versities based on a two-stage network DEA model. Journal of Informetrics, 12, 10–30. https://doi.org/10.1016/j.joi.2017.11.002 https://doi.org/10.1016/j.joi.2017.11.002