Acta Polytechnica CTU Proceedings https://doi.org/10.14311/APP.2023.41.0008 Acta Polytechnica CTU Proceedings 41:8–14, 2023 © 2023 The Author(s). Licensed under a CC-BY 4.0 licence Published by the Czech Technical University in Prague LEVEL OF SERVICE OF PUBLIC TRANSPORT OPERATION – PILOT STUDY Markéta Jirmanová∗, Vojtěch Novotný, Nikol Dousková Czech Technical University in Prague, Faculty of Transportation Sciences, Department of Transportation Systems, Horská 3, 12803 Prague, Czech Republic ∗ corresponding author: jirmamar@fd.cvut.cz Abstract. Smart transport planning based on the use of available data while supporting sustainable transport modes is an integral part of the Smart city concept. This article presents a critical analysis of the Level of Service of Public Transport Operation Assessment Method, which is based on two indicators – the reliability index and the travel speed index. The method is applied to a larger sample of data from several different cities, it makes it possible to evaluate the possible shortcomings of the method, since the method has not yet been applied to such a large number of case studies. Keywords: Public transport priority, smart city, level of service. 1. Introduction The overall increase in urban population mobility has recently created a greater demand for sustainable mo- bility, which is essential for future urban development and meeting the goals of EU Green Deal 2050 [1–3]. Considering the capacity of city roads to be filled with cars, it is important to focus on urban public trans- port, which is a suitable and sustainable alternative to individual car transport [2, 4]. From the sustainable development point of view, there is a need to identify an efficient modal-split and to increase the share of other modes of transport, whereas use of private cars must be reduced [5]. Considering the options for other modes of transport around the city, public transport must be the backbone of sustainable urban mobil- ity [6, 7]. The role of public transport today is not simple, as high road traffic volumes have a negative im- pact on its speed and reliability. From the passenger’s point of view, the main criteria required by customers or potential users is the travel time, reliability or the cleanliness of the cars [8]. We can further divide pub- lic transport quality indicators into subjective and objective [9]. Subjective factors such as the cleanli- ness and comfort of the indicator are not so easy to assess, and it is necessary to directly ask the opinion of the passengers [10]. Objective indicators are those that can be determined from the collected data, these indicators are conclusive, for example travel time, ad- herence to timetables (reliability), delays and others. These objective indicators have a great influence on the use of public transport, as they have a very high influence when deciding whether a passenger will drive their own car or use public transport. 2. Quality of public transport operation and its assessment method In the past, the evaluation of public transport opera- tion was often limited to the evaluation of parameters related to the economics (the so-called circulating or technical speed), or the evaluation of the delay of the connection in reaching the destination. Achievement of travel speed and reliability was often expressed in terms of whole lines, not in terms of individual sec- tions, and the achieved values were compared with the timetable data, which by its very nature (timetable for whole minutes, artificially extended travel times in sec- tions with regular congestion, etc.) is not a completely objective evaluation. The development of ICT and the real-time posi- tioning of public transport vehicles have brought new data sources and new possibilities for their process- ing – whether for the purposes of public transport network operation management (for example [12]) or transport planning (for example [13]). Although there have been other ways of evaluating public transport operations (for example [14] or [9]), most of them work with a more global view and cannot be used as an analytical tool for evaluating individual sections. In 2017, The Quality of Public Transport Operation Assessment Method was created as a response to the lack of an objective data-based method for evaluating the quality of traffic and identifying problematic loca- tions or sections in terms of public transport operation on urban roads (e.g. trams, buses/trolleybuses) [11]. The aim of the method is to provide transport engi- neers with an analytical tool to assess the operation of public transport across the network and to identify sections where public transport operations need to be improved through the implementation of priority measures and thereby improving the quality of public transport and which would lead to more people using 8 https://doi.org/10.14311/APP.2023.41.0008 https://creativecommons.org/licenses/by/4.0/ https://www.cvut.cz/en vol. 41/2023 Public Transport Operation Service Figure 1. Quality of public transport operation and its relation to passengers’ perception of the quality of public transport [11]. Figure 2. Same travel time achieved throughout the day – a section with reliable public transport service [11]. this mode of transportation. The method is generally based on assessment of travel speed and reliability of public transport in in- termediate stop sections, which basically corresponds to the passengers’ perception of the quality of public transport operation (see Figure 1). The Method is based on level-of-service theory and uses objective data-based evaluation of travel speed and reliability [11]. In order to maintain objectivity, both parameters are evaluated only on the basis of the available data on the movement of public trans- port services in a given inter-stop section, respectively their time positions in the stops. The evaluation of these parameters is then aggregated into an overall level of service for unambiguous evaluation and easy presentability. In this context, the method can form one part of the implementation of the smart city con- cept [9]. 2.1. Reliability evaluation For public transport to be considered reliable, it needs to have the same travel time regardless of the time of day or traffic situation. This means that in the case of a graphical display, the values for each travel time should form a horizontal line as seen in Figure 2, on the contrary, in case of unreliable operation, the graph will show high deviations from the average, as seen in Figure 3. For interest, the graphs also show the travel time according to the timetable (usually given in whole minutes), which illustrates the inapplicabil- ity of evaluating timetable compliance in individual intermediate stop sections. For the purposes of the method, the reliability of the operation is expressed by the reliability index. This is now calculated as the standard deviation divided by the length of the segment (a longer segment will tend to greater deviations, therefore it would not be objective without the length of the segment), the whole multiplied by 1000, for the sake of clarity of the index. 9 M. Jirmanová, V. Novotný, N. Dousková Acta Polytechnica CTU Proceedings Figure 3. Typical evolution of travel times affected by the traffic situation – a section with unreliable public transport operation [11]. i(relA−B) = σT T s · 1000 = √ 1 n ∑n i=1 [xT T − E (XT T )]2 s · 1000 (1) 2.2. Travel speed evaluation The second indicator that the method uses is travel speed. In this case, it is necessary to determine the so-called decisive travel speed, which is determined as a ten percent percentile (10% percentile was deter- mined using small sample of data) (2). This should be the highest most often achievable speed that the vehicle can drive, i.e. the speed that the vehicle should ideally achieve when passing freely through the sec- tion. This decisive speed is then used to determine the travel speed index by dividing the average travel speed by the decisive speed (3). V (relA−B;dec) = 0.06 sA−B Q10 (tcest;A−B) (2) i (vcest;A−B) = V (cestA−B;avg) V (cestA−B;dec) (3) 2.3. Final level of service of public transport operation For both indices, a linguistic value is subsequently determined according to their calculated numerical value. Each index has a so-called function for the lin- guistic values of the quality of public transport. For the reliability index, a linguistic value of 100% “excel- lent” corresponds to a value of 0.2. Furthermore, as the numerical value of the reliability index increases, the linguistic value deteriorates up to the value “unac- ceptable”, which for 100% corresponds to a reliability index of 1.5 and higher, as can be seen on Figure 4. For the travel speed index, the situation is the opposite, as can be seen in Figure 5. If the travel speed index is higher than 0.9, its linguistic value is 100% “excellent”, then the lower it is, the worse the linguistic value. If it falls below 0.5, its value is 100% “unacceptable”. From these two linguistic values, the total value of the service level of the given section is then obtained by logical rules. Simplistically, the sum of all affiliations of the two indices is made and whichever linguistic value prevails in the sum of affiliations is the overall Level of Service. Further, it is only converted to integer values, where “unacceptable” corresponds to a value of 5 and “excellent” corresponds to a value of 1. 3. Testing the method – a pilot study However, The Level of Service of Public Transport Operation Assessment Method was originally tested on a small sample of data [11]. The logical next step was to pilot test the method on a larger sample of data and subject it to critical analysis based on the results. Pilot testing was carried out on a total of 107 inter- stop sections of tram or bus services in 4 cities (Prague, Brno, Pilsen and Budapest). The sections were se- lected to form a representative sample – tram and bus sections, sections with and without a dedicated carriageway (e.g. a separate tramway or bus lane), sections with regular congestions and, for example, tram sections in the pedestrian zone. 3.1. Obtaining input data Due to the different data acquisition systems in the cities, it was necessary to first adjust and unify the input data for the evaluation. This was done using 10 vol. 41/2023 Public Transport Operation Service Figure 4. Reliability index and membership function for linguistic values of the quality of public transport traffic [11]. Figure 5. Travel speed index and membership function for linguistic values of the quality of public transport traffic [11]. Python. In order to apply the data to the method, it is necessary to know mainly the time and date of arrival and departure from both stops of one section. Data from cities can have two formats, according to which vehicles report either only arrival or only departure from the stop (arrival – departure, arrival – arrival), therefore the driving time is extended by the time of standing at the stop, or the vehicle reports both, therefore it is possible to get the exact value of the driving time in the section (departure – arrival). A 2-week sample of data was processed from each section. 3.2. Using power BI software to evaluate level of service In order to evaluate such a large number of sections, it was necessary to create at least a partially automated evaluation of the Level of Service. For this purpose, was used software Power BI and was created an eval- uation sheet for each section separately. This sheet contains basic information about the given section so that it is possible to better imagine the traffic situ- ation on the given section (Figure 6). Only working days are used to display graphs in the travel time model. Thanks to this, it is possible to better recall the traffic situation and clearly see the impact of rush hours on the operation of public transport buses. To identify various extraordinary events in traffic or other inconsistencies in the used data, a table is used that shows the average travel time in hourly sections for each day separately. Thanks to the gradual coloring from the darkest red (longest travel time) to white (shortest travel time), it is possible to see different fluctuations during the day and the trend of travel times for each day separately (Figure 7). Likewise, it is possible to detect data inconsistency using hourly slice charts for each day. It is also possible to find here a comparison of the delay in the section compared to 11 M. Jirmanová, V. Novotný, N. Dousková Acta Polytechnica CTU Proceedings Figure 6. Travel speed index and membership function for linguistic values of the quality of public transport traffic [11]. Figure 7. A table used for identifying various extraordinary events in traffic or other inconsistencies in the used data. the timetable. Since the driving time according to the timetable can be artificially adjusted, it is then possible to see whether this value has really been ar- tificially extended or whether it is close to the ideal driving time. 4. Results and critical analysis of the pilot study After evaluating the level of service for all of 107 sections, the results were confronted with both expert expectations and the behaviour of the travel speed and reliability indices depending on the type and characteristics of the section. Most of the sections that were selected and eval- uated correspond to the assumptions of the level of service if there were no traffic abnormalities on the measured days. However, the analysis opened some questions or pointed to the need to calibrate the method: • Determination of decisive travel speed is the 10 percent quantile really appropriate? • Too much influence of the reliability index on the resulting level of service, especially for short sec- tions. • The need to refine the calibration of the linguistic function of affiliation. 4.1. Determination of decisive travel time/speed Now the decisive travel time/speed is determined as the ten percent percentile of all measured travel times. 12 vol. 41/2023 Public Transport Operation Service Figure 8. Graph of index dependence on section length and their linear trends. Anyway, this value was created as an estimate based on a small sample of data, so it is now necessary to verify that this value is closest to the ideal travel time. One of the main factors that could influence the determination of the decisive travel time/drive is the time span of the data used. If values are used that do not include night connections, such as the time span 8:00–20:00, the value of the decisive travel time on a section loaded with individual car traffic is likely to be significantly higher than if the night lines that go after almost ideal conditions. Likewise, the total number of connections per day could have a decisive travel time value, or it is possible that a minimum number of connections per day will need to be determined for which the mathematical evaluation formula will be relevant. 4.2. Short sections and excessive influence of the value of the reliability index on the Level of Service The problem of short sections and too much influence on the overall level of service can be seen in the fol- lowing graph. For the purposes of this graph, both indices (reliability index and travel time index) were recalculated to the numerical value “Level of service”, from which the average of these two values is used to determine the overall level of service of the entire section, these values are displayed on the y-axis, the length of individual sections is then displayed on the x-axis. When displaying trends, ideally, the curve should be horizontal, thus the length of the section would not affect the Level of Service. As can be seen on the graph (Figure 8), the trend of the overall Level of Service is decreasing, so the longer the section, the better the Level of Service. At the same time, the Level of Service trend curve has the same slope as the reliability index trend curve, on the contrary, the travel speed index curve is almost horizontal, from which it can be concluded that the reliability index has a greater influence on the overall Level of Service of the section compared to the travel speed index. 4.3. Linguistic functions of affiliation Like decisive travel time, the linguistic affiliation func- tions were created based on small amount of data. This is not a significant problem when evaluating the method, however, due to the possibility of evaluation on a larger sample of data, it would be good to fo- cus on specific linguistic functions and verify whether these values correspond to reality. 5. Conclusion Thanks to the evaluation of 107 sections and the imple- mentation of The Level of Service of Public Transport Operation Assessment Method on real data in 4 dif- ferent cities, it was verified that the Method could be a suitable evaluation tool for identifying problem sec- tions on the network where the quality of public trans- port operation is insufficient. And therefore, where it would be appropriate to make preferential measures for public transport, or to optimize the operation of public transport in another way. The calibration and correction of the identified problems in this work is an- other important step towards the practical use of The Level of Service of Public Transport Operation As- sessment Method and the improvement of the quality of public transport. References [1] G. Beirão, J. S. Cabral. Enhancing service quality in public transport systems. In WIT Transactions on The Built Environment, Vol 89. WIT Press, 2006. https://doi.org/10.2495/ut060811 13 https://doi.org/10.2495/ut060811 M. Jirmanová, V. Novotný, N. Dousková Acta Polytechnica CTU Proceedings [2] EUR-Lex Green Deal for Europe. Brusell, BE; 2019. [2022-09-10] https: //eur-lex.europa.eu/legal-content/CS/TXT/?qid= 1596443911913&uri=CELEX:52019DC0640#document2. [3] D. Banister. The sustainable mobility paradigm. Transport Policy 15(2):73–80, 2008. https://doi.org/10.1016/j.tranpol.2007.10.005 [4] N. Dousková, V. Novotný, P. Richter, M. Jirmanová. Pilot study of using google traffic data to assess conditions for public transport operation on urban roads. In 2022 Smart City Symposium Prague (SCSP), pp. 1–5. IEEE, 2022. https://doi.org/10.1109/scsp54748.2022.9792550 [5] P. Kurfürst. Traffic Demand Management as an environmentally friendly transport policy tool. The Centre for Transport and Energy, Prague, Czech Republic, 2002. [6] G. Fernandez-Sanchez, A. Fernandez-Heredia. Strategic thinking for sustainability: A review of 10 strategies for sustainable mobility by bus for cities. Sustainability 10(11):4282, 2018. https://doi.org/10.3390/su10114282 [7] R. G. Mugion, M. Toni, H. Raharjo, et al. Does the service quality of urban public transport enhance sustainable mobility? Journal of Cleaner Production 174:1566–1587, 2018. https://doi.org/10.1016/j.jclepro.2017.11.052 [8] G. Beirão, J. S. Cabral. Understanding attitudes towards public transport and private car: A qualitative study. Transport Policy 14(6):478–489, 2007. https://doi.org/10.1016/j.tranpol.2007.04.009 [9] O. Pribyl, P. Pribyl, M. Lom, M. Svitek. Modeling of smart cities based on ITS architecture. IEEE Intelligent Transportation Systems Magazine 11(4):28–36, 2019. https://doi.org/10.1109/mits.2018.2876553 [10] A. J. M. Seco, J. H. G. Gonçalves. The quality of public transport: relative importance of different performance indicators and their potential to explain modal choice. In Urban Transport XIII: Urban Transport and the Environment in the 21st Century. WIT Press, 2007. https://doi.org/10.2495/ut070301 [11] V. Novotný. Public Transport Priority Assessment Tool. Ph.D. thesis, Czech Technical University in Prague, Prague, 2017. [12] M. Matulin, Š. Mrvelj, N. Jelušić. Two-level evaluation of public transport performances. Promet – Traffic & Transportation 23(5):329–339, 2011. https://doi.org/10.7307/ptt.v23i5.151 [13] J. Gurjar, P. Jain, P. Agarwal. Comparative performance evaluation of public transport services from city perspective. Transportation Research Procedia 48:2207–2229, 2020. https://doi.org/10.1016/j.trpro.2020.08.277 [14] X. Lai, J. Teng, L. Ling. Evaluating public transportation service in a transit hub based on passengers energy cost. In 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC), pp. 1–7. IEEE, 2020. https://doi.org/10.1109/itsc45102.2020.9294662 14 https://eur-lex.europa.eu/legal-content/CS/TXT/?qid=1596443911913&uri=CELEX:52019DC0640#document2 https://eur-lex.europa.eu/legal-content/CS/TXT/?qid=1596443911913&uri=CELEX:52019DC0640#document2 https://eur-lex.europa.eu/legal-content/CS/TXT/?qid=1596443911913&uri=CELEX:52019DC0640#document2 https://doi.org/10.1016/j.tranpol.2007.10.005 https://doi.org/10.1109/scsp54748.2022.9792550 https://doi.org/10.3390/su10114282 https://doi.org/10.1016/j.jclepro.2017.11.052 https://doi.org/10.1016/j.tranpol.2007.04.009 https://doi.org/10.1109/mits.2018.2876553 https://doi.org/10.2495/ut070301 https://doi.org/10.7307/ptt.v23i5.151 https://doi.org/10.1016/j.trpro.2020.08.277 https://doi.org/10.1109/itsc45102.2020.9294662 Acta Polytechnica CTU Proceedings 41:8–14, 2023 1 Introduction 2 Quality of public transport operation and its assessment method 2.1 Reliability evaluation 2.2 Travel speed evaluation 2.3 Final level of service of public transport operation 3 Testing the method – a pilot study 3.1 Obtaining input data 3.2 Using power BI software to evaluate level of service 4 Results and critical analysis of the pilot study 4.1 Determination of decisive travel time/speed 4.2 Short sections and excessive influence of the value of the reliability index on the Level of Service 4.3 Linguistic functions of affiliation 5 Conclusion References