Evaluation Framework for Key Performance Indicators of Railway ITS
Vol. 30 No. 4 (2018)
Articles
Downloads
The aim of this study is to develop a framework for investigating a comprehensive set of Key Performance Indicators (KPIs) for the assessment of railway Intelligent Transportation Systems (ITS). The framework is established through four main steps: (1) development of a comprehensive set of KPIs for railway ITS; (2) validation of developed KPIs and collection of judgments from experts through a Delphi questionnaire; (3) evaluation of KPIs weights for assessing railway ITS with the Group Analytical Hierarchy Process (GAHP); and (4) presentation of a SWOT analysis for the developed KPIs by the authors. The results of the framework are presented as a set of 25 indicators for evaluation of railway ITS and their impacts. The framework could be helpful for selecting KPIs of ITS in another mode of transportation. Monitoring of the contributions of ITS towards sustainable railway can be achieved by a developed set of indicators which are classified in accordance with sustainable dimensions.
Mlinarić, T. J., Đorđević, B., & Krmac, E. (2018). Evaluation Framework for Key Performance Indicators of Railway ITS. Promet - Traffic&Transportation, 30(4), 491–500. https://doi.org/10.7307/ptt.v30i4.2774
Downloads
Download data is not yet available.
[1] Fantechi A, Flammini F, Gnesi S. Formal methods for railway control systems. International Journal on Software Tools for Technology Transfer. 2014;16: 643-646.
[2] Ning B, Tang T, Yan F, Wang F-Y, Zeng D. Intelligent Railway Systems in China. IEEE Intelligent Systems. 2006;21(5): 80-83.
[3] Zhicai J, Jianping W, McDonald M. Socio-Economic Impact Assessment of Intelligent Transport Systems. Tsinghua Science and Technology. 2006;11(3): 339-350.
[4] European Commission. Communication from the Commission
- Action Plan for the Deployment of Intelligent Transport Systems in Europe. Brussels; 2008. Available from: http://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:52008DC0886 &from=EN
[5] European Union Parliament. DIRECTIVE 2010/40/EU of the European Parliament and of the Council of the European Union of 7 July 2010 on the framework for the deployment of Intelligent Transport Systems in the field of road transport and for interfaces with other modes of transport; 2010. Available from: http://eurlex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:32010L0040&from=EN
[6] Djordjevic B, Krmac E. Key Performance Indicators for Measuring the Impacts of ITS on transport. International Symposium on Electronics in Transport – ISEP 2016; Ljubljana, Slovenija; 2016.
[7] Liimatainen H, Kallionpää E, Pöllänen M, Stenholm P, Tapio P, McKinnon A. Decarbonizing road freight in the future - Detailed scenarios of the carbon emissions of Finnish road freight transport in 2030 using a Delphi method approach. Technological Forecasting & Social Change. 2014;81: 177-191.
[8] Hojer M. Transport telematics in urban systems - A backcasting Delphi study. Transportation Research Part D. 1998;3(6): 445-463.
[9] Kordnejad B. Stakeholder analysis in intermodal urban freight transport. Transportation Research Procedia. 2016;12: 750-764.
[10] Shiau T-A, Liu J-S. Developing an indicator system for local governments to evaluate transport sustainability strategies. Ecological Indicators. 2013;34: 361-371.
[11] Yedla S, Shrestha MR. Multi-criteria approach for the selection of alternative options for environmentally sustainable transport system in Delhi. Transportation Research Part A: Policy and Practice. 2003;37(8): 717-729.
[12] Podvezko V, Sivilevičius H. The use of AHP and rank correlation methods for determining the significance of the interaction between the elements of a transport system having a strong influence on traffic safety. Transport. 2013;28(4): 389-403.
[13] Jakimavicius M, Burinskiene M, Gusaroviene M, Podviezko A. Assessing multiple criteria for rapid bus routes in the public transport system in Vilnius. Public Transport. 2016;8: 365-385.
[14] Shiau T-A. Evaluating sustainable transport strategies for the counties of Taiwan based on their degree of urbanisation. Transport Policy. 2013;30: 101-108.
[15] Butkevičius J. Development of Passenger Transportation by Railroad from Lithuania to European States. Transport. 2007;12(2): 73-79.
[16] Tsykhmistro S, Cheptsov M, Cheklov V, Marinov M. Euro-Asian Co-operation in Rail Education and Research.
Transport Problems. 2014;9(1): 103-110.
[17] AECOM. Key Performance Indicators for Intelligent Transportation Systems. Bristol: European Commission; 2015. Available from: http://ec.europa.eu/transport/sites/transport/files/themes/its/studies/doc/its-kpi-final_report_v7_4.pdf.
[18] Jarašūniene A. Analysis of possibilities and proposals of intelligent transport system (ITS) implementation in Lithuania. Transport. 2006;21(4): 245-251.
[19] Diakaki C, Papageorgiou M, Papamichail I, Nikolos I. Overview and analysis of Vehicle Automation and Communication Systems from a motorway traffic management perspective. Transportation Research Part A. 2015;75: 147-165.
[20] Tsai M-C, Su C-H. Political risk assessment of five East Asian ports - the view points of global carriers. Marine Policy. 2005;29: 291-298.
[21] Lee BC, Wan J, Shi W, Li K. A cross-country study of competitiveness of the shipping industry. Transport Policy. 2014;35: 366-376.
[22] Emovon I, Norman RA, Murphy AJ. Hybrid MCDM based methodology for selecting the optimum maintenance strategy for ship machinery systems. J Intell Manuf; 2015. doi:10.1007/s10845-015-1133-6
[23] Curiel-Esparza J, Mazario-Diez JL, Canto-Perello J, Martin-Utrillas M. Prioritization by consensus of enhancements for sustainable mobility in urban areas. Environmental Science & Policy. 2016;55: 248-257.
[24] Hruška R, Průša P, Babić D. The use of AHP method for selection of supplier. Transport. 2014;29(2): 195-203. doi:10.3846/16484142.2014.930928
[25] Delbari SA, Ng SI, Aziz YA, Ho JA. An investigation of key competitiveness indicators and drivers of full-service airlines using Delphi and AHP techniques. Journal of Air Transport Management. 2016;52: 23-34.
[26] Chen W, Li J. Safety performance monitoring and measurement of civil aviation unit. Journal of Air Transport Management. 2016;57: 228-233.
[27] Párraga MM, Gonzalez-Cancelas N, Soler-Flores F. DELPHI-SWOT tools used in strategic planning of the Port of Manta. Procedia – Social and Behavioral Sciences. 2014;162: 129-138.
[28] Hafeznia MR, Pirdashti H, Ahmadipour Z. An expert-based decision making tool for enhancing the consensus on Caspian Sea legal regime. Journal of Eurasian Studies. 2016;7: 181-194.
[29] Dimić S, Pamučar D, Ljubojević S, Đorović B. Strategic Transport Management Models-The Case Study of an Oil Industry. Sustainability. 2016;8(9): 954. doi:10.3390/su8090954
[30] Pamučar D, Ćirović G, Sekulović D. Development of an Integrated Transport System in Distribution Centers: A FA'WOT analysis. Tehnički vjesnik. 2015;22(3): 649-658.
[31] Wan C, Yan X, Zhang D, Shi J, Fu S, Ng AK. Emerging LNG-fueled ships in the Chinese shipping industry: a hybrid analysis on its prospects. WMU J Marit Affairs. 2015;14: 43-59. doi:10.1007/s13437-015-0080-6
[32] Chowdhury M. Editorial: 15th Intelligent Transportation Systems World Congress. Journal of Intelligent Transportation Systems. 2010;14(2): 51-53.
[33] Mahmod M, Jonkers E, Klunder GA, Benz T, Winder A. Amitran methodology framework for evaluating the impact of information and communication technology-based measures on CO2 emissions in the transport field. IET Intelligent Transport Systems. 2015;9(4): 418-428.
[34] Jiménez-Redondo N, Escriba Marín S, García Benítez F, Cáceres N. Automated and cost effective railway infrastructure maintenance. ACEM-Rail; 2013.
[35] Psaraki-Kalouptsidi V, Pagoni I, Fröidh O. Transport Infrastructure Capacity Assessment – Rail Transport. National Technical University of Athens, Royal Institute of Technology. Deliverable D6.3 (WP 5 report), 2011. doi:0000-0002-3687-7758
[36] Mitwallyova H, Jankovic V. The influence of railway infrastructure on the live in selected European countries. International Journal of Business and Management. 2015;3(2): 18-26.
[37] Lindfeldt A. Railway capacity analysis: Methods for simulation and evaluation of timetables, delays and infrastructure. Stockholm: KTH Royal Institute of Technology; 2015.
[38] Famurewa SM, Stenstrom C, Asplund M, Galar D, Kumar U. Composite indicator for railway infrastructure management. J. Mod. Transport. 2014;22(4): 214-224.
[39] Sameni MK. Railway Track Capacity: Measuring and Managing. University of Southampton, Faculty of Engineering and the Environment; 2012.
[40] Song B-Y, Moon D-S, Lee HS. Development of the Assessment Indicators for Railway Safety. International Journal of Railway. 2012;5(4): 175-181.
[41] Ahrens J, Dogs J, Kupke D, Sagevik M. UIC reporting guideline sustainable mobility and transport: Reporting Principles and Indicators for Rail. UIC International Union of Railways; 2011.
[42] Kaparias I, Bell GM. Key Performance Indicators for traffic management and Intelligent Transport Systems. CONDUITS, Coordination of Network Descriptors for Urban Intelligent Transport Systems; 2011.
[43] Canaud M, El Faouzi N-E. ECOSTAND: towards a standard methodology for environmental evaluation of ITS. Transportation Research Procedia. 2015;6: 377-390.
[44] Haramina H, Mandić M, Nikšić, M. New method for energy-efficient train operation on commuter rail networks. Technical Gazette. 2012;19(4): 801-806.
[45] Piecyk MI, McKinnon AC. Forecasting the carbon footprint of road freight transport in 2020. International Journal of Production Economics. 2010;128: 31-42.
[46] Still BG, May AD, Bristow AL. The assessment of transport impacts on land use: practical uses in strategic planning. Transport Policy. 1999;6: 83-98.
[47] Mason KJ, Alamdari F. EU network carriers, low cost carriers and consumer behaviour: A Delphi study of future trends. Journal of Air Transport Management. 2007;13: 299-310.
[48] Cafiso S, Graziano AD, Pappalardo G. Using the Delphi method to evaluate opinions of public transport managers on bus safety. Safety Science. 2013;57: 254-263.
[49] Saaty TL. The Analytic Hierarchy Process. McGraw-Hill; 1980.
[50] Srdjevic B, Srdjevic Z, Blagojevic B, Suvocarev K. A twophase algorithm for consensus building in AHP-group decision making. Applied Mathematical Modelling. 2013;37: 6670-6682.
[51] AlSabbagh M, Siu YL, Guehnemann A, Barrett J. Integrated approach to the assessment of CO2e-mitigation measures for the road passenger transport sector in Bahrain. Renewable and Sustainable Energy Reviews. 2017;71: 203-215.
[52] Ishizaka A, Labib A. Selection of new production facilities with the Group Analytic Hierarchy Process Ordering method. Expert Systems with Applications. 2011;38: 7317-7325.
[53] Forman E, Peniwati K. Aggregating individual judgments and priorities with the analytic hierarchy process. European Journal of Operational Research. 1998;108: 165-169.
[54] Ossadnik W, Schinke S, Kaspar RH. Group Aggregation Techniques for Analytic Hierarchy Process and Analytic Network Process: A Comparative Analysis. Group Decis Negot. 2016;25(2): 421-457.
[2] Ning B, Tang T, Yan F, Wang F-Y, Zeng D. Intelligent Railway Systems in China. IEEE Intelligent Systems. 2006;21(5): 80-83.
[3] Zhicai J, Jianping W, McDonald M. Socio-Economic Impact Assessment of Intelligent Transport Systems. Tsinghua Science and Technology. 2006;11(3): 339-350.
[4] European Commission. Communication from the Commission
- Action Plan for the Deployment of Intelligent Transport Systems in Europe. Brussels; 2008. Available from: http://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:52008DC0886 &from=EN
[5] European Union Parliament. DIRECTIVE 2010/40/EU of the European Parliament and of the Council of the European Union of 7 July 2010 on the framework for the deployment of Intelligent Transport Systems in the field of road transport and for interfaces with other modes of transport; 2010. Available from: http://eurlex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:32010L0040&from=EN
[6] Djordjevic B, Krmac E. Key Performance Indicators for Measuring the Impacts of ITS on transport. International Symposium on Electronics in Transport – ISEP 2016; Ljubljana, Slovenija; 2016.
[7] Liimatainen H, Kallionpää E, Pöllänen M, Stenholm P, Tapio P, McKinnon A. Decarbonizing road freight in the future - Detailed scenarios of the carbon emissions of Finnish road freight transport in 2030 using a Delphi method approach. Technological Forecasting & Social Change. 2014;81: 177-191.
[8] Hojer M. Transport telematics in urban systems - A backcasting Delphi study. Transportation Research Part D. 1998;3(6): 445-463.
[9] Kordnejad B. Stakeholder analysis in intermodal urban freight transport. Transportation Research Procedia. 2016;12: 750-764.
[10] Shiau T-A, Liu J-S. Developing an indicator system for local governments to evaluate transport sustainability strategies. Ecological Indicators. 2013;34: 361-371.
[11] Yedla S, Shrestha MR. Multi-criteria approach for the selection of alternative options for environmentally sustainable transport system in Delhi. Transportation Research Part A: Policy and Practice. 2003;37(8): 717-729.
[12] Podvezko V, Sivilevičius H. The use of AHP and rank correlation methods for determining the significance of the interaction between the elements of a transport system having a strong influence on traffic safety. Transport. 2013;28(4): 389-403.
[13] Jakimavicius M, Burinskiene M, Gusaroviene M, Podviezko A. Assessing multiple criteria for rapid bus routes in the public transport system in Vilnius. Public Transport. 2016;8: 365-385.
[14] Shiau T-A. Evaluating sustainable transport strategies for the counties of Taiwan based on their degree of urbanisation. Transport Policy. 2013;30: 101-108.
[15] Butkevičius J. Development of Passenger Transportation by Railroad from Lithuania to European States. Transport. 2007;12(2): 73-79.
[16] Tsykhmistro S, Cheptsov M, Cheklov V, Marinov M. Euro-Asian Co-operation in Rail Education and Research.
Transport Problems. 2014;9(1): 103-110.
[17] AECOM. Key Performance Indicators for Intelligent Transportation Systems. Bristol: European Commission; 2015. Available from: http://ec.europa.eu/transport/sites/transport/files/themes/its/studies/doc/its-kpi-final_report_v7_4.pdf.
[18] Jarašūniene A. Analysis of possibilities and proposals of intelligent transport system (ITS) implementation in Lithuania. Transport. 2006;21(4): 245-251.
[19] Diakaki C, Papageorgiou M, Papamichail I, Nikolos I. Overview and analysis of Vehicle Automation and Communication Systems from a motorway traffic management perspective. Transportation Research Part A. 2015;75: 147-165.
[20] Tsai M-C, Su C-H. Political risk assessment of five East Asian ports - the view points of global carriers. Marine Policy. 2005;29: 291-298.
[21] Lee BC, Wan J, Shi W, Li K. A cross-country study of competitiveness of the shipping industry. Transport Policy. 2014;35: 366-376.
[22] Emovon I, Norman RA, Murphy AJ. Hybrid MCDM based methodology for selecting the optimum maintenance strategy for ship machinery systems. J Intell Manuf; 2015. doi:10.1007/s10845-015-1133-6
[23] Curiel-Esparza J, Mazario-Diez JL, Canto-Perello J, Martin-Utrillas M. Prioritization by consensus of enhancements for sustainable mobility in urban areas. Environmental Science & Policy. 2016;55: 248-257.
[24] Hruška R, Průša P, Babić D. The use of AHP method for selection of supplier. Transport. 2014;29(2): 195-203. doi:10.3846/16484142.2014.930928
[25] Delbari SA, Ng SI, Aziz YA, Ho JA. An investigation of key competitiveness indicators and drivers of full-service airlines using Delphi and AHP techniques. Journal of Air Transport Management. 2016;52: 23-34.
[26] Chen W, Li J. Safety performance monitoring and measurement of civil aviation unit. Journal of Air Transport Management. 2016;57: 228-233.
[27] Párraga MM, Gonzalez-Cancelas N, Soler-Flores F. DELPHI-SWOT tools used in strategic planning of the Port of Manta. Procedia – Social and Behavioral Sciences. 2014;162: 129-138.
[28] Hafeznia MR, Pirdashti H, Ahmadipour Z. An expert-based decision making tool for enhancing the consensus on Caspian Sea legal regime. Journal of Eurasian Studies. 2016;7: 181-194.
[29] Dimić S, Pamučar D, Ljubojević S, Đorović B. Strategic Transport Management Models-The Case Study of an Oil Industry. Sustainability. 2016;8(9): 954. doi:10.3390/su8090954
[30] Pamučar D, Ćirović G, Sekulović D. Development of an Integrated Transport System in Distribution Centers: A FA'WOT analysis. Tehnički vjesnik. 2015;22(3): 649-658.
[31] Wan C, Yan X, Zhang D, Shi J, Fu S, Ng AK. Emerging LNG-fueled ships in the Chinese shipping industry: a hybrid analysis on its prospects. WMU J Marit Affairs. 2015;14: 43-59. doi:10.1007/s13437-015-0080-6
[32] Chowdhury M. Editorial: 15th Intelligent Transportation Systems World Congress. Journal of Intelligent Transportation Systems. 2010;14(2): 51-53.
[33] Mahmod M, Jonkers E, Klunder GA, Benz T, Winder A. Amitran methodology framework for evaluating the impact of information and communication technology-based measures on CO2 emissions in the transport field. IET Intelligent Transport Systems. 2015;9(4): 418-428.
[34] Jiménez-Redondo N, Escriba Marín S, García Benítez F, Cáceres N. Automated and cost effective railway infrastructure maintenance. ACEM-Rail; 2013.
[35] Psaraki-Kalouptsidi V, Pagoni I, Fröidh O. Transport Infrastructure Capacity Assessment – Rail Transport. National Technical University of Athens, Royal Institute of Technology. Deliverable D6.3 (WP 5 report), 2011. doi:0000-0002-3687-7758
[36] Mitwallyova H, Jankovic V. The influence of railway infrastructure on the live in selected European countries. International Journal of Business and Management. 2015;3(2): 18-26.
[37] Lindfeldt A. Railway capacity analysis: Methods for simulation and evaluation of timetables, delays and infrastructure. Stockholm: KTH Royal Institute of Technology; 2015.
[38] Famurewa SM, Stenstrom C, Asplund M, Galar D, Kumar U. Composite indicator for railway infrastructure management. J. Mod. Transport. 2014;22(4): 214-224.
[39] Sameni MK. Railway Track Capacity: Measuring and Managing. University of Southampton, Faculty of Engineering and the Environment; 2012.
[40] Song B-Y, Moon D-S, Lee HS. Development of the Assessment Indicators for Railway Safety. International Journal of Railway. 2012;5(4): 175-181.
[41] Ahrens J, Dogs J, Kupke D, Sagevik M. UIC reporting guideline sustainable mobility and transport: Reporting Principles and Indicators for Rail. UIC International Union of Railways; 2011.
[42] Kaparias I, Bell GM. Key Performance Indicators for traffic management and Intelligent Transport Systems. CONDUITS, Coordination of Network Descriptors for Urban Intelligent Transport Systems; 2011.
[43] Canaud M, El Faouzi N-E. ECOSTAND: towards a standard methodology for environmental evaluation of ITS. Transportation Research Procedia. 2015;6: 377-390.
[44] Haramina H, Mandić M, Nikšić, M. New method for energy-efficient train operation on commuter rail networks. Technical Gazette. 2012;19(4): 801-806.
[45] Piecyk MI, McKinnon AC. Forecasting the carbon footprint of road freight transport in 2020. International Journal of Production Economics. 2010;128: 31-42.
[46] Still BG, May AD, Bristow AL. The assessment of transport impacts on land use: practical uses in strategic planning. Transport Policy. 1999;6: 83-98.
[47] Mason KJ, Alamdari F. EU network carriers, low cost carriers and consumer behaviour: A Delphi study of future trends. Journal of Air Transport Management. 2007;13: 299-310.
[48] Cafiso S, Graziano AD, Pappalardo G. Using the Delphi method to evaluate opinions of public transport managers on bus safety. Safety Science. 2013;57: 254-263.
[49] Saaty TL. The Analytic Hierarchy Process. McGraw-Hill; 1980.
[50] Srdjevic B, Srdjevic Z, Blagojevic B, Suvocarev K. A twophase algorithm for consensus building in AHP-group decision making. Applied Mathematical Modelling. 2013;37: 6670-6682.
[51] AlSabbagh M, Siu YL, Guehnemann A, Barrett J. Integrated approach to the assessment of CO2e-mitigation measures for the road passenger transport sector in Bahrain. Renewable and Sustainable Energy Reviews. 2017;71: 203-215.
[52] Ishizaka A, Labib A. Selection of new production facilities with the Group Analytic Hierarchy Process Ordering method. Expert Systems with Applications. 2011;38: 7317-7325.
[53] Forman E, Peniwati K. Aggregating individual judgments and priorities with the analytic hierarchy process. European Journal of Operational Research. 1998;108: 165-169.
[54] Ossadnik W, Schinke S, Kaspar RH. Group Aggregation Techniques for Analytic Hierarchy Process and Analytic Network Process: A Comparative Analysis. Group Decis Negot. 2016;25(2): 421-457.
