TY - JOUR AU - Wu, Jinhong AB - I. Introduction With the increase of urban population and the expansion of urban space, single-mode public transport can no longer meet the growth of travel demand. Multiple modes of public transport are constantly integrated into urban public transport networks, making urban public transport in a multi-mode state. As various modes of public transport are independent and influence each other, the evaluation and improvement of passenger satisfaction have become the focus of the traffic management department in such a multi-mode environment to attract passenger flow. Passenger satisfaction of public transport service refers to a psychological state of satisfaction or disappointment after comparing the expectations of passengers about the services provided by the public transport system with their overall feelings after receiving the services [1], which can be expressed by the average score of the questionnaire on passenger satisfaction of public transport service during the survey period [2]. The passenger satisfaction survey, on the one hand, promotes the public’s participation in the improvement of the urban public transport system. On the other hand, it also promotes the public transport enterprises to grasp the core of the operation of the urban public transport system. The improvement (or deterioration) of public transport system for a city is usually reflected in the score of passenger satisfaction. Also, the degree of passenger satisfaction with different attributes of the public transportation system indicates the priority of improving the public transportation service. In the process of evaluation of passenger satisfaction of urban public transportation, there are various types of evaluation indexes and they are related to each other. Fuzzy comprehensive evaluation (FCE) method is suitable for solving various non-deterministic problems, but it is not good at directly giving the weight of each index. The weights determined by AHP method reflect the subjective weights with expert intention to a great extent, while the objective weights calculated by EWM(entropy weight method) are inherently strong in mathematical theory. Combined with the characteristics of AHP and EWM, the complementary combination was realized, the comprehensive weight is more reasonable. It is more practical to use AHP- EWM(entropy weight method)-FCE model to evaluate passenger satisfaction. To simplify the research content, in this paper, only the multi-mode public transport system composed of the two typical modes of conventional bus transit and rail transit is considered as the research object. Taking the multi-mode public transport in Ningbo as an example, the characteristics of the analytic hierarchy process(AHP), EWM(entropy weight method) and fuzzy comprehensive evaluation(FCE) methods was combined to build a passenger satisfaction evaluation system for urban public transportation. The application of the AHP-EWM-FCE model in the field of public transport can improve the scientificity and objectivity of index weighting, objectively quantify the passengers’ feelings towards the city’s public transport service, and help to propose improvement suggestions from the aspects of public transport operators and managers in the future, to provide the theoretical basis for the improvement of passenger satisfaction. II. Literature review A. Study on passenger satisfaction The concept of customer satisfaction was first proposed by Richard (1965) [3], and subsequent studies have elaborated on the concept of customer satisfaction from different research perspectives. Many experts and scholars comprehensively used various methods to establish an evaluation model for measuring customer satisfaction. Early studies mainly included Oliver (1980) who established an expected inconsistency model [4], Fornell C., Larcker D. F. (1981) studied the structural equation model with latent variables and measurement errors [5], Churchillg. A. J r and Carol Surprenant’s (1982) cognitive performance model [6], Sasser’ s (1987) customer service level model [7], Engel and Blackwell’s (1993) weighted evaluation model [8]. The method of determining the weight is varied, it is particularly important to choose the right weight determination method; in general, the structural equation method (SEM) and driver measurement method have been widely applied [9]. The SERVQUAL (Service Quality) model was established in 1988 by three scholars, A. Prasuraman, Valarie A. Zeithaml and Leonard L.berry (PZB for short). The SERVQUAL model introduces regression analysis into the research and uses this method to assign the weight of customer satisfaction factors in data processing, which is of great significance to the study of customer satisfaction [10]. Sweden established the Sweden Customer Satisfaction Barometer in 1989, and the United States established the ACSI (American Customer Satisfaction Index) based on the Swedish Customer Satisfaction Barometer in 1994. After Sweden and the United States, the European Customer Satisfaction Index (ECSI) model has been established in Europe, and its internal structure has been innovated based on the research in the first two countries to make it develop continuously. New Zealand, Canada, South Korea and other countries have followed suit by creating their customer satisfaction measurement systems. In 2018, a new methodology for improving the measurement of the quality of the service consisting of three phases has been developed [11], the new methodology considers the assessment of the quality dimensions of a large number of participants (customers), on the one hand, and experts’ assessments on the other hand. The methodology was verified through the research carried out in an express post company. In 2019, optimal route criteria for Transport of hazardous material (THM) are selected using a new approach in the field of multi-criteria decision-making [12]. Weight coefficients of these criteria were determined by applying the Full Consistency Method (FUCOM). Evaluation and selection of suppliers is determined by applying the TOPSIS (Technique for Order of Preference by Similarity to Ideal Solution) and the MABAC (Multi-attributive Border Approximation Area Comparison) methods. The proposed route model was tested on the real example of the transport Eurodiesel in Serbia. When defining criteria that have an influence on traffic accessibility, Stanković, M [13] compare the significance of particular criteria using the Fuzzy AHP method and the Rough AHP method, which would show differences in the values of weight significance criteria and their ranking. Ruisong Yu and Junxiang Cai (2012) proposed a "last kilometer" bus satisfaction evaluation model for Shanghai city by analyzing the operation characteristics of shuttle-bus lines in suburban areas and aiming at the difficulty of traveling in the "last kilometer" of public transport [14]. Jie Yu (2013) [15] focused on the study of conventional bus transit service in small and medium-sized cities, starting from the characteristics of conventional bus transit in small cities, he established a satisfaction evaluation index system for conventional bus transit service in small and medium-sized cities and studied it with the matter-element model. Yucheng Dong (2015) [16] took conventional bus transit of Lianyungang city as an example and constructed a service satisfaction evaluation index system by using WLS method to analyze factors such as bus running speed, ticket price, the attitude of personnel, in-car facilities and station density. Yakun Liu (2015) took 6 districts and counties in Urumqi city as research objects through a questionnaire survey, and conducted the satisfaction evaluation of conventional bus transit with the method of fuzzy evaluation [17]. Huanming Wang and Dajian Zhu (2010), combined with the performance evaluation of public transport services in Shanghai, proposed measures to improve the satisfaction of public transport services, including institutional and financial aspects [18]. Hongmei Wang and lingyu Jia (2011) used the matter-element model to analyze and evaluate the passenger satisfaction of public transport, specifically considering the core needs of passengers for public transport services [19]. B. Empirical study of evaluation on public transport service Friman et al. (2001) established an evaluation model to evaluate the customer satisfaction of public transport and concluded that the overall satisfaction was positively correlated with the cumulative satisfaction [20]. Kennedy et al. (2005) believed that the public should participate in public transport management and analyzed the influence of the public on the satisfaction of public transport [21]. Tyrinopoulos and Antoniou (2008) respectively used the factor analysis model and logit model to analyze passenger satisfaction with public transport performance [22]. Based on the survey data of South Africa, Mokonyama and Venter (2013) used the joint analysis model to identify the satisfaction levels of different service levels of the public [23]. Fiorio et al. (2013) used the survey data of 33 European cities in 2009 to analyze the correlation between public satisfaction and LPT (Local Public Transport), and found that the highest level of public satisfaction was associated with a single LPT provider [24]. Also, the researchers also studied and analyzed the passenger satisfaction of public transport services in Stockholm, Sweden [25], Bilbao, Spain [26], and Istanbul, Turkey [27]. In 2019, a new model that implies the integration of Full Consistency Method and a Rough Power Heronian aggregator for the selection of criteria for the quality of passenger service in rail transport, from the perspective of persons with disabilities as the main category of passengers, has been created [28]. The survey has covered 168 criteria classified in several groups and the entire territory of Serbia. Blagojević, A [29] In order to solve the criteria selection problem, the Fuzzy Analytical Hierarchical Processes (FAHP) method was experimented with, which showed the priority of the assessment of the efficiency of railway undertakings, on the basis of the five groups of criteria. Fanghui Zheng (2005) took bus passengers as the investigation object in Guangzhou city, collected and sorted out the questionnaire, obtained the evaluation result of the passenger satisfaction of conventional bus transit, and proposed improvement measures based on the dissatisfaction factors such as the first and last shift, ticket price, and driving speed [30]. Guobing Hu, Sun, etc. (2011) [31] uses the four points graph model, and, from the perspective of passengers, determines the score of evaluation index and its weights, finds the root cause of passenger dissatisfaction and puts forward related suggestions, the feasibility, effectiveness, and extensibility of the index system, the analysis method and the related suggestions are proved by the case study of public transport in Nanchang city. Xiuzhen Guo and Xiaoxiong Weng (2014) [32] used the analytic hierarchy process (AHP) to determine the weight of indicators, and evaluated the level of public transport service with the method of fuzzy comprehensive evaluation. The AHP method represents a formal framework for solving complex multiatributive decision making problems, as well as a systemic procedure for ranking multiple alternatives and/or for selecting the best from a set of available ones [33]. In reference to the American customer satisfaction index (ACSI) model, based on the quality of service, service facilities, service, safety, environment and other four aspects, Lili Jiao (2012) [34] established the index system, built the customer satisfaction index model of urban rail transit of China, and used partial least square method to estimate the model, with the practicability of the model verified by an example. From the above research status, it can be seen that studies on customer satisfaction are mostly based on practical cases, and different countries have their satisfaction measurement models. Most scholars concentrated on the study of satisfaction factors, models, and the construction of an evaluation index system, focusing on how to build a satisfaction evaluation model for a single-mode public transport, such as bus lines and bus transfers in different cities and carry out case verification. Each study has a certain theoretical and practical value. However, there are still deficiencies in theoretical and practical studies, which are mainly reflected in the following two aspects: First, the current literature on passenger satisfaction of urban public transport service is not comprehensive enough, and the indicator system needs to be further improved. In particular, the analysis of factors affecting passenger satisfaction of public transport service is not thorough enough in terms of passengers’ demands for comfort, convenience, waiting time, and accessibility. Second, the existing research is limited to the single-mode evaluation of the passenger satisfaction: urban conventional bus transit or rail transit, and pays less attention to the overall satisfaction evaluation of urban public transport that includes multiple modes. A. Study on passenger satisfaction The concept of customer satisfaction was first proposed by Richard (1965) [3], and subsequent studies have elaborated on the concept of customer satisfaction from different research perspectives. Many experts and scholars comprehensively used various methods to establish an evaluation model for measuring customer satisfaction. Early studies mainly included Oliver (1980) who established an expected inconsistency model [4], Fornell C., Larcker D. F. (1981) studied the structural equation model with latent variables and measurement errors [5], Churchillg. A. J r and Carol Surprenant’s (1982) cognitive performance model [6], Sasser’ s (1987) customer service level model [7], Engel and Blackwell’s (1993) weighted evaluation model [8]. The method of determining the weight is varied, it is particularly important to choose the right weight determination method; in general, the structural equation method (SEM) and driver measurement method have been widely applied [9]. The SERVQUAL (Service Quality) model was established in 1988 by three scholars, A. Prasuraman, Valarie A. Zeithaml and Leonard L.berry (PZB for short). The SERVQUAL model introduces regression analysis into the research and uses this method to assign the weight of customer satisfaction factors in data processing, which is of great significance to the study of customer satisfaction [10]. Sweden established the Sweden Customer Satisfaction Barometer in 1989, and the United States established the ACSI (American Customer Satisfaction Index) based on the Swedish Customer Satisfaction Barometer in 1994. After Sweden and the United States, the European Customer Satisfaction Index (ECSI) model has been established in Europe, and its internal structure has been innovated based on the research in the first two countries to make it develop continuously. New Zealand, Canada, South Korea and other countries have followed suit by creating their customer satisfaction measurement systems. In 2018, a new methodology for improving the measurement of the quality of the service consisting of three phases has been developed [11], the new methodology considers the assessment of the quality dimensions of a large number of participants (customers), on the one hand, and experts’ assessments on the other hand. The methodology was verified through the research carried out in an express post company. In 2019, optimal route criteria for Transport of hazardous material (THM) are selected using a new approach in the field of multi-criteria decision-making [12]. Weight coefficients of these criteria were determined by applying the Full Consistency Method (FUCOM). Evaluation and selection of suppliers is determined by applying the TOPSIS (Technique for Order of Preference by Similarity to Ideal Solution) and the MABAC (Multi-attributive Border Approximation Area Comparison) methods. The proposed route model was tested on the real example of the transport Eurodiesel in Serbia. When defining criteria that have an influence on traffic accessibility, Stanković, M [13] compare the significance of particular criteria using the Fuzzy AHP method and the Rough AHP method, which would show differences in the values of weight significance criteria and their ranking. Ruisong Yu and Junxiang Cai (2012) proposed a "last kilometer" bus satisfaction evaluation model for Shanghai city by analyzing the operation characteristics of shuttle-bus lines in suburban areas and aiming at the difficulty of traveling in the "last kilometer" of public transport [14]. Jie Yu (2013) [15] focused on the study of conventional bus transit service in small and medium-sized cities, starting from the characteristics of conventional bus transit in small cities, he established a satisfaction evaluation index system for conventional bus transit service in small and medium-sized cities and studied it with the matter-element model. Yucheng Dong (2015) [16] took conventional bus transit of Lianyungang city as an example and constructed a service satisfaction evaluation index system by using WLS method to analyze factors such as bus running speed, ticket price, the attitude of personnel, in-car facilities and station density. Yakun Liu (2015) took 6 districts and counties in Urumqi city as research objects through a questionnaire survey, and conducted the satisfaction evaluation of conventional bus transit with the method of fuzzy evaluation [17]. Huanming Wang and Dajian Zhu (2010), combined with the performance evaluation of public transport services in Shanghai, proposed measures to improve the satisfaction of public transport services, including institutional and financial aspects [18]. Hongmei Wang and lingyu Jia (2011) used the matter-element model to analyze and evaluate the passenger satisfaction of public transport, specifically considering the core needs of passengers for public transport services [19]. B. Empirical study of evaluation on public transport service Friman et al. (2001) established an evaluation model to evaluate the customer satisfaction of public transport and concluded that the overall satisfaction was positively correlated with the cumulative satisfaction [20]. Kennedy et al. (2005) believed that the public should participate in public transport management and analyzed the influence of the public on the satisfaction of public transport [21]. Tyrinopoulos and Antoniou (2008) respectively used the factor analysis model and logit model to analyze passenger satisfaction with public transport performance [22]. Based on the survey data of South Africa, Mokonyama and Venter (2013) used the joint analysis model to identify the satisfaction levels of different service levels of the public [23]. Fiorio et al. (2013) used the survey data of 33 European cities in 2009 to analyze the correlation between public satisfaction and LPT (Local Public Transport), and found that the highest level of public satisfaction was associated with a single LPT provider [24]. Also, the researchers also studied and analyzed the passenger satisfaction of public transport services in Stockholm, Sweden [25], Bilbao, Spain [26], and Istanbul, Turkey [27]. In 2019, a new model that implies the integration of Full Consistency Method and a Rough Power Heronian aggregator for the selection of criteria for the quality of passenger service in rail transport, from the perspective of persons with disabilities as the main category of passengers, has been created [28]. The survey has covered 168 criteria classified in several groups and the entire territory of Serbia. Blagojević, A [29] In order to solve the criteria selection problem, the Fuzzy Analytical Hierarchical Processes (FAHP) method was experimented with, which showed the priority of the assessment of the efficiency of railway undertakings, on the basis of the five groups of criteria. Fanghui Zheng (2005) took bus passengers as the investigation object in Guangzhou city, collected and sorted out the questionnaire, obtained the evaluation result of the passenger satisfaction of conventional bus transit, and proposed improvement measures based on the dissatisfaction factors such as the first and last shift, ticket price, and driving speed [30]. Guobing Hu, Sun, etc. (2011) [31] uses the four points graph model, and, from the perspective of passengers, determines the score of evaluation index and its weights, finds the root cause of passenger dissatisfaction and puts forward related suggestions, the feasibility, effectiveness, and extensibility of the index system, the analysis method and the related suggestions are proved by the case study of public transport in Nanchang city. Xiuzhen Guo and Xiaoxiong Weng (2014) [32] used the analytic hierarchy process (AHP) to determine the weight of indicators, and evaluated the level of public transport service with the method of fuzzy comprehensive evaluation. The AHP method represents a formal framework for solving complex multiatributive decision making problems, as well as a systemic procedure for ranking multiple alternatives and/or for selecting the best from a set of available ones [33]. In reference to the American customer satisfaction index (ACSI) model, based on the quality of service, service facilities, service, safety, environment and other four aspects, Lili Jiao (2012) [34] established the index system, built the customer satisfaction index model of urban rail transit of China, and used partial least square method to estimate the model, with the practicability of the model verified by an example. From the above research status, it can be seen that studies on customer satisfaction are mostly based on practical cases, and different countries have their satisfaction measurement models. Most scholars concentrated on the study of satisfaction factors, models, and the construction of an evaluation index system, focusing on how to build a satisfaction evaluation model for a single-mode public transport, such as bus lines and bus transfers in different cities and carry out case verification. Each study has a certain theoretical and practical value. However, there are still deficiencies in theoretical and practical studies, which are mainly reflected in the following two aspects: First, the current literature on passenger satisfaction of urban public transport service is not comprehensive enough, and the indicator system needs to be further improved. In particular, the analysis of factors affecting passenger satisfaction of public transport service is not thorough enough in terms of passengers’ demands for comfort, convenience, waiting time, and accessibility. Second, the existing research is limited to the single-mode evaluation of the passenger satisfaction: urban conventional bus transit or rail transit, and pays less attention to the overall satisfaction evaluation of urban public transport that includes multiple modes. III. Methodology The research involves completing a questionnaire to evaluate passenger satisfaction, in this questionnaire, if the participants are interested in this research, they will be asked to leave travel information about urban multi-mode public transportation of Ningbo city. All the participation in the project/survey is entirely voluntary and the participant are free to withdraw from the project at any point without giving reason. Any information and data were collected and analyzed anonymously. In the process of passenger satisfaction evaluation of public transport, there are many evaluation indexes and they are related to each other. The fuzzy comprehensive evaluation(FCE) method is based on the fuzzy set theory developed by Zadeh [35] for capturing the uncertainties inherent in a system. The fuzzy evaluation approach can provide a powerful mathematical tool to quantify imprecise information in human judgments. But since it is not good at directly giving the weight of each evaluation index, combining it with the AHP method can improve the objectivity of index weighting. The AHP method has been generally accepted as a powerful multi-criteria decision-making tool for dealing with complex decision problems in public transport research domains. In this paper, the AHP method has been used to determine the weights of different indexes during the evaluation process based on expert judgments. In later sections it will be shown how this method can be coupled with a fuzzy approach to enhance its ability to capture the uncertainties and vagueness of satisfaction perceptions expressed by the passengers. It is more practical and reasonable to use AHP-FCE to evaluate passenger satisfaction of the multi-mode public transport. The research procedure of this paper is as follows (Fig 1). Download: PPT PowerPoint slide PNG larger image TIFF original image Fig 1. Flow chart of research methods. https://doi.org/10.1371/journal.pone.0241004.g001 A. Determining the weight vector by AHP Based on the actual data obtained from the questionnaire survey, this paper evaluates the annual urban multi-model public transport service in Ningbo city and puts forward corresponding countermeasures and suggestions according to the problems shown in the evaluation results. Based on the AHP method, the weight vector Wsi (see step 3 in subsection A) determined by conducting empirical and/or field studies of transportation professionals reflects the intention of decision-makers, which is the subjective weight from consulting expert opinions. One advantage of the AHP method is that it provides both an elicitation method as well as a strong theoretical framework that allows precise quantitative calculations. The procedures of the AHP method can be illustrated step by step as follows: Step 1: Structure a hierarchy of the criteria based on the evaluated factors. Passenger satisfaction of public transport is obtained under the influence of multi-dimensional psychological factors, and the factors are related to each other in a complex way. A hierarchical evaluation model is established based on the principle of giving priority to passengers: First, state an overall objective for the problem and list factors that affect the objective. In this case, evaluation target O = {passenger satisfaction with urban public transport service}, according to the evaluation object O, the evaluation criteria set B = {B1, B2 …, Bn}and sub-criteria set C = {C1, C2 …, Cn}. In the case of this paper, B = {waiting time B1, transfer convenience B2, service B3, information B4, passenger comfort B5, station environment B6, interior sanitation B7}. Then structure a hierarchy of criteria for the problem: for each cluster or level in the hierarchy, some factors will be subjected to a corresponding evaluated objective. Step 2: Construct a pairwise comparison matrix. The major advantage of the AHP method is that, instead of asking experts to directly give a weight for a particular evaluation factor, they will be asked to rate the relative importance of the different factors. The expert group composed of transportation professionals, through the process of integration, communication, and feedback, uses scaling law proposed by Thomas L. Saaty [36], assuming that there are n evaluation factors, the importance intensity of factor i over factor j can be represented by Aij. A complete pairwise comparison matrix A can, therefore, be obtained. Step 3: Calculate the priority vectors of evaluated factors. To calculate the weight vectors of evaluated factors, we used the common method of ANC (average of normalized columns). ANC can be presented as: (1) The weight vector can therefore be obtained from matrix A by normalizing the vector in each column and then averaging over the rows of the resulting matrix. The weight determined based on the AHP method reflects the intention of decision-makers, so it is a subjective weight: Wsi is the subjective weight. Determine the weight vector of the evaluation index, and make the weight distribution set Wi to the index set B or C is Wsi, then the subjective weight set of all levels of the index is W = {Ws1, Ws2…, Wsn}. Step 4: Check the consistency of human judgments (consistency check of single-sorting). From Step 3, the numerical subjective weights = {Ws1, Ws2…, Wsn} of the factors from the numerical judgments matrix A can be obtained. It is important to check that the human judgments are internally consistent. One method is to calculate the consistency ratio (CR)to reduce the possibility of consistent random deviation, the maximum eigenvalue λmax and the consistency index CI of the judgment matrix are calculated of the matrix, then calculate the consistency ratio CR which is a measure of how a given matrix compares to a purely random matrix in terms of their consistency indices: (2) (3) Where, RI is the average random index, which is computed and tabulated as shown in Tables [36], If a value of the consistency ratio CR <0.1, the numerical judgments will be considered to be acceptable [36], and the comparison matrix corresponding to the hierarchical index has passed the consistency check. Otherwise, it is necessary to readjust the index value of the matrix to achieve consistency. Step 5: Check the consistency of human judgments(consistency check of total-sorting). The total-sorting of all levels refers to the sorting weight value of the indexes of each level relative to the indexes of the highest level. Assuming that there are n elements in k layer, when CR(k)<0.1, the whole judgment matrix is considered to pass the consistency check. B. Determining the comprehensive weight vector by AHP-EWM The basic idea of the entropy weight method (EWM) is to determine the objective weight according to the index variability. Compared with various subjective weighting models, the biggest advantage of the EWM is the avoidance of the interference of human factors on the weight of indicators, thus enhancing the objectivity of the comprehensive evaluation results [37,38]. Generally speaking, the smaller the information entropy of an index is, the greater the degree of variation of the index value will be, the more information it provides, the greater the role it can play in the comprehensive evaluation, and the greater its weight will be, and vice versa. The weight determined based on the AHP method reflects the intention of decision-makers, so it is a subjective weight. However, the weight determined by the entropy weight method does not consider the intention of decision-makers, but has a strong mathematical theoretical basis and purely reflects the relationship between data. The two kinds of weights have some limitations, so they are combined organically to give a comprehensive weight that reflects both objective information and subjective information. Information entropy can be used to measure the amount of information. The indexes under each criterion layer form an evaluation matrix. EWM calculates each weight according to the evaluation matrix, which reflects the influence of the index data itself on the weight in the objective information of evaluation, and is an objective weight. Formulas are as follows: (4) (5) (6) Where, xij is the value of the jth index of the ith sample; Pij is the proportion of the ith sample of the jth index; ej is the entropy value of the jth index, and k is related to the number of samples. Generally, let k = 1/ lnm, and 0