SUNRISE (2004-2005)
The SUNRISE project was financed under EU INTERREG IIIC zone South programme which aims to contribute to the urban/rural zone Sustainable Development of the European Regions. The project consisted of a mix of Feasibility Studies and application of Demand Responsive Transport (DRT) services at sites in 6 EU countries. A key feature of the project was to develop a common evaluation methodology, not just at the broad conceptual and indicator level, but also down to the level of measurement methods so that results could be truly comparable. To achieve this, the SUNRISE team developed a detailed toolkit that allowed them to define and measure things in a common way. This includes common definition of indicators, sample sizes, measurement methods and analysis methods. It also includes sample survey forms.
SUNRISE D4: Common Evaluation Plan – Methodology
This is a high level document that describes the end-to-end SUNRISE evaluation methodology. The details are contained in the set of 12 Annexes. It covers two main phases: (1) prior to start of the DRT services: background site description, identification of stakeholders, assessment of transport demand, identification of expected impacts and indicators for site objectives; and (2) after the DRT services start: site performance, site description, results of site objectives and impacts. It describes how to develop a common evaluation plan for a multiple-site project.
Annex 1: Background Site Description
This is a qualitative survey form which describes key geographical characteristics, core socio-economic information, mobility characteristics, the statutory authorities, the operators and the public transport services available in the area to be evaluated before the introduction of the DRT service. Finally, a Problem Statement is provided: this is the first stage in site analysis as it identifies the mobility problem that is to be tackled at the site.
Annex 2: Identification of User Groups (Stakeholders)
This document provides a structured way to identify the User Groups, i.e. those organisations and individuals who have a direct interest in the outcome of introducing the DRT service.
Annex 3: Transport Demand Indicators
Transport Demand surveys are conducted as part of User Requirements. The survey looks at the use of existing public transport services and attitudes towards existing public transport services. This survey form is based on a number of the Social Benefit indicators that are used as part of the post-installation assessment and is therefore part of a useful before and after tool for comparison.
Annex 4: Site Objectives and Expected Impacts
This document provides a tabular structure for identifying the site objectives and expected impacts, grouped in the three main strands used by SUNRISE – Economic Viability, Social Benefit and Technical Performance. At this stage, it also identifies indicators that would address these objectives. The tables are completed with examples.
Annex 5: Indicator Selection
This document provides a comprehensive listing of indicators that could be used in evalation of DRT services, again structured along the three strands of Economic Viability, Social Benefit and Technical Performance. A definition is provided for each Indicator. A subset of the most relevant indicators is highlighted as mandatory for all the SUNRISE sites (i.e. for the multi-site cross-evaluation), while other indicators may be of specific interest to just one or a few sites.
Annex 6: Transport Demand Survey Forms
This document provides the field Survey Forms required for data collection for Transport Demand. The following information is given about each indicator to guide the data collection: (i) A table to be completed if there are any changes to indicator definitions that could adversely affect the cross-site comparison. (ii) A Methodology table to be completed for each indicator selected; (iii) For each indicator a variety of information is given above the indicator table, e.g. the reference number and name of each indicator; indicators that can be adapted for car pooling are marked with a car symbol (); core indicators (to be collected at all sites); the sample source. (iv) For each indicator a variety of information is given within the indicator table, e.g. sample duration/size; components of the indicator including the units of measurement; supplementary data collection guidance notes.
Annex 7: Economic Viability Survey Forms
This document provides the field Survey forms required for data collection for Economic Viability.
Annex 8: Social Benefit Survey Forms
This document provides the field Survey forms required for data collection for Social Benefit.
Annex 9: Technical Performance Survey Forms
This document provides the field Survey forms required for data collection for Technical Performance.
Annex 10: Site Performance Results
This document provides a simple table to collate the results after the flexible service has been operational for a defined period of months. These data will be used for individual and cross site evaluation.
Annex 11: Site Descriptions
This documents shows the results after the flexible service has been operational for a defined period of months. These data will be used for individual and cross site evaluation. For each Assessment Category complete the Site Performance tables for the indicators that have been selected using the data collected using the field survey forms. Transport Demand data are also reported here. While this is structured as a reporting format post-implementation, it is clear that it needs to be prepared prior to implementation and the necessary planning put in place to capture all of the information.
Annex 12: Results of Expected Impacts
This document provides a tabular structure to report the actual impacts (drawn from the measured results and analysis) relative to the Site Objectives and Expected Impacts develop in Annex 4.
Site Objectives and Data Collection Plan for Ring a Link
This document provides a worked example of the Site Objectives, selected Indicators and Data Collection Plan for the DRT Implementation site in Carrick-on-Suir, Ireland, operated by Ring a Link. It consists of the completed Annex 4 for the site plus the full data collection plan for all the selected Indicators.
Course on DRT Methodology Design: DRT Service Evaluation
This short PowerPoint presentation provides an easy-to-follow overview of the evaluation methodology and its structure