CHECK

Task 8 – Monitor and evaluate

Guidance on monitoring and evaluation (M&E) is included in Section 1. An example of SED monitoring is included in Table 4A.7.

Long-term objectives identified as part of Review and Planning (see Section 2) relate to SED. A monitoring and evaluation framework should be developed to track progress against these long-term objectives.

At the SED project level, M&E should be applied to assess if the SED project is achieving the results as planned and is effective in achieving the expected outcomes and positive impacts.

The SED project ToR should include the M&E framework, defining clearly:

• Objectives of the SED project.
• Input targets/indicators: resources expected to be needed, including time, people, finances, information, expertise to deliver activities.
• Output targets/indicators: direct, measurable results derived from activities, which can be quantitative or qualitative.
• Outcome targets/indicators: observable changes that have occurred and can be directly linked to the SED project.
• Impact targets/indicators: estimated longer-term effects of outcomes on households, communities and society which the SED project helped bring about but are the result of a combination of factors, which cannot be directly influenced.

SED project M&E frameworks should be co-ordinated across SED projects where possible. In addition, M&E frameworks of Group-led projects should be leveraged.

Monitoring is an ongoing activity that should be incorporated into everyday SED project work, which also means that it should be resourced for.

Indicators are regularly monitored to assess whether the SED project is implemented according to plan in order to help the project manager quickly identify and solve any issues.

Participatory monitoring is not a mandatory requirement in relation to SED. However, it is good practice and recommended where community trust in the site is low. The CEF could be used as a mechanism to establish and sustain participatory monitoring for SED. This is especially valuable given the collaborative approach required to address SED-related issues. More information about participatory monitoring is included in Governance (see Section 1)

Regular reports summarising the monitoring results for all SED projects should be shared with Group SED/CRD to enable the business to have an overview of projects by SED element, and to enable support to be provided for SED projects early on in case of problems.

Evaluation, in contrast to monitoring, should take place at specific times during the SED project. Baseline research should take place prior or near the start of an SED project to obtain information that allows to define meaningful indicators and targets against which changes, over time, can be tracked and compared. Further evaluations are usually made at intervals of between two and three years and at the end of the SED project. Evaluation can be conducted by the site or by, or in collaboration with, external, independent parties, which may be seen as more objective and hence credible.

In order to assess the efficiency and effectiveness of flagship SED projects and larger expenditures, the Social Return on Investment (SROI) approach can be considered. SROI is an outcomes-based measurement tool that helps understand and quantify the social, environmental and economic value of SED projects. Developed from traditional cost-benefit analysis, SROI is a participative approach that allows to monetise outcomes and impacts so that they can be weighed against project costs. SROI can also be used upfront for developing SED projects by supporting decision-making. See the SROI Tool for more information (see 4A.4 Tools and Guidance Notes)

Multi-year SED and CRD projects should include a mid-term and end-of-project evaluation led by Group SED/CRD. For SED projects that are multi-year or multi-phase, and have a budget exceeding a certain size an external evaluation should be undertaken. Table 4A.6 gives further guidance on this

TABLE 4A.6 Evaluation guidance criteria

* Not programmes

The evaluation process should provide lessons learned that should be used for ongoing SED planning; and, therefore, all evaluations (internal and external) should be shared with Group SED/CRD. Lessons learned may be related to whether:

• the delivery mechanism was effective;
• there were any unintended effects;
• the theory of change was accurate;
• resources allocated were sufficient;
• the monitoring and evaluation process, including data collection, was efficient.