Millennium Development Goals (MDGs) and Result Chains
The impacts of the energy projects implemented under Energising Development generate changes in the areas where the Millennium Development Goals (MDGs) are set (cp. table 1). Impact monitoring makes changes apparent. Such changes are the result of a combined influence of the society's own internal mechanisms of development, and external political, economic and environmental factors, one of which may be a development programme or project. It is quite difficult to tell which factor caused which change, and it is hardly possible to isolate the project's impact from any other influence. Still, impact monitoring is important, because it is a process of learning about relationships. To be more effective and realistic, decisions and project activities should be reviewed from time to time and be adapted to the changing situation. Furthermore, by conducting impact assessments on a regular basis, the mid to long-term sustainability of results and impacts can be monitored.
Importance of Energy to achieve the Millennium Development Goals
Energy is essential to achieving sustainable development and poverty reduction goals. It affects all aspects of development -- social, economic, and environmental -- including livelihoods, access to water, agricultural productivity, health, population levels, education, and gender-related issues.
Some two billion people have no access to modern energy services. The challenge lies in finding ways to reconcile this necessity and demand for energy with its impact on the natural resource base in order to ensure that sustainable development goals are realized.
The MDGs, a critical set of objectives to achieving sustainability, cannot be met without major improvement in the quality and quantity of energy services in developing countries.
Increasing access to modern energy services requires integrated development of enabling policy frameworks, development of local capacities, investment in infrastructure, development and/or adaptation of technologies and provision of knowledge-based advisory services.
The emerging concurrence on the role of energy in sustainable development consists of three key points:
- Energy services are an essential input to economic development and social progress, notably to achieving the Millennium Development Goals. Table 1 below summarises the linkages between energy and the multiple aspects of development.
- Provision of energy services to poor populations in many developing countries under current economic conditions is not attractive to market actors. Priming markets through development and support for businesses is necessary to deliver improved quantity and quality of energy services.
- Governments and public authorities must act dynamically to create the conditions that will allow greatly expanded access to energy services. Public action in all forms - investment, regulatory action, ODA is absolutely necessary.
Sustainable, affordable energy services are essential to attain all of the MDGs, in particular poverty reduction, improved health, gender equality and sustainable management of natural resources[1].
Table 1: Importance of Energy to achieve the Millennium Development Goals
Millennium Development Goal |
Role of energy |
1) Eradicate extreme poverty and hunger
|
|
2) Achieve universal primary education
|
|
3) Promote gender equality and empower women
|
|
4) Reduce child mortality
|
|
5) Improve maternal health
| |
6) Combat HIV/AIDS, malaria and other diseases
| |
7) Ensure environmental sustainability
|
|
8) Develop a global partnership for development |
|
Result Chains
The actual difficulties of assessing development results and impacts lie in the “attribution”, i.e. in the classification of a highly-aggregated development progress for individual projects. This means that the greater the distance from the individual project/programme to the spheres where the changes take place, the more difficult it becomes to assign causal relationships to development results. The GTZ results model (see figure 1) follows the OECD/DAC evaluation principles and deals explicitly with this well-known attribution problem by including an “attribution gap” as a core conceptual element. Development projects and programmes are resourced through German and partner inputs, such as materials, equipment, staff and funds. Using these inputs, the projects launch activities such as advisory services, trainings, funding, or accompanying measures (e.g. awareness and marketing campaigns). Due to these activities outputs are generated, which might occur as qualified institutions/organisations, availability of sufficient financial resources of partner organisations or supporting measures in place. These outputs are then utilised by target groups or intermediaries (use of outputs), e.g. leading to efficient processes and improved services of institutions/organisations or the use of funds for improving energy infrastructure. This use of output is further generating medium-term and long-term development results such as outcomes (e.g. improved access to electricity for rural households)and impacts (e.g. increased household income, reduced workload for women).
Up to the level of “use of outputs”, attribution is relatively easy in most cases. However, as we climb up to the levels of “outcomes” and “impacts” external factors that cannot be influenced by projects and programmes become increasingly important. The attribution gap widens up to an extent where the observed changes cannot be directly related to project outputs any more. Up to the level where a causal relationship between outputs and observed development changes can be shown, projects are entitled to claim the observed positive development changes as a “direct benefit” or “outcome”. The project or programme objective is set at this level of the result chain. Often, however, the actual reason for launching operations in a sector or country is to achieve results beyond that level, and these can usually be influenced only indirectly by the project/programme. In general, it is not possible to identify a causal relationship explaining how these “indirect benefits” came about, as too many actors are involved to clearly isolate the effect of a single intervention. Nonetheless, highly aggregated development results (for instance progress made towards achieving the Millennium Development Goals) need to be kept in view. Even though comprehensive attribution is not possible, EnDev projects should provide plausible hypotheses on the project’s 'contributions' to overarching development results. The following tables show the typical impact chain for projects regarding “Energy for cooking” and “Rural Electrification”. Impact Chain for the Project type: Energy for cooking
Impact Chain for the Project type: Energy for cooking
Table 2: Impact Chain for the Project type: Energy for cooking
Impact Chain | Criteria |
Output |
|
| |
| |
| |
Use of output |
|
| |
| |
| |
Outcome (Direct benefits) |
|
| |
| |
Impact (Indirect benefits) |
|
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
Highly aggregated results |
|
| |
| |
| |
|
Impact Chain for the Project type: Rural Electrification
Table 3: Impact Chain for the Project type: Rural Electrification
Impact Chain | Criteria |
Output |
|
| |
| |
Use of output |
|
| |
| |
Outcome (Direct benefits) |
|
| |
Impact (Indirect benefits) | Electricity for Households: |
| |
| |
| |
| |
| |
| |
| |
| |
Electricity for Social Infrastructure: | |
| |
| |
| |
| |
Electricity for SME & Agriculture: | |
| |
| |
| |
Highly aggregated results |
|
| |
| |
| |
|
Monitoring and impact assessment
Monitoring of output, use of output and direct benefits (outcomes) are part of the existing project monitoring; biannual each EnDev project provides a monitoring report with the no. of people provided with access to a modern form of energy (direct benefit / outcome). Monitoring the indirect benefits (impacts) and highly aggregated results (MDG level) in the impact chains should be part of a regular impact assessment. Therefore, the EnDev projects should select a set of applicable indicators to be monitored on a regular basis through case studies or surveys. If needed, the EnDev team in Eschborn will provide additional support. The following paragraphs and tables present some options for indicators. For reasons of comparison and potential further analysis of data (e.g. cost-benefit-analysis) it is highly recommendable to include certain essential indicators (marked in the tables) for every EnDev Impact-Assessment.
--> Full list Indicators "What to meassure" and "How to meassure"
References
- DFID – http://www.dfid.gov.uk/pubs/files/energyforthepoor.pdf , August 2002
- GTZ - Guidelines for Impact Monitoring in Economic and Employment Promotion Projects with Special Reference to Poverty Reduction Impacts, March 2001; Kuby, Thomas; Vahlhaus, Martina.
- GTZ – Measuring Successes and Setbacks. How to Monitor and Evaluate Household Energy Projects. 1996.
- GTZ – Results-based Monitoring. Guidelines for Technical Cooperation Projects and Programmes, May 2004
- OECD/DAC – http://www.oecd.org/dataoecd/29/21/2754804.pdf Glossary of Key Terms in Evaluation and Results Based Management 2002.
- UNDP - http://www.undp.org/energy/docs2/ENRG-MDG_Guide_all.pdf Energizing the Millennium Development Goals, August 2005
- UN Energy - http://www.undp.org/energy/docs2/UN-ENRG%20paper.pdfThe energy challenge for achieving the Millennium Development Goals</a>”, July 2005http://siteresources.worldbank.org/INTENERGY/Resources/EnergyWorkingNotes_4.pdf Energy and Poverty: Myths, Links, and Policy Issues (272k pdf). Energy Working Notes No. 4, by Jamal Saghir. May 2005.
- ↑ GTZ (2007): Eastern Africa Resource Base: GTZ Online Regional Energy Resource Base: Regional and Country Specific Energy Resource Database: I - Energy Technology