Difference between revisions of "Millennium Development Goals (MDGs) and Result Chains"

From energypedia
***** (***** | *****)
***** (***** | *****)
m
 
(5 intermediate revisions by 3 users not shown)
Line 1: Line 1:
  
 
= Overview =
 
= Overview =
 +
[[Millennium Development Goals (MDGs)|Millennium Development Goals (MDGs)]] are set (see table [[Energy and the MDGs|importance of energy for achieving the MDGs]]). Impact monitoring makes changes apparent. Such changes are the result of a combined influence of the society's own internal mechanisms of development, and external political, economic and environmental factors, one of which may be a development programme or project. It is quite difficult to tell which factor caused which change, and it is hardly possible to isolate the project's impact from any other influence. Still, impact monitoring is important, because it is a process of learning about relationships. To be more effective and realistic, decisions and project activities should be reviewed from time to time and be adapted to the changing situation. Furthermore, by conducting impact assessments on a regular basis, the mid to long-term sustainability of results and impacts can be monitored.
  
The impacts of the energy projects implemented under Energising Development generate changes in the areas where the Millennium Development Goals (MDGs) are set (see table [[Energy and the MDGs|importance of energy for achieving the MDGs]]). Impact monitoring makes changes apparent. Such changes are the result of a combined influence of the society's own internal mechanisms of development, and external political, economic and environmental factors, one of which may be a development programme or project. It is quite difficult to tell which factor caused which change, and it is hardly possible to isolate the project's impact from any other influence. Still, impact monitoring is important, because it is a process of learning about relationships. To be more effective and realistic, decisions and project activities should be reviewed from time to time and be adapted to the changing situation. Furthermore, by conducting impact assessments on a regular basis, the mid to long-term sustainability of results and impacts can be monitored.
+
<br/>
 
 
 
 
  
  
 
= Result Chains =
 
= Result Chains =
 
 
The actual difficulties of assessing development results and impacts lie in the “attribution”, i.e. in the classification of a highly-aggregated development progress for individual projects. This means that the greater the distance from the individual intervention to the spheres where the changes take place, the more difficult it becomes to assign causal relationships to development results.
 
The actual difficulties of assessing development results and impacts lie in the “attribution”, i.e. in the classification of a highly-aggregated development progress for individual projects. This means that the greater the distance from the individual intervention to the spheres where the changes take place, the more difficult it becomes to assign causal relationships to development results.
  
 
A results chain sets out a logical pattern of how successive and conditional inputs, activities, and outputs that an intervention can directly affect, could lead to more distant outcomes and impacts.
 
A results chain sets out a logical pattern of how successive and conditional inputs, activities, and outputs that an intervention can directly affect, could lead to more distant outcomes and impacts.
  
Figure 1 An exemplary results chain
 
  
  
 +
'''<u>Figure 1: An exemplary results chain:</u>'''<br/>[[File:Wirkungskette.png|thumb|left|671px|Result Chain|alt=Wirkungskette.png]]
  
Development projects and programmes are resourced through German and partner '''inputs''', such as materials, equipment, staff and funds. Using these inputs, the projects launch '''activities '''such as advisory services, trainings, funding, or accompanying measures (e.g. awareness and marketing campaigns). Due to these activities '''outputs''' are generated, which might occur as qualified institutions/organisations, availability of sufficient financial resources of partner organisations or supporting measures in place. These outputs are then utilised by target groups or intermediaries '''(use of outputs)''', e.g. leading to efficient processes and improved services of institutions/organisations or the use of funds for improving energy infrastructure. This use of output is further generating medium-term and long-term development results such as '''outcomes '''(e.g. improved access to electricity for rural households)and '''impacts '''(e.g. increased household income, reduced workload for women).
+
Development projects and programmes are resourced through German and partner '''inputs''', such as materials, equipment, staff and funds. Using these inputs, the projects launch '''activities '''such as advisory services, trainings, funding, or accompanying measures (e.g. awareness and marketing campaigns). Due to these activities '''outputs''' are generated, which might occur as qualified institutions/organisations, availability of sufficient financial resources of partner organisations or supporting measures in place. These outputs are then utilised by target groups or intermediaries '''(use of outputs)''', e.g. leading to efficient processes and improved services of institutions/organisations or the use of funds for improving energy infrastructure. This use of output is further generating medium-term and long-term development results such as '''outcomes '''(e.g. improved access to electricity for rural households) and '''impacts '''(e.g. increased household income, reduced workload for women).
  
Up to the level of “use of outputs”, attribution is relatively easy in most cases. However, as we climb up to the levels of “outcomes” and “impacts” external factors that cannot be influenced by projects and programmes become increasingly important. The attribution gap widens up to an extent where the observed changes cannot be directly related to project outputs any more. Up to the level where a causal relationship between outputs and observed development changes can be shown, projects are entitled to claim the observed positive development changes as a “direct benefit” or “outcome”. The project or programme objective is set at this level of the result chain. Often, however, the actual reason for launching operations in a sector or country is to achieve results beyond that level, and these can usually be influenced only indirectly by the project/programme. In general, it is not possible to identify a causal relationship explaining how these “indirect benefits” came about, as too many actors are involved to clearly isolate the effect of a single intervention. Nonetheless, highly aggregated development results (for instance progress made towards achieving the Millennium Development Goals) need to be kept in view. Even though comprehensive ''attribution ''is not possible, EnDev projects should provide plausible hypotheses on the project’s ''''contributions' '''to overarching development results. The following tables show the typical impact chain for projects regarding “Energy for cooking” and “Rural Electrification”.
+
Up to the level of “use of outputs”, attribution is relatively easy in most cases. However, as we climb up to the levels of “outcomes” and “impacts” external factors that cannot be influenced by projects and programmes become increasingly important. The attribution gap widens up to an extent where the observed changes cannot be directly related to project outputs any more. Up to the level where a causal relationship between outputs and observed development changes can be shown, projects are entitled to claim the observed positive development changes as a “direct benefit” or “outcome”. The project or programme objective is set at this level of the result chain. Often, however, the actual reason for launching operations in a sector or country is to achieve results beyond that level, and these can usually be influenced only indirectly by the project/programme. In general, it is not possible to identify a causal relationship explaining how these “indirect benefits” came about, as too many actors are involved to clearly isolate the effect of a single intervention. Nonetheless, highly aggregated development results (for instance progress made towards achieving the Millennium Development Goals) need to be kept in view. Even though comprehensive ''attribution ''is not possible, EnDev projects should provide plausible hypotheses on the project’s ''''contributions' '''to overarching development results. The following tables show the typical impact chain for projects regarding “[[Facts on Cooking Energy|Energy for cooking]]” and “[[Rural Electrification|Rural Electrification]]”.
  
== <br/>Impact Chain for the Project type: Energy for cooking ==
 
  
'''Table 2: Impact Chain for the Project type: Energy for cooking'''
+
== <br/>Impact Chain for the Project Type: Energy for Cooking ==
 +
'''Table 2: Impact Chain for the Project type: [[Facts on Cooking Energy|Energy for cooking]]'''
  
{| class="wikitable" style="width: 100%;" border="1"
+
 
|- style="text-align: center; font-weight: bold; background-color: rgb(192, 192, 192);"
+
{| border="1" class="wikitable" style="width: 100%"
| style="width: 62px; height: 26px;" | Impact Chain
+
|- style="text-align: center; font-weight: bold; background-color: rgb(192, 192, 192)"
| style="width: 307px;" | Criteria<br/>
+
| style="width: 62px; height: 26px" | Impact Chain
 +
| style="width: 307px" | Criteria
 
|-
 
|-
| style="height: 13px; font-weight: bold;" rowspan="4" | Output
+
| style="height: 13px; font-weight: bold" rowspan="4" | Output
 
|  
 
|  
 
*Appropriate & viable stove technologies are developed
 
*Appropriate & viable stove technologies are developed
 
 
|-
 
|-
 
|  
 
|  
 
*Stove producers are trained in technical and marketing skills
 
*Stove producers are trained in technical and marketing skills
 
 
|-
 
|-
 
|  
 
|  
 
*Quality control system is developed
 
*Quality control system is developed
 
 
|-
 
|-
 
|  
 
|  
 
*Increased access to information & knowledge about cooking energy (technologies & techniques) for public
 
*Increased access to information & knowledge about cooking energy (technologies & techniques) for public
 
 
|-
 
|-
| style="height: 13px; font-weight: bold;" rowspan="4" | Use of output
+
| style="height: 13px; font-weight: bold" rowspan="4" | Use of output
 
|  
 
|  
 
*Appropriate & viable stove technologies are applied
 
*Appropriate & viable stove technologies are applied
 
 
|-
 
|-
 
|  
 
|  
 
*Stove producers are competent and apply their technical and marketing skills
 
*Stove producers are competent and apply their technical and marketing skills
 
 
|-
 
|-
 
|  
 
|  
 
*Quality control system is implemented
 
*Quality control system is implemented
 
 
|-
 
|-
 
|  
 
|  
 
*Increased awareness about cooking energy issues in households, social institutions and SMEs
 
*Increased awareness about cooking energy issues in households, social institutions and SMEs
 
 
|-
 
|-
| style="height: 26px; font-weight: bold;" rowspan="3" | Outcome (Direct benefits)
+
| style="height: 26px; font-weight: bold" rowspan="3" | Outcome (Direct benefits)
 
|  
 
|  
 
*Improved sustainable access to cooking energy for households, SME and social institutions:
 
*Improved sustainable access to cooking energy for households, SME and social institutions:
 
 
|-
 
|-
 
|  
 
|  
 
*More high quality stoves are produced and sold by men & women
 
*More high quality stoves are produced and sold by men & women
 
 
|-
 
|-
 
|  
 
|  
 
*More people buy and use efficiently ICS
 
*More people buy and use efficiently ICS
 
 
|-
 
|-
| style="height: 26px; font-weight: bold;" rowspan="11" | Impact (Indirect benefits)
+
| style="height: 26px; font-weight: bold" rowspan="11" | Impact (Indirect benefits)
 
|  
 
|  
 
*Increased income generation for stove producers and retailers, more jobs and SMEs created
 
*Increased income generation for stove producers and retailers, more jobs and SMEs created
 
 
|-
 
|-
 
|  
 
|  
 
*Increased engagement & employment of women
 
*Increased engagement & employment of women
 
 
|-
 
|-
 
|  
 
|  
 
*Biomass energy is saved leading to
 
*Biomass energy is saved leading to
 
 
|-
 
|-
 
|  
 
|  
 
*Savings: less expenses for fuel wood
 
*Savings: less expenses for fuel wood
 
 
|-
 
|-
 
|  
 
|  
 
*Saved time on fuel wood collection
 
*Saved time on fuel wood collection
 
 
|-
 
|-
 
|  
 
|  
 
*Improved working and living conditions
 
*Improved working and living conditions
 
 
|-
 
|-
 
|  
 
|  
 
*Saved cooking and collecting time
 
*Saved cooking and collecting time
 
 
|-
 
|-
 
|  
 
|  
 
*Less workload for women and children
 
*Less workload for women and children
 
 
|-
 
|-
 
|  
 
|  
 
*Improved indoor air quality and less respiratory and eye diseases
 
*Improved indoor air quality and less respiratory and eye diseases
 
 
|-
 
|-
 
|  
 
|  
 
*Improved safety and hygene in the kitchen
 
*Improved safety and hygene in the kitchen
 
 
|-
 
|-
 
|  
 
|  
 
*Less deforestation and land degradation and improved climate protection
 
*Less deforestation and land degradation and improved climate protection
 
 
|-
 
|-
| style="height: 13px; font-weight: bold;" rowspan="5" | Highly aggregated results
+
| style="height: 13px; font-weight: bold" rowspan="5" | Highly aggregated results
 
|  
 
|  
 
*Reduction of extreme poverty
 
*Reduction of extreme poverty
 
 
|-
 
|-
 
|  
 
|  
 
*Improved economic conditions
 
*Improved economic conditions
 
 
|-
 
|-
 
|  
 
|  
 
*Improved environmental conditions
 
*Improved environmental conditions
 
 
|-
 
|-
 
|  
 
|  
 
*Improved health situation
 
*Improved health situation
 
 
|-
 
|-
 
|  
 
|  
 
*Improved situation of women
 
*Improved situation of women
 
 
|}
 
|}
 +
<br/>
  
<br/>
 
  
== Impact Chain for the Project type: Rural Electrification ==
+
== Impact Chain for the Project Type: Rural Electrification ==
 +
'''Table 3: Impact Chain for the Project type: [[Rural_Electrification|Rural Electrification]]'''
  
Table 3: Impact Chain for the Project type: Rural Electrification
 
  
{| class="wikitable" style="width: 100%;" border="1"
+
{| border="1" class="wikitable" style="width: 100%"
|- valign="bottom" style="text-align: center; font-weight: bold; background-color: rgb(192, 192, 192);"
+
|- valign="bottom" style="text-align: center; font-weight: bold; background-color: rgb(192, 192, 192)"
| style="width: 62px; height: 26px;" | Impact Chain
+
| style="width: 62px; height: 26px" | Impact Chain
| style="width: 307px;" | Criteria<br/>
+
| style="width: 307px" | Criteria
 
|- valign="bottom"
 
|- valign="bottom"
| style="height: 13px; font-weight: bold;" rowspan="3" | Output
+
| style="height: 13px; font-weight: bold" rowspan="3" | Output
 
|  
 
|  
 
*Institutions / organisations are qualified
 
*Institutions / organisations are qualified
 
 
|-
 
|-
| style="vertical-align: bottom;" |  
+
| style="vertical-align: bottom" |  
 
*Partner organisations have sufficient financial resources to implement pro-poor electrification programmes
 
*Partner organisations have sufficient financial resources to implement pro-poor electrification programmes
 
 
|- valign="bottom"
 
|- valign="bottom"
 
|  
 
|  
 
*Back-up/accompanying measures are implemented
 
*Back-up/accompanying measures are implemented
 
 
|-
 
|-
| style="height: 26px; font-weight: bold; vertical-align: bottom;" rowspan="3" | Use of output
+
| style="height: 26px; font-weight: bold; vertical-align: bottom" rowspan="3" | Use of output
| style="vertical-align: bottom;" |  
+
| style="vertical-align: bottom" |  
 
*Qualified institutions / organisations work more efficiently and offer innovative products and services
 
*Qualified institutions / organisations work more efficiently and offer innovative products and services
 
 
|-
 
|-
| style="vertical-align: bottom;" |  
+
| style="vertical-align: bottom" |  
 
*Partner organisations use financial resources to provide facilitated access to modern energy services for households, SME, social institutions
 
*Partner organisations use financial resources to provide facilitated access to modern energy services for households, SME, social institutions
 
 
|-
 
|-
| style="vertical-align: bottom;" |  
+
| style="vertical-align: bottom" |  
 
*Long-term sustainability is ensured by the implemented back-up/accompanying measures
 
*Long-term sustainability is ensured by the implemented back-up/accompanying measures
 
 
|-
 
|-
| style="height: 26px; font-weight: bold; vertical-align: bottom;" rowspan="2" | Outcome (Direct benefits)
+
| style="height: 26px; font-weight: bold; vertical-align: bottom" rowspan="2" | Outcome (Direct benefits)
| style="vertical-align: bottom;" |  
+
| style="vertical-align: bottom" |  
 
*Improved sustainable access to electricity for households, SME and social institutions
 
*Improved sustainable access to electricity for households, SME and social institutions
 
 
|-
 
|-
| style="vertical-align: bottom;" |  
+
| style="vertical-align: bottom" |  
 
*The provided electricity is increasingly used for productive purposes and income generation
 
*The provided electricity is increasingly used for productive purposes and income generation
 
 
|- valign="bottom"
 
|- valign="bottom"
| style="height: 13px; font-weight: bold;" rowspan="21" | Impact (Indirect benefits)
+
| style="height: 13px; font-weight: bold" rowspan="21" | Impact (Indirect benefits)
| style="text-decoration: underline;" | Electricity for Households:
+
| style="text-decoration: underline" | Electricity for Households:
 
|-
 
|-
| style="text-decoration: none; vertical-align: bottom;" |  
+
| style="text-decoration: none; vertical-align: bottom" |  
 
*Increased income through household production facilitated by improved working conditions
 
*Increased income through household production facilitated by improved working conditions
 
 
|-
 
|-
| style="vertical-align: bottom;" |  
+
| style="vertical-align: bottom" |  
 
*Monetary savings through reduced energy costs
 
*Monetary savings through reduced energy costs
 
 
|-
 
|-
| style="vertical-align: bottom;" |  
+
| style="vertical-align: bottom" |  
 
*Improved indoor air quality in households
 
*Improved indoor air quality in households
 
 
|-
 
|-
| style="vertical-align: bottom;" |  
+
| style="vertical-align: bottom" |  
 
*Improved conditions for reading / studying of school children
 
*Improved conditions for reading / studying of school children
 
 
|-
 
|-
| style="vertical-align: bottom;" |  
+
| style="vertical-align: bottom" |  
 
*Reduced workload / improved working conditions for women
 
*Reduced workload / improved working conditions for women
 
 
|-
 
|-
| style="vertical-align: bottom;" |  
+
| style="vertical-align: bottom" |  
 
*Improved information and communication facilities
 
*Improved information and communication facilities
 
 
|-
 
|-
| style="vertical-align: bottom;" |  
+
| style="vertical-align: bottom" |  
 
*Enhanced perception of safety
 
*Enhanced perception of safety
 
 
|-
 
|-
| style="vertical-align: bottom;" |  
+
| style="vertical-align: bottom" |  
 
*Enhanced social cohesion in the community
 
*Enhanced social cohesion in the community
 
 
|-
 
|-
| style="vertical-align: bottom;" |  
+
| style="vertical-align: bottom" |  
 
|- valign="bottom"
 
|- valign="bottom"
| style="text-decoration: underline;" | Electricity for Social Infrastructure:
+
| style="text-decoration: underline" | Electricity for Social Infrastructure:
 
|-
 
|-
| style="text-decoration: none; vertical-align: bottom;" |  
+
| style="text-decoration: none; vertical-align: bottom" |  
 
*Improved health services (medical infrastructure)
 
*Improved health services (medical infrastructure)
 
 
|-
 
|-
| style="vertical-align: bottom;" |  
+
| style="vertical-align: bottom" |  
 
*Improved educational services (educational infrastructure)
 
*Improved educational services (educational infrastructure)
 
 
|-
 
|-
| style="vertical-align: bottom;" |  
+
| style="vertical-align: bottom" |  
 
*Enhanced perception of safety
 
*Enhanced perception of safety
 
 
|-
 
|-
| style="vertical-align: bottom;" |  
+
| style="vertical-align: bottom" |  
 
*Enhanced social cohesion in the community
 
*Enhanced social cohesion in the community
 
 
|-
 
|-
| style="vertical-align: bottom;" |  
+
| style="vertical-align: bottom" |  
 
|- valign="bottom"
 
|- valign="bottom"
| style="text-decoration: underline;" | Electricity for SME & Agriculture:
+
| style="text-decoration: underline" | Electricity for SME & Agriculture:
 
|-
 
|-
| style="text-decoration: none; vertical-align: bottom;" |  
+
| style="text-decoration: none; vertical-align: bottom" |  
 
*Increased number / higher productivity of SME
 
*Increased number / higher productivity of SME
 
 
|-
 
|-
| style="vertical-align: bottom;" |  
+
| style="vertical-align: bottom" |  
 
*Development of new businesses / energy-based value chains
 
*Development of new businesses / energy-based value chains
 
 
|-
 
|-
| style="vertical-align: bottom;" |  
+
| style="vertical-align: bottom" |  
 
*Increased agricultural productivity
 
*Increased agricultural productivity
 
 
|-
 
|-
| style="vertical-align: bottom;" |  
+
| style="vertical-align: bottom" |  
 
|-
 
|-
| style="height: 13px; font-weight: bold; vertical-align: bottom;" rowspan="5" | Highly aggregated results
+
| style="height: 13px; font-weight: bold; vertical-align: bottom" rowspan="5" | Highly aggregated results
| style="vertical-align: bottom;" |  
+
| style="vertical-align: bottom" |  
 
*Reduction of extreme poverty
 
*Reduction of extreme poverty
 
 
|-
 
|-
| style="vertical-align: bottom;" |  
+
| style="vertical-align: bottom" |  
 
*Improved economic conditions
 
*Improved economic conditions
 
 
|-
 
|-
| style="vertical-align: bottom;" |  
+
| style="vertical-align: bottom" |  
 
*Improved health situation
 
*Improved health situation
 
 
|-
 
|-
| style="vertical-align: bottom;" |  
+
| style="vertical-align: bottom" |  
 
*Improved educational situation
 
*Improved educational situation
 
 
|-
 
|-
| style="vertical-align: bottom;" |  
+
| style="vertical-align: bottom" |  
 
*Improved situation of women
 
*Improved situation of women
 +
|}
 +
<br/>
  
|}
 
  
 +
= Monitoring and Impact Assessment =
 +
Monitoring of <u>output</u>, <u>use of output</u> and <u>direct benefits</u> (outcomes) are part of the existing project monitoring; biannual each [[Energising Development (EnDev)|EnDev]] project provides a monitoring report with the no. of people provided with access to a modern form of energy (direct benefit / outcome). Monitoring the <u>indirect benefits</u> (impacts) and <u>highly aggregated results</u> (MDG level) in the impact chains should be part of a regular impact assessment. Therefore, the EnDev projects should select a set of applicable indicators to be monitored on a regular basis through case studies or surveys. If needed, the EnDev team in Eschborn will provide additional support. The following paragraphs and tables present some options for indicators. For reasons of comparison and potential further analysis of data (e.g. cost-benefit-analysis) it is highly recommendable to include certain essential indicators (marked in the tables) for every EnDev Impact-Assessment.
  
= Monitoring and impact assessment =
+
► [[Indicator Rural Electrification and Stoves|Full list Indicators "What to meassure" and "How to meassure"]]
  
Monitoring of <u>output</u>, <u>use of output</u> and <u>direct benefits</u> (outcomes) are part of the existing project monitoring; biannual each EnDev project provides a monitoring report with the no. of people provided with access to a modern form of energy (direct benefit / outcome). Monitoring the <u>indirect benefits</u> (impacts) and <u>highly aggregated results</u> (MDG level) in the impact chains should be part of a regular impact assessment. Therefore, the EnDev projects should select a set of applicable indicators to be monitored on a regular basis through case studies or surveys. If needed, the EnDev team in Eschborn will provide additional support. The following paragraphs and tables present some options for indicators. For reasons of comparison and potential further analysis of data (e.g. cost-benefit-analysis) it is highly recommendable to include certain essential indicators (marked in the tables) for every EnDev Impact-Assessment.
+
<br/>
  
--> [[Indicator rural electrification and stoves|Full list Indicators "What to meassure" and "How to meassure"]]
 
  
= Links to further reading<br/> =
+
= Further Information<br/> =
  
[http://www.undp.org/energy/ UNDP: Sustainable energy]
+
*[[Millennium Development Goals (MDGs)|Millennium Development Goals (MDGs)]]
 +
*[http://www.undp.org/energy/ UNDP: Sustainable energy]
 +
*[http://en.wikipedia.org/wiki/Renewable_energy Wikipedia: Renewable energy]
 +
<br/>
  
[http://en.wikipedia.org/wiki/Renewable_energy Wikipedia: Renewable energy]
 
  
 
= References<br/> =
 
= References<br/> =
  
*DFID – <u>[http://www.dfid.gov.uk/pubs/files/energyforthepoor.pdf http://www.dfid.gov.uk/pubs/files/energyforthepoor.pdf] </u>, August 2002
+
*DFID – <u>[http://www.dfid.gov.uk/pubs/files/energyforthepoor.pdf dfid.gov.uk- energy for the poor, pdf] </u>, August 2002
 
*GTZ - Guidelines for Impact Monitoring in Economic and Employment Promotion Projects with Special Reference to Poverty Reduction Impacts, March 2001; Kuby, Thomas; Vahlhaus, Martina.
 
*GTZ - Guidelines for Impact Monitoring in Economic and Employment Promotion Projects with Special Reference to Poverty Reduction Impacts, March 2001; Kuby, Thomas; Vahlhaus, Martina.
 
*GTZ – Measuring Successes and Setbacks. How to Monitor and Evaluate Household Energy Projects. 1996.
 
*GTZ – Measuring Successes and Setbacks. How to Monitor and Evaluate Household Energy Projects. 1996.
 
*GTZ – Results-based Monitoring. Guidelines for Technical Cooperation Projects and Programmes, May 2004
 
*GTZ – Results-based Monitoring. Guidelines for Technical Cooperation Projects and Programmes, May 2004
*OECD/DAC –&nbsp;<u>[http://www.oecd.org/dataoecd/29/21/2754804.pdf%20Glossary http://www.oecd.org/dataoecd/29/21/2754804.pdf Glossary] of Key Terms in Evaluation and Results Based Management</u> 2002.
+
*OECD/DAC – <u>[http://www.oecd.org/dataoecd/29/21/2754804.pdf Glossary, pdf] of Key Terms in Evaluation and Results Based Management</u> 2002.
*UNDP - <u>[http://www.undp.org/energy/docs2/ENRG-MDG_Guide_all.pdf http://www.undp.org/energy/docs2/ENRG-MDG_Guide_all.pdf] Energizing the Millennium Development Goals</u>, August 2005
+
*UNDP - <u>[http://www.undp.org/energy/docs2/ENRG-MDG_Guide_all.pdf undp.org, pdf] Energizing the Millennium Development Goals</u>, August 2005
*UN Energy - <u>[http://www.undp.org/energy/docs2/UN-ENRG%20paper.pdfThe http://www.undp.org/energy/docs2/UN-ENRG%20paper.pdfThe] energy challenge for achieving the Millennium Development Goals&lt;/a&gt;</u>”, July 2005<u>[http://siteresources.worldbank.org/INTENERGY/Resources/EnergyWorkingNotes_4.pdf http://siteresources.worldbank.org/INTENERGY/Resources/EnergyWorkingNotes_4.pdf] Energy and Poverty: Myths, Links, and Policy Issues</u> (272k pdf). Energy Working Notes No. 4, by Jamal Saghir. May 2005.&nbsp;
+
*UN Energy - <u>[http://www.undp.org/energy/docs2/UN-ENRG paper, pdf] energy challenge for achieving the Millennium Development Goals</u>”, July 2005 <u>[http://siteresources.worldbank.org/INTENERGY/Resources/EnergyWorkingNotes_4.pdf worldbank.org, Energy Working Notes] Energy and Poverty: Myths, Links, and Policy Issues</u> (272k pdf). Energy Working Notes No. 4, by Jamal Saghir. May 2005.
 
 
 
<references />
 
<references />
  
 +
[[Category:Millennium_Development_Goals_(MDGs)]]
 +
[[Category:Monitoring]]
 
[[Category:Impacts]]
 
[[Category:Impacts]]

Latest revision as of 13:52, 19 January 2015

Overview

Millennium Development Goals (MDGs) are set (see table importance of energy for achieving the MDGs). Impact monitoring makes changes apparent. Such changes are the result of a combined influence of the society's own internal mechanisms of development, and external political, economic and environmental factors, one of which may be a development programme or project. It is quite difficult to tell which factor caused which change, and it is hardly possible to isolate the project's impact from any other influence. Still, impact monitoring is important, because it is a process of learning about relationships. To be more effective and realistic, decisions and project activities should be reviewed from time to time and be adapted to the changing situation. Furthermore, by conducting impact assessments on a regular basis, the mid to long-term sustainability of results and impacts can be monitored.



Result Chains

The actual difficulties of assessing development results and impacts lie in the “attribution”, i.e. in the classification of a highly-aggregated development progress for individual projects. This means that the greater the distance from the individual intervention to the spheres where the changes take place, the more difficult it becomes to assign causal relationships to development results.

A results chain sets out a logical pattern of how successive and conditional inputs, activities, and outputs that an intervention can directly affect, could lead to more distant outcomes and impacts.


Figure 1: An exemplary results chain:

Wirkungskette.png
Result Chain

Development projects and programmes are resourced through German and partner inputs, such as materials, equipment, staff and funds. Using these inputs, the projects launch activities such as advisory services, trainings, funding, or accompanying measures (e.g. awareness and marketing campaigns). Due to these activities outputs are generated, which might occur as qualified institutions/organisations, availability of sufficient financial resources of partner organisations or supporting measures in place. These outputs are then utilised by target groups or intermediaries (use of outputs), e.g. leading to efficient processes and improved services of institutions/organisations or the use of funds for improving energy infrastructure. This use of output is further generating medium-term and long-term development results such as outcomes (e.g. improved access to electricity for rural households) and impacts (e.g. increased household income, reduced workload for women).

Up to the level of “use of outputs”, attribution is relatively easy in most cases. However, as we climb up to the levels of “outcomes” and “impacts” external factors that cannot be influenced by projects and programmes become increasingly important. The attribution gap widens up to an extent where the observed changes cannot be directly related to project outputs any more. Up to the level where a causal relationship between outputs and observed development changes can be shown, projects are entitled to claim the observed positive development changes as a “direct benefit” or “outcome”. The project or programme objective is set at this level of the result chain. Often, however, the actual reason for launching operations in a sector or country is to achieve results beyond that level, and these can usually be influenced only indirectly by the project/programme. In general, it is not possible to identify a causal relationship explaining how these “indirect benefits” came about, as too many actors are involved to clearly isolate the effect of a single intervention. Nonetheless, highly aggregated development results (for instance progress made towards achieving the Millennium Development Goals) need to be kept in view. Even though comprehensive attribution is not possible, EnDev projects should provide plausible hypotheses on the project’s 'contributions' to overarching development results. The following tables show the typical impact chain for projects regarding “Energy for cooking” and “Rural Electrification”.



Impact Chain for the Project Type: Energy for Cooking

Table 2: Impact Chain for the Project type: Energy for cooking


Impact Chain Criteria
Output
  • Appropriate & viable stove technologies are developed
  • Stove producers are trained in technical and marketing skills
  • Quality control system is developed
  • Increased access to information & knowledge about cooking energy (technologies & techniques) for public
Use of output
  • Appropriate & viable stove technologies are applied
  • Stove producers are competent and apply their technical and marketing skills
  • Quality control system is implemented
  • Increased awareness about cooking energy issues in households, social institutions and SMEs
Outcome (Direct benefits)
  • Improved sustainable access to cooking energy for households, SME and social institutions:
  • More high quality stoves are produced and sold by men & women
  • More people buy and use efficiently ICS
Impact (Indirect benefits)
  • Increased income generation for stove producers and retailers, more jobs and SMEs created
  • Increased engagement & employment of women
  • Biomass energy is saved leading to
  • Savings: less expenses for fuel wood
  • Saved time on fuel wood collection
  • Improved working and living conditions
  • Saved cooking and collecting time
  • Less workload for women and children
  • Improved indoor air quality and less respiratory and eye diseases
  • Improved safety and hygene in the kitchen
  • Less deforestation and land degradation and improved climate protection
Highly aggregated results
  • Reduction of extreme poverty
  • Improved economic conditions
  • Improved environmental conditions
  • Improved health situation
  • Improved situation of women



Impact Chain for the Project Type: Rural Electrification

Table 3: Impact Chain for the Project type: Rural Electrification


Impact Chain Criteria
Output
  • Institutions / organisations are qualified
  • Partner organisations have sufficient financial resources to implement pro-poor electrification programmes
  • Back-up/accompanying measures are implemented
Use of output
  • Qualified institutions / organisations work more efficiently and offer innovative products and services
  • Partner organisations use financial resources to provide facilitated access to modern energy services for households, SME, social institutions
  • Long-term sustainability is ensured by the implemented back-up/accompanying measures
Outcome (Direct benefits)
  • Improved sustainable access to electricity for households, SME and social institutions
  • The provided electricity is increasingly used for productive purposes and income generation
Impact (Indirect benefits) Electricity for Households:
  • Increased income through household production facilitated by improved working conditions
  • Monetary savings through reduced energy costs
  • Improved indoor air quality in households
  • Improved conditions for reading / studying of school children
  • Reduced workload / improved working conditions for women
  • Improved information and communication facilities
  • Enhanced perception of safety
  • Enhanced social cohesion in the community
Electricity for Social Infrastructure:
  • Improved health services (medical infrastructure)
  • Improved educational services (educational infrastructure)
  • Enhanced perception of safety
  • Enhanced social cohesion in the community
Electricity for SME & Agriculture:
  • Increased number / higher productivity of SME
  • Development of new businesses / energy-based value chains
  • Increased agricultural productivity
Highly aggregated results
  • Reduction of extreme poverty
  • Improved economic conditions
  • Improved health situation
  • Improved educational situation
  • Improved situation of women



Monitoring and Impact Assessment

Monitoring of output, use of output and direct benefits (outcomes) are part of the existing project monitoring; biannual each EnDev project provides a monitoring report with the no. of people provided with access to a modern form of energy (direct benefit / outcome). Monitoring the indirect benefits (impacts) and highly aggregated results (MDG level) in the impact chains should be part of a regular impact assessment. Therefore, the EnDev projects should select a set of applicable indicators to be monitored on a regular basis through case studies or surveys. If needed, the EnDev team in Eschborn will provide additional support. The following paragraphs and tables present some options for indicators. For reasons of comparison and potential further analysis of data (e.g. cost-benefit-analysis) it is highly recommendable to include certain essential indicators (marked in the tables) for every EnDev Impact-Assessment.

Full list Indicators "What to meassure" and "How to meassure"



Further Information



References

  • DFID – dfid.gov.uk- energy for the poor, pdf , August 2002
  • GTZ - Guidelines for Impact Monitoring in Economic and Employment Promotion Projects with Special Reference to Poverty Reduction Impacts, March 2001; Kuby, Thomas; Vahlhaus, Martina.
  • GTZ – Measuring Successes and Setbacks. How to Monitor and Evaluate Household Energy Projects. 1996.
  • GTZ – Results-based Monitoring. Guidelines for Technical Cooperation Projects and Programmes, May 2004
  • OECD/DAC – Glossary, pdf of Key Terms in Evaluation and Results Based Management 2002.
  • UNDP - undp.org, pdf Energizing the Millennium Development Goals, August 2005
  • UN Energy - paper, pdf energy challenge for achieving the Millennium Development Goals”, July 2005 worldbank.org, Energy Working Notes Energy and Poverty: Myths, Links, and Policy Issues (272k pdf). Energy Working Notes No. 4, by Jamal Saghir. May 2005.