Difference between revisions of "Impact Monitoring Guidelines"

From energypedia
***** (***** | *****)
m
***** (***** | *****)
m
Line 1: Line 1:
= Introduction =
+
= Introduction =
  
The Impacts Monitoring Group of [[Energising Development (EnDev)|Energising Development has]] developed recommendations for a "proper" impact assessments.  
+
The Impacts Monitoring Group of [[Energising Development (EnDev)|Energising Development has]] developed recommendations for a "proper" impact assessments.
  
We recommend to:  
+
We recommend to:
 +
 
 +
*use the recommended [[Indicator rural electrification and stoves|'''list of indicators''']]
 +
*conduct '''baseline studies '''before project intervention and impact studies after households, social infrastructure or SMEs got access to a form of modern energy
 +
*use a [[Theory Based Approach|'''theory based approach''']] by applying the result chain for developing the study design
 +
*use a [[Mixed Methods|'''mixed methods approach''']]: the logic of the comparative advantages of [[Methoden|methods]]: that means the mix of quantitative (standarised household interviews) and qualitative methods (open/ semi-structured interviews with key persons and households or focus group discussions)
 +
*include [[Control Groups|'''control groups''']] if possible (households which do not have acces to modern energy) into your baseline and impact study 
 +
*consider [[Research_Ethics|'''research ethics''']]
  
*use the recommended [[Indicator rural electrification and stoves|'''list of indicators''']]
 
*conduct '''baseline studies '''before project intervention and impact studies after households, social infrastructure or SMEs got access to a form of modern energy
 
*use a [[Theory Based Approach|'''theory based approach''']] by applying the result chain for developing the study design
 
*use a [[Mixed Methods|'''mixed methods approach''']]: the logic of the comparative advantages of [[Methoden|methods]]: that means the mix of quantitative (standarised household interviews) and qualitative methods (open/ semi-structured interviews with key persons and households or focus group discussions)
 
*include [[Control Groups|'''control groups''']] if possible (households which do not have acces to modern energy) into your baseline and impact study 
 
*consider [[Research ethics|'''research ethics''']]
 
  
<br>
 
  
 
The following tables shows typical steps for baseline and impact studies, which we would recommend and support.
 
The following tables shows typical steps for baseline and impact studies, which we would recommend and support.
  
= Preparation =
+
= Preparation =
  
{| width="95%" cellspacing="0" cellpadding="0" border="1"
+
{| border="1" cellpadding="0" cellspacing="0" width="95%"
 
|-
 
|-
| bgcolor="#0000ff" | <span style="color: rgb(255,255,255)">'''Tasks''' </span>  
+
| bgcolor="#0000ff" | <span style="color: rgb(255,255,255)">'''Tasks'''</span>
| bgcolor="#0000ff" | <span style="color: rgb(255,255,255)">'''Materials/ Support''' </span>  
+
| bgcolor="#0000ff" | <span style="color: rgb(255,255,255)">'''Materials/ Support'''</span>
| bgcolor="#0000ff" | <span style="color: rgb(255,255,255)">'''Library''' </span>
+
| bgcolor="#0000ff" | <span style="color: rgb(255,255,255)">'''Library'''</span>
 
|-
 
|-
| <font size="2">Terms for Consultants/ Enumerators</font>  
+
| <font size="2">Terms for Consultants/ Enumerators</font>
 
|  
 
|  
*<font size="2">Sample Terms</font> for national / international consultants  
+
*<font size="2">Sample Terms</font> for national / international consultants
 
*Sample Terms for enumerators&nbsp;
 
*Sample Terms for enumerators&nbsp;
  
| ToR Consultants:<br>
+
| ToR Consultants:
*[[:file:Example_rwi_baseline_for_repro_tor_is_2008-11-18.pdf|Tor Baseline Study (Rwanda PSP Hydro)&nbsp;]]  
+
*[[:file:Example rwi baseline for repro tor is 2008-11-18.pdf|Tor Baseline Study (Rwanda PSP Hydro)&nbsp;]]
*[[:file:Example_terms_survey_french.pdf|ToR Survey french version]]  
+
*[[:file:Example terms survey french.pdf|ToR Survey french version]]
*[[:file:Example_terms_of_reference_local_expert_18122007.doc|ToR Evaluation english version]]  
+
*[[:file:Example terms of reference local expert 18122007.doc|ToR Evaluation english version]]
 
*[[Library Further Documents|Further Documents]]
 
*[[Library Further Documents|Further Documents]]
  
 
|-
 
|-
| Selection Consultant/ Enumerators  
+
| Selection Consultant/ Enumerators
 
|  
 
|  
 
*<font size="2">Consultants</font>
 
*<font size="2">Consultants</font>
Line 42: Line 42:
 
| &nbsp;
 
| &nbsp;
 
|-
 
|-
| Study of available documents and statistics on national development goals and policies, national sector goals and policies, BMZ goals and concept for the partner country  
+
| Study of available documents and statistics on national development goals and policies, national sector goals and policies, BMZ goals and concept for the partner country
 
|  
 
|  
 
*<font size="2">Checklist on relevant development goals</font>
 
*<font size="2">Checklist on relevant development goals</font>
  
 
|  
 
|  
*UNDP&nbsp;[http://www.energyandenvironment.undp.org/undp/index.cfm?module=Library&page=Document&DocumentID=5761 Energy Services for the Millennium Development Goals]  
+
*UNDP&nbsp;[http://www.energyandenvironment.undp.org/undp/index.cfm?module=Library&page=Document&DocumentID=5761 Energy Services for the Millennium Development Goals]
 
*BMZ&nbsp;[http://www.bmz.de/en/issues/energie/energieeffizienz/index.html Sustainable Energy for Development]
 
*BMZ&nbsp;[http://www.bmz.de/en/issues/energie/energieeffizienz/index.html Sustainable Energy for Development]
  
 
|-
 
|-
| <font size="2">Developing of Results Chains/ Indicators</font>  
+
| <font size="2">Developing of Results Chains/ Indicators</font>
 
|  
 
|  
*[[MDGs and Result Chains|<font size="2">Sample Results Chain</font>]]  
+
*[[MDGs and Result Chains|<font size="2">Sample Results Chain</font>]]
 
*<font size="2">[[Indicator rural electrification and stoves|Impact Criteria and&nbsp;indicators]]</font>
 
*<font size="2">[[Indicator rural electrification and stoves|Impact Criteria and&nbsp;indicators]]</font>
  
 
|  
 
|  
Rural Electrifciation:  
+
Rural Electrifciation:
  
*[[:file:Example_result_chains_de.pdf|Result Chain german version]]  
+
*[[:file:Example result chains de.pdf|Result Chain german version]]
*[[:file:Example_result_chains_en.pdf|Result Chain engl. version]]  
+
*[[:file:Example result chains en.pdf|Result Chain engl. version]]
*[[:file:Example_result_chains_fr.pdf|Result Chain french version]]
+
*[[:file:Example result chains fr.pdf|Result Chain french version]]
  
Cooking:<br>
+
Cooking:
  
*[[:file:Impacts_-_observation_fields_and_indicators.doc|Energy Impacts, Observation Fields and Indicators]]  
+
*[[:file:Impacts - observation fields and indicators.doc|Energy Impacts, Observation Fields and Indicators]]
*IA Kenya: [[:file:Example_ics_results_chains_kenya.doc|Result Chain]]  
+
*IA Kenya: [[:file:Example ics results chains kenya.doc|Result Chain]]
*IA Ethiopia: [[:file:Results_chains_ethiopia.pdf|Result Chain]]  
+
*IA Ethiopia: [[:file:Results chains ethiopia.pdf|Result Chain]]
*IA Kenya: [[:file:Preparation_kenya_-_impacts,_observation_fields_and_indicators.pdf|Model List of Impacts, Observation Fields and Indicators]]
+
*IA Kenya: [[:file:Preparation kenya - impacts, observation fields and indicators.pdf|Model List of Impacts, Observation Fields and Indicators]]
  
 
|-
 
|-
| <font size="2">Developing of Questionnaires, interview guidelines, PRA tools (MAPP), observation criteria and other tools [[Methoden|(catalogue of methods)]]</font>  
+
| <font size="2">Developing of Questionnaires, interview guidelines, PRA tools (MAPP), observation criteria and other tools [[Methoden|(catalogue of methods)]]</font>
 
|  
 
|  
*[[Quantitative Methods|<font size="2">Questionnaire</font>s for&nbsp;HH (stoves), stove producers, social institutions and restaurants using ICS]]  
+
*[[Quantitative Methods|<font size="2">Questionnaire</font>s for&nbsp;HH (stoves), stove producers, social institutions and restaurants using ICS]]
*[[Qualitative Methods|PRA tools for focus group discussions (MAPP)]]  
+
*[[Qualitative Methods|PRA tools for focus group discussions (MAPP)]]
*[[Qualitative Methods|Interview&nbsp;guidelines for village authorities]]  
+
*[[Qualitative Methods|Interview&nbsp;guidelines for village authorities]]
 
*[[Qualitative Methods|Observation criteria for stoves in use (example lists of good cooking practices and of stove conditions)&nbsp;]]
 
*[[Qualitative Methods|Observation criteria for stoves in use (example lists of good cooking practices and of stove conditions)&nbsp;]]
  
 
|  
 
|  
[[Materials for Quantitative Methods|Example Questionnaires]]  
+
[[Materials for Quantitative Methods|Example Questionnaires]]
  
[[Guidelines and materials for qualitative methods|PRA tools, Interview Guidelines, Observation criteria&nbsp;etc.]]  
+
[[Guidelines and materials for qualitative methods|PRA tools, Interview Guidelines, Observation criteria&nbsp;etc.]]
  
<br>
 
  
([[Impact Studies Material#General|Impact Studies Material]])  
+
 
 +
([[Impact Studies Material#General|Impact Studies Material]])
  
 
|-
 
|-
| <font size="2">Sampling/ Selection target Group</font>  
+
| <font size="2">Sampling/ Selection target Group</font>
 
|  
 
|  
*<font size="2">[[Guidelines for Sampling/ Selection Criterias|Guidelines / Sampling &amp; Selection Criterias]]</font>  
+
*<font size="2">[[Guidelines for Sampling/ Selection Criterias|Guidelines / Sampling & Selection Criterias]]</font>
 
*Poverty criteria for selection of&nbsp;HH
 
*Poverty criteria for selection of&nbsp;HH
  
 
|  
 
|  
*Kenya:&nbsp;[[:file:Selection_criteria_v2.doc|Selection Criteria for HH, SI, PU and Producers IA]]&nbsp;  
+
*Kenya:&nbsp;[[:file:Selection criteria v2.doc|Selection Criteria for HH, SI, PU and Producers IA]]&nbsp;
*Kenya: [[:file:Example_local_poverty_criteria_kenya.doc|Local Poverty criteria (example from local village authorities)]]
+
*Kenya: [[:file:Example local poverty criteria kenya.doc|Local Poverty criteria (example from local village authorities)]]
  
 
|-
 
|-
| <font size="2">Training of Supervisors and Enumerators/ Pretesting</font>  
+
| <font size="2">Training of Supervisors and Enumerators/ Pretesting</font>
 
|  
 
|  
*<font size="2">Training Material</font>  
+
*<font size="2">Training Material</font>
 
*<font size="2">Training Agenda</font>
 
*<font size="2">Training Agenda</font>
  
 
|  
 
|  
*Supervisors and Enumerators&nbsp;[[:file:Modèle_recrutement_formation_enqueteurs.doc|Example Training Agenda]]&nbsp;(french version)&nbsp;  
+
*Supervisors and Enumerators&nbsp;[[:file:Modèle recrutement formation enqueteurs.doc|Example Training Agenda]]&nbsp;(french version)&nbsp;
*Kenya: [[:file:Example_ics_training_of_enumerators_kenya.doc|ICS Training of Enumerators]]
+
*Kenya: [[:file:Example ics training of enumerators kenya.doc|ICS Training of Enumerators]]
  
 
|}
 
|}
  
<font size="2"></font>&nbsp;
+
&nbsp;
  
= Implementation =
+
= Implementation =
  
<br>
 
  
{| width="95%" cellspacing="0" cellpadding="0" border="1"
+
 
 +
{| border="1" cellpadding="0" cellspacing="0" width="95%"
 
|-
 
|-
| bgcolor="#0000ff" | <span style="color: rgb(255,255,255)">'''Task'''</span>  
+
| bgcolor="#0000ff" | <span style="color: rgb(255,255,255)">'''Task'''</span>
| bgcolor="#0000ff" | <span style="color: rgb(255,255,255)">'''Materials/ Support'''</span>  
+
| bgcolor="#0000ff" | <span style="color: rgb(255,255,255)">'''Materials/ Support'''</span>
 
| bgcolor="#0000ff" | <span style="color: rgb(255,255,255)">'''Library'''</span>
 
| bgcolor="#0000ff" | <span style="color: rgb(255,255,255)">'''Library'''</span>
 
|-
 
|-
| <font size="2">Logistics</font>  
+
| <font size="2">Logistics</font>
| <font size="2">Checklist on how to implement HH Interviews</font><br>  
+
| <font size="2">Checklist on how to implement HH Interviews</font>
*[[Short Household Survey|<font color="#002bb8">H1: Short Household Survey</font>]]  
+
*[[Short Household Survey|<font color="#002bb8">H1: Short Household Survey</font>]]
*[[Profound Household Survey|<font color="#002bb8">H2: Profound Household Survey</font>]]  
+
*[[Profound Household Survey|<font color="#002bb8">H2: Profound Household Survey</font>]]
 
*[[Qualitative Household Appraisal|<font color="#002bb8">H3: Qualitative Household Appraisal</font>]]
 
*[[Qualitative Household Appraisal|<font color="#002bb8">H3: Qualitative Household Appraisal</font>]]
  
 
|  
 
|  
<br>&nbsp;  
+
<br/>&nbsp;
  
 
|-
 
|-
| <font size="2">Conducting Interviews</font>  
+
| <font size="2">Conducting Interviews</font>
| &nbsp;  
+
| &nbsp;
 
|  
 
|  
*Manual [[:file:Example_hhquest_introduction_en.doc|<font color="#002bb8">Conducting Interviews</font>&nbsp;]](english version)&nbsp;  
+
*Manual [[:file:Example hhquest introduction en.doc|<font color="#002bb8">Conducting Interviews</font>&nbsp;]](english version)&nbsp;
*Manual [[:file:Exemple_hhquest_introduction_enquêteurs_fr.doc|<font color="#002bb8">Conducting Interviews</font>&nbsp;]](french version)&nbsp;
+
*Manual [[:file:Exemple hhquest introduction enquêteurs fr.doc|<font color="#002bb8">Conducting Interviews</font>&nbsp;]](french version)&nbsp;
  
 
|-
 
|-
| <font size="2">Data entry</font>  
+
| <font size="2">Data entry</font>
| &nbsp;  
+
| &nbsp;
 
| &nbsp;
 
| &nbsp;
 
|}
 
|}
Line 145: Line 145:
 
&nbsp;
 
&nbsp;
  
= Data Analysis/ Reporting =
+
= Data Analysis/ Reporting =
  
{| cellspacing="0" cellpadding="0" width="95%" border="1"
+
{| border="1" cellpadding="0" cellspacing="0" width="95%"
 
|-
 
|-
| bgcolor="#0000ff" | '''<span style="color: rgb(255,255,255)">Task</span>'''  
+
| bgcolor="#0000ff" | '''<span style="color: rgb(255,255,255)">Task</span>'''
| bgcolor="#0000ff" | '''<span style="color: rgb(255,255,255)">Materials/ Support</span>'''  
+
| bgcolor="#0000ff" | '''<span style="color: rgb(255,255,255)">Materials/ Support</span>'''
 
| bgcolor="#0000ff" | '''<span style="color: rgb(255,255,255)">Library</span>'''
 
| bgcolor="#0000ff" | '''<span style="color: rgb(255,255,255)">Library</span>'''
 
|-
 
|-
| <font size="2">Data analysis</font>  
+
| <font size="2">Data analysis</font>
 
|  
 
|  
 
*<font color="#002bb8">[[Guiding Questions for data analysis|<font size="2">Guiding Questions for data analysis</font>&nbsp;]]</font>
 
*<font color="#002bb8">[[Guiding Questions for data analysis|<font size="2">Guiding Questions for data analysis</font>&nbsp;]]</font>
  
 
|  
 
|  
*Kenya Stove HH: <font color="#002bb8">[[:file:Example hh guiding questions for data analysis v2.doc|Guiding Questions for data analysis]]</font>  
+
*Kenya Stove HH: <font color="#002bb8">[[:file:Example hh guiding questions for data analysis v2.doc|Guiding Questions for data analysis]]</font>
 
*Kenya Stove Producer: [[:file:Stove dealers guiding questions for data analysis v2.doc|<font color="#002bb8">Guiding Question for data analysis</font>]]
 
*Kenya Stove Producer: [[:file:Stove dealers guiding questions for data analysis v2.doc|<font color="#002bb8">Guiding Question for data analysis</font>]]
  
 
|-
 
|-
| <font size="2">Data interpretation – in exchange with the project team (in a workshop)</font>  
+
| <font size="2">Data interpretation – in exchange with the project team (in a workshop)</font>
 
|  
 
|  
 
*Checklist for data interpretation
 
*Checklist for data interpretation
Line 168: Line 168:
 
| &nbsp;
 
| &nbsp;
 
|-
 
|-
| <font size="2">Report writing</font> (+ summary writing)  
+
| <font size="2">Report writing</font> (+ summary writing)
 
|  
 
|  
*Example for report summary  
+
*Example for report summary
 
*Example for ICS description (Annex)
 
*Example for ICS description (Annex)
  
Line 177: Line 177:
  
 
|-
 
|-
| Handover of raw data  
+
| Handover of raw data
 
|  
 
|  
<br>
 
  
<br>
+
 
 +
 
  
 
|  
 
|  
 
|}
 
|}
  
<br>&nbsp;  
+
<br/>&nbsp;
  
 
[[Category:Impacts]]
 
[[Category:Impacts]]

Revision as of 08:17, 17 May 2012

Introduction

The Impacts Monitoring Group of Energising Development has developed recommendations for a "proper" impact assessments.

We recommend to:

  • use the recommended list of indicators
  • conduct baseline studies before project intervention and impact studies after households, social infrastructure or SMEs got access to a form of modern energy
  • use a theory based approach by applying the result chain for developing the study design
  • use a mixed methods approach: the logic of the comparative advantages of methods: that means the mix of quantitative (standarised household interviews) and qualitative methods (open/ semi-structured interviews with key persons and households or focus group discussions)
  • include control groups if possible (households which do not have acces to modern energy) into your baseline and impact study 
  • consider research ethics


The following tables shows typical steps for baseline and impact studies, which we would recommend and support.

Preparation

Tasks Materials/ Support Library
Terms for Consultants/ Enumerators
  • Sample Terms for national / international consultants
  • Sample Terms for enumerators 
ToR Consultants:
Selection Consultant/ Enumerators
  • Consultants
 
Study of available documents and statistics on national development goals and policies, national sector goals and policies, BMZ goals and concept for the partner country
  • Checklist on relevant development goals
Developing of Results Chains/ Indicators

Rural Electrifciation:

Cooking:

Developing of Questionnaires, interview guidelines, PRA tools (MAPP), observation criteria and other tools (catalogue of methods)

Example Questionnaires

PRA tools, Interview Guidelines, Observation criteria etc.


(Impact Studies Material)

Sampling/ Selection target Group
Training of Supervisors and Enumerators/ Pretesting
  • Training Material
  • Training Agenda

 

Implementation

Task Materials/ Support Library
Logistics Checklist on how to implement HH Interviews


 

Conducting Interviews  
Data entry    

 

Data Analysis/ Reporting

Task Materials/ Support Library
Data analysis
Data interpretation – in exchange with the project team (in a workshop)
  • Checklist for data interpretation
 
Report writing (+ summary writing)
  • Example for report summary
  • Example for ICS description (Annex)
Handover of raw data