Impact Monitoring Guidelines

The focus of the EnDev 2 M&E Sytem has shifted from Outcome Monitoring (EnDev 1) to Outcome and Impact Monitoring (EnDev 2). Therefore the Monitoring Group are developing recommendations for a "proper" impact M&E System.

We recommend to:

• conduct baseline studies before project intervention and impact studies after households, social infrastructure or SMEs got access to a form of modern energy
• a theory based approach by applying the result chain for developing the study design
• use a mixed methods approach: the logic of the comparative advantages of methods: that means the mix of quantitative (standarised household interviews) and qualitative methods (open/ semi-structured interviews with key persons and households or focus group discussions)
• to include control groups if possible (households which do not have acces to modern energy) into your baseline and impact study 

The following table shows typical steps for baseline and impact studies, which we would recommend and support.

Steps	Tasks	Materials/ Support	Library
Step 1: Preperation	Terms for Consultants/ Enumerators	Sample Terms for national / international consultants Sample Terms for enumerators
	Selection Consultant/ Enumerators	Consultants
	Study of available documents and statistics on national development goals and policies, national sector goals and policies, BMZ goals and concept for the partner country	Checklist on relevant development goals	UNDP Energy Services for the Millennium Development Goals BMZ Sustainable Energy for Development
	Developing of Results Chains/ Indicators	Sample Results Chain Impact Criteria and indicators	Cooking Energy Impacts, Observation Fields and Indicators IA Kenya: Result Chain IA Ethiopia: Result Chain IA Kenya: Model List of Impacts, Observation Fields and Indicators
	Developing of Questionnaires, interview guidelines, PRA tools (MAPP), observation criteria and other tools	Questionnaires for HH (stoves), stove producers, social institutions and restaurants using ICS PRA tools for focus group discussions (MAPP) Interview guidelines for village authorities Observation criteria for stoves in use (example lists of good cooking practices and of stove conditions)	Questionnaires, PRA tools, Interview Guidelines, Observation Criteria: Country documents / Impact Studies Material
	Sampling/ Selection target Group	Guidelines/ Selection Criterias Poverty criteria for selection of HH	Kenya: Selection Criteria for HH, SI, PU and Producers IA  Kenya: Local Poverty criteria (example from local village authorities)
	Training of Supervisors and Enumerators/ Pretesting	Training Material Training Agenda	Supervisors and Enumerators Example Training Agenda (french version)  Kenya: ICS Training of Enumerators
Step 2: Implementation	Logistics	Checklist on how to implement HH Interviews
	Conducting Interviews		Manual Conducting Interviews (english version)  Manual Conducting Interviews (french version)
	Data entry
Step 3: Data Analysis/ Reporting	Data analysis	Guiding Question for data analysis	Kenya Stove HH: Guiding Question for data analysis Kenya Stove Producer: Guiding Question for data analysis
	Data interpretation – in exchange with the project team (in a workshop)	Checklist for data interpretation
	Report writing	Example for report summary Example for ICS description (Annex)