Difference between revisions of "Profound Household Survey"

From energypedia
***** (***** | *****)
***** (***** | *****)
m
 
(12 intermediate revisions by 6 users not shown)
Line 1: Line 1:
 
 
  
'''Module H2: Profound Household survey'''
+
= Overview<br/> =
  
'''General Approach:'''
+
[[File:Conducting a household survey in Kangemi, Kenia, Katharina Wiedemann.JPG|thumb|right|180px|Conducting a household survey in Kangemi, Kenia]]Extensive and structured household questionnaire comprising information on socio-economic conditions, access to services, different wealth and income categories, health, education and gender issues. Survey covers the project region and a control region to credibly create a counterfactual situation and thereby enable causal attribution of impacts to the intervention.
  
Extensive and structured household questionnaire comprising information on socio-economic conditions, access to services, different wealth and income categories, health, education and gender issues. Survey covers the project region and a control region to credibly create a counterfactual situation and thereby enable causal attribution of impacts to the intervention. Depending on the information interests, two different approaches are applicable: Control regions may be non-electrified (Option A) or already disposing of electricity access (Option B). For stove projects, option A refers to regions without any former improved stove intervention and Option B to regions where comparable improved stoves interventions have already taken place. An appraisal of the two options can be found in <span><span>Box <span>1</span></span>. In both of the cases, surveys are conducted before and after the intervention. They are complemented by open, semi-structured key informant interviews (cf. Annex on qualitative methods). Furthermore, the wider set of socio-economic household characteristics that is covered by this module facilitates detecting unintended (positive or negative) impacts.</span>
+
<br/>
  
&nbsp;'''Purpose:'''
+
<br/>
  
Provides information that allows for deriving statements about the ''causal'' relationship between modern energy provision and development indicators using modern state-of-the-art evaluation techniques. Baseline survey delivers profound knowledge about the target region. If Option B is chosen, information from the comparison group that already uses electricity or stoves respectively can be used to assess the beneficiary’s behaviour already before project implementation same as potential difficulties and opportunities to be expected in the wake of the EnDev project. <br>
+
-> Module H2: Profound Household survey
  
{| cellspacing="0" cellpadding="0" width="622" align="left" border="1"
+
= General Approach<br/> =
|-
+
 
| valign="top" width="622" |
+
<u>Depending on the information interests, two different approaches are applicable:</u>
'''<font size="2"><span>Box</span><span> </span><span>1</span>: Options for Choice of Control Region</font>'''
+
*Control regions may be non-electrified (Option A) or
 +
*already disposing of electricity access (Option B).
 +
 
 +
 
 +
 
 +
For stove projects, option A refers to regions without any former improved stove intervention and Option B to regions where comparable improved stoves interventions have already taken place. An appraisal of the two options can be found in <span><span>Box <span>1</span></span>. In both of the cases, surveys are conducted before and after the intervention. They are complemented by open, semi-structured key informant interviews (cf. Annex on qualitative methods). Furthermore, the wider set of socio-economic household characteristics that is covered by this module facilitates detecting unintended (positive or negative) impacts.</span>
 +
 
 +
<br/>
  
<font size="2">The obvious counterfactual situation for the stove and electrification projects would be Option A – a region where these interventions have not been taken place before. However, Option B provides as well for a viable counterfactual. While Option A investigates in how far the project sites outperform the control regions, Option B explores in how far the project sites catch up in relation to the control regions. The crucial point is that between the before and the after survey, no such intervention takes places. At this point, one disadvantage of Option A becomes evident: It is often not for sure that during that time period the control region actually remains non-electrified or without improved stoves inter­ventions respectively. It has already happened that unforeseen activities by other donors or partner country institutions in the course of the project period rendered the implementation of this approach impossible. On the other hand, Option A has the advantage that it can serve as an “ex-ante impact assessment”. This implies that the information gathered in the control regions helps to anticipate the beneficiary’s behaviour, potential difficulties and opportunities to be expected in the wake of the EnDev project before project implementation. These findings can then potentially be fed back into the project design.</font>
+
= Purpose<br/> =
  
|}
+
Provides information that allows for deriving statements about the ''causal'' relationship between modern energy provision and development indicators using modern state-of-the-art evaluation techniques. Baseline survey delivers profound knowledge about the target region. If Option B is chosen, information from the comparison group that already uses electricity or stoves respectively can be used to assess the beneficiary’s behaviour already before project implementation same as potential difficulties and opportunities to be expected in the wake of the EnDev project.
  
<br>
+
<br/>
  
<br>
+
{| align="left" cellspacing="0" cellpadding="0" border="1" style="width: 622px;  width: 100%"
 +
|-
 +
| style="vertical-align: top;  width: 622px;  background-color: rgb(255, 255, 204)" |
 +
'''<span>Box</span><span></span><span>1</span>: Options for Choice of Control Region'''
  
<br>
+
The obvious counterfactual situation for the stove and electrification projects would be Option A – a region where these interventions have not been taken place before. However, Option B provides as well for a viable counterfactual. While Option A investigates in how far the project sites outperform the control regions, Option B explores in how far the project sites catch up in relation to the control regions. The crucial point is that between the before and the after survey, no such intervention takes places. At this point, one disadvantage of Option A becomes evident: It is often not for sure that during that time period the control region actually remains non-electrified or without improved stoves inter­ventions respectively. It has already happened that unforeseen activities by other donors or partner country institutions in the course of the project period rendered the implementation of this approach impossible. On the other hand, Option A has the advantage that it can serve as an “ex-ante impact assessment”. This implies that the information gathered in the control regions helps to anticipate the beneficiary’s behaviour, potential difficulties and opportunities to be expected in the wake of the EnDev project before project implementation. These findings can then potentially be fed back into the project design.&lt;/font&gt;
  
<br>
+
|}
  
<br>
+
<br/>
  
<br>
+
<br/>
  
<br>
+
<br/>
  
<br>
+
<br/>
  
<br>
+
<br/>
  
<br>
+
<br/>
  
<br>
+
<br/>
  
<br>
+
<br/>
  
<br>
+
<br/>
  
<br>'''Included Tools:'''
+
<br/>
  
&nbsp;
+
<br/>
  
*Household questionnaire draft  
+
= Included Tools<br/> =
*Data entry template  
+
 
*Guidelines for open, semi-structured interviews  
+
*Household questionnaire draft
*Implementation notes on the questionnaire and data entry  
+
*Data entry template
*Material for training of enumerators and field supervisors  
+
*Guidelines for open, semi-structured interviews
*Checklist for logistics  
+
*Implementation notes on the questionnaire and data entry
 +
*Material for training of enumerators and field supervisors
 +
*Checklist for logistics
 
*Literature on related studies
 
*Literature on related studies
  
'''Implementation Procedure:'''
+
<br/>
 +
 
 +
= Implementation Procedure<br/> =
  
Substantial methodological and statistical skills as well as survey experience are required to implement this module. Therefore, an international consultant with appropriate references in this area should be included in planning and implementation of the study as well as the analysis of the gathered data.  
+
Substantial methodological and statistical skills as well as survey experience are required to implement this module. Therefore, an international consultant with appropriate references in this area should be included in planning and implementation of the study as well as the analysis of the gathered data.
  
 
'''Expected Costs:'''
 
'''Expected Costs:'''
  
Minimum 20,000-25,000 Euro for each of the two waves (before and after).  
+
Minimum 20,000-25,000 Euro for each of the two waves (before and after).
 
 
'''Integrated Indicators:'''
 
  
Different from Module H1, this module addresses poverty impacts that can not be easily attributed to the project. It includes questions that are less easy to determine by respondents and which exhibit a higher sensitivity to the formulation of the questions (e.g. health-related issues). This might be, for example, due to the fact that the information itself is sensitive (e.g. income) or that issues are prone to an auspices bias (the tendency for responses to be affected by the respondent’s awareness of the survey sponsor, e.g. prioritization of basic services). This is addressed by, for example, eliciting the information through asking for more subcategories so that the intention of the question is not that easy to detect and calculation work to aggregate subcategories is not left to the respondent.
+
'''Integrated Indicators:'''
  
All indicators mentioned in Module H1 are also integrated in this module (see the indicator table in Module H1). In addition, poverty impacts, for which the relation and attribution to the intervention is not that trivial to work out, are included. The last column of the table gives reference to the whether the indicator is applicable to stove projects (S), electrification projects (E) or both.  
+
Different from Module H1, this module addresses poverty impacts that can not be easily attributed to the project. It includes questions that are less easy to determine by respondents and which exhibit a higher sensitivity to the formulation of the questions (e.g. health-related issues). This might be, for example, due to the fact that the information itself is sensitive (e.g. income) or that issues are prone to an auspices bias (the tendency for responses to be affected by the respondent’s awareness of the survey sponsor, e.g. prioritization of basic services). This is addressed by, for example, eliciting the information through asking for more subcategories so that the intention of the question is not that easy to detect and calculation work to aggregate subcategories is not left to the respondent.
  
 +
All indicators mentioned in Module H1 are also integrated in this module (see the indicator table in Module H1). In addition, poverty impacts, for which the relation and attribution to the intervention is not that trivial to work out, are included. The last column of the table gives reference to the whether the indicator is applicable to stove projects (S), electrification projects (E) or both.
  
 +
<br/>
  
{| cellspacing="0" cellpadding="0" width="736" border="1"
+
{| cellspacing="0" cellpadding="0" border="1" style="width: 100%"
 
|-
 
|-
| width="151" |  
+
| style="width: 151px;  background-color: rgb(153, 153, 153)" |  
 
'''Observation fields'''
 
'''Observation fields'''
  
| width="78" |  
+
| style="width: 151px;  background-color: rgb(153, 153, 153)" |  
 
'''MDG relevance'''
 
'''MDG relevance'''
  
| width="144" |  
+
| style="width: 151px;  background-color: rgb(153, 153, 153)" |  
 
'''Indicator'''
 
'''Indicator'''
  
| width="284" |  
+
| style="width: 151px;  background-color: rgb(153, 153, 153)" |  
 
'''What to measure?'''
 
'''What to measure?'''
  
| valign="top" width="79" |  
+
| style="width: 151px;  background-color: rgb(153, 153, 153)" |  
 
'''Applicable for'''
 
'''Applicable for'''
  
 
|-
 
|-
| width="151" |  
+
| style="width: 151px" |  
 
'''Additional income from productive activities'''
 
'''Additional income from productive activities'''
  
| width="78" |  
+
| style="width: 78px" |  
 
'''MDG 1'''
 
'''MDG 1'''
  
| width="144" |  
+
| style="width: 144px" |  
 
Increased income from home­business activities facilitated by improved working conditions
 
Increased income from home­business activities facilitated by improved working conditions
  
| valign="top" width="284" |  
+
| style="vertical-align: topwidth: 284px" |  
 
*Average monthly net income from productive use of electricity
 
*Average monthly net income from productive use of electricity
  
| valign="top" width="79" |  
+
| style="vertical-align: topwidth: 79px" |  
S &amp; E
+
S & E
  
 
|-
 
|-
| width="151" |  
+
| style="width: 151px" |  
 
'''More food available and additional income generating activities'''
 
'''More food available and additional income generating activities'''
  
| width="78" |  
+
| style="width: 78px" |  
 
'''MDG 1'''
 
'''MDG 1'''
  
| width="144" |  
+
| style="width: 144px" |  
 
Increased agricultural activity
 
Increased agricultural activity
  
| valign="top" width="284" |  
+
| style="vertical-align: topwidth: 284px" |  
 
*Annual agricultural yields
 
*Annual agricultural yields
  
| valign="top" width="79" |  
+
| style="vertical-align: topwidth: 79px" |  
S &amp; E
+
S & E
  
 
|-
 
|-
| width="151" |  
+
| style="width: 151px" |  
 
'''Time savings'''
 
'''Time savings'''
  
| width="78" |  
+
| style="width: 78px" |  
 
'''MDG 1 + 3'''
 
'''MDG 1 + 3'''
  
| width="144" |  
+
| style="width: 144px" |  
 
Decrease of women’s workload
 
Decrease of women’s workload
  
| valign="top" width="284" |  
+
| style="vertical-align: topwidth: 284px" |  
 
*(Women’s) daily working hours and general time use
 
*(Women’s) daily working hours and general time use
  
| valign="top" width="79" |  
+
| style="vertical-align: topwidth: 79px" |  
S &amp; E
+
S & E
  
 
|-
 
|-
| width="151" rowspan="2" |  
+
| rowspan="2" style="width: 151px" |  
 
'''Improved learning conditions of school children'''
 
'''Improved learning conditions of school children'''
  
| width="78" rowspan="2" |  
+
| rowspan="2" style="width: 78px" |  
 
'''MDG 2'''
 
'''MDG 2'''
  
| width="144" |  
+
| style="width: 144px" |  
 
Increased time and money available for school education and learning
 
Increased time and money available for school education and learning
  
| valign="top" width="284" |  
+
| style="vertical-align: topwidth: 284px" |  
*Enrolment and attendance rates by school type and gender  
+
*Enrolment and attendance rates by school type and gender
 
*Number of absence days per year (incl. absence reason)
 
*Number of absence days per year (incl. absence reason)
  
| valign="top" width="79" |  
+
| style="vertical-align: topwidth: 79px" |  
S &amp; E
+
S & E
  
 
|-
 
|-
| width="144" |  
+
| style="width: 144px" |  
 
Improved effective level of education of school children
 
Improved effective level of education of school children
  
| valign="top" width="284" |  
+
| style="vertical-align: topwidth: 284px" |  
 
*Percentages of children who know to read – for example – a newspaper article (by age)
 
*Percentages of children who know to read – for example – a newspaper article (by age)
  
| valign="top" width="79" |  
+
| style="vertical-align: topwidth: 79px" |  
S &amp; E
+
S & E
  
 
|-
 
|-
| width="151" |  
+
| style="width: 151px" |  
 
'''Improved information and communication opportunities'''
 
'''Improved information and communication opportunities'''
  
| width="78" |  
+
| style="width: 78px" |  
 
'''MDG 2 + 3 + 6'''
 
'''MDG 2 + 3 + 6'''
  
| width="144" |  
+
| style="width: 144px" |  
 
Increased use of information and communication facilities
 
Increased use of information and communication facilities
  
| valign="top" width="284" |  
+
| style="vertical-align: topwidth: 284px" |  
*Usage pattern of TV, video, DVD, radio, cell phone, landline phone  
+
*Usage pattern of TV, video, DVD, radio, cell phone, landline phone
 
*Purpose of use of TV, video, DVD, radio, cell phone, landline phone
 
*Purpose of use of TV, video, DVD, radio, cell phone, landline phone
  
| valign="top" width="79" |  
+
| style="vertical-align: topwidth: 79px" |  
 
E
 
E
  
 
|-
 
|-
| width="151" rowspan="2" |  
+
| rowspan="2" style="width: 151px" |  
 
'''Cleaner air in the household'''
 
'''Cleaner air in the household'''
  
| width="78" rowspan="2" |  
+
| rowspan="2" style="width: 78px" |  
 
'''MDG 3 + 4 + 5 + 6'''
 
'''MDG 3 + 4 + 5 + 6'''
  
| width="144" |  
+
| style="width: 144px" |  
&nbsp;Improved indoor air quality in households
+
Improved indoor air quality in households
  
| valign="top" width="284" |  
+
| style="vertical-align: topwidth: 284px" |  
 
*Percentage of household members with eye infections and respiratory diseases by gender and age categories
 
*Percentage of household members with eye infections and respiratory diseases by gender and age categories
  
| valign="top" width="79" |  
+
| style="vertical-align: topwidth: 79px" |  
S &amp; E
+
S & E
  
 
|-
 
|-
| width="144" |  
+
| style="width: 144px" |  
&nbsp;Decrease in medical costs for diseases related to indoor air pollution
+
Decrease in medical costs for diseases related to indoor air pollution
  
| valign="top" width="284" |  
+
| style="vertical-align: topwidth: 284px" |  
 
*Expenditure on treatment of respiratory and eye diseases
 
*Expenditure on treatment of respiratory and eye diseases
  
| valign="top" width="79" |  
+
| style="vertical-align: topwidth: 79px" |  
S &amp; E
+
S & E
  
 
|-
 
|-
| width="151" rowspan="3" |  
+
| rowspan="3" style="width: 151px" |  
'''Improved medical infrastructure'''  
+
'''Improved medical infrastructure'''
  
 
''(if targeted by the intervention)''
 
''(if targeted by the intervention)''
  
| width="78" rowspan="2" |  
+
| rowspan="2" style="width: 78px" |  
 
'''MDG 4 + 5 + 6'''
 
'''MDG 4 + 5 + 6'''
  
| width="144" |  
+
| style="width: 144px" |  
 
Increased medical service use
 
Increased medical service use
  
| valign="top" width="284" |  
+
| style="vertical-align: topwidth: 284px" |  
 
*Percentage of households using medical services (vaccination etc.)
 
*Percentage of households using medical services (vaccination etc.)
  
| valign="top" width="79" |  
+
| style="vertical-align: topwidth: 79px" |  
 
E
 
E
  
 
|-
 
|-
| width="144" |  
+
| style="width: 144px" |  
 
Improved health situation
 
Improved health situation
  
| valign="top" width="284" |  
+
| style="vertical-align: topwidth: 284px" |  
 
*Percentage of household members with recurrent diseases by gender and age categories
 
*Percentage of household members with recurrent diseases by gender and age categories
  
| valign="top" width="79" |  
+
| style="vertical-align: topwidth: 79px" |  
 
E
 
E
  
 
|-
 
|-
| width="78" |  
+
| style="width: 78px" |  
 
'''MDG 5'''
 
'''MDG 5'''
  
| width="144" |  
+
| style="width: 144px" |  
 
Improved maternal health situation
 
Improved maternal health situation
  
| valign="top" width="284" |  
+
| style="vertical-align: topwidth: 284px" |  
 
*Maternal health indicators
 
*Maternal health indicators
  
| valign="top" width="79" |  
+
| style="vertical-align: topwidth: 79px" |  
 
E
 
E
  
 
|}
 
|}
  
<br>&nbsp;
+
<br/>
 +
 
 +
= Further Information =
 +
 
 +
*[[Catalogue_of_Methods_for_Impact_Studies|Catalogue of Methods for Impact StudiesMethods]]<br/>
 +
*[[Millennium_Development_Goals_(MDGs)|Millennium Development Goals (MDGs)]]
 +
 
 +
<br/>
 +
 
 +
= References<br/> =
 +
 
 +
<references />
  
<br>
+
[[Category:Impacts]]
 +
[[Category:Millennium_Development_Goals_(MDGs)]]
 +
[[Category:Questionnaires_/_Interviews]]

Latest revision as of 16:12, 8 August 2014

Overview

Conducting a household survey in Kangemi, Kenia

Extensive and structured household questionnaire comprising information on socio-economic conditions, access to services, different wealth and income categories, health, education and gender issues. Survey covers the project region and a control region to credibly create a counterfactual situation and thereby enable causal attribution of impacts to the intervention.



-> Module H2: Profound Household survey

General Approach

Depending on the information interests, two different approaches are applicable:

  • Control regions may be non-electrified (Option A) or
  • already disposing of electricity access (Option B).


For stove projects, option A refers to regions without any former improved stove intervention and Option B to regions where comparable improved stoves interventions have already taken place. An appraisal of the two options can be found in Box 1. In both of the cases, surveys are conducted before and after the intervention. They are complemented by open, semi-structured key informant interviews (cf. Annex on qualitative methods). Furthermore, the wider set of socio-economic household characteristics that is covered by this module facilitates detecting unintended (positive or negative) impacts.


Purpose

Provides information that allows for deriving statements about the causal relationship between modern energy provision and development indicators using modern state-of-the-art evaluation techniques. Baseline survey delivers profound knowledge about the target region. If Option B is chosen, information from the comparison group that already uses electricity or stoves respectively can be used to assess the beneficiary’s behaviour already before project implementation same as potential difficulties and opportunities to be expected in the wake of the EnDev project.


Box1: Options for Choice of Control Region

The obvious counterfactual situation for the stove and electrification projects would be Option A – a region where these interventions have not been taken place before. However, Option B provides as well for a viable counterfactual. While Option A investigates in how far the project sites outperform the control regions, Option B explores in how far the project sites catch up in relation to the control regions. The crucial point is that between the before and the after survey, no such intervention takes places. At this point, one disadvantage of Option A becomes evident: It is often not for sure that during that time period the control region actually remains non-electrified or without improved stoves inter­ventions respectively. It has already happened that unforeseen activities by other donors or partner country institutions in the course of the project period rendered the implementation of this approach impossible. On the other hand, Option A has the advantage that it can serve as an “ex-ante impact assessment”. This implies that the information gathered in the control regions helps to anticipate the beneficiary’s behaviour, potential difficulties and opportunities to be expected in the wake of the EnDev project before project implementation. These findings can then potentially be fed back into the project design.</font>












Included Tools

  • Household questionnaire draft
  • Data entry template
  • Guidelines for open, semi-structured interviews
  • Implementation notes on the questionnaire and data entry
  • Material for training of enumerators and field supervisors
  • Checklist for logistics
  • Literature on related studies


Implementation Procedure

Substantial methodological and statistical skills as well as survey experience are required to implement this module. Therefore, an international consultant with appropriate references in this area should be included in planning and implementation of the study as well as the analysis of the gathered data.

Expected Costs:

Minimum 20,000-25,000 Euro for each of the two waves (before and after).

Integrated Indicators:

Different from Module H1, this module addresses poverty impacts that can not be easily attributed to the project. It includes questions that are less easy to determine by respondents and which exhibit a higher sensitivity to the formulation of the questions (e.g. health-related issues). This might be, for example, due to the fact that the information itself is sensitive (e.g. income) or that issues are prone to an auspices bias (the tendency for responses to be affected by the respondent’s awareness of the survey sponsor, e.g. prioritization of basic services). This is addressed by, for example, eliciting the information through asking for more subcategories so that the intention of the question is not that easy to detect and calculation work to aggregate subcategories is not left to the respondent.

All indicators mentioned in Module H1 are also integrated in this module (see the indicator table in Module H1). In addition, poverty impacts, for which the relation and attribution to the intervention is not that trivial to work out, are included. The last column of the table gives reference to the whether the indicator is applicable to stove projects (S), electrification projects (E) or both.


Observation fields

MDG relevance

Indicator

What to measure?

Applicable for

Additional income from productive activities

MDG 1

Increased income from home­business activities facilitated by improved working conditions

  • Average monthly net income from productive use of electricity

S & E

More food available and additional income generating activities

MDG 1

Increased agricultural activity

  • Annual agricultural yields

S & E

Time savings

MDG 1 + 3

Decrease of women’s workload

  • (Women’s) daily working hours and general time use

S & E

Improved learning conditions of school children

MDG 2

Increased time and money available for school education and learning

  • Enrolment and attendance rates by school type and gender
  • Number of absence days per year (incl. absence reason)

S & E

Improved effective level of education of school children

  • Percentages of children who know to read – for example – a newspaper article (by age)

S & E

Improved information and communication opportunities

MDG 2 + 3 + 6

Increased use of information and communication facilities

  • Usage pattern of TV, video, DVD, radio, cell phone, landline phone
  • Purpose of use of TV, video, DVD, radio, cell phone, landline phone

E

Cleaner air in the household

MDG 3 + 4 + 5 + 6

Improved indoor air quality in households

  • Percentage of household members with eye infections and respiratory diseases by gender and age categories

S & E

Decrease in medical costs for diseases related to indoor air pollution

  • Expenditure on treatment of respiratory and eye diseases

S & E

Improved medical infrastructure

(if targeted by the intervention)

MDG 4 + 5 + 6

Increased medical service use

  • Percentage of households using medical services (vaccination etc.)

E

Improved health situation

  • Percentage of household members with recurrent diseases by gender and age categories

E

MDG 5

Improved maternal health situation

  • Maternal health indicators

E


Further Information


References