Make sure you register to our monthly newsletter, it's going out soon! Stay up do date about the latest energy news and our current activities.
Click here to register!

Difference between revisions of "Monitoring and Evaluation (M&E) - Wind Energy"

From energypedia
***** (***** | *****)
***** (***** | *****)
m
 
(9 intermediate revisions by 3 users not shown)
Line 1: Line 1:
= Introduction  =
+
[[Portal:Wind|► Back to Wind Portal]]
  
‘Increasing flexibility, up to date and reliable reporting, observing achievements of objectives, potential risks, changing and unintended impacts…’<ref>OECD 2002: Glossary of Key Terms in Evaluation and Results Based Management. pp. 27</ref> - development programmes/projects are committed to pursue these (and other) requirements while, simultaneously, work in an efficient, effective and sustainable manner.
 
  
Monitoring &amp; Evaluation supports the performance of programme’s work to achieve the demanded requirements. An M&amp;E-System can help meeting requirements of flexibility, accountability, continuous observation and information plus delivering information to the efficiency, effectiveness and sustainability of a programme. <br>
+
= Overview =
 +
‘Increasing flexibility, up to date and reliable reporting, observing achievements of objectives, potential risks, changing and unintended impacts…’<ref name="OECD 2002: Glossary of Key Terms in Evaluation and Results Based Management. pp. 27">OECD 2002: Glossary of Key Terms in Evaluation and Results Based Management. pp. 27</ref> - development programmes/projects are committed to pursue these (and other) requirements while, simultaneously, work in an efficient, effective and sustainable manner.
  
== Definition of results-based M&amp;E<br>  ==
+
'''Monitoring & Evaluation (M&E) '''supports the performance of programme’s work to achieve the demanded requirements. An M&E-System can help meeting requirements of flexibility, accountability, continuous observation and information plus delivering information to the efficiency, effectiveness and sustainability of a programme.
  
The OECD Glossary of Key Terms in Evaluation and Results Based Management defines '''''Monitoring''''' as “a continuing function that uses systematic collection of data on specified indi-cators to provide management and the main stakeholders of an ongoing development inter-vention with indications of the extent of progress and achievement of objectives and progress in the use of allocated funds” <ref>id. pp. 21</ref>. <br>  
+
<br/>
  
*Monitoring continuously observes what is happening because of development interventions and with what effects. <br>
 
*Monitoring provides information if a development intervention is still on track while following anticipated results.<br>
 
*Additionally, unintended effects of the intervention resp. changing conditions in an intervention’s environment. <br>
 
  
Monitoring can hence be labelled as a tool for the “navigation” of a project that looks at the requirements of flexibility; it observes the achievements of a project, its potential risks and the changing and unintended impacts. As such results of Monitoring can provide information to further necessary activities in order to achieve the objective(s) of a project . <br> [[Image:M&E cartoon.JPG|frame|right|Monitoring & Evaluation]]
+
= Definition of Results-based M&E<br/> =
 +
The OECD Glossary of Key Terms in Evaluation and Results Based Management defines '''Monitoring''' as “a continuing function that uses systematic collection of data on specified indi-cators to provide management and the main stakeholders of an ongoing development inter-vention with indications of the extent of progress and achievement of objectives and progress in the use of allocated funds” <ref>id. pp. 21</ref>.
  
'''''Evaluation''''' is defined by the OECD Glossary of Key Terms in Evaluation and Results Based Management as “the systematic and objective assessment of an on-going or completed pro-ject, programme or policy, its design, implementation and results (…) to determine the rele-vance and fulfillment of objectives, development efficiency, effectiveness, impact and sus-tainability.” (<ref>GTZ 2008: Results-based Monitoring. Guidelines for Technical Cooperation. Eschborn</ref>. While Monitoring “escorts” the project continuously, <br>
 
  
*evaluation is done at certain stages in order to assess whether the aspired objectives to these certain stages have been met. <br>
+
*Monitoring continuously observes what is happening because of development interventions and with what effects.
*Evaluation does not only look at the achievement itself (what has happened?) but as well at how this has happened (or not). <br>
+
*Monitoring provides information if a development intervention is still on track while following anticipated results.
*Evaluation therefore addresses accountability and, at the same time, observes inputs, activities, outputs, use of outputs and benefits with regard to planned and achieved efficiency, effectiveness and sustainability of the development intervention. <br>
+
*Additionally, unintended effects of the intervention resp. changing conditions in an intervention’s environment.
 +
Monitoring can hence be labelled as a tool for the “navigation” of a project that looks at the requirements of flexibility; it observes the achievements of a project, its potential risks and the changing and unintended impacts. As such results of Monitoring can provide information to further necessary activities in order to achieve the objective(s) of a project.<br/>[[File:M&E cartoon.JPG|frame|right|180px|Monitoring & Evaluation]]
 +
 
 +
'''Evaluation''' is defined by the OECD Glossary of Key Terms in Evaluation and Results Based Management as “the systematic and objective assessment of an on-going or completed pro-ject, programme or policy, its design, implementation and results (…) to determine the rele-vance and fulfillment of objectives, development efficiency, effectiveness, impact and sus-tainability.” (<ref>GTZ 2008: Results-based Monitoring. Guidelines for Technical Cooperation. Eschborn</ref>. While Monitoring “escorts” the project continuously,
 +
 
 +
 
 +
*evaluation is done at certain stages in order to assess whether the aspired objectives to these certain stages have been met.
 +
*Evaluation does not only look at the achievement itself (what has happened?) but as well at how this has happened (or not).
 +
*Evaluation therefore addresses accountability and, at the same time, observes inputs, activities, outputs, use of outputs and benefits with regard to planned and achieved efficiency, effectiveness and sustainability of the development intervention.
 
*Evaluation can therefore emphasize legitimation of a project but also may provide information that can lead to alterations of the project’s concepts.
 
*Evaluation can therefore emphasize legitimation of a project but also may provide information that can lead to alterations of the project’s concepts.
 +
Monitoring & Evaluation (M&E) joins the functions to provide a tool that supports meeting the above mentioned requirements. Pursuing M&E will combine the information provided by both functions with the intention of knowing what has happened and with which effects. The ‘how this has happened’ will provide lessons learned for ongoing activities and future projects.
 +
 +
Pursuing Results-based M&E follows GTZ’s Results-based Monitoring Guidelines, indicating to take in “the whole results chain, from inputs, via activities and outputs through to the out-comes and impacts”<ref>cartoon: GTZ 1996: PIM - Booklet 4: The concept of participatory impact monitoring by Eberhard Gohl / Dorsi German. Eschborn, p. 10</ref> I.e. M&E will observe the mentioned result chain, probably with the following objectives: <ref>http://www.gtz.de/en/themen/umwelt-infrastruktur/energie/21183.htm</ref>
 +
 +
[[Monitoring and Evaluation (M&E) - Wind Energy#toc|►Go to Top]]<br/>
 +
 +
  
Monitoring &amp; Evaluation joins the functions to provide a tool that supports meeting the above mentioned requirements. Pursuing M&amp;E will combine the information provided by both functions with the intention of knowing what has happened and with which effects. The ‘how this has happened’ will provide lessons learned for ongoing activities and future projects.
 
  
Pursuing Results-based M&amp;E follows GTZ’s Results-based Monitoring Guidelines, indicating to take in “the whole results chain, from inputs, via activities and outputs through to the out-comes and impacts”<ref>cartoon: GTZ 1996: PIM - Booklet 4: The concept of participatory impact monitoring by Eberhard Gohl / Dorsi German. Eschborn, p. 10</ref> I.e. M&amp;E will observe the mentioned result chain, probably with the following objectives: <ref>http://www.gtz.de/en/themen/umwelt-infrastruktur/energie/21183.htm</ref><br>
+
= Possible Objectives of M&E<br/> =
 +
Provision of information to what has happened because of development intervention (effects) (– Efficiency of project, accountability to clients, public)
  
== Possible objectives of M&amp;E<br>  ==
 
  
*provision of information to what has happened because of development intervention (effects) (– Efficiency of project, accountability to clients, public)
+
*What has happened?
 +
*With which effects?
 +
*Who is doing what?...
 +
<br/>
  
o What has happened?<br>o With which effects?<br>o Who is doing what?...<br>
+
How has this happened and why? (programme steering)
  
*How has this happened and why? (programme steering)
 
  
o How did we achieve XY? (lessons learned, best practices – knowledge management)<br>o Why did something not happen? (lessons learned, best practices – knowledge man-agement) <br>o Change of conditions? <br>  
+
*How did we achieve XY? (lessons learned, best practices – knowledge management)
 +
*Why did something not happen? (lessons learned, best practices – knowledge man-agement)
 +
*Change of conditions?
 +
<br/>
  
*Assessment of project’s concept and objectives – poss. providing statements to alterations (legitimation, sustainability &amp; significance; accountability to clients, public)
+
Assessment of project’s concept and objectives – poss. providing statements to alterations (legitimation, sustainability & significance; accountability to clients, public)
  
o Adequate baseline information (What is the starting point? Programme steering)<br>o Adapted strategies according to project’s environment (programme steering)<br>
 
  
*Assessment of project’s inputs, activities, outputs, use of outputs, benefits – poss. providing statements to alterations (Effectiveness of inputs, activities in relation to outputs, use of outputs and benefits) (accountability to clients, public – knowledge management)<br>
+
*Adequate baseline information (What is the starting point? Programme steering)
 +
*Adapted strategies according to project’s environment (programme steering)
 +
<br/>
  
== Resources<br>  ==
+
Assessment of project’s inputs, activities, outputs, use of outputs, benefits – poss. providing statements to alterations (Effectiveness of inputs, activities in relation to outputs, use of outputs and benefits) (accountability to clients, public – knowledge management)
  
[http://www.gtz.de/en/unternehmen/32827.htm GIZ Results-based Monitoring Guidelines] <br>
+
[[Monitoring and Evaluation (M&E) - Wind Energy#toc|►Go to Top]]
  
[http://www2.gtz.de/monitoring/network/non-gtz.asp GIZ Results-based Monitoring Community ]
 
  
<br>
 
  
== Exemplary Results from TERNA<br><br>  ==
 
  
The following provides an overview about the results (along the result chain) of the TERNA programme.
+
= Downloads<br/> =
  
The results are structured along the following fields of activities:  
+
*[http://www.giz.de/de/downloads/giz2011-en-result-based-monitoring.pdf GIZ: Methods and instruments, Results-based monitoring]
 +
<br/>
 +
= Exemplary Results from TERNA<br/> =
 +
The following provides an overview about the results (along the result chain) of the [http://www.gtz.de/en/themen/6657.htm GIZ] wind energy programme'''TERNA''' ('''T'''echnical '''E'''xpertise for '''R'''e'''n'''ewable Energy '''A'''pplication).
  
*[[M&E - Wind Energy#Country_Studies.C2.A0|country studies]] to analyse the energy-policy framework conditions
+
<br/>
*[[M&E - Wind Energy#Policy_Advisory_Services|policy advisory services]]
 
*wind measurement / [[M&E - Wind Energy#Windpark_Planning|windpark planning]]
 
  
=== Country Studies&nbsp;  ===
+
<u>The results are structured along the following fields of activities:</u>
  
[[Image:TERNA country study image.jpg|frame|left|231x295px|5 Editions since 1999. Edition 2007: 5 000 Downloads. Information provision for investors. Support in identification of markets. Contribution to investment decisions]]
 
  
<br>
+
*[[Monitoring and Evaluation (M&E) - Wind Energy#Country Studies.C2.A0|country studies]] to analyse the energy-policy framework conditions
 +
*[[Monitoring and Evaluation (M&E) - Wind Energy#Policy Advisory Services|policy advisory services]]
 +
*wind measurement / [[Monitoring and Evaluation (M&E) - Wind Energy#Windpark Planning|windpark planning]]
  
<br>
 
  
<br>
 
  
<br>  
+
=== Download: Country Studies ===
 +
►Download "Energy-policy Framework Conditions for Electricity Markets and Renewable Energies"<ref>Source: BWE and VDMA Power Systems 2009: 9 in: GTZ 2009: Development of Implementation Strategies for a Regional Regulatory Action Plan (RRAP) for the Western Cape. http://www.gtz.de/de/dokumente/gtz2009-en-regional-regulatory-action-plan-western-cape.pdffckLRfckLRTraining and Capacity Building pp. 112</ref>
  
<br>
+
[[File:TERNA country study image.jpg|frame|left|180px|5 Editions since 1999. Edition 2007: 5 000 Downloads. Information provision for investors. Support in identification of markets. Contribution to investment decisions]]
  
<br>
 
  
<br>
 
  
<br>
 
  
<br>  
+
=== Policy Advisory Services<br/> ===
 +
<u>Outputs (Product-Portfolio):</u>
  
<br>
 
  
<br>  
+
*delegation studies, workshops
 +
*provision of comments to draft laws
 +
*studies
 +
<br/>
 +
 
 +
<u>Outputs contributed to the following:</u>
  
<br>
 
  
<br>  
+
*Promotion of RE support law (e.g. in China)
 +
*Contribution to national feed-in tariff (e.g. in RSA)
 +
*promotion insturments on provincial level
 +
*strengthening the wind sector
 +
<br/>
  
<br>  
+
<u>Indirect effects:</u>
  
<br>
 
  
<br>  
+
*formulation of further dissemination of wind in Morocco and Ethiopia (Ausbauziele)
 +
<br/>
  
<br>
+
[[File:Policy advisory services output results example RSA.JPG|thumb|left|180px|Policy advisory services output results example RSA]]
  
<br>
+
[[Monitoring and Evaluation (M&E) - Wind Energy#toc|►Go to Top]]
  
<br>
 
  
<br>
 
  
<ref>Source: BWE and VDMA Power Systems 2009: 9 in: GTZ 2009: Development of Implementation Strategies for a Regional Regulatory Action Plan (RRAP) for the Western Cape. http://www.gtz.de/de/dokumente/gtz2009-en-regional-regulatory-action-plan-western-cape.pdffckLRfckLRTraining and Capacity Building pp. 112</ref><br>
 
  
=== Policy Advisory Services<br> ===
+
=== Windpark Planning<br/> ===
 +
<u>Outputs:</u>
  
Outputs (Product-Portfolio): <br>
 
  
*delegation studies, workshops
+
*wind measurements 24 sites, 9 countries
*provision of comments to draft laws
+
*feasibility studies: 11 sites, 7 countries
*studies
+
*training measures
 +
*publication of studies
 +
*support in tendering
 +
*local know-how
 +
<br/>
 +
 
 +
<u>Used for:</u>
 +
 
  
Outputs contributed to the following:
+
*tendering
 +
<br/>
  
*Promotion of RE support law (e.g. in China)
+
<u>Direct Results:</u>
*Contribution to national feed-in tariff (e.g. in RSA)
 
*promotion insturments on provincial level
 
*strengthening the wind sector
 
  
Indirect effects:
 
  
*formulation of further dissemination of wind in Morocco and Ethiopia (Ausbauziele)
+
*projects, ready for investment, bankable
 +
<br/>
 +
 
 +
<u>Indirect results:</u>
  
<br>  
+
<br/>[[File:Windparkplanning indirect result.JPG|thumb|left|180px|Indirect Results Windpark Planning]]
  
[[Image:Policy advisory services output results example RSA.JPG|frame|center|Policy advisory services output results example RSA]]  
+
[[Monitoring and Evaluation (M&E) - Wind Energy#toc|►Go to Top]]
  
<br>
 
  
=== Windpark Planning<br>  ===
 
  
Outputs:<br>
 
  
*wind measurements 24 sites, 9 countries
+
= Possible Higher Aggregated Development Results<br/> =
*feasibility studies: 11 sites, 7 countries
+
<u>Poverty alleviation and development:</u>
*training measures
 
*publication of studies
 
*support in tendering
 
*local know-how
 
  
Used for:
 
  
*tendering
+
*Improvement of living conditions
 +
*Generation of income/socio-eocnomic development
 +
*Improving living conditions
 +
*Reduced dependency fossil fuels
 +
<br/>
  
Direct Results:  
+
<u>Clima / environmental objectives</u>:
  
*projects, ready for investment, bankable
 
  
Indirect results:
+
*Reduced dependency fossil fuels
 +
*Increased efficiency
 +
*Dissemination of wind energy/RE
 +
[[Monitoring and Evaluation (M&E) - Wind Energy#toc|►Go to Top]]
  
<br> [[Image:Windparkplanning indirect result.JPG|frame|center|Indirect Results Windpark Planning]] <br>
 
  
<br>  
+
= Value Added Chain Wind Industry<br/> =
 +
[[File:Value added chain wind industry.JPG|frame|left|180px|Value added chain wind industry]]
  
== Possible higher aggregated development results&nbsp;  ==
+
[[Monitoring and Evaluation (M&E) - Wind Energy#toc|►Go to Top]]
  
Poverty alleviation and development:
 
  
*Improvement of living conditions&nbsp;
 
*Generation of income/socio-eocnomic development<br>
 
*Improving living conditions <br>
 
*Reduced dependency fossil fuels<br>
 
  
Clima / environmental objectives <br>
 
  
*Reduced dependency fossil fuels
+
= Further Information =
*Increased efficiency
 
*Dissemination of wind energy/RE <br>
 
  
<br>
+
*[[Clean Development Mechanism (CDM) and Baseline-Assessments for Wind Energy Projects#Clean Development Mechanism .28CDM.29 Project Cycle|Monitoring]]
 +
*[[Portal:Wind|Wind Portal on energypedia]]
  
== Value added Chain Wind Industry  ==
 
  
[[Image:Value added chain wind industry.JPG|frame|center|Value added chain wind industry]] <references /> <br> <br>
 
  
[[Portal:Wind]]<br>  
+
= References =
 +
<references />
  
 
[[Category:Wind]]
 
[[Category:Wind]]
 +
[[Category:Monitoring]]

Latest revision as of 10:45, 20 January 2015

► Back to Wind Portal


Overview

‘Increasing flexibility, up to date and reliable reporting, observing achievements of objectives, potential risks, changing and unintended impacts…’[1] - development programmes/projects are committed to pursue these (and other) requirements while, simultaneously, work in an efficient, effective and sustainable manner.

Monitoring & Evaluation (M&E) supports the performance of programme’s work to achieve the demanded requirements. An M&E-System can help meeting requirements of flexibility, accountability, continuous observation and information plus delivering information to the efficiency, effectiveness and sustainability of a programme.



Definition of Results-based M&E

The OECD Glossary of Key Terms in Evaluation and Results Based Management defines Monitoring as “a continuing function that uses systematic collection of data on specified indi-cators to provide management and the main stakeholders of an ongoing development inter-vention with indications of the extent of progress and achievement of objectives and progress in the use of allocated funds” [2].


  • Monitoring continuously observes what is happening because of development interventions and with what effects.
  • Monitoring provides information if a development intervention is still on track while following anticipated results.
  • Additionally, unintended effects of the intervention resp. changing conditions in an intervention’s environment.

Monitoring can hence be labelled as a tool for the “navigation” of a project that looks at the requirements of flexibility; it observes the achievements of a project, its potential risks and the changing and unintended impacts. As such results of Monitoring can provide information to further necessary activities in order to achieve the objective(s) of a project.

Monitoring & Evaluation

Evaluation is defined by the OECD Glossary of Key Terms in Evaluation and Results Based Management as “the systematic and objective assessment of an on-going or completed pro-ject, programme or policy, its design, implementation and results (…) to determine the rele-vance and fulfillment of objectives, development efficiency, effectiveness, impact and sus-tainability.” ([3]. While Monitoring “escorts” the project continuously,


  • evaluation is done at certain stages in order to assess whether the aspired objectives to these certain stages have been met.
  • Evaluation does not only look at the achievement itself (what has happened?) but as well at how this has happened (or not).
  • Evaluation therefore addresses accountability and, at the same time, observes inputs, activities, outputs, use of outputs and benefits with regard to planned and achieved efficiency, effectiveness and sustainability of the development intervention.
  • Evaluation can therefore emphasize legitimation of a project but also may provide information that can lead to alterations of the project’s concepts.

Monitoring & Evaluation (M&E) joins the functions to provide a tool that supports meeting the above mentioned requirements. Pursuing M&E will combine the information provided by both functions with the intention of knowing what has happened and with which effects. The ‘how this has happened’ will provide lessons learned for ongoing activities and future projects.

Pursuing Results-based M&E follows GTZ’s Results-based Monitoring Guidelines, indicating to take in “the whole results chain, from inputs, via activities and outputs through to the out-comes and impacts”[4] I.e. M&E will observe the mentioned result chain, probably with the following objectives: [5]

►Go to Top



Possible Objectives of M&E

Provision of information to what has happened because of development intervention (effects) (– Efficiency of project, accountability to clients, public)


  • What has happened?
  • With which effects?
  • Who is doing what?...


How has this happened and why? (programme steering)


  • How did we achieve XY? (lessons learned, best practices – knowledge management)
  • Why did something not happen? (lessons learned, best practices – knowledge man-agement)
  • Change of conditions?


Assessment of project’s concept and objectives – poss. providing statements to alterations (legitimation, sustainability & significance; accountability to clients, public)


  • Adequate baseline information (What is the starting point? Programme steering)
  • Adapted strategies according to project’s environment (programme steering)


Assessment of project’s inputs, activities, outputs, use of outputs, benefits – poss. providing statements to alterations (Effectiveness of inputs, activities in relation to outputs, use of outputs and benefits) (accountability to clients, public – knowledge management)

►Go to Top



Downloads


Exemplary Results from TERNA

The following provides an overview about the results (along the result chain) of the GIZ wind energy programmeTERNA (Technical Expertise for Renewable Energy Application).


The results are structured along the following fields of activities:



Download: Country Studies

►Download "Energy-policy Framework Conditions for Electricity Markets and Renewable Energies"[6]

5 Editions since 1999. Edition 2007: 5 000 Downloads. Information provision for investors. Support in identification of markets. Contribution to investment decisions



Policy Advisory Services

Outputs (Product-Portfolio):


  • delegation studies, workshops
  • provision of comments to draft laws
  • studies


Outputs contributed to the following:


  • Promotion of RE support law (e.g. in China)
  • Contribution to national feed-in tariff (e.g. in RSA)
  • promotion insturments on provincial level
  • strengthening the wind sector


Indirect effects:


  • formulation of further dissemination of wind in Morocco and Ethiopia (Ausbauziele)


Policy advisory services output results example RSA

►Go to Top



Windpark Planning

Outputs:


  • wind measurements 24 sites, 9 countries
  • feasibility studies: 11 sites, 7 countries
  • training measures
  • publication of studies
  • support in tendering
  • local know-how


Used for:


  • tendering


Direct Results:


  • projects, ready for investment, bankable


Indirect results:


Indirect Results Windpark Planning

►Go to Top



Possible Higher Aggregated Development Results

Poverty alleviation and development:


  • Improvement of living conditions
  • Generation of income/socio-eocnomic development
  • Improving living conditions
  • Reduced dependency fossil fuels


Clima / environmental objectives:


  • Reduced dependency fossil fuels
  • Increased efficiency
  • Dissemination of wind energy/RE

►Go to Top


Value Added Chain Wind Industry

Value added chain wind industry

►Go to Top



Further Information


References

  1. OECD 2002: Glossary of Key Terms in Evaluation and Results Based Management. pp. 27
  2. id. pp. 21
  3. GTZ 2008: Results-based Monitoring. Guidelines for Technical Cooperation. Eschborn
  4. cartoon: GTZ 1996: PIM - Booklet 4: The concept of participatory impact monitoring by Eberhard Gohl / Dorsi German. Eschborn, p. 10
  5. http://www.gtz.de/en/themen/umwelt-infrastruktur/energie/21183.htm
  6. Source: BWE and VDMA Power Systems 2009: 9 in: GTZ 2009: Development of Implementation Strategies for a Regional Regulatory Action Plan (RRAP) for the Western Cape. http://www.gtz.de/de/dokumente/gtz2009-en-regional-regulatory-action-plan-western-cape.pdffckLRfckLRTraining and Capacity Building pp. 112