Make sure you register to our monthly newsletter, it's going out soon! Stay up do date about the latest energy news and our current activities.
Click here to register!

Difference between revisions of "Monitoring and Evaluation (M&E) - Wind Energy"

From energypedia
***** (***** | *****)
***** (***** | *****)
m
 
(31 intermediate revisions by 4 users not shown)
Line 1: Line 1:
<span style="color: rgb(255, 0, 0);">WORK in PROGRESS&nbsp;</span>
+
[[Portal:Wind|► Back to Wind Portal]]
  
2031_Drillisch-Suisse-Eole-6-2-04; 20091216 Präsentation TERNA Wirkungen<br>
 
  
<br>  
+
= Overview =
 +
‘Increasing flexibility, up to date and reliable reporting, observing achievements of objectives, potential risks, changing and unintended impacts…’<ref name="OECD 2002: Glossary of Key Terms in Evaluation and Results Based Management. pp. 27">OECD 2002: Glossary of Key Terms in Evaluation and Results Based Management. pp. 27</ref> - development programmes/projects are committed to pursue these (and other) requirements while, simultaneously, work in an efficient, effective and sustainable manner.
  
= Introduction<br>  =
+
'''Monitoring & Evaluation (M&E) '''supports the performance of programme’s work to achieve the demanded requirements. An M&E-System can help meeting requirements of flexibility, accountability, continuous observation and information plus delivering information to the efficiency, effectiveness and sustainability of a programme.
  
‘Increasing flexibility, up to date and reliable reporting, observing achievements of objectives, potential risks, changing and unintended impacts…’<ref>. BMZ/GTZ 2003: Handreichung zur Bearbeitung von AURA-Angeboten. BMZ-Referate 220 und 222, GTZ-Stabstelle 04 Unternehmensentwicklung, OE 042 Interne Evaluierung</ref> - development programmes/projects are committed to pursue these (and other) requirements while, simultaneously, work in an efficient, effective and sustainable manner.
+
<br/>
  
Monitoring &amp; Evaluation supports the performance of programme’s work to achieve the demanded requirements. An M&amp;E-System can help meeting requirements of flexibility, accountability, continuous observation and information plus delivering information to the efficiency, effectiveness and sustainability of a programme. <br>
 
  
== Definition of results-based M&amp;E<br> ==
+
= Definition of Results-based M&E<br/> =
 +
The OECD Glossary of Key Terms in Evaluation and Results Based Management defines '''Monitoring''' as “a continuing function that uses systematic collection of data on specified indi-cators to provide management and the main stakeholders of an ongoing development inter-vention with indications of the extent of progress and achievement of objectives and progress in the use of allocated funds” <ref>id. pp. 21</ref>.
  
The OECD Glossary of Key Terms in Evaluation and Results Based Management defines '''''Monitoring''''' as “a continuing function that uses systematic collection of data on specified indi-cators to provide management and the main stakeholders of an ongoing development inter-vention with indications of the extent of progress and achievement of objectives and progress in the use of allocated funds” <ref>OECD 2002: Glossary of Key Terms in Evaluation and Results Based Management. pp. 27</ref>. <br>
 
  
*Monitoring continuously observes what is happening because of development interventions and with what effects. <br>
+
*Monitoring continuously observes what is happening because of development interventions and with what effects.
*Monitoring provides information if a development intervention is still on track while following anticipated results.<br>
+
*Monitoring provides information if a development intervention is still on track while following anticipated results.
*Additionally, unintended effects of the intervention resp. changing conditions in an intervention’s environment. <br>
+
*Additionally, unintended effects of the intervention resp. changing conditions in an intervention’s environment.
 +
Monitoring can hence be labelled as a tool for the “navigation” of a project that looks at the requirements of flexibility; it observes the achievements of a project, its potential risks and the changing and unintended impacts. As such results of Monitoring can provide information to further necessary activities in order to achieve the objective(s) of a project.<br/>[[File:M&E cartoon.JPG|frame|right|180px|Monitoring & Evaluation]]
  
Monitoring can hence be labelled as a tool for the “navigation” of a project that looks at the requirements of flexibility; it observes the achievements of a project, its potential risks and the changing and unintended impacts. As such results of Monitoring can provide information to further necessary activities in order to achieve the objective(s) of a project . <br> [[Image:M&E cartoon.JPG|frame|right|Monitoring & Evaluation]]
+
'''Evaluation''' is defined by the OECD Glossary of Key Terms in Evaluation and Results Based Management as “the systematic and objective assessment of an on-going or completed pro-ject, programme or policy, its design, implementation and results (…) to determine the rele-vance and fulfillment of objectives, development efficiency, effectiveness, impact and sus-tainability.” (<ref>GTZ 2008: Results-based Monitoring. Guidelines for Technical Cooperation. Eschborn</ref>. While Monitoring “escorts” the project continuously,
  
'''''Evaluation''''' is defined by the OECD Glossary of Key Terms in Evaluation and Results Based Management as “the systematic and objective assessment of an on-going or completed pro-ject, programme or policy, its design, implementation and results (…) to determine the rele-vance and fulfillment of objectives, development efficiency, effectiveness, impact and sus-tainability.” (<ref>id. pp. 21</ref>. While Monitoring “escorts” the project continuously, <br>
 
  
*evaluation is done at certain stages in order to assess whether the aspired objectives to these certain stages have been met. <br>
+
*evaluation is done at certain stages in order to assess whether the aspired objectives to these certain stages have been met.
*Evaluation does not only look at the achievement itself (what has happened?) but as well at how this has happened (or not). <br>
+
*Evaluation does not only look at the achievement itself (what has happened?) but as well at how this has happened (or not).
*Evaluation therefore addresses accountability and, at the same time, observes inputs, activities, outputs, use of outputs and benefits with regard to planned and achieved efficiency, effectiveness and sustainability of the development intervention. <br>
+
*Evaluation therefore addresses accountability and, at the same time, observes inputs, activities, outputs, use of outputs and benefits with regard to planned and achieved efficiency, effectiveness and sustainability of the development intervention.
 
*Evaluation can therefore emphasize legitimation of a project but also may provide information that can lead to alterations of the project’s concepts.
 
*Evaluation can therefore emphasize legitimation of a project but also may provide information that can lead to alterations of the project’s concepts.
 +
Monitoring & Evaluation (M&E) joins the functions to provide a tool that supports meeting the above mentioned requirements. Pursuing M&E will combine the information provided by both functions with the intention of knowing what has happened and with which effects. The ‘how this has happened’ will provide lessons learned for ongoing activities and future projects.
  
Monitoring &amp; Evaluation joins the functions to provide a tool that supports meeting the above mentioned requirements. Pursuing M&amp;E will combine the information provided by both functions with the intention of knowing what has happened and with which effects. The ‘how this has happened’ will provide lessons learned for ongoing activities and future projects.  
+
Pursuing Results-based M&E follows GTZ’s Results-based Monitoring Guidelines, indicating to take in “the whole results chain, from inputs, via activities and outputs through to the out-comes and impacts”<ref>cartoon: GTZ 1996: PIM - Booklet 4: The concept of participatory impact monitoring by Eberhard Gohl / Dorsi German. Eschborn, p. 10</ref> I.e. M&E will observe the mentioned result chain, probably with the following objectives: <ref>http://www.gtz.de/en/themen/umwelt-infrastruktur/energie/21183.htm</ref>
  
Pursuing Results-based M&amp;E follows GTZ’s Results-based Monitoring Guidelines, indicating to take in “the whole results chain, from inputs, via activities and outputs through to the out-comes and impacts”<ref>GTZ 2008: Results-based Monitoring. Guidelines for Technical Cooperation. Eschborn</ref> I.e. M&amp;E will observe the mentioned result chain, probably with the following objectives: <ref>cartoon: GTZ 1996: PIM - Booklet 4: The concept of participatory impact monitoring by Eberhard Gohl / Dorsi German. Eschborn, p. 10</ref><br>
+
[[Monitoring and Evaluation (M&E) - Wind Energy#toc|►Go to Top]]<br/>
  
== Possible objectives of M&amp;E<br>  ==
 
  
*provision of information to what has happened because of development intervention (effects) (– Efficiency of project, accountability to clients, public)
 
  
o What has happened?<br>o With which effects?<br>o Who is doing what?...<br>
 
  
*How has this happened and why? (programme steering)
+
= Possible Objectives of M&E<br/> =
 +
Provision of information to what has happened because of development intervention (effects) (– Efficiency of project, accountability to clients, public)
  
o How did we achieve XY? (lessons learned, best practices – knowledge management)<br>o Why did something not happen? (lessons learned, best practices – knowledge man-agement) <br>o Change of conditions? <br>
 
  
*Assessment of project’s concept and objectives – poss. providing statements to alterations (legitimation, sustainability &amp; significance; accountability to clients, public)
+
*What has happened?
 +
*With which effects?
 +
*Who is doing what?...
 +
<br/>
  
o Adequate baseline information (What is the starting point? Programme steering)<br>o Adapted strategies according to project’s environment (programme steering)<br>
+
How has this happened and why? (programme steering)
  
*Assessment of project’s inputs, activities, outputs, use of outputs, benefits – poss. providing statements to alterations (Effectiveness of inputs, activities in relation to outputs, use of outputs and benefits) (accountability to clients, public – knowledge management)<br>
 
  
== Resources<br> ==
+
*How did we achieve XY? (lessons learned, best practices – knowledge management)
 +
*Why did something not happen? (lessons learned, best practices – knowledge man-agement)
 +
*Change of conditions?
 +
<br/>
  
[http://www.gtz.de/en/unternehmen/32827.htm GIZ Results-based Monitoring Guidelines] <br>
+
Assessment of project’s concept and objectives – poss. providing statements to alterations (legitimation, sustainability & significance; accountability to clients, public)
  
[http://www2.gtz.de/monitoring/network/non-gtz.asp GIZ Results-based Monitoring Community ]
 
  
<br>  
+
*Adequate baseline information (What is the starting point? Programme steering)
 +
*Adapted strategies according to project’s environment (programme steering)
 +
<br/>
  
= Exemplary Results from TERNA<br><br>  =
+
Assessment of project’s inputs, activities, outputs, use of outputs, benefits – poss. providing statements to alterations (Effectiveness of inputs, activities in relation to outputs, use of outputs and benefits) (accountability to clients, public – knowledge management)
  
The following provides an overview about the results (along the result chain) of the TERNA programme.
+
[[Monitoring and Evaluation (M&E) - Wind Energy#toc|►Go to Top]]
  
== Outputs - Country Studies&nbsp;  ==
 
  
[[Image:TERNA country study image.jpg|frame|center|5 Editions since 1999. Edition 2007: 5 000 Downloads. Information provision for investors. Support in identification of markets. Contribution to investment decisions]]
 
  
<br>
 
  
<ref>http://www.gtz.de/en/themen/umwelt-infrastruktur/energie/21183.htm</ref>  
+
= Downloads<br/> =
  
<br> <br>  
+
*[http://www.giz.de/de/downloads/giz2011-en-result-based-monitoring.pdf GIZ: Methods and instruments, Results-based monitoring]
 +
<br/>
 +
= Exemplary Results from TERNA<br/> =
 +
The following provides an overview about the results (along the result chain) of the [http://www.gtz.de/en/themen/6657.htm GIZ] wind energy programme'''TERNA''' ('''T'''echnical '''E'''xpertise for '''R'''e'''n'''ewable Energy '''A'''pplication).
  
== Outputs - Policy Advisory Services<br> ==
+
<br/>
  
Outputs (Product-Portfolio): <br>  
+
<u>The results are structured along the following fields of activities:</u>
  
*delegation studies, workshops  
+
 
*provision of comments to draft laws  
+
*[[Monitoring and Evaluation (M&E) - Wind Energy#Country Studies.C2.A0|country studies]] to analyse the energy-policy framework conditions
 +
*[[Monitoring and Evaluation (M&E) - Wind Energy#Policy Advisory Services|policy advisory services]]
 +
*wind measurement / [[Monitoring and Evaluation (M&E) - Wind Energy#Windpark Planning|windpark planning]]
 +
 
 +
 
 +
 
 +
=== Download: Country Studies ===
 +
►Download "Energy-policy Framework Conditions for Electricity Markets and Renewable Energies"<ref>Source: BWE and VDMA Power Systems 2009: 9 in: GTZ 2009: Development of Implementation Strategies for a Regional Regulatory Action Plan (RRAP) for the Western Cape. http://www.gtz.de/de/dokumente/gtz2009-en-regional-regulatory-action-plan-western-cape.pdffckLRfckLRTraining and Capacity Building pp. 112</ref>
 +
 
 +
[[File:TERNA country study image.jpg|frame|left|180px|5 Editions since 1999. Edition 2007: 5 000 Downloads. Information provision for investors. Support in identification of markets. Contribution to investment decisions]]
 +
 
 +
 
 +
 
 +
 
 +
=== Policy Advisory Services<br/> ===
 +
<u>Outputs (Product-Portfolio):</u>
 +
 
 +
 
 +
*delegation studies, workshops
 +
*provision of comments to draft laws
 
*studies
 
*studies
 +
<br/>
  
Outputs contributed to the following:  
+
<u>Outputs contributed to the following:</u>
  
*Promotion of RE support law (e.g. in China)  
+
 
*Contribution to national feed-in tariff (e.g. in RSA)  
+
*Promotion of RE support law (e.g. in China)
*promotion insturments on provincial level  
+
*Contribution to national feed-in tariff (e.g. in RSA)
 +
*promotion insturments on provincial level
 
*strengthening the wind sector
 
*strengthening the wind sector
 +
<br/>
 +
 +
<u>Indirect effects:</u>
  
Indirect effects:
 
  
 
*formulation of further dissemination of wind in Morocco and Ethiopia (Ausbauziele)
 
*formulation of further dissemination of wind in Morocco and Ethiopia (Ausbauziele)
 +
<br/>
 +
 +
[[File:Policy advisory services output results example RSA.JPG|thumb|left|180px|Policy advisory services output results example RSA]]
 +
 +
[[Monitoring and Evaluation (M&E) - Wind Energy#toc|►Go to Top]]
 +
 +
 +
 +
 +
=== Windpark Planning<br/> ===
 +
<u>Outputs:</u>
 +
 +
 +
*wind measurements 24 sites, 9 countries
 +
*feasibility studies: 11 sites, 7 countries
 +
*training measures
 +
*publication of studies
 +
*support in tendering
 +
*local know-how
 +
<br/>
 +
 +
<u>Used for:</u>
 +
 +
 +
*tendering
 +
<br/>
 +
 +
<u>Direct Results:</u>
 +
 +
 +
*projects, ready for investment, bankable
 +
<br/>
 +
 +
<u>Indirect results:</u>
  
[[Image:Policy advisory services output results example RSA.JPG|frame|center|Figure: Policy advisory services output results example RSA]]  
+
<br/>[[File:Windparkplanning indirect result.JPG|thumb|left|180px|Indirect Results Windpark Planning]]
  
<br>
+
[[Monitoring and Evaluation (M&E) - Wind Energy#toc|►Go to Top]]
  
== Outputs - Windpark Planning<br>  ==
 
  
<br>
 
  
[[Image:Windparkplanning output and direct result.JPG|750px|Windparkplanning output and direct result.JPG]]<br>
 
  
== Indirect Results - Wind Park Planning<br> ==
+
= Possible Higher Aggregated Development Results<br/> =
 +
<u>Poverty alleviation and development:</u>
  
<br>
 
  
[[Image:Windparkplanning indirect result.JPG|750px|Windparkplanning indirect result.JPG]]<br>  
+
*Improvement of living conditions
 +
*Generation of income/socio-eocnomic development
 +
*Improving living conditions
 +
*Reduced dependency fossil fuels
 +
<br/>
  
<br>  
+
<u>Clima / environmental objectives</u>:
  
== Higher aggregated development results in the energy sector  ==
 
  
Armutsbekämpfung und Entwicklung
+
*Reduced dependency fossil fuels
 +
*Increased efficiency
 +
*Dissemination of wind energy/RE
 +
[[Monitoring and Evaluation (M&E) - Wind Energy#toc|►Go to Top]]
  
*Verbesserung der Lebensbedingungen
 
*Generierung von Einkommen
 
*Erhöhung der Versorgungssicherheit
 
*Verringerung der Abhängigkeit vom Öl
 
  
Klima- und Umweltverträglichkeit<br>  
+
= Value Added Chain Wind Industry<br/> =
 +
[[File:Value added chain wind industry.JPG|frame|left|180px|Value added chain wind industry]]
  
*Effizienzsteigerung
+
[[Monitoring and Evaluation (M&E) - Wind Energy#toc|►Go to Top]]
*Verbreitung erneuerbarer Energien<br>
 
  
<br>
 
  
== Value added Chain Wind Industry  ==
 
  
[[Image:Value added chain wind industry.JPG|801x528px|Value added chain wind industry.JPG]]<ref>Source: BWE and VDMA Power Systems 2009: 9 in: GTZ 2009: Development of Implementation Strategies for a Regional Regulatory Action Plan (RRAP) for the Western Cape. http://www.gtz.de/de/dokumente/gtz2009-en-regional-regulatory-action-plan-western-cape.pdffckLRfckLRTraining and Capacity Building pp. 112</ref>
 
  
<references /><br>
+
= Further Information =
  
[[Portal:Wind]]  
+
*[[Clean Development Mechanism (CDM) and Baseline-Assessments for Wind Energy Projects#Clean Development Mechanism .28CDM.29 Project Cycle|Monitoring]]
 +
*[[Portal:Wind|Wind Portal on energypedia]]
  
<br>
 
  
<br>
 
  
<br>  
+
= References =
 +
<references />
  
 
[[Category:Wind]]
 
[[Category:Wind]]
 +
[[Category:Monitoring]]

Latest revision as of 10:45, 20 January 2015

► Back to Wind Portal


Overview

‘Increasing flexibility, up to date and reliable reporting, observing achievements of objectives, potential risks, changing and unintended impacts…’[1] - development programmes/projects are committed to pursue these (and other) requirements while, simultaneously, work in an efficient, effective and sustainable manner.

Monitoring & Evaluation (M&E) supports the performance of programme’s work to achieve the demanded requirements. An M&E-System can help meeting requirements of flexibility, accountability, continuous observation and information plus delivering information to the efficiency, effectiveness and sustainability of a programme.



Definition of Results-based M&E

The OECD Glossary of Key Terms in Evaluation and Results Based Management defines Monitoring as “a continuing function that uses systematic collection of data on specified indi-cators to provide management and the main stakeholders of an ongoing development inter-vention with indications of the extent of progress and achievement of objectives and progress in the use of allocated funds” [2].


  • Monitoring continuously observes what is happening because of development interventions and with what effects.
  • Monitoring provides information if a development intervention is still on track while following anticipated results.
  • Additionally, unintended effects of the intervention resp. changing conditions in an intervention’s environment.

Monitoring can hence be labelled as a tool for the “navigation” of a project that looks at the requirements of flexibility; it observes the achievements of a project, its potential risks and the changing and unintended impacts. As such results of Monitoring can provide information to further necessary activities in order to achieve the objective(s) of a project.

Monitoring & Evaluation

Evaluation is defined by the OECD Glossary of Key Terms in Evaluation and Results Based Management as “the systematic and objective assessment of an on-going or completed pro-ject, programme or policy, its design, implementation and results (…) to determine the rele-vance and fulfillment of objectives, development efficiency, effectiveness, impact and sus-tainability.” ([3]. While Monitoring “escorts” the project continuously,


  • evaluation is done at certain stages in order to assess whether the aspired objectives to these certain stages have been met.
  • Evaluation does not only look at the achievement itself (what has happened?) but as well at how this has happened (or not).
  • Evaluation therefore addresses accountability and, at the same time, observes inputs, activities, outputs, use of outputs and benefits with regard to planned and achieved efficiency, effectiveness and sustainability of the development intervention.
  • Evaluation can therefore emphasize legitimation of a project but also may provide information that can lead to alterations of the project’s concepts.

Monitoring & Evaluation (M&E) joins the functions to provide a tool that supports meeting the above mentioned requirements. Pursuing M&E will combine the information provided by both functions with the intention of knowing what has happened and with which effects. The ‘how this has happened’ will provide lessons learned for ongoing activities and future projects.

Pursuing Results-based M&E follows GTZ’s Results-based Monitoring Guidelines, indicating to take in “the whole results chain, from inputs, via activities and outputs through to the out-comes and impacts”[4] I.e. M&E will observe the mentioned result chain, probably with the following objectives: [5]

►Go to Top



Possible Objectives of M&E

Provision of information to what has happened because of development intervention (effects) (– Efficiency of project, accountability to clients, public)


  • What has happened?
  • With which effects?
  • Who is doing what?...


How has this happened and why? (programme steering)


  • How did we achieve XY? (lessons learned, best practices – knowledge management)
  • Why did something not happen? (lessons learned, best practices – knowledge man-agement)
  • Change of conditions?


Assessment of project’s concept and objectives – poss. providing statements to alterations (legitimation, sustainability & significance; accountability to clients, public)


  • Adequate baseline information (What is the starting point? Programme steering)
  • Adapted strategies according to project’s environment (programme steering)


Assessment of project’s inputs, activities, outputs, use of outputs, benefits – poss. providing statements to alterations (Effectiveness of inputs, activities in relation to outputs, use of outputs and benefits) (accountability to clients, public – knowledge management)

►Go to Top



Downloads


Exemplary Results from TERNA

The following provides an overview about the results (along the result chain) of the GIZ wind energy programmeTERNA (Technical Expertise for Renewable Energy Application).


The results are structured along the following fields of activities:



Download: Country Studies

►Download "Energy-policy Framework Conditions for Electricity Markets and Renewable Energies"[6]

5 Editions since 1999. Edition 2007: 5 000 Downloads. Information provision for investors. Support in identification of markets. Contribution to investment decisions



Policy Advisory Services

Outputs (Product-Portfolio):


  • delegation studies, workshops
  • provision of comments to draft laws
  • studies


Outputs contributed to the following:


  • Promotion of RE support law (e.g. in China)
  • Contribution to national feed-in tariff (e.g. in RSA)
  • promotion insturments on provincial level
  • strengthening the wind sector


Indirect effects:


  • formulation of further dissemination of wind in Morocco and Ethiopia (Ausbauziele)


Policy advisory services output results example RSA

►Go to Top



Windpark Planning

Outputs:


  • wind measurements 24 sites, 9 countries
  • feasibility studies: 11 sites, 7 countries
  • training measures
  • publication of studies
  • support in tendering
  • local know-how


Used for:


  • tendering


Direct Results:


  • projects, ready for investment, bankable


Indirect results:


Indirect Results Windpark Planning

►Go to Top



Possible Higher Aggregated Development Results

Poverty alleviation and development:


  • Improvement of living conditions
  • Generation of income/socio-eocnomic development
  • Improving living conditions
  • Reduced dependency fossil fuels


Clima / environmental objectives:


  • Reduced dependency fossil fuels
  • Increased efficiency
  • Dissemination of wind energy/RE

►Go to Top


Value Added Chain Wind Industry

Value added chain wind industry

►Go to Top



Further Information


References

  1. OECD 2002: Glossary of Key Terms in Evaluation and Results Based Management. pp. 27
  2. id. pp. 21
  3. GTZ 2008: Results-based Monitoring. Guidelines for Technical Cooperation. Eschborn
  4. cartoon: GTZ 1996: PIM - Booklet 4: The concept of participatory impact monitoring by Eberhard Gohl / Dorsi German. Eschborn, p. 10
  5. http://www.gtz.de/en/themen/umwelt-infrastruktur/energie/21183.htm
  6. Source: BWE and VDMA Power Systems 2009: 9 in: GTZ 2009: Development of Implementation Strategies for a Regional Regulatory Action Plan (RRAP) for the Western Cape. http://www.gtz.de/de/dokumente/gtz2009-en-regional-regulatory-action-plan-western-cape.pdffckLRfckLRTraining and Capacity Building pp. 112