Applications

Applications

Due to confidentiality, many uses of Outcome Harvesting cannot be shared. Here are some of the publicly available examples of developmental, formative and summative evaluations that used Outcome Harvesting. They illustrate the potential of the approach to be usefully adapted to a wide variety of monitoring and evaluation needs.

Oxfam Novib

OUTCOME "HARVESTING" - EVALUATION OF OXFAM NOVIB´S GLOBAL PROGRAMME 2005-2008, Ricardo Wilson-Grau, Juliette Majot, Wolfgang Richert. 

Summative evaluation of Oxfam Novib’s €22 million program to support 38 grantees working on sustainable livelihoods and social and political participation. Documents over 300 outcomes from 111 countries. Annexes are available on request from Ricardo Wilson-Grau.

BioNET

BIONET 20072010 EVALUATION, Ricardo Wilson-Grau, Geoffrey Howard, Mike Jeger

Summative evaluation and assessment of the prospects for the BioNET global “taxonomy for development” network to increase its impact on food security, in particular through greater support to plant health systems.

 Reports on the experience of identifying and documenting 200 emergent outcomes.

GPPAC

GPPAC EVALUATION 2006-2011, Natalia Ortiz and Ricardo Wilson-Grau, 2012

A formative assessment of the 208 outcomes achieved and the performance of the global secretariat and 15 regional affiliates of the Global Partnership for the Prevention of Armed Conflict.

GNDR logo

OUTCOMES EVALUATION OF THE GLOBAL NETWORK OF CIVIL SOCIETY ORGANISATIONS FOR DISASTER REDUCTION (GNDR) 2012 - 2015, Kornelia Rassmann and Richard Smith.

This summative, participatory evaluation used three notions of outcome: i) 180 "basic perceived outcomes" that were, however, not sufficiently specific to be treated as outcomes as defined in the Outcome Harvesting approach; ii) 21 “SMART Outcomes” that do meet the criteria; and iii) 6 specific outcome themes were selected from the 21 outcomes and developed into extended ‘Outcome Stories’ for triangulation (substantiation) by more independent sources.

CPC

OUTCOMES EVALUATION OF THE GLOBAL CHILD PROTECTION IN CRISIS (CPC) NETWORK 2008 - 2011, Kornelia Rassmann, Richard Smith, John Mauremootoo (2012)

Summative evaluation using a fusion of Outcome Harvesting and the Network Functions Approach (NFA). Assesses the extent to which 137 outcomes (1) facilitated learning, (2) influenced child protection policy and practice, and (3) enhanced CPC's standing within the child protection landscape. The participatory process of the evaluation served as a means for knowledge sharing and learning. The evaluation analyzes the network’s contribution to the outcomes with respect to its form and purpose functions (NFA). 

 

Safer World logo

DOING THINGS DIFFERENTLY: RETHINKING MONITORING AND EVALUATION TO UNDERSTAND CHANGE, 2016, Madeline Church

In 2012-2015, Safer World has put in place a way of monitoring, evaluating and learning from its work focused on behaviour and relationship change. This paper outlines the process Safer World went through to adapt, embed, and embrace an approach inspired by Outcome Mapping and Outcome Harvesting.

Mercy Corps

EVALUATION OF THE MERCY CORPS BROADENING PARTICIPATION THROUGH CIVIL SOCIETY PROGRAMME IN IRAQ, 2013-2015, Ricardo Wilson-Grau and the team leader of Mercy Corps-Jordan and the BPCS Iraq advocacy program manager. (Due to Mercy Corps policy, they cannot be named.)

This summative, internal evaluation harvested the 148 most significant changes in behaviours, actions or decisions of Iraqi citizens and government entities for strengthening Iraq’s transition to participatory democracy, to which Mercy Corps-supported civil society organisations or allies contributed. With support of the evaluation team, the BPCS chief of party, Mercy Corps Iraq senior M&E manager and the BPCS senior program director led Mercy Cops staff in an exercise to analyse and interpret the outcomes in the light of the evaluation questions that guided the exercise.

 

 

World Bank InstituteCASES IN OUTCOME HARVESTING: TEN PILOT EXPERIENCES IDENTIFY NEW LEARNING FROM MULTI-STAKEHOLDER PROJECTS TO IMPROVE RESULTS, Jenny Gold and Ricardo Wilson-Grau with World Bank Institute project staff, June 2014

Starting in 2012, the World Bank Institute undertook formative pilot evaluations to explore how Outcome Harvesting tools might help project teams and clients to manage knowledge and learn from complex and difficult to monitor development processes. This booklet contains an average of 30 outcomes per pilot:

  1. Leadership for Results: Developing Capacity and Delivering Results toward Public Sector Reform in Burundi
  2. Implementing Reform Initiatives in Solid Waste Management in Bosnia
  3. Improving Governance in Pharmaceutical Procurement and Supply Chain Management in Kenya, Tanzania and Uganda
  4. Strengthening Parliamentary Oversight of National Budgets in Africa
  5. Priority Setting and Constitutional Mandates in Health
  6. Improving Open Contracting Processes at the Country and Global Level
  7. Strengthening Capacities of Local Governments in South East Europe
  8. Strengthening Implementation of Legislation on Access to Information across Latin America
  9. Scaling up Capacity Development of City Officials and Practitioners across China Through eLearning
  10. Improving Social Accountability in the Philippines Education Sector