Workshop 1: Multi-stakeholder partnerships for achieving the SDGs: implications for evaluation practice
The 2030 Agenda for Sustainable Development calls for multi-stakeholder partnerships for achieving the SDGs. The importance of promoting diverse partnerships and greater cooperation between Governments, civil society, Parliaments and the private sector to increase awareness and use of evaluations, was one of the key messages from the NEC 2015 Conference. Multi-stakeholder approaches to development are not new, and the SDGs seek to renew and strengthen the emphasis on multi-stakeholder approaches.
Multi-stakeholder approaches to development come with a number of complexities and challenges. What does this mean for evaluation practice? Are our current methodologies and approaches appropriate for dealing with the complexities of multi-stakeholder approaches? What capacities do we need to evaluate multi-stakeholder approaches?
This workshop will provide participants with the opportunity to explore and reflect on the practicalities of evaluating multi-stakeholder approaches to achieving the SDGs. This is a practical workshop where participants will develop terms of reference for an evaluation of a multi-stakeholder partnership. There is no ‘right way’ to design the evaluation, and so the learning will come from the engagement within the groups. From the discussions we expect to generate principles that evaluators can apply, and that will contribute to the final conference output.
Presenter: Angela Bester
Date: 16 October 2017
Activity Venue: TBD
Workshop 2: Améliorer l’utilisation des données d’évaluation par les décideurs au sein du gouvernement
Cet atelier sera présenté en français
Cet atelier de formation aborde les différentes conceptualisations de l’utilisation de l’évaluation, le processus d’élaboration des politiques publiques de développement et les facteurs en jeu pour qu’une évaluation gagne en influence. Les participants reçoivent des lignes directrices précises et systématiques sur la façon de prendre en compte les obstacles et faciliter l’utilisation d’évaluation au cours de la phase de planification des évaluations. Les participants apprendront aussi comment développer un plan d’influence politique explicite pour toutes les évaluations menées afin d’augmenter la probabilité d’utilisation de ces évaluations par le public-cible, en particulier les décideurs au sein du gouvernement.
Presenter: Debazou Y. Yantio
Date: 16 October 2017
Workshop 3: Private sector evaluation
Multilateral development banks (MDBs) undertake interventions in developing countries through both the private and public sectors. MDB support to the public sector is still dominant, although private sector interventions have shown a steep growth over recent years. While public sector operations are often initiated by the MDBs in cooperation with national or local governments, private sector interventions involve corporate sponsors who control their project initiatives. The relationship of sponsors with the MDB is often long-term as the current client-oriented model and strategic intent of the two private sector-specialized institutions among the MDBs, the International Finance Corporation (IFC) as well as the European Bank for Reconstruction and Development (EBRD), indicate. The financial instruments to support the development of the private sector are mostly of a short to medium term nature. This workshop discusses the specificity and dynamics of private sector evaluation, thereby highlighting the methodological approaches and evaluation practices that are used by MDBs for this type of operations at the institutional and project levels.
The effectiveness of this universe of private sector interventions should not be judged by their financial return only. On the one hand, investment operations certainly entail a profitability angle, but the rationale for participation of the public sector in supporting them is rather based on their broader social returns. In other words, institutions intervening in this space do so with two sorts of bottom lines in mind: (i) financial and (ii) economic/social/environmental. For a view on the first, the market may suffice, for the combined effect, evaluation is indispensable.
The workshop will start with a presentation on methodologies used in private sector evaluation and compare them with public sector evaluation methodologies and practices. In this respect, more than 20 years of experience in developing good practice standards in the Evaluation Cooperation Group (ECG) will be presented. To make the workshop as interactive as possible, two case studies will be presented. The main themes of the case studies will be the evaluation of financial intermediaries and evaluating direct equity investments. Finally, as learning from experience is one of the main features of development evaluation, the workshop will discuss adaptive learning as an institutional strategy.
Presenter: Raghavan Narayanan
Date: 16 October 2017
Activity Venue: TBD
Presenter:Fredrik Korfker
Timing: 16 October 2017
Workshop 4: Theory-based evaluation in practice
Interventions are theories and evaluation is the test. This well-known reference is indicative of an influential school of thought and practice in evaluation, often called theory-driven or theory-based evaluation. While having been around for more than four decades, over the last decade theory-based evaluation has received new impetus and has become part and parcel of the toolkit of program evaluators across the globe.
The past decade has also seen a dramatic increase in impact evaluation debates and practices. While theory-based evaluation has often been cast as an alternative to quantitative counterfactual-based impact evaluation, in practice the two can reinforce each other. At the same time, the scope for applying different expressions of theory-based evaluations is much broader than impact evaluation only. The workshop will address the following main themes:
1. What is theory-based evaluation and why is it important?
2. What are useful principles for reconstructing a program theory?
3. How can we apply theory-based evaluation in practice?
Learning outcome
After this course, participants have developed an initital (but sound) understanding of the role of theory in evaluation and how to apply theory-based evaluation in practice.
Learning modalities
- Short interactive lectures
- Group exercise and presentations on the basis of an empirical case
Course level: Beginning/intermediate
Presenter: Jos Vaessen
Date: 16 October 2017
Workshop 5: ¿El género+ se está quedando atrás en la medición de los ODS?
Este taller tendrá lugar en español.
La experiencia ha demostrado que empoderar a las mujeres contribuye a promover el crecimiento económico y el desarrollo de los países. Pese a los avances logrados en las últimas décadas, la desigualdad de género sigue siendo un obstáculo para la plena participación de las mujeres en la actividad económica, el desarrollo social y la toma de decisiones en el ámbito público. Para avanzar en el logro de los objetivos de desarrollo sostenible, es crucial superar la desigualdad y eliminar toda forma de discriminación basada en el género.
El enfoque de género ha estado presente al más alto nivel en la evaluación y medición de los ODS desde la adopción de la nueva agenda de desarrollo. En los últimos años, han aumentado los esfuerzos para definir indicadores y metas para medir el avance hacia los ODS con una perspectiva de género. Sin embargo, estos esfuerzos son todavía insuficientes.
Este taller pretende intercambiar reflexiones y prácticas y hacer una lectura crítica sobre los indicadores y metodologías que podrían contribuir a un uso más intensivo del enfoque de género en los procesos de evaluación y seguimiento de los ODS en los próximos años. Mediante una metodología participativa, se presentarán, entre otros contenidos, estrategias para la aplicación del enfoque de género en las políticas públicas y herramientas de evaluación con enfoque de género, con aplicaciones prácticas y casos reales.
Presenter: Alejandra Faúndez
Date: 16 October 2017
Workshop 6: Knowledge brokers game-based workshop
In a complex world, knowledge is needed to run effective public policies. However, the flow of knowledge between the experts that produce the knowledge, and its users, who are the decision-makers, is not a straightforward process.
A knowledge broker is a public professional acting as an intermediary, ensuring that the message from studies to decision-making gets across. Knowledge brokering helps decision-makers to be better equipped to create evidence-based policies that are better designed and will more successfully serve the citizens.
The training is designed as a one-day game-based session. Participants play the role of managers within their regional evaluation units. Their mission is to help different decision-makers in successfully implementing socio-economic projects.
Participants can learn six key knowledge brokering skills:
1. Identifying knowledge needs of policy actors
2. Acquiring credible studies
3. Combining results into policy arguments
4. Reaching users with appropriate dissemination strategies
5. Delivering research results at the right moment of decision-making cycle
6. Managing a unit and its network with limited resources
The simulation game is run in turns which are followed by detailed feedback and debriefing sessions grounded in latest empirical research on evidence used in decision-making.
Presenter: Tomasz Kupiec, Doctor of Economic Science - EGO-Evaluation for Government Organization, Poland
Date: 16 October 2017
Workshop 7:Establishing a National Evaluation System: Case of Kazakhstan / Создание национальной системы оценки: пример Казахстана (In Russian, with English translation)
В рамках этого семинара участники ознакомятся с историческими и административными предпосылками создания системы оценки эффективности деятельности государственных органов Казахстана.
Казахстанская система оценки действует уже более 7 лет, от трех государственных органов, оцененных в 2011 году, до более чем 40 органов, проходящих ежегодную оценку.
Системой разработан уникальный подход к методологии оценки. Более того, она создала новую культуру оценки в бюрократическом аппарате правительства. Система зарекомендовала себя как эффективный инструмент совершенствования системы государственного управления и стимулирования эффективной работы министерств и местных государственных органов. Например, до запуска Системы, в 2006 году граждане заполняли более 23 млн. запросов и жалоб о различным вопросам госуправления. В 2013 году количество жалоб снизилось до 10,8 млн., а в 2016 году – до 2,3 млн.
Семинар начнется с презентации опыта внедрения национальной системы оценки в Правительстве Республики Казахстан. Кроме того, будет презентован опыт стран региона, участвующих в Региональном хабе в сфере государственной службы в Астане. Семинар послужит диалоговой площадкой для обмена практическим опытом, инновациями и перспективами в разработке национальных систем оценки и способствует налаживанию партнерства между участниками.
Соорганизаторы: Правительство Республики Казахстан, Региональный хаб в сфере государственной службы в Астане
Within this workshop, participants will immerse into historical and administrative background of establishing a performance evaluation system for Kazakhstani government bodies. The Kazakhstani Evaluation System is on for more than 7 years, scaling its work from just 3 state bodies assessed in 2011 to more than 40 agencies going through the annual assessment now.
The System has developed its own unique approaches to methodology, moreover it launched a new culture of evaluation within the bureaucratic governmental apparatus. The System proved itself as an effective tool for improving governance and stimulating the ministries and municipal state bodies to perform better. For instance, before the launch of the System, in 2006 citizens used to fill over 23 mln requests and complaints against various governance issues. In 2013 number of complaints dropped to 10.8 mln, in 2016 – to 2.3 mln.
The workshop will start with a presentation on national evaluation system in the Government of the Republic of Kazakhstan. It will also showcase the experience of countries of the region that participate in the Regional Hub of Civil Service in Astana. The workshop will provide a dialogue platform for the exchange of practical experience, innovations and perspectives in elaborating national evaluation systems and facilitate networking and partnership building between participants.
Presenter:Aibatyr Zhumagulov,Vice-Minister of National Economy, Republic of Kazakhstan
Date: 17 October 2017
Presenter: Sabina Sadieva, Head of the Centre for State Body Efficiency Evaluation, JSC “Economic Research Institute”, Republic of Kazakhstan.
Date: 17 October 2017
Activity Venue: TBD
Workshop 8: Outcome Harvesting —An evaluation approach for identifying and understanding development outcomes in complex circumstances
This workshop is designed for seasoned development evaluators and government officials responsible for commissioning and supervising evaluations.
Workshop content: Using exercises with a simulated case study, participants spend 60% of the workshop doing exercises in small groups as a means of working through the Outcome Harvesting steps:
1. Design the Outcome Harvest with key evaluative questions based on the principal uses of the primary users of the process and findings.
2. Review documentary material to draft potential outcome descriptions of who changed their behavior, how the intervention contributed and other relevant data such as the significance of the outcome.
3. Engage with human sources of information to complete outcome descriptions and formulate additional ones
4. Substantiate the veracity of select outcome descriptions with independent third parties and deepen understanding.
5. Analyze and interpret the outcome information to answer the evaluation questions.
6. Support the use of the Outcome Harvest findings.
Presenter: Ricardo Wilson-Grau
Date: 17 October 2017
Workshop 9: Tools for Conducting Evaluation System Diagnostics in Governments
Many evaluators highlight challenges in evaluation use. Improving evaluation utilization is a task that is often far larger than the individual evaluator, it is a systems issue. It is important for evaluation commissioners and managers to move towards systematic evaluation practice that meets the demands of the organization and increase utilization of evaluation findings.
Evaluation system diagnostics are helpful to (re)align evaluation practice with demands from across different political and organizational levels and thereby contribute to improving the utilization and relevance of evaluations. This workshop presents a set of diagnostic tools and concepts that seek to identify different demands for evaluation.
This workshop introduces a diagnostic toolset that has been developed through eleven analytical processes of government evaluation systems in Africa, application in international NGOs and in evaluation systems development in the UK Government. These tools are designed to answer three questions:
(i) What is value of evaluation in the context?
(ii) What demands emerge from different stakeholders?
(iii) What is the relevance of the current evaluation systems in responding to these demands?
Answers to these questions are of high importance for the development of evaluation systems as they inform refinement of the political and technical aspects of the evaluation system, namely: policy, incentives, procurement, competencies and quality assurance mechanisms.
The workshop presents a range of tools and concepts that can identify new opportunities for evaluation. In considering the three questions above, participants will engage with:
surveys that have been developed that seek to understand different potential uses of evaluations;
additional tools that aid the identification of underlying problems, such as the Five Whys Analysis;
application of organizational culture concepts to understand latent demand and some useful political economy frameworks.
Presenter: Stephen Porter
Date: 17 October 2017
Activity Venue: TBD
Presenter:Haneen Malallah
Timing: 17 October 2017
Activity Venue: TBD
Presenter:Emma Fawcett
Timing: 17 October 2017
Workshop 10: Building better from the beginning: developing theories of change in the context of climate change and ensuring quality at entry for climate change and environment programmes
The workshop will focus on providing the rationale for why it’s especially important to think about building for evidence, right from the beginning and why environment and climate change programmes have special challenges that make it more important to think about this, right from the beginning. The first challenge in this process is recognizing how good data and designs can help inform good policy and strategy for climate change and environment programmes. The second challenge is recognizing where theories of change can play a critical role in helping not just with project/program design but also in evaluability. The third is understanding that in climate change and environment related programmes, thinking about the ‘last mile’ is especially critical: Cook stoves may be excellently well designed and the supply chain may have been set up very well but what are the factors that lead to households ‘adopting’ new and efficient cook stoves? What are we learning from other sectors and what can we do to close this last mile gap? The workshop will close with discussing biases that may enter in our assessments of how effective programs have been, unless these are well thought out.
Presenter: Jyotsna Puri, Ph.D.
Date: 17 October 2017
Activity Venue: TBD
Workshop 11: Using Technology to Enhance Applied Research & Evaluation
This workshop will focus on a range of new technological tools and examine how they can be used to improve applied research and program evaluations. Specifically, we will explore the application of free or inexpensive software to engage clients and a range of stakeholders, collect research and evaluation data, formulate and prioritize research and evaluation questions, express and assess logic models and theories of change, track program implementation, provide continuous improvement feedback, determine program outcomes/impact, and to present data and findings. Participants will be given information on how to access tools such as Crowdsourcing, Geographical Information Systems (GIS), data visualization, and interactive conceptual framing software to improve the quality of their applied research and evaluation projects.
Presenter: Tarek Azzam
Date: 17 October 2017
Workshop 12: Evaluating the Sustainable Development Goals within a “No one left behind” lens through equity-focused and gender-responsive evaluations
The Agenda 2030 for Sustainable Development puts forward “a plan for action for people, planet and prosperity” and “seeks to strengthen universal peace in larger freedom” through strategic partnerships. It includes a vision and principles, a results framework of global SDGs, a framework for means of implementation and follow-up and review mechanism.
This means evaluation should play a crucial role to support effective and efficient SDG implementation. Evaluation will offer evidence-based learning on how policies and programmes delivered results and what needs to be done differently. The main principle of the 2030 Agenda is that no one should be left behind. The follow-up and review mechanisms also call for inclusiveness, participation and ownership. This is why equity-focused and gender-responsive evaluation is needed. This transformative kind of evaluation can help countries to identify structural causes of inequalities through deeper analysis of power relationship, social norms and cultural beliefs. Integrating equity-focused and gender-responsive evaluations will provide strong evidence to ensure national voluntary reviews of SDGs are leaving no one behind.
The purpose of this one day workshop is 1) to provide guidance on how to integrate an equity-focused and gender equality approach to national evaluation systems generally and 2) promote the use of equity-focused and gender-responsive evaluations to inform the national reviews of SDGs.
Presenter: Mona Selim, Isabel Suarez, Messay Tassew and Florencia Tateossian, UN Women
Date: 17 October 2017
Workshop 13: Impact evaluation: scope and limits in the real world
It is often claimed that randomized controlled trials (RCTs) for impact evaluation are the gold standard of evaluation, because they meet scientific standards for causal inference. However, in the world of evaluation practice as well as scholarly debate, interrelated terms like result, evidence and impact are controversial concepts whose meaning is often challenged and debated by groups in different epistemological and methodological traditions. Although few would deny the relevance of credibly identifying the development impact of policies and programs and the need to shift focus on results, there is great variation and discussion around what constitutes rigorous evidence of impact and what type of methodological strategies can and should be pursued.
This workshop presents a review of the theoretical and methodological foundations of experimental (and quasi-experimental, by extension) impact evaluation in order to clarify the purposes, logic and limitations of these evaluation strategies, and offer a critical reflection on the scope and limits of impact evaluation.
For the purposes of this workshop, a pluralist perspective will be adopted in order to discuss three relevant dimensions of this debate: 1) methodological diversity and complementarity, 2) ethical and logistical considerations; 3) decision-making value of impact evaluation.
Presenter: Claudia Maldonado
Date: 17 October 2017
OPENING CEREMONY
Timing: 08:45 to 10:00
Venue: Ballroom 1
Welcoming addresses by the conference hosts
Mr. Indran Naidoo, Director, Independent Evaluation Office, UNDP
Ms. Cihan Sultanoğlu, Assistant Administrator and Director Regional Bureau for Europe and the CIS, UNDP
Government of Turkey: TBD
KEYNOTE ADDRESS
Ms. Michelle Gyles-McDonnough, Director, Sustainable Development Unit, Executive Office of the Secretary General at the United Nations
PLENARY 1: NEC 2017: People, Planet and Progress in the SDG Era
This session will explore the key themes of the conference. The plenary will share lessons, experiences, challenges and progress since 2015 in establishing and strengthening national evaluation systems? What are the implications of the SDGs for evaluation practice and national evaluation capacities? In light of this, what are new directions for evaluation and national evaluation systems?
Speaker:
Mr. Indran Naidoo, Director of the Independent Evaluation Office, UNDP
Ms. Riitta Oksanen, Deputy Director General
Department for Development Policy, Ministry for Foreign Affairs, Finland and President, European Evaluation Society
Timing: 11:00 to 12:30
Venue: Ballroom 1
PARALLEL SESSIONS - SET A
Session 1: Leaving no one behind: from global commitments to national experiences to set up a framework to evaluate SDGs
Achieving the SDGs mean “leaving no one behind”. This means there are new opportunities to further strengthen national evaluation capacities to evaluate localized SDGs and national development policies/strategies with a human rights and gender-responsive lens. A multi-stakeholder panel led by the UN Women Independent Evaluation Office will generate a discussion about global trends and national practices.
Speakers:
Ms. Inga Sniukaite, Director a.i., Independent Evaluation Office, UN Women
Ms.Olfa Soukri Cherif, Member of Parliament, Tunisia
Mr. Alejandra Faundez, Chile
Mr. Alan Fox, Evaluation Advisor, Independent Evaluation office, UNDP
Timing: 14:00 to 15:30
Venue: Ballroom 1
Session 2: Evaluation and innovation for sustainable development
The Independent Evaluation Office (IEO) of UNDP has developed a diagnostic
guidance to assist in developing a systematic approach to determining key areas, pathways, and parameters for evaluating national development strategies and SDGs.
The main purpose of the session is to share the guidance
with government and discuss national evaluation issues in the SDGs context
and lessons from countries where there has been progress in the national
evaluation systems. The session will also offer the possibility of identifying
champion countries for piloting the guidance.
Moderator
Mr. Arild Hauge, Deputy Director, Independent Evaluation Office, UNDP
Speakers:
Ms. Sabina Sadiyeva, Head of the Center for State Bodies’ Performance Assessment, JSC “Economic Research Institute”, Kazakhstan
Mr. Ruijun Wang,Director General, National Center for Science and Technology Evaluation, China
Mr. El Hassan El Mansouri, General Secretary, National Observatory for Human Development, Morocco
Ms. Nina Sarishvili, Head of Service, Policy Planning and Strategic Coordination, Secretary of the SDGs Council, Georgia
Timing: 14:00 to 15:30
Venue: Ballroom 2
Session 3: Partnership with Civil Society to Elevate National Evaluation Capacities
This session will explore factors that make such partnerships successful and the challenges that may be encountered by various actors in this sphere. What makes for effective partnerships with civil society actors? How can such partnerships be leveraged to elevate national evaluation capacities?
Moderator:
Ms.Emma Fawcett,Evaluation, Learning and Effectiveness Advisor, Oxfam America
Speakers:
Mr. Iván Morales, Country Director Oxfam en El Salvador
Ms. Ana Liliana Vega, President, Agricultural Development Bank, El Salvador
Ms. Ana Ella Gómez, Manager, Economic Autonomy Programme, Ciudad Mujer (Women's City), El Salvador
Ms. Alfredo González Reyes, Director of Programmes, Oxfam, Mexico
Mr. Tilahun Gemeda, R4/Microinsurance Program Officer, Oxfam,Ethiopia
Timing: 14:00 to 15:30
Venue: Atelier 1
PARALLEL SESSIONS SET B
Session 4: Country-led evaluation in the era of the Sustainable Development Goals: Guidance note and on-line assessment tool
The Independent Evaluation Office (IEO) of UNDP has developed a diagnostic guidance to assist in developing a systematic approach to determining key areas, pathways, and parameters for evaluating national development strategies and SDGs. The main purpose of the session is to share the guidance with government and discuss national evaluation issues in the SDGs context and lessons from countries where there has been progress in the national evaluation systems. The session will also offer the possibility of identifying champion countries for piloting the guidance.
Chair:
Mr. Arild Hauge, Deputy Director, Independent Evaluation Office, UNDP
Mr. Per Øyvind Bastøe, Director, Evaluation Department, NORAD and DAC Chair
Ms. Nina Sarishvili, Head of Service, Policy Planning and Strategic Coordination, Administration of the Government of Georgia
Mr. Mohd. Monirul Islam, Deputy Chief, General Economics Division, Planning Commission, Bangladesh
Ms. Iye Moakofi, Principal District Plans Coordinator, Ministry of Local Government & Rural Development, Botswana
Mr. Timothy Lubanga, Commissioner of Monitoring & Evaluation, Office of the Prime Minister, Uganda
Timing: 16:00 to 17:30
Venue: Ballroom 1
Session 5: Evaluating progress in SDG16: Effective governance and sustaining peace
Goal 16 on just, peaceful and inclusive societies is not only a valuable and important objective in its own right, it is also an important enabling goal for the entire sustainable development agenda. There are few agreed methodologies to measure and evaluate the issues addressed in Goal 16. Eight of the 23 indicators are tier 3, demanding new methodologies and the use of alternative measures. This session will explore how to measure and evaluate dimensions of Goal 16 and the factors that hamper progress in achieving targets of SDG 16.
Moderator:
Ms. Shelley Inglis, Regional Cluster Leader, Governance and Peacebuilding, Regional Centre for Europe and the CIS, UNDP
Speaker:
Mr. Dmitri Belan, Research Officer, Moldova Social Innovation Hub (MiLab),
UNDP
Mr. Edward K. Mulbah, Executive Director, Peacebuilding Office, Ministry of Internal Affairs, Liberia
Ms. Elnura Omurkulova-Ozierska, Researcher, National Strategic Studies Institute in Kyrgyzstan
Ms. Alexandra Wilde, Advisor, Oslo Governance Centre, UNDP
Timing: 16:00 to 17:30
Venue: Ballroom 2
Session 6: SDG indicator framework, data and evaluation: global, regional and national follow-up and review processes.
This session will provide updates on the overarching SDG indicator framework, data and the implications for evaluation and discuss global, regional and national follow-up and review processes.
Moderator:
Mr. Paulo Jannuzzi, Professor, National School of Statistical Sciences, Brazilian Institute of Geography and Statistics, Brazil
Speaker:
Ms. Yongyi Min, Chief, SDG Monitoring Unit, Statistics Division, Department of Economic and Social Affairs, UN
Ms. Phindile Masango, Economist, Ministry of Economic Planning and Development, Swaziland
This session will seek to break barriers in evaluation by (1) connecting experiences of building partnerships between evaluation associations and governments, (2) describing the useful practices of feeding knowledge into political systems and (3) facilitating the potential of evaluation units as knowledge brokers.
Moderator:
Ms. Irena Vojackova-Sollorano, UN Resident Coordinator and UNDP Resident Representative in Turkey
Speakers:
Ms. Prudence Kaoma, Assistant Director, Research and Evaluation, Ministry of National Development Planning, Zambia
Mr. John Njovu, Honorary Member, Monitoring and Evaluation Association (ZaMEA), Zambia
Ms. Jennifer Mutua, Chair, Evaluation Society of Kenya
Mr. Tomasz Kupiec, Researcher, Evaluation for Government Organizations (EGO), Poland
Timing: 16:00 to 17:30
Venue: Atelier 3
Session 8: The evaluation has been completed – now what?
This session outlines the vital steps that should follow the completion of an evaluation to enhance its utility. The panelists discuss a management perspective and share strategies applied, ideas and innovations useful in communicating and disseminating evaluations.
Moderator:
Ms. Karla Hershey, UN Resident Coordinator and UNDP Resident Representative, Serbia
Speakers:
Ms.Ekaterina Paniklova, Senior Programme Coordinator, UNDP Istanbul Regional Hub for Europe and the CIS
Mr. Toily Kurbanov, Deputy Executive Coordinator, UNV
Ms. Sasha Jahic, Communications Analyst, UNDP IEO
Ms. Clair Grant-Salmon, Head of Audience Development, International Institute for Environment and Development (IIED)
Timing: 16:00 to 17:30
Venue: Atelier 5
Session 9: Multiple dimensions and multiple stakeholders: innovations in monitoring and evaluation for the SDGs
Achieving the SDGs requires, among other things, a credible country-led evaluation system that evaluates the impact of large scale policies and programs and generates actionable findings. Finding appropriate measures of poverty is also part of the challenge. What else do we need?
Moderator
Mr. Gonzalo Guerra, Regional Adviser on Monitoring and Planning, Regional Hub for Latin America and the Caribbean
Speakers:
Mr. Marco Vinicio Espinal Martínez, Monitoring and Evaluation Specialist, National Competitiveness Council, Dominican Republic
Mr. Amos Misomali, Resident Advisor, Johns Hopkins University, Malawi
Timing: 16:00 to 17:30
Venue: Atelier 5
Plenary 2: People and the planet: Is the environment being left behind? What are evaluations telling us?
A high-level panel will answer a series of questions about using evaluation as a methodological lens. Climate change for many countries has become largely about adaptation: to what extent is this emphasis justified (are evaluations underscoring the greater effectiveness of adaptation action rather than mitigation action?) What are evaluations saying about trade-offs? Are win wins possible? Can livelihoods be secured while ensuring increased resilience? What are the lessons for other SDGs?
Ms. Jyotsna (Jo) Puri, Head, Independent Evaluation Office, Green Climate Fund
Mr. Juha Uitto, Director, Independent Evaluation Office, Global Environment Facility (GEF)
Ms. Diann Black-Layne, Ambassador, Chief Environment Officer, Ministry of Agriculture, Lands, Housing and the Environment, Government of Antigua and Barbuda
Timing: 09:00 to 10:30
Venue: Ballroom 1
Plenary 3: Dealing with complexity in an increasingly interconnected world: Rethinking the DAC Criteria
Does the 2030 Agenda require a rethink of what has become known as the “DAC evaluation criteria”? A high-level panel will discuss this question and engage the audience in their reflections.
Moderator:
Ms. Caroline Heider, Director General, Independent Evaluation Group
Speakers:
Ms. Susanne Frueh, Director, Internal Oversight Service
United Nations Educational, Scientific and Cultural Organization (UNESCO) and UNEG Chair
Mr. Per Øyvind Bastøe, Director, Evaluation Department, NORAD and DAC Chair
Ms. Riitta Oksanen, Senior Advisor, Development Evaluation, Ministry for Foreign Affairs, Government
Finland and EES President
Mr. Indran Naidoo, Director, Independent Evaluation Office, UNDP and UNEG vice Chair
Session Coordinator: IEO/EES
Timing: 11:00 to 12:30
Venue: Ballroom 1
PARALLEL SESSIONS C
Session 10: SDGs and the private sector: How companies are measuring their contributions to development?
Achieving the SDGs will require far more action and capital than governments, multilaterals, and foundations can provide. As the public sector looks to the private sector as a partner for sustainable development, understanding the contribution of companies and investors becomes critical. The Istanbul International Center for Private Sector in Development will lead this session with opportunities to share lessons on from both the public and private sectors on the monitoring and evaluation of social and environmental impact.
Moderator:
Mr. Marcos Neto, Director, UNDP, Istanbul International Center for Private Sector in Development
Speakers:
Mr. Prateek Ahuja, Regional Manager, Medtronic, India
Mr. Asher Hasan, Founder & CEO, Naya Jeevan, Pakistan
Ms. Gonca Ongan, Managing Director, Koç University Social Impact Forum, Turkey
Mr. Tomohiro Nagasaki, Impact Team Lead, Business Call to Action
Timing: 14:00 to 15:30
Venue: Ballroom 1
Session 11: Missing the forests for the trees? What are global evaluations of forestry programmes telling us?
Achieving the SDGs will require far more action and capital than governments, multilaterals, and foundations can provide. As the public sector looks to the private sector as a partner for sustainable development, understanding the contribution of companies and investors becomes critical. The session will share with opportunities and lessons from both the public and private sectors on the monitoring and evaluation of social and environmental impact.
Moderator:
Ms. Jyotsna (Jo) Puri, Head of the Independent Evaluation Office of the Green Climate Fund
Speakers:
Mr. Alan Fox, Evaluation Advisor, Independent Evaluation Office, UNDP
Mr. Mario Boccucci, Head, UN-REDD Programme Secretariat
Mr. Nuri Ozbagdatli, Climate Change and Environment Portfolio Manager, UNDP Turkey
Timing: 14:00 to 15:30
Venue: Ballroom 2
Session 12: Civil Society’s role in evidence and social accountability to ensure no one is left behind
Social accountability strategies can further equitable development policy and practice – but leveraging their power relies on evidence gathering and use. This participatory session will explore the intersection of civil society, social accountability, government performance-based accountability systems and evaluation.
Moderator
Ms. Haneen Malallah, Knowledge, Learning, and Accountability Advisor, Oxfam America
Speakers
Mr. Sulley Gariba, Evaluation specialist; public policy analyst, Institute for Policy Alternatives, Ghana
Mr. Mohammad-Anwar Sadat Adam, Economic Justice Programme and Campaigns Manager, Oxfam, Ghana
Mr. Stefano D’Errico, Monitoring, Evaluation, Accountability and Learning Manager, International Institute for Environment and Development (IIED)
Timing: 14:00 to 15:30
Venue: Atelier 1
PARALLEL SESSIONS - D
Session 13: From Data to Decisions: How is New Data Altering Evaluation, Policy and Programming in Real Time?
The session seeks to explore the political economy and technical challenges and opportunities underlying the use of new data in evaluations and public policy-making. The multi-stakeholder panel will bring to the NEC some of the latest approaches in measuring impact in real time, and how those could be applied to the SDG agenda. The session will also serve as a forum to share and reflect upon the kick-off meeting of the cross regional project for data innovation in the measurement of SDGs.
Moderator:
Ms. Lejla Sadiku, Open Data Specialist, Regional Centre for Europe and the CIS, UNDP
Speakers:
Mr. Emmanuel Letouzé, Data-Pop Alliance and MIT Media Lab
Ms. Paula Hidalgo-Sanchis, Manager, UN Global Pulse Lab, Uganda
Mr. Dmitri Belan, Research Officer and Service Designer, MiLab Moldova
Timing: 16:00 to 17:00
Activity Venue: Ballroom 1
Session 14A: Review of national evaluation systems and capacities in Asia Pacific for evaluating progress towards SDGs
In 2017 UNDP and UNICEF launched a joint initiative in the Asia Pacific Region to develop country case studies to assess evaluation systems and capacities. The objective of the initiative is to generate knowledge to guide NECD for the SDGs; identify national evaluation systems successes and lessons; foster peer learning; and inform global, regional NECD guidance through the production of readiness assessments at the country level. The framework, methodology and research tools as well as emerging findings from country case studies and the region will be shared.
Moderator:
Mr. Arild Hauge, Deputy Director, Independent Evaluation Office, UNDP
Speakers:
Mr Riccardo Polastro, Regional Evaluation Advisor, East Asia and Pacific Regional Office, UNICEF
Ms. Michaela Prokop, Regional Programme Advisor, Sustainable Development Goals, Regional Centre for Asia and the Pacific, UNDP
Ms. Hanani binti Sapit, Director, Outcome Evaluation Division, Implementation Coordination Unit, Prime Minister's Department, Government of Malaysia
Ms. Ayanthi De Silva, Director General, Department of Project Management and Monitoring, Ministry of Development Assignments, Sri Lanka
Timing: 16:00 to 17:00
Venue: Ballroom 2
Session 14B: Partnerships: Peer-to-peer learning for strengthened evaluation capacities
Collaboration and peer learning between governments is likely to lead to better M&E systems, which have larger impacts on government performance. This session will explore lessons from different continents.
Chair:
Mr. Arild Hauge, Deputy Director, Independent Evaluation Office, UNDP
Speakers:
Mr. Timothy Lubanga, Commissioner for Monitoring and Evaluation, Office of the Prime Minister and Chair of The Twende Mbele Management Committee, Uganda
Ms. Ana Laura Garcia, Deputy Director, Management and Evaluation, Planning and Budget Office, Presidency of the Republic of Uruguay
Mr. Miguel Angel Lombardo, Administrator, South Cooperation for Policy Evaluation, International and Ibero-American Foundation for Administration and Public Policies, Spain
Timing: 17:00 to 18:00
Venue: Ballroom 2
Session 15A: Fishbowl: independence, credibility & use of evaluations
This highly participatory session will look at the latest issues surrounding independence, creditability and use of evaluations.
Facilitator:
Ms. Riitta Oksanen, Deputy Director General, Department for Development Policy, Ministry for Foreign Affairs, Finland
Timing: 16:00 to 17:00
Venue: Atelier 2
Session 15B: Partnerships: DAC donors and their role in Evaluation Capacity Development for SDGs
This participative session will discuss the role of donors in strengthening evaluation capacity development (management by governments and other partners as well as the actual conducting of evaluations). It will start with an introduction of the work and proposals of the ECD Working group within Evalnet (OECD/DAC) and then aims to discuss and inventory the practical needs from the demand side and the potential role of donors.
Moderator:
Ms. Riitta Oksanen, Deputy Director General Department for Development Policy, Ministry for Foreign Affairs, Finland and President, European Evaluation Society
Speaker:
Mr. Antonie de Kemp, Team leader Development Cooperation, Policy and Operations Evaluation Department, Netherlands Ministry of Foreign Affairs
Timing: 17:00 to 18:00
Venue: Atelier 2
Session 16A: Murder on the Orient Express? Mysterious ways of impact investing
A group of evaluators from around the world are invited to board the NEC ‘train’ at Istanbul to solve the case of the missing Belgian impact investor with global reach and blue-chip assets. In a race against time, the evaluators have to solve the case by studying the impact investing model, following the clues provided (intentionality, theory of change, indicators), and figuring out the mysterious proponents behind Global Impact Investing Network (GIIN).
Moderator:
Mr. Fredrik Korfker, Development Finance Consultant
Speakers:
Mr. Raghavan Narayanan, Industry Lead, Independent Evaluation Group Private Sector Evaluations, World Bank
Timing: 16:00 to 17:00
Venue: Atelier 3
Session 16B: Theory-Based Evaluation of Public-Private Partnership Projects and Programmes
Do public private partnerships (PPPs) actually create value for money? Do the OECD-DAC criteria cover the complexities of PPPs or are there additional how and why questions that need to be asked? Can theory-based evaluation in PPP intervention contribute to better policy formulation?
Moderator:Mr.Fredrik Korfker, Development Finance Consultant Speakers:
Ms. Elsa de Sarmento, Associate researcher at Novafrica, Nova Business School of Management and Economics, Portugal.
Ms. Mehmet Uzunkaya, Planning Expert, Ministry of Development, Turkey
Timing: 17:00 to 18:00
Venue: Atelier 3
Session 17: Evaluations: a missed opportunity for the SDGs Voluntary National Review?
This session will analyse how evaluation has been addressed in the Voluntary National Reviews presented to the UN’s High Level Political Forum and generate discussion with participants on how country-led evaluations will contribute to progress towards the SDGs.
Moderator:
Mr. Indran Naidoo, Director, Independent Evaluation Office, UNDP
Speakers:
Mr. Stefano D’Errico, Monitoring, evaluation, accountability and learning manager, IIED
Mr. Sami Pirkkala, Prime Minister’s Office, Finland
Mr. Izzet Ari, Head of Department, Ministry of Development, Turkey
Ms. Luz Keila Virginia Gramajo Vilchez, SDGs Technical Coordinator, Presidential Secretariat for Planning and Programming, Guatemala
Timing: 16:00 to 18:00
Venue: Atelier 4
Session 18: Dealing with complexity: an innovative meta-results framework for the evaluation, monitoring and reporting of transformative interventions at scale on the nexus forest-climate change mitigation-sustainable development
The session will introduce and discuss with participants the M&E challenges, opportunities as well as the elements of possible solutions related to the complex transformation on the management of land and forest that is being attempted globally in response to the Paris Agreement (specifically article 5) and the SDG (specifically SDG15)
Facilitator:
Mr. Mario Boccucci, Head, UN-REDD Programme Secretariat + others TBC
Timing: 16:00 to 18:00
Venue: Atelier 5
Plenary 4: Dealing with complexity in an increasingly interconnected world
Keynote Speaker:
Mr. Michael Woolcock,Lead Social Development Specialist, Development Research Group, World Bank
Assessing ‘complex’ development interventions requires extended engagement with contextual idiosyncrasies and implementation processes. As such, making warranted claims about ‘effectiveness’ entails integrating theory with the full arsenal of research methods and data (qualitative, quantitative, and comparative-historical) available to social scientists. The future will surely be more rather than less ‘complex’, as will the policy responses demanded by citizens, as will the binding constraints on the full effectiveness of most interventions. Evaluations addressing these issues must themselves be designed accordingly, rather than imagining that singular (putatively ‘rigorous’) approaches can elicit the “key facts” needed to verify claims about impact, and inform decisions regarding whether to scale up successes and/or replicate them elsewhere.
Moderator:
Mr. Indran Naidoo, Director, Independent Evaluation Office, UNDP
Timing: 09:00 to 10:00
Venue: Ballroom 1
PARALLEL SESSIONS E
Session 19: New Directions: Dealing with complexity in evaluation under real-world constraints
What are the most important conceptual or methodological challenges for evaluation in terms of dealing with complexity? Is evaluation as currently institutionalized in many public policy contexts equipped to adequately address complexity issues in policy interventions? What are the main institutional constraints for evaluation as a practice to deal with complexity issues in function of generating credible/useful knowledge regarding the merit and worth of policy interventions? The panel will seek to answer these questions and more.
Timing: 10:30 to 12:00
Venue: Ballroom 1
Chair: Caroline Heider, Director General of the Independent Evaluation Group at the World Bank Speakers:
Michael Woolcock, Lead Social Development Specialist, Development Research Group, World Bank
Jos Vaessen, Maastricht University / Adviser on
evaluation methods at the Independent Evaluation
Group, World Bank
Ricardo Wilson-Grau, Independent evaluator and organizational development consultant
Session 20: New partnerships: private sector, the SDGs and evaluation. Current challenges in private sector evaluation
The private sector is a major driver of development and many business opportunities can contribute to the SDGs. With respect to evaluation, new configurations lead to new questions. This session will explore evaluation of interventions in support of the private sector and public sector development, highlight the specificity and dynamics of private sector evaluation, and discuss the potential for harmonizing approaches across development evaluation and evaluation of social impact investing.
Moderator:
Mr. Raghavan Narayanan, Industry Lead, Private Sector Evaluations, Independent Evaluation Group, World Bank
Speakers:
Mr. Fredrik Korfker, Development Finance Consultant
Mr. Kashif Iqbal, Senior Strategy Manager, Strategy & Organisational Performance Office, International Islamic Trade Finance Corporation, Saudia Arabia
Mr. Bas Warmenhoven, PricewaterhouseCoopers, Manager, Dutch Good Growth Fund, Netherlands
Ms. Elsa Sarmento, Evaluation Consultant
Timing: 10:30 to 12:00
Venue: Ballroom 2
Session 21: Evaluations are not enough: translating evidence into action
Policies are in place, programmes have been implemented and evaluated. But have the changes needed to achieve the SDGs really occurred? What does it take to go the “last mile,” to galvanize lasting behavioral change? What does this imply for evaluation?
Moderator:
Ms. Jyotsna (Jo) Puri, Head, Independent Evaluation Office, Green Climate Fund
Speakers:
Mr. Toby Park, Senior Advisor, Energy and Sustainability, Behavioural Insights Team, U.K.
Mr. Nilesh Chatterjee, Consultant/Advisor, Public health/behavioural sciences, India
Mr. Arab Hoballah, Team Leader, SWITCH-Asia SCP Facility
Timing: 10:30 to 12:00
Venue: Atelier 1
PARALLEL SESSIONS F
Session 22: Evaluation and the SDGs: Complexity and the future we want
This session will explore the use of SDG data and indicators to support a model-based approach to dealing with complexity, and inform evaluation tools and frameworks that respond to such complexities.
Moderator:
Mr. George Bouma, Team Leader, Sustainable Development Cluster, Regional Centre for Europe and the CIS, UNDP, Turkey
Speakers:
Ms. Yulduz Abduganieva, Department Head, Ministry of Economy, Uzbekistan
Mr. Odiljon Mamadaliev, Head, Department on Information Dissemination, International Data Exchange and Public Relations, State Committee of the Republic of Uzbekistan on Statistics, Uzbekistan
Mr. Adrian Lupusor, Executive Director, Expert-Grup, Moldova
Ms. Maja Jovovic Schmidt-Gutzat, Department Head, Economic, Development and Financial Affairs, Ministry of Foreign Affairs, Montenegro
Ms. Antonina Rishko-Porcescu, Evaluator, Ukrainian Evaluation Association/EvalYouth, Moldova
Mr. Mihail Peleah, Programme Specialist, Green Economy and Employment, Packaging policies for SDGs, Regional Centre for Europe and the CIS, UNDP, Turkey
Timing: 13:30 to 15:00
Venue: Ballroom 1
Session 23: Evaluation in a world of risk and uncertainty. How to evaluate resilience?
Do the traditional evaluation criteria work in a world of volatility and increasing disaster and climate risks? What is resilience and how does one evaluate it? A panel of evaluators and development practitioners will explore these questions.
Moderator:
Mr. Armen Grigoryan, Team Leader, Climate Change and DRR, Regional Centre for Europe and the CIS, UNDP, Turkey
Speakers:
Ms. Karen Ortega, Programme Officer, Mitigation, Data and Analysis (MDA), UN Framework Convention on Climate Change Secretariat
Ms. Magda Stepanyan, Founder and CEO, Risk Society, Netherlands
Mr. Alan Fox, Evaluation Advisor, Independent Evaluation Office, UNDP
Mr. Krunoslav Katic, Technical Consultant, SEE URBAN, Regional Centre for Europe and the CIS, UNDP, Turkey
Ms. Ala Druta, Team Leader, Climate Change Office, Ministry of Agriculture, Regional Development and Environment, Republic of Moldova
Ms. Olga Atroshchanka, Programme Officer, UNDP, Belarus
Timing: 13:30 to 15:00
Activity Venue: Ballroom 2
Session 24: Avancées et innovations en évaluation (cette session sera présentée en français)
Cette session offrira l’occasion de partager, en français, les progrès et les innovations en matière d'évaluation.
Médiateur :
M. Mamadou N’Daw, Conseiller en évaluation et gestion axée sur les résultats, Bureau Régional pour l’Afrique, PNUD
Intervenants :
M. Etienne Lupaka, Expert chargé de suivi et évaluation, Ministère du Plan, République démocratique du Congo (Observatoire Congolais du Développement Durable)
M. Mahahmadou Zibo Maiga, Coordonnateur, Cellule Technique du Cadre Stratégique de lutte contre la pauvreté, Mali et
M. Chiaka Dembélé, Association pour la Promotion de l’évaluation au Mali (APEM) (L’évaluation et conflit dans le Sahel : cas du Mali)
M. Mahamadou Boukoum, Directeur du suivi et de l'évaluation des politiques économiques et sociales, Direction du suivi et de l'évaluation des politiques économiques et sociales (DSEPES), Burkina Faso et M. Achille Yameogo, Secrétaire général adjoint, Réseau Burkinabè du Suivi & Evaluation (Les pratiques d’évaluation des politiques et programmes nationaux au Burkina Faso)
M. Achille Yameogo, Secrétaire général adjoint, Réseau Burkinabè du Suivi & Evaluation
Mme Aida Kraiem, Directeur, Présidence du Gouvernement, Tunisie
Mme Ghofran Ajimi, Directeur, Présidence du Gouvernement, Tunisie
Timing: 13:30 to 15:00
Venue: Atelier 2
Session 25: Challenges and Opportunities in Evaluating SDGs – National Government Perspectives
What are the main challenges that governments facie in evaluating public policies and programmes in the context of SDGs? How are governments preparing to respond to these challenges? This session will explore challenges and opportunities in establishing robust evaluation systems in different countries and contexts.
Chair:
Mr. Arild Hauge, Deputy Director, Independent Evaluation Office, UNDP
Speakers:
Ms. Rhodora G. Alday, Director, Policy Development and Planning Bureau, Department of Social Welfare and Development, Philippines
Mr. Shi Xiaoyong, Head of the Strategy Evaluation and Research Department of NCSTE, Associate Research Fellow, China
Ms. Fidelity Kepeletswe, National Strategy Office, Botswana
Ms. Victoria Geresomo, Acting Director Monitoring and Evaluation, Department of Economic Planning and Development, Malawi
Ms. Ida Lindkvist and Ms. Anette Wilhelmsen, Evaluation Department, NORAD, Norway
Timing: 13:30 to 15:00
Venue: Atelier 3
Session 26:: Multi-stakeholder partnerships and the SDGs: Analytical approaches for their evaluation
This discussion-oriented session will explore issues surrounding multi-stakeholder partnerships and evaluation. Are specific methods required for multi-stakeholder partnerships and what would be needed to bring such methods into the evaluation mainstream? Bring your lessons and examples to share.
Moderator:
Ms. Angela Bester, Evaluation Practitioner, South Africa
Speakers:
Mr. Leon M. Hermans, Assistant Professor, Delft University of Technology, Netherlands
Timing: 13:30 to 15:00
Venue: Atelier 4
Session 27: Evaluation and No One Left Behind: What have your experiences taught you?
If you feel like something was missed out during the conference – this open session gives you a chance to bring it up. This participatory session will offer opportunities to share practical lessons, opportunities and challenges in ensuring our countries leave no one behind and how evaluations can support this goal.
Mr. Towfiqul Islam Khan, Research Fellow, Center for Policy Dialogue, Bangladesh
Mr. Habib Jabbari, Deputy Director, Planning, Spatial Planning and Environment, Plan and Budget Organization, Iran
Ms. Irene Molly Doroh, Director, Department of Implementation, Monitoring and Evaluation, Office of the President and Cabinet, Zimbabwe
Timing: 13:30 to 15:00
Venue: Atelier 5
CONCLUDING PLENARY AND CLOSING CEREMONY
This session will bring together the findings of the conference sessions to formulate answers to the following questions:
In the current, rapidly evolving development context and the framework of the SDGs, how do principles and practices of evaluation need to change?
What are the implications for national evaluation capacities?
What needs to be done to ensure that evaluation enhances progress towards the SDGs and responds to the 2030 Agenda for Sustainable Development?
Timing: 16:00 to 17:00
Venue: Ballroom 1
Angela Bester
Angela Bester is an evaluation practitioner who has managed, led and conducted evaluations for the South African Government and the United Nations, as well as for international development agencies. Prior to her current role, Angela served as Director-General: Office of the Public Service Commission in South Africa where she established the capacity of the Office to carry out its Constitutional mandate to evaluate public administration. Angela has a keen interest in developing national evaluation capacities and served on the Board of the South African Monitoring and Evaluation Association.
Ricardo Wilson-Grau
President of Ricardo Wilson-Grau Consultoria em Gestão Empresarial Ltda, he resides in Rio de Janeiro, Brazil but works internationally. Since 2003, he has evaluated over fifty international social change networks, European and North American development funders and civil society organisations. With forty co-evaluators, he developed the “Outcome Harvesting” that now has been used to collect and make sense of thousands of outcomes of over four hundred NGOs, CBOs, government agencies, multilaterals, research institutes and networks in 143 countries around the world. He has led Outcome Harvesting workshops at EES 2014 and 2016, ReLAC 2015 and AfrEA 2017.
Stephen Porter
Stephen Porter is currently the Director for the Learning, Effectiveness and Accountability Department at Oxfam America. Stephen has a range of experience in development practice, including academic, donor and experience applying a rights-based approach to evaluation. Previously, Stephen was Evaluation Advisor for Market Development at the UK Department for International Development and was the Director of the Center for Learning on Evaluation and Results for Anglophone Africa at the University of Witwatersrand. He holds an MPhil in Public Policy from the University of Cape Town. Stephen has eleven journal and book chapters published on the topic of evaluation systems development.
Raghavan Narayanan
Raghavan has more than 18 years of operational experiences spanning investment financing, asset management and financial advisory services and brings unique private sector development insights to evaluation sciences. At the Independent Evaluation Group (IEG), he specializes in real sector evaluations and strategic initiatives. Recently, he has been tasked with managing IEG’s flagship reports and thematic evaluations on World Bank Group private capital mobilization activities. Before joining the World Bank Group, Raghavan was an economist and policy advisor for the extractives industry and has rotated through various positions in venture capital, investment banking and private equity investment funds. He holds an MBA from Georgetown University (U.S.), a B.Eng. from Nanyang Technological University (Singapore) and has received training at Carleton University (Canada) on monitoring and evaluation.
Fredrik Korfker
Fredrik is an international development finance, banking and evaluation professional with 45 years of experience gained in commercial banks, development finance corporations and multilateral development banks. His more than 20 years of evaluation experience has been gained since 1996 through leading the Evaluation Department of the European Bank for Reconstruction and Development (EBRD) in London. After retirement in January 2011 he did mainly private sector-related evaluation consultancy assignments for the UNDP, the World Bank, the African Development Bank, the Belgian Government, the Asian Development Bank, the Dutch Government and IFAD. In a volunteering capacity, he leads the thematic working group on private-sector evaluation of the European Evaluation Society. Fredrik holds a BA equivalent of business administration from Nijenrode University (former NOIB), Breukelen, The Netherlands, and a Master of Economics from the Erasmus University (former NEH) in Rotterdam, The Netherlands.
Debazou Y. Yantio
Debazou Y. Yantio, Expert en politique et évaluation du développement, Facilité africaine de soutien juridique (ALSF), Abidjan, Côte d’Ivoire. Depuis 1994, M. Yantio a participé ou dirigé des missions liées à l’évaluation de programme dans 19 pays en Afrique, 6 en Europe, 3 en Asie et 3 en Amérique du Nord. Il a fourni ses services de consultant en évaluation aux agences
du système des Nations Unies, aux institutions multilatérales de développement, aux gouvernements locaux, aux organisations non gouvernementales, y compris au niveau communautaire à la base. Il est fondateur et ancien président de l’Association camerounaise de l’évaluation du développement (CaDEA). Son intérêt professionnel porte sur l’évaluation de l’impact de l’assistance juridique pour les partenariats public-privé (PPP) en faveur des pays en développement, l’établissement de passerelles entre l’évaluation et la pratique de la politique de développement, et le renforcement des capacités évaluatives nationales en Afrique.
Emma Fawcett
Emma Fawcett is an Evaluation, Learning and Effectiveness Advisor at Oxfam America, where she supports MEL work within inclusive value chains, country-led evaluations on women’s economic empowerment, and gender disaggregated analysis of datasets from recently completed impact evaluations. Prior to joining Oxfam, she was a a Program Manager at the Una Chapman Cox Foundation, a Professorial Lecturer at American University, and a Research Fellow at the Inter-American Development Bank. She has conducted policy-oriented development research and evaluations on a range of topics, including economic and private sector development. Emma holds a PhD in international relations from American University.
Haneen Malallah
Haneen Malallah has worked extensively in the social sector in managerial, consulting, and advisory capacities in the United States as well as entities operating nationally in Jordan and Oman. She is currently serving as the Knowledge, Learning, and Accountability Advisor at Oxfam America. Ms. Malallah has been an adjunct faculty at the SIT Graduate Institute as well as Marylhurst University. Ms. Malallah holds an MS in Management, with a focus on Development Management. She received a Fulbright Scholarship (2005 – 2007) and the King Hussein Peace Scholarship (1999).
Jyotsna Puri
Dr. Jyotsna Puri (Jo) is currently the Head of the Independent Evaluation Unit of the Green Climate Fund. She is also adjunct associate professor at the School of International and Public Affairs (SIPA), Columbia University, New York. Dr. Puri’s areas of work include policy impact analysis on poverty reduction, environment, agriculture, health and climate change, etc. She has more than 22 years of experience in policy research and development evaluation at several organizations including the World Bank, Columbia University and the UN. Also, she has led evaluation-related work for UNDP, UNICEF, GEF and the MacArthur Foundation. Dr. Puri also has extensive policy experience and provides advice on evidence-based climate change and environmental policy, evidence-based advocacy for behaviour change, community-based engagements for improving health, and methods for evaluating humanitarian action. Her expertise is using mixed methods that use rigorous quantitative methods informed by high quality qualitative approaches. Dr. Puri’s academic qualifications include a Ph.D. and M.Sc. in Resource Economics and a Masters in Development Economics.
Tarek Azzam
Tarek Azzam, PhD, is Director of The Evaluators’ Institute and Associate Professor at the Division of Behavioral and Organizational Sciences, Claremont Graduate University. Azzam’s research focuses on developing new methods suited for real world evaluations. These methods attempt to address some of the logistical, political, and technical challenges that evaluators commonly face in practice. His work aims to improve the rigor and credibility of evaluations and increase its potential impact on programs and policies. Azzam has also been involved in multiple projects that have included the evaluation of student retention programs at the university level, Science Technology Engineering Math education programs, children’s health programs, and international development efforts for the Rockefeller and Packard Foundations.
Jos Vaessen
Jos Vaessen (Ph.D. Maastricht University) is adviser on evaluation methods at the Independent Evaluation Group, World Bank Group. Since 1998 he has been involved in evaluation research activities, first as an academic and consultant to bilateral and multilateral development organizations and from 2011 to 2015 as an evaluation manager at UNESCO. Jos firmly believes in a strong link between research and practice. His ongoing involvement in some evaluation-related research and teaching activities as honorary lecturer at Maastricht University contributes to the necessary cross-fertilization between these two domains. Jos has been author of several internationally peer-reviewed publications, including three books. He regularly serves on reference groups of evaluations for different institutions and is a member of the Board of the European Evaluation Society.
Alejandra Faúndez
Trabajadora Social y Magíster en Gestión y Políticas Públicas de la Universidad de Chile. Por más de 20 años ha sido consultora y evaluadora de programas públicos nacionales e internacionales encargados por el UNFPA, ONU Mujeres, UNICEF, PNUD, BID, UNESCO, SEGIB, AECID, MERCOSUR, PLAN International, OEA, CLEAR y CEPAL. Su especialidad son los temas de políticas públicas inclusivas, indicadores sociales y enfoque de igualdad de género. En su experiencia docente, ha facilitado numerosos talleres y cursos en toda América Latina.
Ha sido Coordinadora de docencia y extensión de FLACSO-Chile, del Programa de entrenamiento en Evaluación del Staff College de Naciones Unidas, de la Oficina de Evaluación de ONU Mujeres de Nueva York; del Instituto Interamericano para el Desarrollo Económico y Social (INDES-BID) y de la iniciativa de EVALPARTNERS y ReLAC.
Es miembro del grupo de expertas regionales del PNUD en transversalización del enfoque de igualdad de género y de la Red Latinoamericana de Evaluación (ReLAC). Ha escrito numerosas publicaciones como artículos, libros y documentos en las materias de su especialidad. Actualmente es Directora para América Latina de la Consultora Inclusión y Equidad.
Dominika Wojtowicz
Dominika Wojtowicz, PhD - Kozminski University, Poland
Tomasz Kupiec, PhD - Evaluation for Government Organizations S.C.
Claudia Maldonado
Professor-Researcher at the Center for Research and Teaching in Economics (CIDE) in Mexico. She holds a Ph.D in Political Science from the University of Notre Dame and a Master´s Degree in Public Affairs from Princeton University. Her research focuses on program evaluation, capacity-building in evaluation, the politics of evidence-based policy and comparative public policy. In the last decade, she has taught graduate and undergraduate course in program evaluation and trained public servants, academics, practitioners and civil society leaders in program evaluation and the logic of evidence-based public policy in Argentina, Brazil, Colombia, Guatemala, Mexico, Peru, Panama and Uruguay. She was the founding Director of the CLEAR Center for Latin America and the Caribbean, coordinates the Center´s Diploma on Public Policy and Evaluation since 2012 and has performed social program evaluations since 1998. She has advised government agencies and social organizations on M&E both nationally and internationally. She is the author and coordinator of several publications about the use of evaluation (Cejudo & Maldonado 2011); the development strategies of Brazil and Mexico in comparative perspective (Magaldi & Maldonado 2014); the emergence of evaluation as a discipline (Maldonado & Pérez Yarahuán 2015) and the state of the art of national evaluation systems in Latin America (Pérez-Yarahuán & Maldonado 2016), among others.
-
Dominika Wojtowicz
PhD in Management Science. Analyst, evaluator and assistant professor at the Chair of Economy of the Koźmiński University. She gives lectures on the methodology of quantitative and qualitative research used in policy analyses. Her scientific interests focus on the broadly understood effectiveness of public intervention geared towards strengthening the regional and local development. She participated in many research projects focused on specific areas of public policies. She is an author of expert opinions in the field of impact of the EU funds on regional economies in Poland, on behalf of, inter alia, the European Parliament and the European Commission. She is an author and co-author of publications on the EU Cohesion Policy, regional development policies and of numerous research reports. She was a coordinator of studies on modern evaluation methods for specific areas of public interventions, studies on the use of evaluation in EU Member States, as well as on the methods used within the Regulatory Impact Assessment. She is an advisor and trainer for public administration officers in the field of evaluation.
Tomasz Kupiec
Doctor of economic science at Kozminski University, Warsaw, Tomasz has been working on evaluations since 2007 as a manager of regional evaluation unit in Silesia, Poland and as an independent evaluator of public policies since 2010. He is the author of a number of publications on evaluation use determinants, and shaping and performance of evaluation systems. Together with Karol Olejniczak he is developing the concept of knowledge brokering as a theoretical basis for evaluation units in public organizations.
Aibatyr Zhumagulov
Mr. Aibatyr Zhumagulov, Vice-Minister of National Economy, Republic of Kazakhstan. Mr. Zhumagulov started his professional career in the banking area in the National Bank of the Republic of Kazakhstan. Hereafter, apart from working in banking and investment areas, he worked in Ministry of Industry and New Technology of RK in capacity of Director of Department for key branches. He has held position of Managing Director of JSC “Baiterek National Management Holding” and headed Board of Directors of JSC “Export – credit insurance corporation KazExportGarant” and also was a member of Board of Directors of JSC “Kazyna Capital Management”, JSC “Kazakhstani Fund of Guaranteeing Credits on mortgage”, JSC “National Agency for technological development” and “House Construction Savings Bank of Kazakhstan” JSC.
Sabina Sadieva
Ms. Sabina Sadieva, Head of the Centre for State Body Efficiency Evaluation, JSC “Economic Research Institute”, Republic of Kazakhstan. Her professional experience includes leading Change Management unit in the business transformation program of the Kazpost company, working for the Center of Strategic Research and Analysis of the Presidential Office, also conducting a number of Monitoring & Evaluation projects in the non-governmental sector.
Director,
Sustainable Development Unit, Executive Office of the SG at the UN, New York
Cihan Sultanoğlu
UN Assistant Secretary-General,
UNDP Assistant Administrator and Director,
RBEC
Caroline Heider
Director General and Senior Vice President, Evaluation, World Bank Group
Michael Woolcock
Lead Social Scientist in the World Bank's Development Research Group
Indran Naidoo
Director, Independent Evaluation Office of UNDP
Susanne Frueh
Director, Internal Oversight Service of UNESCO and UNEG Chair
Jyotsna Puri
Head of the Independent Evaluation Office of the Green Climate Fund
Inga Sniukaite
UN Women Independent Evaluation Office
Jos Vaessen
Independent Evaluation Group, World Bank / Maastricht University
Fredrik Korfker
Development Finance expert, former Chief Evaluator of the EBRD
Michelle Gyles-McDonnough
Ms. Michelle Gyles-McDonnough (Jamaica) is the Director, Sustainable
Development Unit, Executive Office of the Secretary-General at the United Nations, New York.
Throughout her career, Ms. Gyles-McDonnough has practiced privately as a lawyer; served as advisor to the Secretary-General of the Organization of American States and has deep development experience within UNDP, including as Chief of UNDP's sub-regional facility for the Caribbean, UN Resident Coordinator for Barbados and the OECS, Resident Coordinator for Malaysia, Singapore and Brunei Darussalam and was recently appointed as Deputy Assistant Administrator and Deputy Regional Director Designate for Asia and the Pacific. She is currently Director of the Sustainable Development Unit in the Executive office of the Secretary-General.
Ms. Gyles-McDonnough holds a law degree from Columbia University School of Law, with honours in international and foreign law, a Masters in Public Administration from the John F. Kennedy School of Government at Harvard University, and also a Diploma in Executive Education from The Wharton School at the University of Pennsylvania. She received her undergraduate degree at Bryn Mawr College in Pennsylvania
Michael Woolcock
Michael Woolcock is Lead Social Scientist in the World Bank's Development Research Group, where he was worked since 1998. For twelve years he has also been a (part-time) Lecturer in Public Policy at Harvard University's Kennedy School of Government. His current research focuses on strategies for enhancing state capability for implementation, on crafting more effective interaction between informal and formal justice systems, and on using mixed methods to assess the effectiveness of 'complex' development interventions. In addition to more than 75 journal articles and book chapters, he is the co-author or co-editor of ten books, including Contesting Development: Participatory Projects and Local Conflict Dynamics in Indonesia (with Patrick Barron and Rachael Diprose; Yale University Press 2011), which was a co-recipient of the 2012 best book prize by the American Sociological Association's section on international development, and, most recently, Building State Capability: Evidence, Analysis, Action (with Matt Andrews and Lant Pritchett; Oxford University Press 2017). He has recently returned from 18 months in Malaysia, where he helped establish the World Bank’s first Global Knowledge and Research Hub. An Australian national, he completed his undergraduate studies at the University of Queensland, and has an MA and PhD in sociology from Brown University.
Jos Vaessen
Jos Vaessen (Ph.D. Maastricht University) is adviser on evaluation methods at the Independent Evaluation Group, World Bank Group. Since 1998 he has been involved in evaluation research activities, first as an academic and consultant to bilateral and multilateral development organizations and from 2011 to 2015 as an evaluation manager at UNESCO. Jos firmly believes in a strong link between research and practice. His ongoing involvement in some evaluation-related research and teaching activities as honorary lecturer at Maastricht University contributes to the necessary cross-fertilization between these two domains. Jos has been author of several internationally peer-reviewed publications, including three books. He regularly serves on reference groups of evaluations for different institutions and is a member of the Board of the European Evaluation Society.
Jyotsna Puri
Dr. Jyotsna Puri (Jo) is currently the Head of the Independent Evaluation Unit of the Green Climate Fund. She is also adjunct associate professor at the School of International and Public Affairs (SIPA), Columbia University, New York. Dr. Puri’s areas of work include policy impact analysis on poverty reduction, environment, agriculture, health and climate change, etc. She has more than 22 years of experience in policy research and development evaluation at several organizations including the World Bank, Columbia University and the UN. Also, she has led evaluation-related work for UNDP, UNICEF, GEF and the MacArthur Foundation. Dr. Puri also has extensive policy experience and provides advice on evidence-based climate change and environmental policy, evidence-based advocacy for behaviour change, community-based engagements for improving health, and methods for evaluating humanitarian action. Her expertise is using mixed methods that use rigorous quantitative methods informed by high quality qualitative approaches. Dr. Puri’s academic qualifications include a Ph.D. and M.Sc. in Resource Economics and a Masters in Development Economics.
Indran Naidoo
Indran Naidoo is the Director of the Independent Evaluation Office (IEO) of the United Nations Development Programme (UNDP), a post he assumed in January 2012. The IEO is the largest evaluation office in the United Nations globally. It serves as the Secretariat of the UN Evaluation Group (UNEG). As an independent position, and in accordance with the evaluation policy and its principles he reports directly to the Executive Board (representing 170 countries and territories) on the performance of the organization. The substantive work of the office is overseen by the Independent Audit and Evaluation Advisory Committee and methodological oversight provided by the International Evaluation Advisory Panel. The IEO has produced during his tenure over 60 books, publications, corporate and country level evaluations that is the largest repository of development intervention evaluations in the UN. He has presented papers and participated in panels on evaluation and development platforms across the globe and serves as academic advisor.
Indran brought substantial professional and academic experience to the IEO, having held oversight leadership positions for 22 years, as South Africa`s 1st Director of M&E in the National Department of Land Affairs in 1995 which was meant to oversee the democratic imperative of the land reform program. In 2000 he was promoted to the country`s constitutional independent oversight body, the Public Service Commission (PSC) where he served for 12 years across the institutions accountability portfolio, in positions from Chief Director to Deputy Director General for both Leadership and Management Practices and Monitoring and Evaluation, until Acting Director General when he joined the UN. During this period he fostered a culture of M&E in the country and internationally through developing evaluation associations and networks, presenting evaluation as a normative benefit for good governance, accountability, transparency and democracy, and was known for leadership roles as founding board member of the South African Monitoring and Evaluation Association (SAMEA), conference co-chair for the 3rd African Evaluation Association and Board member of the International Development Evaluation Association (IDEAS). At the teaching level he designed and offered courses of the work of the PSC as instructor and guest speaker for 8 years at the International Program for Development Evaluation Training (IPDET).
At the IEO major advancements to the function have been made; the office has transitioned to a fully professionalized evaluation model delivered through 21 professionals in an office representing 25 nations with substantive, language and experience diversity. The work is presented globally through its independent website, the office has a dedicated and board approved budget, reports are customized for global and differentiated access, and all work is advised by the international evaluation advisory panel. Boundaries have been pushed and new fronts developed through thought leadership on evaluation and development, collaborative work undertake with the Office of Audit and Investigations and significantly the National Evaluation Capacity series since 2013 moved to become the most diverse and largest (by country participation) international evaluation conferences with government, partners and professionals to date.
Indran holds academic graduate and post-degrees in English, Geography, Education Evaluation. He began as an educator, with a B. Paed (Arts), B.A. (Hons) in Geography degree from the University of KwaZulu Natal and Bachelor of Education (Curriculum Development) from the University of South Africa. He was awarded a Master’s degree in Geography from West Virginia University (USA) and completed a PhD in Evaluation from the University of Witwatersrand. He received several academic honours, awards and scholarships; key of which was his selection for the prestigious Abe Bailey Fellowship, participation in the Senior Executive management courses in educational management at Oxford University and Senior Executive Programme at the Harvard (USA) and Wits (SA) Business Schools, all of which were in-residence.
Fredrik Korfker
Fredrik is an international development finance, banking and evaluation professional with 45 years of experience gained in commercial banks, development finance corporations and multilateral development banks. His more than 20 years of evaluation experience has been gained since 1996 through leading the Evaluation Department of the European Bank for Reconstruction and Development (EBRD) in London. After retirement in January 2011 he did mainly private sector-related evaluation consultancy assignments for the UNDP, the World Bank, the African Development Bank, the Belgian Government, the Asian Development Bank, the Dutch Government and IFAD. In a volunteering capacity, he leads the thematic working group on private-sector evaluation of the European Evaluation Society. Fredrik holds a BA equivalent of business administration from Nijenrode University (former NOIB), Breukelen, The Netherlands, and a Master of Economics from the Erasmus University (former NEH) in Rotterdam, The Netherlands.
Caroline Heider
Caroline Heider is currently the Director General of the Independent Evaluation Group at the World Bank (IEG), a position she has held since 2011. Ms. Heider has dedicated the last 30 years of her career to evaluating the work of development and humanitarian organizations, transforming findings into lessons and promoting innovative ways for institutions to apply the knowledge derived from evaluations towards accelerating development effectiveness. As a senior leader, Ms. Heider has a proven track record in leading change, strengthening institutions, and building evaluation capacity through testing and trying new methods to get to better evidence and greater insights. She has first-hand experience evaluating policies and programs in over 30 countries around the world.
Ms. Heider is a leading voice in the international evaluation community. She is a life-time member of the International Development Evaluation Association (IDEAS) and a member of the American Evaluation Association. She chaired the Global Evaluation Advisory Committee of UN Women for the first years of its existence. In the past, she has been a member of the Australasian Evaluation Society and served a 2-year term as vice-chair of the UN Evaluation Group.
Before IEG, Ms. Heider headed the Office of Evaluation at the World Food Program. She has also held leading positions in the evaluation offices of the Asian Development Bank and several UN agencies, including the International Fund for Agriculture Development, the UN Development Program, and UN Industrial Development Organization.
Susanne Frueh
Susanne has some 30 years of work experience with seven different UN entities combining operational and management experience with hands-on evaluation, results-based management and strategic planning expertise. Following work in consulting and programme management during her earlier career, she has worked at senior leadership level in the evaluation functions of the United Nations Capital Development Fund (UNCDF),1996 - 1999, the World Food Programme (WFP), 1999-2002 and the UN Office for Humanitarian Coordination (UNOCHA), 2002-2007. Between 2009 and 2014 she was the executive secretary of the Joint Inspection Unit, a subsidiary body to the United Nations General Assembly with system-wide mandate for evaluation, inspection and investigations.
In July 2014 Susanne took up her current position as the director of the internal oversight service of UNESCO in Paris. In this function she directs the internal audit, evaluation and investigations functions of UNESCO and is a member of UNESCO's Senior Management Team.
In 2011, Susanne was nominated by the Secretary-General to be a member of the Interim Coordination Mechanism for system-wide evaluation responsible for developing and negotiating a new UN policy on independent system-wide evaluation. She also served as an Advisory Board member of the mid-term review on the Hyogo Framework for Action (2011-12) and as a peer panelist or peer advisor on the evaluation functions/policies of FAO (2004, 2016), WFP (2007,2013/14), IFAD (2015), the UN Office for Internal Oversight Services (2012) and UNRWA (2015).
Susanne holds a number of professional credentials such as memberships in the American and European Evaluation Associations (AEA, EEA), member of the UN Evaluation Group (UNEG) since 1996, serving on its then Executive Committee for two years, an Advisory Board member of the German Institute for Development Evaluation (DEVAL) since 2013.. She is the holder of an M.Sc. in Geography from the University of South Carolina (USA), obtained in 1986 and two bachelor-level certificates in Geography (with minors in Political Science and Sociology) and American Studies obtained in 1983 and 1984 from the Justus-Liebig Universitaet, Giessen (Germany). Her Master's Thesis evaluated the social, economic and evironmental impact of mass tourism on CanCun, Mexico.