Evaluations
In today’s dynamic landscape, understanding the real-world effects of policies and initiatives is crucial, not only for accountability but also for learning and continuous improvement. Mid-term and ex-post evaluations stand at the forefront of this endeavor, providing analyses that assess achievements both during and after implementation.
At Syntesia – Policy and Economics, we evaluate strategies, policies, programs, and projects, applying the OECD-DAC and EU evaluation criteria. Our work also takes into account cross-cutting themes, including gender equality, social inclusion, environment and climate, and fragility and conflict-sensitivity. Our evaluations shed light on the successes, challenges and unintended effects of policies and programs, offering a foundation for evidence-based decision-making and policy refinement. Our services are designed to provide policymakers and stakeholders with the insights needed to adjust and optimize existing efforts, ensuring they deliver intended benefits and align with objectives. We also provide learnings and actionable recommendations to inform future endeavors, supporting continuous policy improvements. In addition, we carry out evaluability assessments, establish baselines and design M&E frameworks that strengthen the capacity of institutions to implement and learn from their initiatives.
Our approach is rigorous and suited to the evaluation’s needs and scope. Evaluations are commonly theory-based, grounded in the reconstruction of theories of change or intervention logic frameworks covering results at the output, outcome and impact levels. We employ a participatory approach to promote stakeholder buy-in and ownership. We combine qualitative and quantitative methods to build a comprehensive picture, making use of approaches such as contribution analysis and process tracing to test causal logic, outcome harvesting to capture learnings in complex environments, counterfactual methods (including difference-in-differences and propensity score matching) to estimate effects, as well as cost-benefit and cost-effectiveness analyses to assess value for money. By working with specialized experts and engaging local evaluators in the countries where we operate, we ensure our evaluations are technically robust, context-sensitive and culturally responsive.
projects
see all projects >filter by
Evaluation
Evaluation of the Anti-Tax Avoidance Directive
This study examines the implementation, application, and performance of the Anti-Tax Avoidance Directive (ATAD) to date, and will support DG TAXUD in concluding an evaluation of the Directive.
Contact: [email protected]
Evaluation
Assessment of the activities of the European Centre for Disease Prevention and Control
Evaluation of the activities of the European Centre for Disease Prevention and Control (ECDC) in the 2019-2025 period, including of the proposal to extend the agency’s mandate to non-communicable cross-border threats.
Contact: [email protected]
Evaluation
Evaluation of customs cooperation in the EU
Study for DG TAXUD conducted in support of Tetra Tech and in partnership with Intellera and Wavestone to assist the interim evaluation of the 2021-2027 Customs program, an initiative supporting implementation of customs policy and legislation at EU and national levels.
Evaluation
Mid-term evaluation of the Customs Control Equipment Instrument
Interim evaluation for DG TAXUD conducted in support of Ipsos of the Customs Control Equipment Instrument (CCEI), aimed at assessing implementation in the 2021-2024 period.
Evaluation
Mid-term evaluation of tax administration cooperation in the EU
This study for DG TAXUD was carried out in partnership with Ipsos to support the interim evaluation of the 2021-2027 Fiscalis program, a cooperation initiative for national tax administrations within the EU.
Contact: [email protected]
Evaluation
Evaluation of procurement processes of the European Centre for Disease Prevention and Control
This involved the assessment of the procurement procedures of the European Centre for Disease Prevention and Control (ECDC), including a benchmarking exercise with comparable European agencies.
Contact: [email protected]
Evaluation
Strategic review of private sector development support in fragile contexts in Africa
The Africa Fragility Initiative (AFI) is an IFC platform supporting responsible private sector growth in 32 African countries with fragile dynamics. This strategic review covered AFI’s support for local economic development by strengthening the domestic private sector, applying conflict sensitivity to IFC’s work in fragile and conflict-affected situations (FCS), and innovating and providing thought leadership on FCS issues. It included efforts such as the Local Champions Initiative, as well as pilot innovative tools and approaches in the areas of climate mitigation and adaptation, and refugees/forced displacement. The review covered the six traditional evaluation criteria, and involved the elaboration of case studies on conflict sensivity, knowledge management and investment facilitation.
Contact: [email protected]
Evaluation
Portfolio evaluation of food security support in fragile and conflict-affected countries
Hosted by the World Bank, the US$ 2 billion Global Agriculture and Food Security Program (GAFSP) seeks to improve food security in IDA countries. This assignment involved an assessment of GAFSP’s engagement in fragile and conflict-affected situations (FCS) as well as of the integration of fragility/conflict-sensitive features in the design and implementation of GAFSP-supported projects across the world. It also included the development of a theoretical framework on the interactions between conflict/fragility and food (in)security, as well as the elaboration of case studies on GAFSP-supported projects in Ethiopia, Haiti, Liberia, and Timor-Leste.
Evaluation
End-term evaluation of support to farmers in Georgia
Evaluation of core support provided by the Embassy of Sweden for the implementation of 2020–2024 Strategy of the Georgian Farmers’ Association (GFA), including the reconstruction of a Theory of Change for the Strategy. The evaluation was carried out under framework agreement with the Swedish Development Cooperation Agency (Sida) managed by NIRAS.
Evaluation
Evaluation of global program on preventive chemicals management
Comprehensive assessment for the Swedish Chemicals Agency (KEMI) of a program aimed at building capacity and improving preventive chemicals management among governments and other actors in low-income countries.
Contact: [email protected]
Evaluation
Evaluation of the investment climate in Ethiopia
End-line assessment of the second phase of the investment climate pillar of the Ethiopia Multi-Donor Initiative (MDI), an IFC-managed initative aiming to enhance Ethiopia’s business environment by improving business regulations at national and sub-national levels, promoting investments, supporting the tourism sector, and facilitating trade. The assessment covered the six traditional evaluation criteria, and involved – at the impact level – the calculation of compliance cost savings and private sector savings from implemented reforms.
Contact: [email protected]
Evaluation
Monitoring policy coherence for sustainable development in Romania
Support to the Government of Romania for the development of a monitoring framework for the Romanian National Sustainable Development Strategy and corresponding National Action Plan.
Contact: [email protected]
Evaluation
Cost-benefit analysis of SME disclosure on taxonomy alignment
This study for DG GROW provided an evidence-based assessment of the potential costs and benefits – in terms of access to climate finance and participation in the value chain – for small and medium-sized enterprises (SMEs) in voluntarily reporting their alignment with the EU taxonomy. It also included recommendations to simplify the reporting process and reduce the burden on SMEs. The study involved the implementation of a survey of approximately 4,400 SMEs across 13 Member States.
Evaluation
Evaluation of the administrative cooperation in direct taxation in the EU
In collaboration with Ramboll and London Economics, this study for DG TAXUD assessed the implementation of EU rules on administrative cooperation in direct taxation between 2018 and 2023. It examined the effectiveness, efficiency, relevance, coherence, and EU added value of Directive 2011/16, identifying key lessons to strengthen the administrative cooperation mechanisms on direct taxation.
Evaluation
Assessment of project building capacity to monitor gender equality in EU candidate countries
Evaluation for the European Institute for Gender Equality (EIGE) of a project seeking to increase the capacity of EU candidate countries and potential candidates to measure and monitor impact of gender equality policies.
Contact: [email protected]
Evaluation
Assessment of private sector engagement in area of forced displacement in Kenya
Managed by IFC, the Kakuma Kalobeyei Challenge Fund (KKCF) is a multi-donor initiative promoting private sector engagement in a refugee-hosting area in Northwestern Kenya. This theory-based, mid-term review of the KKCF covered the six traditional evaluation criteria as well as the cross-cutting areas of fragility/conflict-sensitivity, gender, and environmental & social aspects. It also involved the elaboration of case studies on selected KKCF investees in the agribusiness, education/childcare, financial services, and telecommunications sectors.
Contact: [email protected]
Evaluation
Evaluation of global partnerships for sustainable development
This evaluation covered the US$ 17 million multi-donor Partnership Fund for the Sustainable Development Goals (SDGs) hosted by the World Bank Group, seeking in particular to promote global partnerships for sustainable development (SDG 17). In collaboration with MDF, it involved the assessment of the effectiveness, impact, efficiency, and sustainability of the fund’s portfolio of 50 projects worldwide. It also included an elaboration of the fund’s Theory of Change framework.
Evaluation
Monitoring policy coherence for sustainable development
Revision and operationalization of the monitoring plan of UN-SDG’s Strategy on Policy Coherence for Sustainable Development Strategy in Italy and globally.
Contact: [email protected]
Evaluation
Evaluation of the investment climate in Mozambique
End-of-project performance evaluation of the second phase of the Mozambique Investment Climate Project, an IFC initative aiming to enhance Mozambique’s business environment by improving regulations in areas such as property registration, insolvency resolution, business licensing and registration, and electricity access. The evaluation supported the drafting of the Project Completion Report, but also sought to inform the Government of Mozambique, national counterparts, and other stakeholders of results achieved (including the calculation of compliance cost savings at the impact level)and lessons learned.
Contact: [email protected]