2. Purpose and objectives of the evaluationMandate for conducting evaluation: SNV has implemented SWaSSH4A since 2022 and is, as a partner of the Austrian Development Agency, mandated and interested in conducting a final project evaluation. As per the project document (section 7.2), the end-of-project evaluation will be outsourced. The TOR at hand describe the corresponding assignment for which SNV seeks to hire a consulting team.Purpose of the evaluation: The main purpose of this evaluation is learning and accountability for better project design and implementation in the future.Users of the evaluation: SNV will use the evaluation results for learning and designing future projects. ADA is the second main user of the evaluation results.The key objectives of the final evaluation are:<ol><li>To assess the project's Relevance, Effectiveness and prospects for Sustainability</li><li>To identify facilitating and hindering factors for results achievement</li><li>To document lessons learned and good practices, and good practices, and</li><li>To provide practical recommendations based on the findings.</li></ol>3. ScopeThis evaluation will assess the relevance, effectiveness and prospects for sustainability of the SWaSSH4A from the project design phase (end 2020 to October 2022) to its implementation up to the end of data collection of this evaluation (November 2022 to early October 2025). The evaluation will cover all output areas of the project as summarised under section 1.3 (project background).Geographical scope: The evaluation will generally cover all 4 districts where the project is being implemented, with a deeper analysis in a sample of the 34 project sub-counties (Table 1).Project districts and SubcountiesAlebtong:    Omoro, Adwir, Angetta, Amugu, Abako, Awei, Aloi, Akura, Abia and ApalaDokolo:       Kangai, Adeknino, Kwera, Okwongodul, Dokolo, Okwalongwen, Bata, Amwoma,   Agwata &amp; AdokKole:           Akalo, Bala, Ayer, Aboke, Okwerodot and AlitoLira:            Awiodyek, Agali, Itek, Bar, Ogur, Agweng, Aromo and AyamiApplicants for this assignment are asked to suggest, in their technical offer, a sampling strategy that ensures sampled Subcounties and villages are equally spread over the 4 project districts. The sampling strategy should start from the 51 villages with rehabilitated boreholes under the project combined with other criteria such as flood-prone areas, hard to reach areas, and high demand water sources. Beyond the villages with rehabilitated boreholes, the sampling strategy should also include villages with water sources that were repaired or have benefited from Operation and Maintenance Systems. The sampling strategy will be refined during the inception phase. Data collection in the field includes a minimum of 10 villages.In terms of evaluation criteria assessed, the evaluation will be limited to relevance, effectiveness and prospects for sustainability of the SWaSSH4A project. As part of the assessment of relevance, effectiveness and sustainability, the evaluation will also assess how the project contributed to gender equality (OECD-DAC policy marker on Gender equality (Marker 1) and how and with which results (and against which challenges) it applied the Gender, Equity, and Social Inclusion (GESI), The OECD-DAC evaluation standards as well as the ADA PP Evaluation Guidelines are to be used as framework for this evaluation.4. Evaluation QuestionsRelevance: <ol><li>To what extent does the project address the specific WASH needs of vulnerable groups (women, persons with disabilities, poor households) and the affordability of services for the poorest wealth quintiles in the project districts?</li><li>How well has the project aligned with Uganda’s National Development Plan III, national WASH targets, and the climate resilience of WASH infrastructure by local governments and how could the contribution/relevance to national WASH priorities and goals have been enhanced/be enhanced in future?</li></ol>Effectiveness: <ol><li>To what extent have the project’s intended results been achieved, and what factors influenced (non-) achievements and how? Can unintended results be identified. and if so, which ones?</li><li>To what extent and how has the project enhanced women and girls’ access to water, sanitation and hygiene, promoted their participation in decision-making processes and enabled them to equally exercise their rights?</li><li>To what extent and how has the project strengthened the capacity of the district and subcounty local governments and line agencies (MWE Rural Water and Sanitation Regional Centre 1) to lead and institutionalise quality sanitation demand creation and rural water supply development, including Behaviour Change Communication (BCC) for WASH?</li><li>How effective are the Water Source Committees and other supportive structures (Handpump Mechanics/ Association) in ensuring proper Operation and maintenance of water facilities, as well as ensuring water safety and service continuity? What good practice and challenges can be identified in this context?</li></ol>Prospects for sustainability: <ol><li>What is the likelihood that the responsible governance structures (DWSCCs, SWSSBs, WSCs, HPMA) and established multi-stakeholder coordination mechanisms, will continue to sustain achieved results after project closure and why?</li><li>To what extent are water supply services financially sustainable at the WSC level, and are water tariffs affordable and accessible to the poorest households (short-, mid- and long term and how can challenges in this context be addressed?</li><li> How resilient are the WASH systems and infrastructure to climate-related risks such as flooding and drought, and what measures are in place to ensure their durability and continued service delivery?</li></ol>5. Design and ApproachThe evaluation will follow ADA evaluation guidelines and OECD/DAC norms and standards, as well as common ethical criteria for evaluations, ensuring the highest levels of integrity and accountability. The evaluation should be gender sensitive, participatory and respect the rights and dignity of all involved and promote a learning approach. Stakeholder and community engagement should be done by applying the principles of informed consent, confidentiality, transparency, and a focus on the common good. The consultant/s will propose a methodology and are expected to deploy multiple methods, drawing on different sources and triangulating information to successfully deliver this assignment. A human rights-based approach (HRBA), ADC’s cross-cutting issues, as well as the basic principles and quality standards applying to ADA’s programme and project design, should be incorporated in the methodology.The following data collection methods are suggested and deemed sufficiently rigorous to allow for a complete, fair and unbiased assessment. In the technical proposal, the evaluators will suggest how to use these (and others) to conclude the assessment with the utmost quality.<ol><li>Document Review (secondary Data): The evaluators will review: the baseline and midline reports, project proposal (budget, log frame), workplans, project reports (technical and financial), programmatic monitoring data collected and analysed using a data management platform, project publications (conference contributions, technical briefs and case studies) and any other documents deemed critically important for the evaluation</li><li>Onsite visual observation: In conjunction with other methods, the evaluator will observe community water use conditions and O&amp;M-related activities, household sanitation and hygiene facilities, ask questions, visit communities, water sources, sub-counties and districts and make sketches, take photographs or videos, etc)</li><li>Key informant interviews: Semi-structured interviews will be conducted with key informants (groups or individuals) including project staff, SNV´s local partners staff, sub-county and district officials, Water User Committee (WUC) members, Sub-county Water and Sanitation Board (SWSSB) members, ADA staff, Ministry of Water and Environment (MWE) officials at RWSC 1, local leaders of the target communities, beneficiaries, Hand Pump Mechanics (HPMs) and representatives of their associations, spare parts dealers, other development partners and organisations as relevant.</li><li>Focus Group Discussions (max. of 4-8 people each group): including community members across wealth and social groups, women and men, people with disabilities, the elderly and youth.</li></ol>In their technical proposal, the evaluation team may suggest which methods are used to assess which areas of analysis and gather information from groups of informants. Specifically, the evaluators should review the evaluation questions and add from their experience as well as indicate how the data and information to answer the questions will be obtained and analysed. The Evaluation report (in an annex) should capture all details of the evaluator's own data and information collection (questionnaires, group compositions). All documents gathered and generated, including photos, will be handed over to SNV at the end of the assignment in a well-structured manner.For the assessment of outputs, the evaluation can use the project´s programmatic monitoring data and the results and data of the baseline and midline surveys. Surveys to collect WASH coverage data at individual households are thus not foreseen under the evaluation. It should be mentioned that an endline survey is planned following parallel with the evaluation, and drawing on its draft results might be possible.6. Timeline and Deliverables6.1 TimelineThe evaluation is expected to be conducted between end of August to end of October 2025.The following deliverables are to be produced and submitted as part of this assignment:<ul><li>Draft and final inception report with a work plan, refined and based on technical proposal (maximum 10 pages, excluding annexes), in line with the structure and content requirements of Annex 5 of the ADA Guidelines for Programme and Project evaluations.</li><li>Presentation of preliminary findings (virtual meeting)</li><li>Draft and final evaluation report (not more than 30 pages excluding annexes), in line with the structure and content requirements of Annex 6 of the ADA Guidelines for Programme and Project evaluations.</li><li>Completed Result-Assessment Form (RAF), submitted together with the draft evaluation report</li><li>Physical Presentation of final evaluation results at regional and national dissemination workshops</li></ul>The inception report, evaluation report, and RAF need to fulfil ADA standards for program and project evaluations and will be quality checked by SNV and ADA before approval.The estimated number of working days needed for this assignment are 100. For details see below:Milestones/deliverables and timeline1. Evaluation kick-off/Inception meeting (1) by Mid September2. Document Review, Preliminary Interviews and Draft and Present Inception Report (12) by Mid-September3. Finalise Inception Report, addressing feedback by SNV and ADA (during meeting and in written on the report) (3) by End September4. Data collection in the field (District, Subcounty, Village Levels) and Virtual (60) by October5. Data processing and analysis (7) by October6. Presentation of Preliminary Findings and submission of Draft evaluation report with Results AssessmentForm (RAF) (12) by End October7. Finalise evaluation report with RAF addressing Feedback by SNV and ADA (5) End OctoberThe evaluation team is responsible for preparing a comprehensive report which presents findings to address the evaluation questions, highlight key changes as a result of the project intervention draw out lessons learned, present findings and recommendations. The report should reflect comments and feedback received from stakeholders. The evaluation team should refer to the ADA guidelines for the structure of the evaluation reports (Annex 5). The language of the report should be English, with no jargon and with specialist terms explained.The recommendations must be related to the conclusions without replicating them. A recommendation derives directly from one or more conclusions. Recommendations should be as realistic, operational and pragmatic as possible; that is, they should take careful account of the circumstances currently prevailing in the context of the project, and of the resources available to implement them. They could concern policy, organizational and operational aspects for both SNV and ADA.The evaluation deliverables to be generated by the evaluation team include:1. Draft and Final Inception reportThe evaluators will prepare an inception report which details the evaluator’s understanding of the evaluation and how the evaluation questions will be addressed. This is to ensure that the evaluators and the stakeholders SNV and ADA have a shared understanding of the evaluation. The inception report will include the evaluation matrix summarising the evaluation design, methodology, evaluation questions, data sources and collection analysis tool for each data source and the measure by which each question will be evaluated. (for structure and content requirements, see Annex 5 on quality checklist for Inception Report). The draft inception report will be reviewed by SNV and ADA, and the Final Inception Report should be submitted two (2) weeks from the date of contract signing.2. Draft and final evaluation reportThe evaluation team will prepare a draft Evaluation Report for the project, cognizant of the proposed format of the report and checklist used for the assessment of evaluation reports (for structure and content requirements, see Annex 6 of ADA guidelines). The draft report (max. 45 pages excluding Annexes) will be reviewed by SNV and ADA to ensure that the evaluation meets the required quality criteria. The report will be produced in English. The consultant needs to prepare a presentation of the preliminary findings and share it with SNV and major stakeholders.  A completed Results- Assessment Form (RAF) must be submitted together with the draft evaluation report (Annex 9 of the guidelines). Report to be coherently structured with a logical flow       3. The final report (30-50 pages) for the project will include comments from SNV and ADA and will be submitted 5 days after receiving all the comments. This will be submitted to SNV through the SWaSSH4A Project Manager for validation. It will include recommendations (for future programming and to inform policy) and conclusions. (See Annex 6 of ADA guidelines for Quality Checklist for Evaluation Report). The end of project evaluation report should be by 23rd October 2025.Payment ScheduleThe consultant will be paid in three instalments as indicated below.Payment                           Deliverable to trigger payment                    % of contract amount payable1st Instalment                   Inception report for the assignment                                      30%2nd Instalment                  Draft evaluation report                                                          40%3rd Instalment                   Final evaluation report                                                          30%The contract price will be fixed regardless of changes in the cost components.7. Evaluation Management ArrangementsThe evaluation will be managed by SNV in collaboration with a review panel that includes representatives from SNV and ADA, with the SWaSSH4A project manager serving as the main focal point, supported by the project team, to ensure that all deliverables meet the Terms of Reference. The evaluation management team will uphold the OECD/DAC principles, particularly impartiality and independence, throughout the process.It is SNVs responsibility to avail data and documents as listed above and assist the evaluators in getting in touch with the relevant key informants and provide contacts and information to organise group discussions. It is the responsibility of the evaluators to follow up, plan and schedule for the activities. The evaluators are responsible for logistics arrangements (travel, accommodation). SNV shall not bear any cost.Responsibilities of the Team Leader<ol><li>Finalise the evaluation questions, methodology, and work plan in consultation with the evaluation manager.</li><li>Review background materials and conduct initial research and analysis.</li><li>Develop a detailed schedule for fieldwork and other activities, including time for unexpected delays.</li><li>Assign roles and responsibilities within the evaluation team, ensuring gender balance and efficient use of time.</li><li>Coordinate with SNV and other partners to ensure timely and high-quality fieldwork.</li><li>Lead the fieldwork, including interviews, focus group discussions, and other data collection methods.</li><li>Keep the evaluation manager and stakeholders informed, especially if there are changes or challenges, as well as a list of people to be interviewed, planned visits, and team member responsibilities.</li><li>Analyse the data collected and develop findings, conclusions, and practical recommendations.</li><li>Present preliminary findings to the evaluation manager, SNV, and other relevant teams.</li><li>Prepare and revise the final report, executive summary, and annexes based on feedback from SNV and ADA.</li><li>Ensure the evaluation process is objective, inclusive, and meets quality standards.</li><li>Lead the writing of all reports and ensure they are delivered within the agreed timeframe.</li><li>Participate in regional and national-level dissemination</li></ol>Responsibilities of SNV (Evaluation Manager)<ol><li>Participate in the kick-off meeting to ensure everyone understands the purpose, scope of the evaluation and ensure standard templates are used.</li><li>Provide all relevant background documents, including previous evaluations, reports, studies, existing data and information that will support the evaluation.</li><li>Provide information on SNV´s approach to using score cards to assess progress in governance through facilitated discussion and scoring in groups and with key informants</li><li>Write an official letter to introduce the evaluation expert or team to key stakeholders.</li><li>Review and give feedback on the draft inception report and formally approve it before data collection starts.</li><li>Participate in meetings with the evaluation team to monitor progress and provide technical guidance.</li><li>Ensure the evaluation remains independent and objective throughout the process.</li><li>Facilitates dissemination workshops at the regional and national level (outside this assignment, expert/team participates only).</li></ol>

SNV is a mission-driven global development partner strengthening capacities and catalysing partnerships&nbsp;that can transform the agri-food, energy, and water systems.

Consultancy for Final Project Evaluation

About the Job

About the Company

SNV

Similar Jobs

Consultancy on Aquaculture Industry Analysis

Consultancy on Aquaculture Industry Analysis

Consultant-Capital Project Delivery

Consultant-Capital Project Delivery

Research Economist (Tourism and Real Estate Development) - Hong Kong

Research Economist (Tourism and Real Estate Development) - Hong Kong

Request for Expressions of Interest for consultancy service to support the Knowledge Management, communications and reporting tasks

Request for Expressions of Interest for consultancy service to support the Knowledge Management, communications and reporting tasks

Private Sector Coordinator

Private Sector Coordinator

Consultant as Social Research Assistant (Jayapura based)

Consultant as Social Research Assistant (Jayapura based)

Country Program Leader – Agri-food, Energy and Water

Country Program Leader – Agri-food, Energy and Water

Environmental Impact Assessment (EIA) Specialist

Environmental Impact Assessment (EIA) Specialist

Learning and Knowledge Management Advisor (Re-advertised)

Learning and Knowledge Management Advisor (Re-advertised)

Senior Social Consultant

Senior Social Consultant