Final Evaluation (Haiti Health and Wash Cholera Prevention Programme: Phase 1 and Phase 2)
The International Federation of Red Cross and Red Crescent Societies (IFRC) is the world's largest humanitarian organization, with 192 member National Societies. As part of the International Red Cross and Red Crescent Movement, our work is guided by seven fundamental principles; humanity, impartiality, neutrality, independence, voluntary service, unity and universality.
The IFRC global strategy, aligned with the Ending Cholera Roadmap 2030 and the Global Task Force on Cholera Control (GTFCC) strategy, focuses on interventions in hotspots, geographic areas which constitute greater cholera burden and from where the disease regularly spreads further within other areas in the country. Supporting the HRC National Society, the RC Movement actions are aligned with the IFRC global strategy for cholera elimination, strengthening the community resilience and local capacity building to tackle the epidemic and the National Plan for Cholera Elimination (Long-Term Plan - a continuation and an update of the Medium-Term Plan). In 2018, the Swedish Red Cross begun providing financial support for the joint programming of the IFRC and the HRC for cholera management in Haiti. The support was initially provided for one year and continued support was thereafter approved also for a second year. With no-cost extensions, the full programme period has been from 1 January 2018 to 30 June 2020.
The overall purpose of this evaluation is to provide the Secretariat of the International Federation of Red Cross and Red Crescent Societies (IFRC), the Haitian Red Cross (HRC), Swedish Red Cross and other stakeholders and donors with an adapted learning process to the current challenges facing implementation and to highlight the achievements of the 2018 – 2020 Haiti Health & Water, Sanitation and Hygiene (WASH) – Cholera Prevention Programme, Phase I and Phase II
This evaluation will be used by IFRC senior management, Haitian Red Cross Governance, Management, Health Technical teams, HRC branch representatives in Department of Centre (Lascahobas, Mirebalais) and Artibonite Department (Dessalines and Petite Riviere), the Swedish Red Cross, Head of Country Cluster Support Team, Program Managers, and Haiti Health and Water Sanitation authorities to plan, inform and guide future joint programs.
It is intended that this evaluation will cover an appropriate sample of the areas in which activities have been implemented under the programme. For this evaluation, a comparative study will be made between the baseline situation and the current situation, aiming at the level of increased knowledge, attitude and practices on cholera, other waterborne diseases and hygiene and sanitation practices.
Phase I - Artibonite Department
- Municipality of Dessalines
- Municipality of Petite Riviere
Phase II – Department of Centre
- Municipality of Lascahobas
- Municipality of Mirebalais
The time to be assessed: entire implementation:
- From January 2018 to May 2019 - Phase I
- From June 2019 to June 2020 - Phase II
Job Duties and Responsibilities
The proposed methodology for this final evaluation, considering Haiti’s security context and COVID-19 containment and social distancing measures, is an adapted and remote learning process that can systematize the achievements of the programme through:
Conducting a desk review of documentation of the Cholera Prevention Programme Phase I and Phase II in Haiti and related information. This will include the Funding Proposal, Plan of Action, Progress reports and M & E data:
- Logical Framework
- Baseline study and endline survey (please see below)
- Risk Register
- Activity Schedule
- Activity Based Budget
- Monitoring and Evaluation Plan
- Data means of verification
- Indicators Tracking Table
- Progress narrative reports
- Documentation from external factors such as
- International Red Cross Movement Partner in Haiti
- Ministry of Public Health and Population (MSPP) Health Directorate for Centre Department
- DINEPA: National Water Supply and Sanitation Directorate under the Ministry of Public Works, Transport and Communications (MTPTC)
- World Health Organization (WHO)
Primary data collection: management of the endline survey.
Interview session with the project team
- The evaluator will have the opportunity to have an interview session with the entire project team, both at the management level and at the field implementation level, in order to get a good understanding of the context and to see with the field team all that has been achieved in terms of activity.
- IFRC Community Health Project Manager
- IFRC other team members (Finance, PMER, logistic)
- Project Field teams (Hygiene Promotion Officer, WASH Officer)
- Haitian Red Cross National Society representatives (volunteers, health staff at headquarters and related branches, management and others considered appropriate)
- The evaluator will review and adapt, if necessary, the survey format and data collection methods used by the Haitian Red Cross volunteers to carry out the baseline study in the municipalities of Dessalines and Petite Riviere (Artibonite Department) and Mirebalais and Lascahobas (Centre Department. The baseline surveys for Phase I and Phase II of the Programme will be considered when developing the end line survey. To be able to measure the different indicators and highlight geographical variations, the sampling should stratify at the level of communes and communal sections. To obtain statistically representative results for these two axes of analysis, the size of these samples should be calculated by weighing them according to the size of the populations of each communal section.
- The evaluator will identify, supervise, and train Haitian Red Cross volunteers to collect the necessary data for the endline survey through telephone or online surveys with the following key informants:
- Direct target population
- Head of households
- CBS network representatives
- Students (boys/girls)
- Other considered appropriate
- HRC representatives (volunteers, health staff at headquarters and related branches, management and others considered appropriate)
- Community leaders
- IFRC team members
- Local and national authorities
- The evaluator will carry out some qualitative interviews with selected community members/target population, to triangulate and verify the results of the endline survey.
- To carry out the survey, interviewers and supervisors will be selected in collaboration with the local branches of the Haitian Red Cross-National Society in each municipality.
- The criteria for selecting interviewers are as follows, keeping in mind the importance of a diversified group of surveyors of different ages and gender:
- Haitian Red Cross volunteer
- Knowledge of WASH and Cholera
- Residents of the areas of implementation (Dessalines, Petite Riviere, Mirebalais and Lascahobas)
- Availability for the entire duration of the survey
Since the situation related to Covid-19 will not allow us to make home visits aimed at evaluating the practice of certain knowledge related to water treatment and handwashing and others at the household level, if the situation arises, we will ask some beneficiaries to film certain moments of water treatment and handwashing in the family environment.
Highlight relevant and effective initiatives implemented in the Cholera project, which benefit the communities of Dessalines, Petite Rivière, Lascahobas and Mirebalais and which have been useful automatically with the current context of COVID-19.
It is expected that the evaluator will analyse, validate, and adjust the proposed methodology to assess programs level of implementation and achievements. If necessary, provide, a counter proposal that enables the evaluator to conduct the process with high quality, while also attending to the expected results.
- Evaluation Survey and schedule for interviews– The evaluator will validate the proposed methodology and create the surveys and interviews to be conducted.
- Guidance note for surveyors –The evaluator will develop a guidance note for volunteers conducting the surveys in order to ensure that the process is conducted in a coherent and systematic manner.
- Draft Report/s. The evaluator will produce a draft report after the debriefing, which will be reviewed by the IFRC Health Team, IFRC PMER team, and the Swedish Red Cross.
- Final Report.A Final report will be submitted within 10 days of receiving the feedback from the draft report.
- Academic background in public health, international development, social development, evaluation or research.
- More than 3 years of evaluation experience, especially for development and public health programs.
- Experience in creating and using remote data collection tools.
- Extensive experience in the evaluation of both urban and rural programs and or Cholera Prevention programming and evaluation.
- Experience working in both emergency and longer-term contexts (recommended)
Knowledge, skills and languages
- The ability to design/utilize appropriate evaluation tools with knowledge of data gathering techniques and demonstrated ability to understand and analyse collected data.
- Understanding of low-capacity environments, with experience in supporting capacity-building efforts for different programme stakeholders.
- Excellent written and spoken Creole and English
- Experience training local staff to serve as data collection agents recommended.
- Strong computer skills in spreadsheet, word processing, and statistical analysis software familiarity
Fluent spoken and written Creole and English
Competencies and values
Evaluation Quality & Ethical Standards
The evaluators should take all reasonable steps to ensure that the evaluation is designed and conducted to respect and protect the rights and welfare of people and the communities of which they are members, and to ensure that the evaluation is technically accurate, reliable, and legitimate, conducted in a transparent and impartial manner, and contributes to organizational learning and accountability. Therefore, the evaluation team should adhere to the evaluation standards and specific, applicable process outlined in the IFRC Framework for Evaluation. The IFRC Evaluation Standardsare:
- Utility: Evaluations must be useful and used.
- Feasibility: Evaluations must be realistic, diplomatic, and managed in a sensible, cost effective manner.
- Ethics & Legality:Evaluations must be conducted in an ethical and legal manner, with regard for the welfare of those involved in and affected by the evaluation.
- Impartiality & Independence: Evaluations should be impartial, providing a comprehensive and unbiased assessment that considers the views of all stakeholders.
- Transparency: Evaluation activities should reflect an attitude of openness and transparency.
- Accuracy: Evaluations should be technical accurate, providing enough information about the data collection, analysis, and interpretation methods so that its worth or merit can be determined.
- Participation: Stakeholders should be consulted and meaningfully involved in the evaluation process when feasible and appropriate.
- Collaboration: Collaboration between key operating partners in the evaluation process improves the legitimacy and utility of the evaluation
It is also expected that the evaluation will respect the seven Fundamental Principles of the Red Cross and Red Crescent: 1) humanity, 2) impartiality, 3) neutrality, 4) independence, 5) voluntary service, 6) unity, and 7) universality.
Interested candidates should submit their application material by June 7, 2020. Application material is non-returnable, and we thank you in advance for understanding that only short-listed candidates will be contacted for the next step in the application process.
Application materials should include:
- Curriculum Vitae (CV)
- Cover letterclearly summarizing the experience of the consultant(s) proposed as it pertains to this evaluation, daily rate, and three professional references.
- Short methodological proposal to address in this evaluation. Please include data collection method, data analysis method, among others.
- At least two examples of an evaluation report most similar to that described in this TOR.
Due to the current travel restrictions related to COVID 19. Preferrably, the evaluator should already present in Haiti.