Local Consultant for Integrated Nutrition for Growth Project End-of-Project Evaluation

Local Consultant for Integrated Nutrition for Growth (IN4G) Project End-of-Project Evaluation

1. Organisational context

ChildFund in Laos is the representative office of ChildFund Australia – an independent international development organisation that works to reduce poverty for children in developing communities.

ChildFund Australia is a member of the ChildFund Alliance – a global network of 11 child-focused development and humanitarian organisations reaching nearly 32 million children and their family members in 70 countries. ChildFund Australia is a registered charity, a member of the Australian Council for International Development, and fully accredited by the Department of Foreign Affairs and Trade which manages the Australian Government’s overseas aid program.

ChildFund began working in Laos in 2010 and works in partnership to create community and systems change which enables vulnerable children and young people, in all their diversity, to assert and realise their rights. Projects are implemented in Houaphanh, Xieng Khouang, Phongsaly, Sayabouly, Luang Prabang, Khammouane, Savannakhet, Sekong Provinces and Vientiane capital.

With a focus on upholding child rights and improving access to quality education, ChildFund in Laos also prioritises projects which focus on child nutrition, sexual reproductive health and rights, media literacy, and job readiness.

1. Background

Lao PDR has some of the highest rates of stunting in Southeast Asia with 33% of children under 5 are stunted and 13% are severely stunted; 9% are wasted; 21% underweight (LSIS 2017). Among certain provinces rates are even higher with 41% stunting in Houaphanh Province (and 60% reported in Xamneua District in the SCALING project baseline in 2018), and 46% in Xieng Khouang Province.

Houaphanh also has the country’s second highest wasting rates at 16.4%, almost double the national average (LSIS 2017). Poor, ethnic minority groups, and upland areas of the country are also disproportionately affected, with stunting levels reaching 50% among Hmong-Mien children (a large ethnic group in both Houaphanh and Xieng Khouang provinces). Project staff have observed and received feedback that health facilities are poorly managed, including lack of medical equipment, poor garbage disposal, management of inpatient and outpatient services, and reporting, etc. This affects the demand for healthcare, as community members do not feel there are a good quality of services and therefore do not go. Poor health services also mean that malnutrition detection/growth monitoring services are not effective, with improvements needed to growth measuring practises, case management, and recording in to the health information system.

Most recently CFL has participated in the large nutrition focused consortium project “SCALING - Sustainable Change Achieved through Linking Improved Nutrition and Governance” which covered a comprehensive set of integrated interventions. Integrated Nutrition for Growth (IN4G) Project aims to draw from the expertise and technical components gained from SCALING which focused on multiple contributors to malnutrition including:

• Increasing access to and quality of maternal and child health care (in Houaphanh, 14% of newborns have low birth weight (compared to 6% in Xieng Khouang and and 10% nationally);
• a need to strengthen livelihoods to improve access to health services and nutritious foods (through village savings loans associations);
• improving gender norms to reduce women’s workload and improve women’s agency to care for and feed their themselves and their families;
• improving water and sanitation conditions to reduce infections in children; and
• educating and promoting behaviour change in pregnant women, mothers, caregivers, and youth regarding good health and nutrition (only 24% of children under 2 are fed a Minimum Acceptable Diet).

These approaches also align with the multifaceted causes of malnutrition in Laos as given by several sources (eg. “Nutrition In Lao PDR Causes, Determinants, And Bottlenecks” 2016, World Bank).

CFL is working with NPA partner, the Community Association for Salvation and Environment (CASE), in implementing the project activities in 5 villages in Khoun District, Xieng Khouang. CASE aligns closely in their work to reduce the high rates of malnutrition in Khoun, and is implementing two approaches in a new partnership approach.

The IN4G project signed the MoU with the Ministry of Health in December 2021 and its activities have been implemented in the project areas – 10 villages in Xamneua District, Houaphanh, and 5 villages in Khoun District, Xieng Khouang.

The project has three outcomes:

Outcome 1:Mothers and caregivers, female and male youth improve health, nutrition and hygiene practices at the home and community level.

Outcome performance indicators:

• Percentage of children under 5 with underweight status in project target villages (NPAN Overall indicator 3)
• Percentage of children under 5 with stunting status in project target villages (NPAN Overall indicator 1)
• The knowledge, attitudes and practises of pregnant women and mothers of children <5 are improved (sub-indicators are given in the project proposal).
• Percentage of women who report having greater ability to make key household decisions.
• Percentage of adolescents in lower secondary school (girls and boys with and without a disability) believing women should delay pregnancy until age 18 or over.

Outcome 2:

Formal health facilities better able to provide quality health services to meet the needs of their catchment population.

Outcome performance indicator:

• Health Center scores improved as recorded by Community Accountability Mechanism scorecard are (based on community priorities identified in activity) - Midterm status will be measured by interviews and a case study to show the starting situation at sample health facilities.

Outcome 3:

Local, subnational and national level systems are strengthened and supported to better respond to the nutrition needs of the community.

Outcome performance indicator:

• Provincial and District Nutrition Committees and villages understand and engage in the National Plan of Action of Nutrition (2021-25)

3. Purpose

This project has undertaken a baseline study and a mid-term evaluation. Towards the end of the project, this project requires an external, independent end-of-project evaluation. The evaluation questions should be driven by the OECD evaluation criterion of relevance, coherence, efficiency, effectiveness, impact, and sustainability, as well as cross-cutting issues including children’s right, gender inclusion, disability inclusion, community participation and inclusion of marginalised groups. In the findings, the consultant will also help to highlight the potential lessons learnt, challenges, solutions, and recommendation.

Target audience and key stakeholders of this endline evaluations will be mothers and caregivers, female and male youth, LSS teachers, breastfeeding mothers and health workers and government counterparts from district to provincial level, NPA partner staff (CASE) and ChildFund staff.

The purpose of this evaluation is to undertake an outcome evaluation which to assess the:

1. OECD-DAC criteria

Relevance: The extent to which the project design and project outcomes responded to the needs of individual, group and organisational participants. Addressing the questions relating to hindering and facilitating factors; relevance of interventions to the target groups; utilising the most appropriate interventions.

• Did this project reach the most vulnerable communities?
• Did the project address the highest priority needs of vulnerable mothers and children?
• Was the intervention appropriate and its implementation relevant to the operational context?

Coherence:

• To what extent did the interventions carried out under this project complements the work of broader NPA and government actors with similar programmatic aims? (external coherence)

Efficiency: The extent to which all project activities and outputs outlined in the project design were achieved on time, within budget and with quality. This includes an analysis of the cost-efficiency and value for money of the project interventions versus the benefits from the project and the number of people reached.

• Was adequate human, financial and logistical resources applied to delivering project outcomes? (operational efficiency)
• To what extent did the project adapt the intervention, approaches and methodologies in response to the changing context over the course of the project (response towards project learnings)?

Effectiveness: The extent to which the project objectives and associated key performance indicators (outlined above) were achieved, citing quantitative and qualitative evidences (e.g., change stories),

contributing and hindering factors in all project components at all levels of implementation and project management.

• To what extent the project has achieved its intended outcomes, in relation to the key performance indicators of the project?

Sustainability: The extent to which the capacity of the project stakeholders and partners was built to enable the benefits of the project to continue with/without support from CFL and other external actors. This will also examine what sustainability measures were put in place and what measures should be included should there be a next phase.

• What are evidences showing that project achievements will continue/sustain upon project completion?

• Which components of the project are owned and driven by the communities, partners and relevant government authorities?

• What are the most significant changes the project has contributed towards improved health, nutrition and hygiene practices of mothers, fathers and caregivers, female and male youth at home and community level.

2. Cross-cutting issues

Gender inclusion - The extent to which barriers to participation were identified and addressed, such as promoting gender equity, empowering girls and women, LGBTQ, gender roles and power relations.

• How specific activities impacts the welfare of mother and girls? whether any activities provided opportunity for empowering mothers and girls?

Disability inclusion - The extent to which barriers were identified and addressed, such as access to services, participation in activities and decision-making.

• How are the interventions contributing towards tackling inequality faced by people and children with disability?

Inclusion of vulnerable groups - The extent to which barriers were identified and addressed of identified vulnerable groups, such as access to services, participation in project design, project briefings, activities, decision-making and project feedback.

• How inclusive the intervention has been for different vulnerable groups?

3. Organisational Learning

Drawing from the above two areas, an assessment of project implementation challenges and evidence of promising practices and lessons learnt, ultimately resulting in a set of recommendations to inform both future project design and ChildFund’s Health and Nutrition programming and advocacy to relevant stakeholders.

3.     Key Taks and Responsibilities

It is expected that the consultant(s) to conduct the following tasks:

1. To conduct a desk-review in order to gather and review relevant project documents and reports including the Need Assessment, Baseline Report, Mid-Term Evaluation Report, from ChildFund in Laos and related government and implementing partners.

2. Prepare a detailed inception report for submission to ChildFund for review and approval. This shall clearly describe evaluation methods in detail, data collection tools, work plan to undertake the assignment etc.

3. Focusing on outcomes and their performance indicators (as mentioned above); review and update existing tools and develop new tools if necessary including the Focus Group Discussions, School Observation-Checklists and Key Informant Interview approaches in order to measure the progress towards these outcomes and indicators, as well as output indicators.

4. Train enumerators on both quantitative and qualitative data collection methods.

5. Conduct field level data collection based on agreed assessment tools, maintain quality and accepted norms and standards, lead the data entry and analysis.

6. Develop a comprehensive draft report on findings/results of the study with input from ChildFund/project team.

7. Prepare presentation slides in both English and Lao as well as present findings of the endline evaluations to ChildFund and relevant stakeholders through a workshop.

8. Incorporate comments and suggestions forwarded and produce final report as per the agreed timetable.

9. Methodology

The consultant, in consultation with ChildFund in Laos and ChildFund Australia Health and MEL advisors, is expected to develop the appropriate methodology to collect data.

The methodology and tools have to:

• Strongly support the active participatory approach and engagement from the project stakeholders including vulnerable mothers and children, school principals and teachers, students’ parents and community leaders, government counterparts and ChildFund in Laos staff.
• The methods, data collection and analysis should also consider and include the perspectives of different genders and people living with disabilities (PLWD). The tools used during baseline and midterm assessments should be utilised or modified to suit the need for end of project evaluation, wherever relevant.
• Data collection methods should be guided by the project SMART indicators and other useful information to give a clear picture of the project. The consultant is expected to develop a clear guideline to assist the process.
• Both qualitative and quantitative data should be collected and reported, and data sources clearly cited.
• Tools and methods must coherently respond to the project objectives and performance indicators.

Report:

• The report must be written in English, provide in an electronic format (Microsoft Word and PDF). Raw and analysed data to be submitted by Excel or Word file.
• The actual evaluation report is limited to 30 pages excluding annexes. A maximum 3-page executive summary should be included as part of the report.
• Report format:
  • Table of contents
  • List of Abbreviations
  • List of tables
  • List of figures
  • Executive summary (main findings including the results of the outcome indicators of the project – max 3 pages)
• Background
• Results and key achievements
• Recommendations
  • Introduction providing background information about the project and objectives of the project
  • Purpose of the evaluation
• Key questions
• Approach/Methodology
• Limitations
  • Evaluation Findings (include findings for each Outcome and it’s performance indicators, including 1 case study)
• Relevance
• Coherence
• Efficiency
• Effectiveness
• Sustainability
• Impact
  • Discussions and Recommendations
  • Annexes (include all tools used)

1. Deliverable and Indicative Timetable

Note: this is subject for negotiation with the Consultant

Indicative dates

Outputs and Activities

Number of Days

Week 1 of Jan 24

Review and finalise the ToR

-

Week 2-4 of Jan 24

§  Consultant Recruitment

§  Interview

§  Negotiation and signing the contract

-

Week 1-2 of Feb 24

§  Consultant prepares and presents the Inception Report to CFL and CFA Technical Advisors

§  Work in collaboration with the Senior MEL coordinator, Sydney-based Health and MEL Technical Advisors to develop methodology and review/update tools

3

16/02/24

§  Submit the final inception report

Week 4 of Feb 24

§  Revise the inception report and resubmit it for the final review and approval

Week 1-2 of Mar 24

15/03/24

Data Collection

1.     Data collection in Khoun district, Xiengkhouang province

§  Enumerator training (1 day)

§  Piloting tools (1 day)

§  Data collection in 2 villages (Pieng & Keosead)

4

2.     Data collection in Xamnuea district, Houaphan province

§  Enumerator training (1 day)

§  Piloting tools (1 day)

§  Data collection in 3 villages (Khod, Hanghone, PaYnoug) is 5 Days

Complete data collection

Week 3-4 of Mar 24

Data tabulation and data analysis (7 days)

§  Debriefing/presenting results (1 day)

§  Report writing (first draft) (7 days)

§  Submit the 1st Draft Report (English)

Week 1-2 of Apr 24

§  Incorporate feedback and finalise the second draft report (2 days)

§  Submit the second draft report (English)

§  If any further comments, respond to and incorporate CF’s further comments and feedback and submit third draft/Final Report (1 day)

Total is 30 days

Selection Criteria for Consultant

Core Competencies

• Commitment to ChildFund Australia’s values, vision and mission;
• Teamwork;
• Communication;
• Accountability and integrity; and
• Adaptability and flexibility.

Essential Qualification and Experience:

• At least Master Degree in Health, Public Health, Nutrition, International Development, Monitoring and Evaluation, or related disciplines with minimum five (5) years’ experience in conducting similar evaluation and/or research works in developing countries particularly in South East Asia.
• Relevant experience in development sector around INGOs’ work or relevant agency
• Experience in monitoring and evaluation, and conducting end-of-project evaluation, impact studies, utilizing quantitative and qualitative research methods including data collection techniques and analysis
• Strong experience in community health improvement.
• Familiarity with child‐focused programming;
• Flexible and able to adapt to a multi-cultural environment and complex situations, with demonstrable high-level interpersonal and cross-cultural skills especially with ethnic minorities
• Familiarity with the development context of Lao PDR including relevant language skills;
• Good experience in collaboration and interaction with communities and government bodies from local to national level, especially the Ministry of Health of Laos.
• Strong facilitation skills, particularly with children, youth and ethnic women;
• Self-driven, strong organizational and planning skills, with the ability to work independently or in a group, as well as under pressure
• Fluent in both Lao and English, and showing ability to communicate ethnic languages; Hmong and Khmu would be an asset.

Submission Procedure:

Applications can be made by email to Bamboo HR (linked will be identified when the announcement is launched); all other applications will be rejected. Interested applicants should submit

1. CV of the lead consultant and their team (if any) and a cover letter
2. Technical proposal
3. Financial proposal

NOTE: The financial proposal should specify a total lump sum amount and a breakdown of a daily professional fee and communication costs etc. Applications without a financial proposal will be regarded as incomplete and will not be considered for further assessment.

ChildFund in Laos does not require interested candidates to submit copies of certificates, ID cards or any other information.

ChildFund in Laos is an equal opportunity employer and has a strict child protection policy and background checks will be undertaken prior to any offer of employment.  All candidates should submit two professional referees including their current or most recent employer.

Please submit your application via https://teamchildfund.bamboohr.com/careers/462. before 4:30 pm of 21st January 2024

ChildFund is an Equal Employment Opportunity (EEO) employer and strongly encourage people from all backgrounds, abilities, and identities to apply for any vacancies.