Consultant’s Terms of Reference for Final Project Evaluation of “PG01-008 - Access to Primary Health Care through Outreach Services (APCHOS) Project” in Central Province (Kairuku, Hiri and Rigo) districts

Organisational context

ChildFund Papua New Guinea (CFPNG) is registered as a local NGO under the Papua New Guinea Association Incorporation Act, working to reduce poverty for children in developing communities. ChildFund Papua New Guinea was established by ChildFund Australia, which is a member of the ChildFund Alliance – a global network of 12 member organisations which assists almost 23 million children and their families in 70 countries.

ChildFund began work in Papua New Guinea in 1994 and works in partnership to create community and systems change which enables vulnerable children and young people, in all their diversity, to assert and realise their rights.

Projects are implemented in seven provinces across the country, in both rural and urban settings, with a focus on maternal and child health, nutrition, water and sanitation, education, and child protection and resilience against family and sexual violence. ChildFund PNG also priorities climate change and disaster preparedness.

In 2015, ChildFund PNG established the country’s first ever Family and Sexual Violence Counselling Hotline which operates in Port Moresby and provides national coverage for survivors.

Background

Papua New Guinea (PNG) suffers from a heavy burden of communicable diseases, maternal and child morbidity and deaths[1]. Many health indicators have remained stagnant over the past decade, made worse by an underperforming health system and low government investment. Maternal mortality rates are the highest in the region (between 215 to 733/100,000 live births[2]); child vaccination rates have declined resulting in an outbreak of polio in 2018[3],[4]; TB infection has emerged as a national health emergency[5]; and stunting affects 50% of rural children under 5[6]. These outcomes are further expected to have worsened in the face of the COVID-19 epidemic and its additional burden on already weak essential health services.

The PG01-008 Access to Primary Health Care through outreach services (APCHOS) Project (3 years from July 2019 to June 2022) aims to improve the health and wellbeing of children in Kairuku, Hiri and Rigo districts of Central Province by supporting the delivery of primary health care for mothers and children and building the capacity of the district and provincial health system. The project was initially delivered in 10 wards in Kairuku and 10 wards in Rigo District. (8 wards were existing areas from a previous project PG01-006, and 12 are new expansion areas.) In 2019-20, the project also grew to cover 7 additional new wards in Hiri District.

The project focuses on improving access to Primary Health Care through integrated health outreach services, increasing child vaccinations, strengthening Tuberculosis (TB) control programs, developing community volunteer networks, upskilling of health care workers, and building the capacity of the district and provincial health system. Most recently during the COVID-19 pandemic, CFPNG has also pivoted to support the mobilization of resources and personnel to conduct COVID-19 awareness, prevention, and vaccine promotion activities in Central Province (however this is not reflected in the project proposal prepared prior to the pandemic).

The project has three outcomes, further explained in the project proposal and baseline report. They are:

Outcome 1. Mothers, children and youth improve health, nutrition and hygiene practises at the home and community level.

Outcome 2. Formal health facilities are better able to provide quality health services to meet the needs of their catchment population - particularly focussed on services targeting mothers, children and youth.

Outcome 3. Local, subnational and national level systems are strengthened and supported to better respond to the health needs of the community

A baseline survey was conducted internally in Sept - Oct 2019, with a focus on determining the health and nutrition knowledge and practises of mothers with children under 5 years. This included a quantitative household KAP survey, and supporting FGDs and interviews with male and female adults, youth, health volunteers, and health staff. Health facilities were also observed against checklists of staff, equipment and services. For relevant key indicators, data was also disaggregated by youth (<25yo) and disability status. The final evaluation should use this as a key reference from which to compare progress of the project over the last 3 years.

Purpose

The selected consultant will undertake a summative end of project evaluation in March/April 2022, prior to the project end date on 30 June 2022. The objective of the evaluation is to understand the effectiveness, sustainability, successes and challenges of the main approaches of the projects, and provide recommendations for how technical approaches and project implementation could be improved in future health project design. The results and reports may also be shared back with project stakeholders and government in the interests of learning and accountability.

Due to COVID-19 not being referenced in the project proposal, there are no indicators to compare against, however the consultant should consider how the project has contributed to COVID-19 prevention and response where relevant.

The evaluation should consider design and analysis in line with the OECD DAC Evaluation Criteria[1], including assessment of:

The progress towards the project objectives and performance indicators as outlined in the in the project proposal and baseline report, and evidence of learning outcomes among beneficiaries - taking into account the experiences of female and male youth, men, women, and people and children living with disability;
What are the likely sustainability of outcomes after the project has ended; and
Efficiency of project implementation, including project management, partnerships, cost and timeliness of implementation - highlighting challenges and lessons learned during the project.
The effectiveness and relevance of key approaches/activities compared to local needs and capacities of stakeholder groups.

Scope of Work

The evaluation will take place toward the end of the 3-year project period. It will assess the whole project covering target sites in Kairuku, Hiri and Rigo Districts of Central Province (noting that wards in Hiri were added in the second year of the project and therefore were not sampled in the baseline report). The consultant should suggest an appropriate sampling methodology to consider Hiri District areas, reduce sample size where possible, and maintain statistical validity of results from the target areas.

The evaluation consultant is required to (key outputs in bold):

Review relevant primary and secondary sources of information associated with the project proposal documents, bi-annual and annual reports, baseline report, mid-project review, health facility data and any other relevant project-related materials.
Develop and submit an inception report outlining:
1. the proposed evaluation methodologies and tools relevant to achieving the objectives of the evaluation, and mapped against the project outcome indicators (with technical input and guidance available from the health program manager at ChildFund PNG, and the Health and MELF Advisors at ChildFund Australia)
2. a schedule for the evaluation including tool development, training, data collection, analysis and write up.
3. tools for key informant interviews/FGDs and quantitative KAP questionnaire. Many of these exist from the baseline study but will require review and refinement to ensure they are adequate for the endline.
4. If the consultant is not based in PNG, the report and tools must be finalised and submitted prior to travel to the country.
Include qualitative and quantitative data collection methods, with the consultant responsible for design, leading and documenting Focus Group Discussions (FGDs), key informant interviews, recording of change stories/short case studies from key stakeholder groups, and oversight of the KAP survey.
Design the evaluation and data collection with consideration of the views of different genders, youth, and PLWD
Lead the planning of field data collection, with support from CFPNG project staff. This includes organizing an evaluation team and planning logistics for fieldwork, comprising the consultant team, ChildFund PNG staff, and recruitment of additional enumerators if necessary and budget permits. The consultant should consider local capacities and conduct training on tools and methods prior to data collection.
Ensure quality of the data collection, data entry, data cleaning and data analysis process to meet this evaluation’s expected objectives. Data collection and entry should ensure confidentiality of respondents is respected.
Conduct a workshop to present preliminary findings to ChildFund and ChildFund’s key partners and stakeholders, and use this to seek feedback and validation on key findings prior to the report finalisation.
Produce a draft, and then final report (including data annexes) according to the report format provided below, and in line with workplan timelines. The final reports shall consider feedback from ChildFund and key partners.
To observe ChildFund’s Child Safeguarding policy and the core values of ChildFund PNG
Title Page
Table of contents
Executive summary_(maximum 3 pages, including recommendations)_
Introduction
Evaluation methodology and limitations
Findings against indicators and OECD Evaluation criteria_[1]_ (incorporating sections of gender and disability inclusion, and 1-2 case studies)
Discussion and Recommendations_(including analysis of the strengths and weaknesses of key approaches of the projects to help inform future project design)._
Conclusion
Attachments (additional charts or data, final data collection tools, interview notes and consent forms, full copies of data sets and statistical analysis, and any other relevant attachments).

Methodology

Methods will include a combination of quantitative and qualitative approaches including

KAP survey (to compare key indicators from baseline),
comparison of baseline and endline health facility/department data
triangulation and elaboration of findings through interviews and focus group discussions
case studies highlighting examples of key change (including quotes and quality photos of the subject/s).

Deliverables and Indicative Timetable

Note that the timeline is subject to negotiation with the Consultant

Indicative dates Outputs and activities Number of days for consultant

3rd week March - Contracting and orientation of consultant 3

- Sharing of key documents

· Desk review and preparation of inception report (outlining the evaluation approach and methodologies, workplan and

data collection tools)

· Please allow 3 - 5 days for the ChildFund team to feed back on the report, or consider submitting the inception report in

pieces to facilitate earlier review.

· Pay instalment to consultant

4th - 5th week Mar · Consultant travel to POM

· Enumerator training and Field data collection in Central Province, 10 (2 days training + 2-3 days per district

Kairuku, Hiri and Rigo Districts. depending on travel distance)

1st week April ·Data cleaning and analysis 3-5 days

·Presentation of preliminary findings

2nd week April -Submission of draft report 2 days

·Please allow 1 week for the ChildFund team to feed back on the report

3rd week April -Revision and submission of final reports 2 days

-Final payment to consultant

Total number of days 20-25 days

Management and Reporting Arrangement

The Consultant will report to ChildFund PNG’s Health Program Manager, Olive Oa. The ChildFund Australia Health and/or MELF Advisors will be involved to support review of tools and report. All reports must be written in English and provided in an electronic format (Microsoft Word). Quantitative data sets and analyses must be provided in Excel.

Confidentiality

All discussions and documents relating to this ToR will be treated as confidential by the parties.

Child Safeguarding

The Consultant will undertake the Services to a high standard; use its best endeavors to promote the best interests of ChildFund; protect the reputation of ChildFund and work in a manner consistent with the mission, vision and policies of ChildFund (see Child Safeguarding Policy/Child Safeguarding Code of Conduct PSEAH policy and Employee Code of Conduct). ChildFund Australia has a zero-tolerance policy to abuse, exploitation and harassment in all its forms.

Counter-Terrorism and Anti-Money Laundering

ChildFund Australia acknowledges its obligation under the Australian laws relating to counter-terrorism and anti-money laundering. In order to meet its obligation, the consultant is obligated to provide information required for ChildFund to undertake counter terrorism screening before engagement. The consultant’s name, date & place of birth and ID number will be checked against Department of Foreign Affairs and Trade (DFAT) consolidated list, National Security Australia list, World Banks listing and the Asian Development bank listing to ensure not engage with entities or individuals appearing on the lists.

Conflict of Interest

The Consultant must declare any financial, personal, family (or close intimate relationship) interest in matters of official business which may impact on the work of ChildFund

Fraud and Corruption prevention and awareness

ChildFund Australia has a zero approach to fraud and corruption act. The successful consultant will be required to comply with ChildFund Australia’s fraud and corruption prevention and awareness Policy and act against any form of fraud or corruption and not offer, promise, give or accept any bribes.

Insurance

The successful applicant will be required to have in place insurance arrangements appropriate to provision of the requirement in this TOR including (without limitation) travel insurance.

Acknowledgment and Disclaimer

ChildFund, its Board and staff make no express or implied representation or warranty as to the currency, reliability or completeness of the information contained in this ToR. Nothing in this ToR should be construed to give rise to any contractual obligations or rights, expressed or implied, by the issue of this ToR or the submission of Expression of Interest in response to it. No contract would be created until a formal written contract is executed between ChildFund and a selected consultant.

Selection Criteria for Consultant

At the minimum, the lead consultant must possess the following:

Required experience:

Degree in the field of Public Health, Evaluation, Social Sciences, Statistics, or other related fields.
Minimum 5 years’ experience in community health programming including evidence of leading research and/or project evaluations.
Demonstrated experience using both quantitative and qualitative methods, including design and analysis.
Proven experience in data analysis, presentation methods and report writing.
Good spoken and written communication skills in English (and preferably also Tok Pisin).
Experience working in maternal and child health programs in the Asia Pacific region.
Previous experience working in or evaluating community-based maternal and child health or youth SRH projects, especially in rural areas.
Strong experience of working in challenging environments, particularly remote and low resource settings with people from different cultures and backgrounds.

The Consultant must be available for distance (skype, zoom or MS Teams) and face-to-face meetings, as necessary, and in accordance with any Covid-19 restrictions.

Applications should include:

CV(s) and details of 2 referees
Sample of past work
a proposal indicating competence for the required work, professional fee, brief outline of approaches/methodologies and timeline based on the Terms of Reference.

Full Terms of Reference (ToR) can be downloaded from www.childfund.org.au/work-with-us

Applications closing date: 23 March 2022