Purpose of the Evaluation
- The purpose of the end line evaluation is to independently assess the overall performance, achievements, and results of the ECHO-funded project by measuring progress against baseline values and project targets.
- The evaluation will determine the extent to which the project has improved access to safe, inclusive, and protective learning opportunities for children in the targeted LGAs of Borno State.
- The evaluation will also assess the relevance, effectiveness, efficiency, impact, and sustainability of the project interventions implemented throughout the project lifecycle.
- The findings will provide evidence on the project’s results, identify lessons learned and good practices, and generate recommendations to inform future programming in Education in Emergencies (EiE) and Child Protection interventions in Northeast Nigeria.
- The evaluation will be conducted by an independent external consultant or evaluation team, working in close coordination with Plan International Nigeria and its partner CASFOD.
Child rights, gender and inclusion:
- The evaluation will apply a child-centred and inclusive approach consistent with Plan International’s Child and Youth Safeguarding Policy and Ethical MERL Framework.
- Special attention will be given to the participation of girls, boys, children with disabilities and other vulnerable groups.
- Data collection tools will incorporate gender-sensitive and disability-inclusive approaches, including the use of the Washington Group Short Set questions to capture disability-disaggregated data where appropriate.
- Participation of children in the evaluation will be voluntary, age-appropriate and conducted in safe environments with appropriate consent procedures.
Users of the Evaluation:
- The findings of the end line evaluation will be used by multiple stakeholders to inform decision-making and learning.
Primary users include:
- Plan International Nigeria programme and MERL teams
- Unique Care and Support Foundation (CASFOD)
- GoalPrime Organization Nigeria.
- DG ECHO and Sweden & Finland National Organisation (SNO & FLNO)
- Ministry of Education and relevant government education authorities
- Education sector coordination platforms and implementing partners.
Evaluation Design:
Overall Evaluation Approach:
- The evaluation will adopt a mixed-methods approach, combining quantitative and qualitative methods to generate a comprehensive assessment of project outcomes and results.
- The external consultant will build on the methodology used during the baseline assessment to ensure comparability of results across key project indicators.
- The evaluation will measure progress across the project’s result areas including:
- Access to formal and non-formal education
- Quality of teaching and learning
- Safe and protective learning environments
- Community resilience and disaster preparedness capacity
- The evaluation will include document review, primary data collection, and triangulation of multiple data sources to ensure reliability and validity of findings.
Methods for Data Collection and Analysis:
- The evaluation will involve a combination of primary and secondary data collection methods.
- The consultant will conduct a desk review of relevant project documentation including the project proposal, logical framework, baseline assessment report, monitoring data, distribution records, training reports, and other relevant project documents.
- Primary data will be collected through structured surveys administered to selected beneficiaries and stakeholders in the target communities.
- Qualitative data will be collected through Focus Group Discussions (FGDs) and Key Informant Interviews (KIIs) with children, parents or caregivers, teachers, SBMC members, community leaders, and government officials.
- Digital data collection platforms such as Kobo Toolbox may be used to improve efficiency and data quality.
- The consultant will ensure proper data validation, cleaning, and analysis procedures.
- Quantitative data will be analysed using descriptive statistical methods and compared with baseline values to measure changes across key indicators.
- Qualitative data will be analysed through thematic content analysis and triangulated with quantitative findings to strengthen interpretation of results.
Participant selection and recruitment:
- Participants will be selected from the project implementation areas of Mobbar, Damboa, and Kala Balge LGAs in Borno State.
- The evaluation will include a diverse group of stakeholders including:
- Children enrolled in formal and non-formal education programmes
- Teachers and education personnel trained under the project
- Parents and caregivers
- School Based Management Committee (SBMC) members
- Community leaders
- Government education officials
The consultant will ensure that the sample includes adequate representation of girls and boys, women and men, and persons living with disabilities.
Sampling Approach:
- The consultant will propose a sampling strategy that ensures representation of the target population across the project locations.
- Quantitative respondents may be selected using random or systematic sampling techniques, while qualitative participants will be selected using purposive sampling to capture perspectives from key stakeholder groups.
- The sampling approach should allow comparison with baseline findings where possible, to measure changes in key project indicators.
Ethics and Safeguarding:
- Plan International is committed to ensuring that the rights of individuals participating in data collection are respected and protected in accordance with its Ethical MERL Framework and Child and Youth Safeguarding Policy.
- The external consultant must ensure that all evaluation activities are conducted in line with ethical research standards.
- Participation in the evaluation will be voluntary and based on informed consent.
- Confidentiality and anonymity of respondents must be guaranteed throughout the data collection and reporting process.
- Special safeguards must be applied when engaging children in the evaluation.
- Parental or guardian consent must be obtained prior to participation, and data collection with children must be conducted in safe and child-friendly environments.
Budget:
- The evaluation will be conducted by an independent consultant or evaluation firm contracted by Plan International Nigeria.
- The budget will cover professional consultancy fees as well as operational costs associated with the evaluation such as travel, data collection logistics, enumerator costs, and report production.
- Payment to the consultant will be made based on agreed milestones and submission of deliverables as outlined in the contract.
Expected Qualifications
The external consultant or evaluation team should possess the following qualifications:
- Advanced Degree in education, social sciences, development studies, monitoring and evaluation, or a related field.
- Demonstrated experience conducting programme evaluations in humanitarian or development contexts.
- Strong expertise in Education in Emergencies (EiE), Child Protection, or related sectors.
- Proven experience using mixed-methods research methodologies including quantitative and qualitative approaches.
- Experience conducting evaluations in Northeast Nigeria or similar fragile and conflict-affected contexts is highly desirable.
- Strong analytical and report writing skills in English.
Evaluation Scope of Work:
- The consultant will lead and coordinate the overall assessment process. Specifically, the consultant will undertake the following:
- Prepare a technical proposal with a work plan (Gantt Chart) and a separate financial proposal and submit it to Plan International Nigeria for review not later than the date specified in the announcement.
- Hold preliminary discussions with the Country MERL Manager/Coordinator/Officer, Project coordinators and key stakeholders.
- Design appropriate data collection methodology, tools and sample size to align with the baseline and midline assessment
- Develop appropriate training and field manual in the local language to guide the data collection process.
- Design and manage training for supervisors and interviewers/data collectors.
- Oversee the data collection process to include: assessment pre-test/Pilot test; and ensure effective management of data collection teams by supervisors.
- Produce a draft report on findings (per the required format and data request).
- Incorporate comments from the project team into the draft report and produce a final report.
- De-brief the project team and other Plan International employees both at the field and country office (after the initial field trip and upon submission of the report).
- Coordinate with the project team to disseminate study findings to respondents and other stakeholders.
- Prepare and submit an electronic copy of the raw data and final report, and two hard copies of the final report within the specified time of agreement.
- Produce a final report and make relevant amendments/enrichment based on the draft report comments.
Inception report including:
- An updated timeline
- A detailed methodology including draft sampling methodology and size
- Review data collection tools
- Ethical and safeguarding considerations and risk assessment
- Consent forms for any primary data collection
- Craft methods for data analysis and quality control
- A brief justification of the methods and techniques envisaged (including relevant underlying values and assumptions/ theories) with a justification of the selection made.
Final data collection tools;
- Final Sampling methodology (including unit of sampling and sampling frame);
- Draft endline evaluation report, including cleaned data files (e.g. Excel, SPSS, Kobo toolbox…), transcripts of qualitative data syntax/ code books etc. and completed consent forms (including for children and their caregivers and adults;
- Final endline evaluation report including an Executive Summary and indicators monitoring table with reference data;
- Other communication products to disseminate.
Plan International’s Responsibilities:
- The MERL Coordinator/ Officer with support from other staff on the Project will facilitate the following responsibilities:
- Provide consultants with relevant Project documents.
- Link consultants to relevant stakeholders in Borno.
- Supervise the training of field enumerators in Borno.
- Ensure effective coordination of the study logistics to facilitate the consultant(s) in undertaking the assignment.
- Consolidate Plan International’s comments for incorporation by the consultants.
- Provide additional information as required.
Gmail
Yahoomail