Technical Lead – Impact Evaluation at Jhpiego - John Hopkins University

Overview

• The Team Lead / Impact Evaluation Expert will provide overall technical, methodological, and strategic leadership for the Impact Evaluation of the C19RM investment.
• The role serves as the Lead Impact Evaluator, responsible for ensuring that the evaluation is scientifically rigorous, methodologically defensible, and credible to national stakeholders and donors.
• The Team Lead will lead the design and interpretation of the evaluation, provide final authority on methods and findings, and ensure that outputs clearly demonstrate before–after change, contribution, and systems-level impact across C19RM thematic domains.
• While day-to-day analysis and coordination are delegated, the Team Lead retains ultimate accountability for evaluation integrity and quality.

Responsibilities
Evaluation Leadership & Methodological Oversight:

• Provide overall leadership for the impact evaluation design, ensuring alignment with internationally recognized evaluation standards (e.g., OECD-DAC).
• Approve and oversee the evaluation framework, theory of change, and analytical approach, including before–after and quasi-experimental comparisons where feasible.
• Ensure appropriate integration of quantitative, qualitative, and systems-level evidence to demonstrate contribution and impact.
• Provide final methodological sign-off on sampling strategies, indicator selection, attribution logic, and analytical assumptions.

Technical Oversight of Analysis & Evidence Generation:

• Provide technical supervision to the Research Managers, ensuring coherence between quantitative findings, qualitative insights, and thematic interpretations.
• Review and challenge analytical outputs, dashboards, scorecards, and synthesis narratives to ensure validity and clarity.
• Ensure triangulation of data sources (routine data, program documents, field findings, stakeholder perspectives).
• Guide interpretation of findings to ensure conclusions are evidence-based, balanced, and defensible.

Reporting, Synthesis & Knowledge Products:

• Lead and approve the structure, framing, and key messages of the Impact Evaluation Report and End-of-Project Report.
• Ensure findings are clearly articulated in donor-appropriate language, aligned with national and Global Fund frameworks (IHR, NAPHS, NHSRII).
• Review and approve thematic chapters, executive summaries, recommendations, and policy-relevant insights.
• Support development of dissemination materials, including presentations, policy briefs, and validation workshop outputs.

Stakeholder Engagement & Validation:

• Serve as the primary technical interface with national stakeholders, including government counterparts, partners, and donors.
• Lead or co-facilitate validation workshops, technical review meetings, and dissemination engagements.
• Respond to technical queries and feedback, ensuring revisions strengthen (not dilute) evaluation rigor.
• Ensure stakeholder inputs are appropriately reflected while maintaining methodological independence.

Team Leadership & Quality Assurance:

• Provide strategic guidance, mentorship, and quality oversight to Research Managers and Subject Matter Experts.
• Ensure clear role boundaries, decision rights, and accountability across the evaluation team.
• Work closely with the Program Specialist to ensure coordination, timelines, and document flow support high-quality delivery.
• Proactively identify and mitigate technical or delivery risks that could compromise evaluation quality or timelines.

Manuscript Development:

• Provide overall intellectual leadership for manuscripts, including framing of research questions, analytical narratives, and key messages.
• Ensure methodological rigor, coherence, and alignment with donor and journal standards.
• Serve as lead or senior corresponding author, providing final technical approval of all manuscripts prior to submission.

Supervises:

• Research Manager 1 – Quantitative, MEL & Methods
• Research Manager 2 – Qualitative, Coordination & Synthesis
• Subject Matter Experts (Technical Oversight)
• Program Specialist (Functional Oversight)

Other Duties:

• Perform any other duties assigned by the supervisor in line with the Impact Evaluation deliverable.

Required Qualifications 

• Advanced Degree (Master’s or PhD) in Public Health, Epidemiology, Biostatistics, Health Economics, Evaluation Science, or a closely related field.
• Minimum of 10 years experience leading or co-leading large-scale health evaluations, impact assessments, or complex learning studies.
• Demonstrated experience with impact evaluation approaches, including before–after analysis, contribution analysis, or quasi-experimental designs.
• Strong background in health systems strengthening, pandemic preparedness, or donor-funded national programs.
• Proven experience leading multidisciplinary teams and delivering high-quality, donor-facing reports under tight timelines.
• Familiarity with Nigeria’s health system and national planning frameworks is strongly preferred.

Required Technical Skills & Software Proficiency Evaluation, Analysis & Data Tools:

• Quantitative analysis: STATA, R, SPSS, or equivalent statistical software
• Qualitative analysis: NVivo, ATLAS.ti, or equivalent qualitative analysis software (conceptual understanding required; hands-on use desirable)
• Data visualization & dashboards: Microsoft Excel (advanced), Power BI, Tableau, or equivalent tools.

Data Management & Collaboration:

• Microsoft Excel (advanced functions, pivot tables, data validation)
• Microsoft Teams, SharePoint, or similar collaboration platforms
• Familiarity with DHIS2 and routine health information systems (interpretive level)

Reporting & Knowledge Products:

• Microsoft Word (advanced formatting and track changes)
• Microsoft PowerPoint (executive-level presentations)
• Experience reviewing or guiding development of infographics and visual products in collaboration with designers

Knowledge, Skills & Competencies:

• Strong methodological judgment and ability to interrogate data and assumptions.
• Excellent analytical synthesis and technical writing skills.
• Ability to translate complex findings into clear, actionable insights for decision-makers.
• Strong facilitation and stakeholder engagement skills.
• High attention to detail, quality, and scientific integrity.
• Ability to work effectively under pressure and manage multiple streams of work concurrently.
• Demonstrated leadership, diplomacy, and decisiveness in complex technical environments.

Key Accountability Statement:

• The Team Lead / Impact Evaluation Expert holds final responsibility for the scientific rigor, credibility, and defensibility of all evaluation outputs.
• All findings, conclusions, and recommendations released to stakeholders and donors must meet the highest standards of evidence and professional integrity.