MLE Strategy Manager - Evidence Action

Organization:
Country:
  • United States of America
Education:
  • Master's
Start Date (Earliest):
Length of Commitment:
None

About the Position

The Monitoring, Learning, and Evaluation (MLE) Strategy team serves a critical role in the organization, ensuring data-driven decision-making by designing and managing “right fit” monitoring, research, and evaluation plans, and working closely with leadership to ensure data is interpreted with rigor. Working closely with regional MLE Delivery teams, the MLE Strategy team creates MLE systems to deliver timely and useful program insights. Created at the start of 2021, the MLE Strategy team was established to meet a growing organizational need for focused, global support to develop and maintain high quality MLE plans across Evidence Action’s programs and geographies. Since then, the organizational demand for MLE Strategy support has grown substantially-- a testament to the team’s critical role within the organization -- and we continue to identify ways in which this team can add value.For this reason, Evidence Action is looking to hire two dynamic and motivated MLE Strategy Managers who can serve as the MLE lead for one to two Evidence Action programs. From coordinating MLE support for programs to developing and iterating on monitoring plans to managing research and learning projects, the MLE Strategy Manager will play a critical role in ensuring MLE activities are comprehensive, cost-efficient, and well-designed to meet program goals. The MLE Strategy role provides a unique experience for individuals interested in a more practical application of technical knowledge and those interested in collaborating closely across teams to shape how MLE can strategically serve the programs. This dynamic and critical position will report to the MLE Strategy Associate Director.LocationThis position can be located in Washington, DC; Nairobi, Kenya; or, remote.

Responsibilities will include:

  • Serve as the monitoring, learning, and evaluation lead for one to two Evidence Action programs
  • Routinely update and track progress against program MLE scopes of work (SoW), and ensure sufficient coordination with the MLE implementation teams and programs teams in the Africa region and/or India (depending on the program) to meet the goals of the MLE SoW
  • Develop sufficient understanding of the program design, the contexts in which the program is implemented, the body of research informing the program, and (program-relevant) international M&E best practices to effectively lead the program’s MLE strategy Participate in program meetings and program strategy discussions to understand changing programmatic MLE needsLead routine MLE meetings and ad-hoc MLE discussions with relevant Program and MLE implementation staff to ensure MLE activities are well-planned and program expectations for MLE are being met
  • Regularly review and engage with MLE results to ensure the Program staff make data-driven decisions by correctly interpreting and applying MLE insightsReview and provide feedback for donor reports, and support other donor reporting requests by developing high-quality M&E documents to share with donors, as requested
  • Draft high-quality, comprehensive, and clear MLE-related documents, as needed, to facilitate program or donor decision-making, including MLE overview documents, decision memos, project budgets, and concept notesManage and iterate on program monitoring, learning, and evaluation plans 
  • Foster an expertise in the program’s existing MLE plan, processes, analyses, and reports in order to effectively manage the program’s MLE and identify areas for improvement, when appropriate (e.g., more cost-efficient methods of data collection, emerging developments in international best practices, etc.)
  • Engage the Program team to develop and maintain a program “learning agenda” that outlines specific learning objectives to be further explored through ongoing monitoring, operational research, or program evaluations
  • Design and/or project manage operational research and program evaluations, as needed, and ensure the evaluation design factors for budget and implementation constraints and provides targeted results. Review and provide feedback on MLE implementation documents to ensure fidelity to design and rigor, including data collection protocols, analysis plans, and dashboard/reporting templates
  • Lead and document adaptations of program monitoring and evaluation plans (as needed) and collaborate closely with the programs for the purposes of program design change, program expansion, and/or program sustainability efforts
  • Coordinate with the Program and MLE teams to review monitoring plans and systems every 2 to 3 years so that the monitoring design evolves alongside programs, including reviews of monitoring frameworks, sampling plans, survey designs, monitoring protocols, analytical frameworks, and reporting templatesDraft requests for proposals or other recruitment documents to successfully identify and recruit M&E partners when additional capacity is required for MLE activities
  • Travel, as appropriate, to meet with country and MLE implementation teams and observe aspects of the program’s MLE activitiesPerform technical tasks to design (or redesign) monitoring, learning, or evaluation activities, as neededDraft and iterate on program theories of change to conceptualize how programs expect to create impactIdentify and recommend key performance indicators to monitor and evaluate the program’s processes and performance
  • Research and recommend “right fit” methodologies to meet MLE needs
  • Draft well-designed and comprehensive surveys to capture relevant and reliable data for MLE activities, informed by relevant research and international best practices
  • Conduct sample size calculations and draft sampling plans to match the desired activity needs
  • Clean and manage multiple and/or large datasets for emerging programs Conduct descriptive and statistical data analysis, produce result tables, and draft comprehensive and clear result narrativesCollaborate with, and seek to gather input and feedback from, Program and Regional MLE implementation staff to develop relevant aspects of the MLE design
  • Conduct scoping trips to ensure designs are appropriate, realistic, and a good use of resources.
  • Other duties, as assigned
  • Manage and mentor direct reports
  • Manage IRB processes for MLE activities, as per organizational and country protocols
  • Manage external partners and vendors recruited to fulfill MLE plans, including but not limited to health epidemiologists and research institutions engaged for prevalence studies, appropriate data collection firms engaged for monitoring or research needs, and research firms engaged for evaluations
  • Collaborate and iterate on new program development and expansion/sustainability efforts with program and MLE implementation teams, including supporting proposal development activities
  • Support the development and maintenance of internal MLE design resources such as the MLE design ‘menu’, a document listing M&E methodologies and describing the approach, appropriate use, and limitations of each methodology.
  • Contact and engage technical experts in the design and execution of monitoring, research, and evaluation
  • Conduct informal or formal internal trainings on monitoring and evaluation concepts for program staff when new concepts are introduced;
  • Prepare presentations or reports on monitoring frameworks and research projects for internal and external audiences, including donors
  • Support program and MLE implementation teams with preparing abstracts, presentations, reports and publications to disseminate program results. 

Qualifications

Required qualifications:

  • Master’s degree in economics, public policy, statistics, international development or any other relevant quantitative field and a minimum of 3 years of M&E experience; or, a minimum of 5 years M&E experience
  • Deep knowledge of M&E design concepts and methodologies, and experience designing M&E plans and surveys/data collection tools; in particular, experience with development of program monitoring frameworks and Theories of Change
  • Experience with program or project management, and a familiarity with basic organizational and management tools
  • Demonstrated knowledge of and familiarity with using statistical software like Stata and Excel, including experience managing, analyzing, and interpreting quantitative data
  • Strong critical and analytical thinking skills to identify appropriate MLE design needs for different program countries and inline with global program strategies, and problem solve for the realities of implementation
  • Strong writing skills to deliver high-quality deliverables to international program teams and donors
  • Excellent interpersonal and oral communication skills to effectively communicate technical concepts to both technical and lay persons, including the ability to present sensitive issues/positions
  • Ability to maintain effective and respectful working relationships with a team that is geographically dispersed and willingness to work in a global matrixed work setting
  • Demonstrated ability to self-manage, problem solve, and prioritize assignments in an efficient manner and in alignment with program deadlines
  • Strong attention to detail, accuracy, and quality in all deliverables and projectsFlexibility to adapt to shifting priorities and timelines according to requirements of program teams
  • Commitment to being a good steward of resources and Evidence Action’s mission to implement cost-effective programsWillingness to travel to program locations in countries such as India, Uganda, Malawi, Nigeria, Liberia, and Kenya; travel is likely to be up to 25% of the year, pending travel restrictions as a result of COVID-19

Preferred qualifications:

  • Previous work experience supporting in international settings and international organizations
  • Previous work experience conducting qualitative research and analysis
  • Knowledge and experience using software's such as PowerBI, R, ArcGIS, QGIS, Nvivo
  • Familiarity with the evidence base and best practices for leading global health interventions
  • Familiarity with international health data, research, and surveys