Evaluating the relevance and effectiveness of the L4UHC model is essential to improve the programme and inform related initiatives. Currently, there is limited published evaluation data in this field so our independent study of L4UHC will also help build the global knowledge base.
An independent evaluation of L4UHC, carried out by Oxford Policy Management, found that the programme “plays an important role in the UHC ecosystem” and that 85% of those surveyed would recommend the programme to others.
The aim of the evaluation is not only to examine whether inputs, outputs, outcomes and impact have occurred as expected, but also to probe more exploratory learning questions, including:
- What worked, what did not work, and why;
- Under what conditions the L4UHC is likely to be effective;
- And how it can be tailored to maximise its chances of success.
Working with the L4UHC partners, Oxford Policy Management has developed an evaluation plan for 2019-20.
Given the complexity of the intervention and environment, a theory-driven evaluation approach has been adopted, using contribution analysis, which allows us to understand the role of the programme, amongst other factors. This is based on a theory of change that elaborates the expected pathways and assumptions that need to be met for L4UHC to meet its goal. Data from a range of sources and tools will be used to compare with this theory and to judge the performance of L4UHC against the DAC criteria.
Data sources include:
- In-depth interviews with participants, participating country resource people, host country facilitators, L4UHC facilitators and organisers, and L4UHC management team members;
- Surveys of participants;
- A range of secondary data sources, including programme data and reports, in-country reports and data, and programme budgets and expenditure;
- Visits to two focal countries (one in Africa and one in Asia).