Selecting a Study Design and Appropriate Data Collection Methods for Evaluating PYD Programs
General information about study design is beyond the scope of this toolkit; however, a basic overview of quantitative and qualitative design methodologies can be found in Annex H in the printed document.
A number of qualitative and quantitative M&E approaches can be used to measure the results of your PYD program. A mixed methods approach using both qualitative and quantitative strategies is often the most ideal design because it provides a balanced and richer (i.e., in-depth) analysis of the program. By using both qualitative and quantitative data, the evaluation can offer more practical and reliable insights on the program’s results.
Demonstrating change in PYD constructs is essential to establish that the program is having some impact or result. At a minimum, obtaining baseline and endline data (i.e., data collected before and after program implementation) will ensure more rigorous measurement of change over time for targeted program beneficiaries.
When considering indicators and study design through a PYD lens, it is essential to understand that while youth are the focus, they should not be the only source of data. Collecting data from other stakeholders, such as their peers, parents, partners, teachers, or other adult mentors, will ensure that the analysis is more accurate and comprehensive. Collecting data from different sources and looking for consistencies and important points of departure is referred to as triangulation. If the data collection process includes such measures of triangulation, you are more likely to detect if your chosen indicators start to diverge from the reality they are supposed to represent. Triangulation also includes verification from sources considered independent and/or objective, such as direct observation, video and photo fixation, and geotagging. However, funders need to account for the fact that data triangulation, while important, can be costly. Finally, to ensure your work is appropriate to the local context, you should also examine multiple external data sources such as reports, contextual analysis, country data or data from international agencies.
Using the PYD Measurement Framework for the selection of indicators and study design
Although your PYD program likely has an end goal within a particular sector such as education, health, or employment, it is essential to measure the PYD constructs embedded in your program to determine if the program is working as intended. PYD programs are designed to work holistically to support healthy development across domains. Because of this, PYD programs should target and evaluations should include indicators for more than one PYD construct.
Table . Selecting PYD Indicators and Data Collection Methods
Go to:
> Home: PYD toolkit
> A framework for measuring PYD;
> A set of illustrative PYD indicators
> Application of PYD framework and indicators at each phase of a program design and evaluation:
>> Phase 1. Define (or refine) key desired outcomes or research questions
>> Phase 2. Determine PYD features and beneficiaries of the program
>> Phase 3. Finalize the logic model
>> Phase 4. Decide what to measure, and how (study design and indicators)
>> Phase 5. Analyze the data, disseminate the findings and adapt your program
> Considerations for adapting measures cross-culturally
> Additional resources and references
> FAQs
> PYD Glossary