Turning pre-test/post-test numbers into defensible evidence
Introduction
Topics 27–29 covered the types, process, and use of evaluation findings. This topic supplies the quantitative backbone that turns raw data — pre-test scores, post-test scores, adoption rates — into evidence that can actually support Topic 29's instrumental and conceptual uses. These are not exotic tools: the statistical methods below are the ones most commonly used in published Indian extension education evaluation research, and are the same ones you already applied by hand in Practical 9.
๐ฏ Learning Outcomes
- Use descriptive statistics (mean, frequency, percentage) to summarise evaluation data.
- Explain when and why a paired (dependent) t-test is used for pre-test/post-test evaluation designs.
- Explain when an independent t-test or chi-square test is more appropriate than a paired t-test.
- Describe how correlation is used alongside these tests in published extension evaluation research.
- Locate and use this course's own Paired T-Test Calculator tool.
๐ Why This Matters
A published Indian Journal of Extension Education study on farmer knowledge gain from a sugarcane cultivation video used exactly three tools — mean, paired t-test, and correlation — to analyse pre-test and post-test data, showing that a small, standard toolkit is sufficient for credible extension evaluation research, not an elaborate statistical apparatus.
1. Descriptive Statistics
Before any inferential test, evaluation data is typically summarised using basic descriptive statistics: the mean (average score across respondents), frequency (how many respondents fall into each category), and percentage (proportion showing a given result, such as adoption of a practice). These numbers alone are often reported directly in a Kirkpatrick Learning-level or Behaviour-level analysis (Topic 27).
2. The Paired (Dependent) t-test
The paired t-test compares two sets of scores from the same respondents — most commonly, a pre-test score and a post-test score from the same trainees — to determine whether the observed difference is statistically meaningful rather than due to chance. This is the single most common statistical tool in published extension training evaluation studies precisely because most extension evaluations use a before/after design on the same group of trainees.
๐ Cross-Reference — Practical 9 and This Course's Own Tool
Practical 9 (Pre-test/Post-test Evaluation) is where you already applied this exact logic hands-on. This course's own Paired T-Test Calculator tool automates the calculation, letting you focus on interpreting the result rather than the arithmetic — the same role a spreadsheet or statistical software plays in the published studies referenced throughout this topic.
3. Correlation
Correlation measures the strength and direction of a relationship between two variables — for example, whether greater exposure to a training video is associated with greater knowledge gain. It does not, on its own, establish that one variable causes the other, but it is routinely used alongside the paired t-test in published extension research to explore what factors relate to observed knowledge gain.
4. When Other Tools Are More Appropriate
| Tool | Used When | Example |
|---|---|---|
| Paired t-test | Comparing the same group's scores before and after training | Farmer knowledge scores before and after a sugarcane cultivation video |
| Independent t-test | Comparing two different, separate groups | Comparing knowledge gain between an app-based learning group and a printed-material group of health workers |
| Difference-of-differences | Comparing the size of the gain (not just the endpoint) between two groups | (Post-test − Pre-test) for Group 1 minus the same for Group 2, isolating which intervention produced a larger gain |
| Chi-square test | Comparing categorical data (yes/no adoption, category counts) rather than continuous scores | Whether adoption of a practice (adopted/not adopted) differs meaningfully between two farmer groups |
⚠️ A Real Worked Comparison
A recent study on Anganwadi Workers' refresher training compared a mobile-app-based learning group against a physical-card learning group: the app group's scores rose from a pre-test mean of 5.92 to a post-test mean of 8.56, while a separate group's difference was smaller — illustrating exactly the difference-of-differences logic in Section 4's table, used specifically to determine which of two training methods (Topic 24) produced the larger genuine gain, not just which group scored higher overall.
๐พ Extension Angle
A published study evaluating WhatsApp-delivered messages on sugarcane cultivation practices used a "before-after without control group" design with paired analysis — a design choice directly shaped by practical field constraints, since maintaining a genuinely separate control group of farmers is often logistically difficult in real extension settings, even though it would strengthen the evaluation's rigor per Topic 26's accuracy standard.
๐ฎ๐ณ Indian Institutional Context
These exact tools — mean, paired t-test, correlation — are the standard statistical toolkit in evaluation studies published in ICAR's own Indian Journal of Extension Education, meaning this topic's content reflects live, current Indian extension research practice rather than an imported or generic statistics curriculum.
๐ Beyond Agriculture
The same toolkit is used to evaluate capacity development programmes for India's ASHA (Accredited Social Health Activist) and Anganwadi health and nutrition workers — recent studies comparing app-based and physical-card refresher training methods for these community health workers used the identical pre-test/post-test, paired-comparison, and intervention-group-comparison logic covered in Sections 2 and 4 above, showing this statistical toolkit is genuinely sector-agnostic across India's community worker training systems.
Frequently Asked Questions
- Studies published in the Indian Journal of Extension Education using mean, paired t-test, and correlation for pre-test/post-test knowledge-gain evaluation (e.g., studies on video and WhatsApp-based extension delivery for sugarcane cultivation practices).
- Jayaratne, K. S. U., Chaudhary, A., & Diaz, J. M. Knowledge testing options in pre-test post-test evaluation design: Implications for Extension program evaluation. Advancements in Agricultural Development.
- Studies on app-based and card-based refresher training for Anganwadi and ASHA community health workers in India, comparing pre-test/post-test gains across intervention groups.
- Raab, R. T., Swanson, B. E., Wentling, T. L., & Clark, C. D. (Eds.). (1987). A Trainer's Guide to Evaluation. Rome: Food and Agriculture Organization of the United Nations. [Cross-referenced — see Topics 25, 27, 28.]