Quasi-experimentation A Guide To Design And Analysis Pdf š š
Hartley frowned. "So I should flip a coin? Randomly assign kids to software or no software?"
"You canāt," Lena said. "Parents would riot if their kid got āno software.ā Plus, the software is tied to Ms. Chenās classroom computers. You have a āreal-world, no randomization. But that doesnāt mean itās hopeless."
"Lena, look," Hartley said, tapping his desk. "I installed it in Ms. Chenās third-grade class. Sheās our best teacher. The other third-grade class, Mr. Abelās, is using the old curriculum. After three months, Iāll compare their test scores. Simple, right?" quasi-experimentation a guide to design and analysis pdf
But to be rigorous, she added a and used Huber-White robust standard errors (because monthly scores from the same class arenāt independent ā a key point from quasi-experimental guides).
Result: The +7 points was statistically significant (p < .01) and practically meaningful. Lena presented to Hartley: "The software works, but only by 7 points, not the 15-point jump you saw in the raw comparison. The raw difference was inflated by Ms. Chenās prior excellence." Hartley frowned
Hartley laughed. "You quasi-people have a workaround for everything."
Lena smiled. "Thatās the guide to design and analysis. No randomization? No problem. Just more thinking." Quasi-experimentation isnāt āsecond-best.ā Itās a toolkit for causal inference when experiments are impossible. Master the threats (history, selection, maturation, regression), choose a design (ITS, DID, nonequivalent groups), and analyze with care ā robust standard errors and pre-trend checks are your friends. "Parents would riot if their kid got āno software
"Exactly," Lena said. "And next time, if you canāt randomize, use a ā give half the classes the software in Phase 1, the other half in Phase 2. Compare each against itself over time."
Lena sighed. "Thatās not simple. Thatās a . Ms. Chen is a star teacher. Her kids were already scoring 15% higher before the software. If her class does better afterward, was it the software or just⦠Ms. Chen?"
Hartley nodded. "So we keep the software, but we train Mr. Abel on it too."