Quasi-experimentation A Guide To Design And Analysis Pdf đ
Hartley nodded. "So we keep the software, but we train Mr. Abel on it too."
"You canât," Lena said. "Parents would riot if their kid got âno software.â Plus, the software is tied to Ms. Chenâs classroom computers. You have a âreal-world, no randomization. But that doesnât mean itâs hopeless."
Hereâs a short, engaging story that captures the essence of (as in the spirit of Cook, Campbell, and Shadishâs work, often summarized in guides like Quasi-Experimentation: A Guide to Design and Analysis ). Title: The Principalâs Predicament Dr. Lena Torres, a research consultant, faced a familiar problem. The school principal, Mr. Hartley, had just spent $50,000 on a new "MindGrow" reading software. He needed to know if it worked. quasi-experimentation a guide to design and analysis pdf
"Exactly," Lena said. "And next time, if you canât randomize, use a â give half the classes the software in Phase 1, the other half in Phase 2. Compare each against itself over time."
Lena sighed. "Thatâs not simple. Thatâs a . Ms. Chen is a star teacher. Her kids were already scoring 15% higher before the software. If her class does better afterward, was it the software or just⊠Ms. Chen?" Hartley nodded
Hartley frowned. "So I should flip a coin? Randomly assign kids to software or no software?"
But to be rigorous, she added a and used Huber-White robust standard errors (because monthly scores from the same class arenât independent â a key point from quasi-experimental guides). "Parents would riot if their kid got âno software
Result: The +7 points was statistically significant (p < .01) and practically meaningful. Lena presented to Hartley: "The software works, but only by 7 points, not the 15-point jump you saw in the raw comparison. The raw difference was inflated by Ms. Chenâs prior excellence."
Lena smiled. "Thatâs the guide to design and analysis. No randomization? No problem. Just more thinking." Quasi-experimentation isnât âsecond-best.â Itâs a toolkit for causal inference when experiments are impossible. Master the threats (history, selection, maturation, regression), choose a design (ITS, DID, nonequivalent groups), and analyze with care â robust standard errors and pre-trend checks are your friends.
"Lena, look," Hartley said, tapping his desk. "I installed it in Ms. Chenâs third-grade class. Sheâs our best teacher. The other third-grade class, Mr. Abelâs, is using the old curriculum. After three months, Iâll compare their test scores. Simple, right?"
Hartley laughed. "You quasi-people have a workaround for everything."