#  Modeling Item-Level Heterogeneous Treatment Effects With the Explanatory Item Response Model: Leveraging Large-Scale Online Assessments to Pinpoint the Impact of Educational Interventions 

 



 file\_download 

 **Size:** 468.9 KB 

 **Format:** PDF 

 **Date:** 01/12/2026 

 

 [ Download Resource file\_download ](/sites/g/files/omnuum9881/files/2026-01/gilbert-et-al-2023-modeling-item-level-heterogeneous-treatment-effects-with-the-explanatory-item-response-model.pdf) 





This methodological study introduces a novel approach for analyzing item-level heterogeneous treatment effects (IL-HTE) using the Explanatory Item Response Model (EIRM), addressing a key limitation of traditional impact analyses that rely on total test scores or average treatment effects. The authors show that educational interventions may affect different assessment items in substantively different ways—variation that is often masked when outcomes are aggregated. Through Monte Carlo simulations, the study demonstrates that ignoring IL-HTE can lead to underestimated standard errors and inflated false positive rates when researchers aim to generalize beyond a specific test form. The empirical application draws on data from a large cluster-randomized trial of the Model of Reading Engagement (MORE) involving nearly 8,000 third-grade students and a digital reading comprehension assessment. While the average treatment effect was small and nonsignificant, the EIRM revealed meaningful positive effects on specific items, particularly those assessing mid-transfer reading comprehension aligned with the intervention’s social studies extensions. By modeling treatment effects at the item level, the study shows how EIRM can uncover fine-grained patterns of learning transfer, improve statistical inference, and provide more actionable insights for researchers, practitioners, and policymakers about where and how interventions work.



 

 

 See also:- [ Research and Reports ](/resource-type/research-report)
- [ Data Analyst ](/audience/data-analyst)
- [ Researcher ](/audience/researcher)
- [ Curriculum ](/focus-areas/curriculum)
- [ Reading Instruction ](/focus-areas/reading-instruction)
- [ School Improvement & Redesign ](/focus-areas/school-improvement-and-redesign)
- [ MORE (Model of Reading Engagement)/READS Lab ](/projects/more-model-reading-engagement)
- [ 2023 ](/year/2023)
- [ K12 ](/sector/k12)