دورية أكاديمية

Overlap Violations in Clustered Observational Studies of Educational Interventions

التفاصيل البيبلوغرافية
العنوان: Overlap Violations in Clustered Observational Studies of Educational Interventions
اللغة: English
المؤلفون: Luke Keele (ORCID 0000-0002-3859-2713), Matthew Lenard, Lindsay Page (ORCID 0000-0001-5932-6791)
المصدر: Journal of Research on Educational Effectiveness. 2024 17(1):1-18.
الإتاحة: Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Peer Reviewed: Y
Page Count: 18
تاريخ النشر: 2024
نوع الوثيقة: Journal Articles
Reports - Research
Descriptors: Intervention, Cluster Grouping, Observation, Catholic Schools, Research Design, Effect Size, Instructional Effectiveness, Statistical Analysis
DOI: 10.1080/19345747.2022.2144563
تدمد: 1934-5747
1934-5739
مستخلص: In education settings, treatments are often non-randomly assigned to clusters, such as schools or classrooms, while outcomes are measured for students. This research design is called the clustered observational study (COS). We examine the consequences of common support violations in the COS context. Common support violations occur when the covariate distributions of treated and control units have substantial areas of non-overlap. Such violations are likely to occur in a COS, especially with a small number of treated clusters. We provide a comprehensive review of methods for overlap violations in the context of COS designs. We provide an overview of diagnostic tests and trimming methods to ensure overlap holds for the distributions of treated and control covariates. We then outline how trimming changes the estimand and how profiling can be used to understand the causal quantity for which overlap holds. Finally, we demonstrate how steps to achieve adequate overlap can result in very narrowly defined causal effects that may have little policy relevance. We use data on Catholic schools to illustrate concepts throughout.
Abstractor: As Provided
Entry Date: 2024
رقم الأكسشن: EJ1408298
قاعدة البيانات: ERIC
الوصف
تدمد:1934-5747
1934-5739
DOI:10.1080/19345747.2022.2144563