Assessment
The Learning Crisis: Three Years After COVID-19
Tomasz Gajderowicz, Maciej Jakubowski, Alec Kennedy, Christian Christrup Kjeldsen, Harry Anthony Patrinos, Rolf Strietholt.Topics: Student LearningThe COVID-19 pandemic caused widespread disruptions to education, with school closures affecting over one billion children. These closures, aimed at reducing virus transmission, resulted in significant learning losses, particularly in mathematics and science. Using data from TIMSS 2023, which… more →
Unequal Access: How Public Library Closures Affect Educational Performance
Topics: Families and CommunitiesLocal public institutions, such as public libraries, offer access to low-cost educational resources, potentially mitigating human capital investment disparities. However, from 2008 to 2019, 766 public library outlets closed across the US, reducing access to these critical resources. This study… more →
Combining Early Grade Assessments to Study Literacy Skills: Addressing the Variability in Tests Taken across Schools and Students
Topics: MethodsThere is considerable variability in the literacy assessments taken in Kindergarten through second grade, across schools and between multilingual learners and other students, and within students over time. This makes it difficult to study changes in students’ acquisition of ELA skills in these… more →
Results from NCME Survey on Revisions to the Standards for Educational and Psychological Testing
Doris Zahner, Jeffrey T. Steedle, James Soland, Catherine Welch, Qi Qin, Kathryn Thompson, Richard Phelps.Tags: AssessmentThe Standards for Educational and Psychological Testing have served as a cornerstone for best practices in assessment. As the field evolves, so must these standards, with regular revisions ensuring they reflect current knowledge and practice. The National Council on Measurement in Education (… more →
Addressing Threats to Validity in Supervised Machine Learning: A Framework and Best Practices for Education Researchers
Topics: MethodsGiven the rapid adoption of machine learning methods by education researchers, and growing acknowledgement of their inherent risks, there is an urgent need for tailored methodological guidance on how to improve and evaluate the validity of inferences drawn from these methods. Drawing upon an… more →
Mechanisms of Effect Size Differences Between Researcher Developed and Independently Developed Outcomes: A Meta-Analysis of Item-Level Data
Topics: MethodsDifferences in effect sizes between researcher developed (RD) and independently developed (ID) outcome measures are widely documented but poorly understood in education research. We conduct a meta-analysis using item-level outcome data to test potential mechanisms that explain differences in… more →
Staffing Interventions to Support Students Experiencing Homelessness: Evidence from New York City
There is limited empirical evidence about educational interventions for students experiencing homelessness, who experience distinct disadvantages compared to their low-income peers. We explore how two school staffing interventions in New York City shaped attendance outcomes of students… more →
Distance to Degrees: How College Proximity Shapes Students’ Enrollment Choices and Attainment Across Race-Ethnicity and Socioeconomic Status
Leveraging rich data on the universe of Texas high school graduates, we estimate how the relationship between geographic access to public two- and four-year postsecondary institutions and postsecondary outcomes varies across race-ethnicity and socioeconomic status. We find that students are… more →
More Money for Less Time? Examining the Relative and Heterogenous Financial Returns to Non-Degree Credentials and Degree Programs
There is a large and growing number of non-degree credential offerings between a high school diploma and a bachelor's degree, as well as degree programs beyond a bachelor’s degree. Nevertheless, research on the financial returns to non-degree credentials and degree-granting programs is often… more →
What Impacts Should We Expect from Tutoring at Scale? Exploring Meta-Analytic Generalizability
Topics: MethodsU.S. public schools are engaged in an unprecedented effort to expand tutoring in the wake of the pandemic. Broad-based support for scaling tutoring emerged, in part, because of the large effects on student achievement found in prior meta-analyses. We conduct an expanded meta-analysis of 282… more →
Failing to Learn from Failure: The Facade of Online Credit Recovery Assessments
Tags: Curriculum, AssessmentOnline credit recovery (OCR) courses are the most common means through which students retake courses required for high school graduation. Yet a growing body of research has raised concerns regarding student learning in these courses, with low quality assessments posited as one contributing… more →
A Matter of Time? Measuring Effects of Public Schooling Expansions on Families’ Constraints
Topics: Families and CommunitiesAs women increasingly entered the labor force throughout the late 20th century, the challenges of balancing work and family came to the forefront. We leverage pronounced changes in the availability of public schooling for young children—through duration expansions to the kindergarten day—to… more →
The Promises and Pitfalls of Using Language Models to Measure Instruction Quality in Education
Topics: MethodsAssessing instruction quality is a fundamental component of any improvement efforts in the education system. However, traditional manual assessments are expensive, subjective, and heavily dependent on observers’ expertise and idiosyncratic factors, preventing teachers from getting timely and… more →
Teacher Licensure and Workforce Quality: Insights from Covid-Era Emergency Licenses in Massachusetts
Topics: Teacher and Leader DevelopmentMuch recent debate among policymakers and policy advocates focuses on whether states should reduce teacher licensure requirements to ease the burdens of recruiting high quality teachers to the workforce. We examine the effectiveness of individuals who entered the teacher workforce in… more →
Does Corequisite Remediation Work for Everyone? An Exploration of Heterogeneous Effects and Mechanisms
The landscape of developmental education has experienced significant shifts over the last decade nationwide, as more than 20 states and higher education systems have transitioned from the traditional prerequisite model to corequisite remediation. Drawing on administrative data from Tennessee… more →
The Notorious SBG: Administrators’ Perceptions of Standards-Based Grading Practices
Tags: AssessmentThis mixed-methods study synthesizes Standards-Based Grading (SBG) literature, analyzes 249 Arkansas administrators' survey responses using OLS regressions, and identifies themes through in-vivo coding of qualitative feedback. Results show more SBG support among liberal, elementary-level… more →
Does One Plus One Always Equal Two? Examining Complementarities in Educational Interventions
Topics: MethodsTags: Assessment, EfficacyPublic policies targeting individuals based on need often impose disproportionate burden on communities that lack the resources to implement these policies effectively. In an elementary school setting, I examine whether community-level interventions focusing on similar needs and providing… more →
GED® College Readiness Benchmarks and Post-Secondary Success
Tags: College readiness, AssessmentIn 2016, the GED® introduced college readiness benchmarks designed to identify testers who are academically prepared for credit-bearing college coursework. The benchmarks are promoted as awarding college credits or exempting “college-ready” GED® graduates from remedial coursework. I show… more →
Are Students On Track?: Comparing the Predictive Validity of Administrative and Survey Measures of Cognitive and Noncognitive Skills for Long-Term Outcomes
Tags: AssessmentEducation leaders must identify valid metrics to predict student long-term success. We exploit a unique dataset containing data on cognitive skills, self-regulation, behavior, course performance, and test scores for 8th-grade students. We link these data to data on students' high school outcomes… more →
HBCU Enrollment and Longer-Term Outcomes
Using data from nearly 1.2 million Black SAT takers, we estimate the impacts of initially enrolling in an Historically Black College and University (HBCU) on educational, economic, and financial outcomes. We control for the college application portfolio and compare students with similar… more →