Search EdWorkingPapers by author, title, or keywords.
Educator preparation, professional development, performance and evaluation
In recent decades, U.S. education leaders have advocated for more intellectually ambitious mathematics instruction in classrooms. Evidence about whether more ambitious mathematics instruction has filtered into contemporary classrooms, however, is largely anecdotal. To address this issue, we analyzed 93 lessons recorded by a national random sample of middle school mathematics teachers. We find that lesson quality varies, with the typical lesson containing some elements of mathematical reasoning and sense-making, but also teacher-directed instruction with limited student input. Lesson quality correlates with teachers’ use of a textbook and with teachers’ mathematical background. We consider these findings in light of efforts to transform U.S. mathematics instruction.
The pursuit of multiple educational outcomes makes teaching a complex craft subject to potential conflicts and competing commitments. Using a dataset in which teachers were randomly assigned to students paired with videotapes of instruction, we both document and unpack such a tradeoff. Upper-elementary teachers who excel at raising students’ math test scores often are less successful at improving student-reported engagement in class (and vice versa). Further, the teaching practices that improve math test scores (e.g., cognitively demanding content) can simultaneously decrease engagement. At the same time, paired quantitative and qualitative analyses reveal two areas of practice that support both outcomes: active mathematics with opportunities for hands-on participation; and established routines and procedures to proactively organize the classroom environment. In addition to guiding practice-based teacher education, our mixed-methods analysis can serve as a model for rigorously studying and identifying dimensions of “good” teaching that promote multidimensional student development.
We examine the dynamic nature of student-teacher match quality by studying the effect of having a teacher for more than one year. Using data from Tennessee and panel methods, we find that having a repeat teacher improves achievement and decreases absences, truancy, and suspensions. These results are robust to a range of tests for student and teacher sorting. High-achieving students benefit most academically and boys of color benefit most behaviorally. Effects increase with the share of repeat students in a class suggesting that classroom assignment policies intended to promote sustained student-teacher relationships such as looping may have even larger benefits.
This study introduces the signal weighted teacher value-added model (SW VAM), a value-added model that weights student-level observations based on each student’s capacity to signal their assigned teacher’s quality. Specifically, the model leverages the repeated appearance of a given student to estimate student reliability and sensitivity parameters, whereas traditional VAMs represent a special case where all students exhibit identical parameters. Simulation study results indicate that SW VAMs outperform traditional VAMs at recovering true teacher quality when the assumption of student parameter invariance is met but have mixed performance under alternative assumptions of the true data generating process depending on data availability and the choice of priors. Evidence using an empirical data set suggests that SW VAM and traditional VAM results may disagree meaningfully in practice. These findings suggest that SW VAMs have promising potential to recover true teacher value-added in practical applications and, as a version of value-added models that attends to student differences, can be used to test the validity of traditional VAM assumptions in empirical contexts.
Growing literature documents the promise of active learning instruction in engaging students in college classrooms. Accordingly, faculty professional development (PD) programs on active learning have become increasingly popular in postsecondary institutions; yet, quantitative evidence on the effectiveness of these programs is limited. Using administrative data and an individual fixed effects approach, we estimate the effect of an active learning PD program on student performance and persistence at a large public institution. Findings indicate that the training improved subsequent persistence in the same field. Using a subset of instructors whose instruction was observed by independent observers, we identify a positive association between training and implementation of active learning teaching practices. These findings provide suggestive evidence that active learning PD has the potential to improve student outcomes.
The unprecedented challenges of teaching during COVID-19 prompted fears of a mass exodus from the profession. We examine the extent to which these fears were realized using administrative records of Massachusetts teachers between 2015-16 and 2021-22. Relative to pre-pandemic levels, average turnover rates were similar going into the fall of 2020 but increased by 17 percent going into the fall of 2021. The fall 2021 increases were particularly high among newly hired teachers (31 percent increase), but were lower among Black and Hispanic/Latinx teachers (5 percent increases among both groups). Ethnoracial diversity of new hires increased during the pandemic, in part due to reduced professional licensure requirements. Together, these changes led to small increases in the overall ethnoracial diversity of Massachusetts teachers, but improvements to early-career retention will be needed to ensure long-term stability and diversity within the workforce.
Instructional coaching is an attractive alternative to one-size-fits-all teacher training and development in part because it is purposefully differentiated: programming is aligned to individual teachers’ needs and implemented by an individual coach. But, how much of the benefit of coaching as an instructional improvement model depends on the specific coach with whom a teacher works? Collaborating with a national teacher training and development organization, TNTP, we find substantial variability in effectiveness across coaches in terms of changes in teachers’ classroom practice (0.43 standard deviations). The magnitude of coach effectiveness heterogeneity is close to average coaching program effects identified in other research. These findings suggest that identifying, recruiting, and supporting highly skilled coaches will be key to scaling instructional coaching programs.
A growing literature uses value-added (VA) models to quantify principals' contributions to improving student outcomes. Principal VA is typically estimated using a connected networks model that includes both principal and school fixed effects (FE) to isolate principal effectiveness from fixed school factors that principals cannot control. While conceptually appealing, high-dimensional FE regression models require sufficient variation to produce accurate VA estimates. Using simulation methods applied to administrative data from Tennessee and New York City, we show that limited mobility of principals among schools yields connected networks that are extremely sparse, where VA estimates are either highly localized or statistically unreliable. Employing a random effects shrinkage estimator, however, can alleviate estimation error to increase the reliability of principal VA.
Black and Latinx students are under-represented in Advanced Placement (AP) and Dual Enrollment (DE), and implicit bias of educators has been discussed as one potential contributing factor. In this study, I test whether implicit and explicit racial bias are related to AP and DE participation and racial/ethnic gaps in participation, controlling for various observable contextual factors. I find a small relationship between implicit racial bias and disparate AP participation for Black students relative to White students, and suggestive evidence of a relationship between explicit racial bias and disparate DE participation for Black students relative to White students. Further, more explicitly-biased communities tend to have lower AP participation rates overall. Implications for school leaders regarding implicit bias training and other ways to address systemic inequities in access are discussed.